Cloud Database supporting Big Data Analytics (支援大數據分析之雲端資料庫)
With the advance of 4G/5G broadband Internet and Artificial Intelligence of Things (AIoT), a greater variety of data are collected in increasing volumes and with more velocity. In order to handle big data, cloud computing integrates (1) virtualization and (2) distributing computing and then supports the horizontal-scaling capacity. However, regarding the traditional data storage, relational database, a.k.a., SQL database, can provide efficient data processing based on their well-structured relationships among data. How to establish and maintain this kind of relationships among data becomes one heavy burden of modern big data environment. Not only SQL (NoSQL) database is proposed to support the widely-deployed cloud based development and operation. Based on the aforementioned assumption, NESL pioneered and focused on (i) the differentiation analysis between SQL and NoSQL databases, and (ii) the optimal data conversion and translation from SQL to NoSQL databases.
 |
 |
隨著4G/5G寬頻網際網路和人工智慧物聯網(AIoT)的發展，資料匯流的種類越來越多、數量越來越大、速度越來越快。為了處理Big Data，雲端計算整合了(1)虛擬化和(2)分散式運算，並支援水平擴展能力。然而，對於傳統的資料存取與儲存，關聯式資料庫(又稱SQL資料庫)可以基於其良好的資料結構關係提供高效的資料處理功能。如何建立和維護這種資料間的緊密關係成為現代Big Data環境的一個沉重負擔。NoSQL資料庫便是因應支援廣泛部署基於雲端之開發和運營所提出之新一代資料庫技術。基於上述假設，本實驗室(NESL)率先並重點關注於(i) SQL和NoSQL資料庫之間的差異化分析，以及(ii)從SQL資料庫到NoSQL資料庫的最佳資料轉換和轉譯。
著作參考：
- C. -H. Lee and Z. -W. Shih, "A Comparison of NoSQL and SQL Databases Over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms," Proceedings of IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Taichung, Taiwan, May 19-21, 2018
- C. -H. Lee and Y. -L. Zheng, "SQL-to-NoSQL Schema Denormalization and Migration: A Study on Content Management Systems," Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), Hong Kong, China, Oct. 9-12, 2015, pp. 2022-2026
- C. -H. Lee and Y. -L. Zheng, "Automatic SQL-to-NoSQL schema transformation over the MySQL and HBase databases," Proceedings of IEEE International Conference on Consumer Electronics - Taiwan, Taipei, Taiwan, Jun. 6-8, 2015, pp. 426-427
開放式原始碼：
- [Cloud] Apache Hadoop，https://hadoop.apache.org/
- [Cloud] Apache Spark，https://spark.apache.org/
- [NoSQL] Apache HBase，https://hbase.apache.org/
- [NoSQL] MongoDB，https://www.mongodb.com/
* [相容硬體] 意指 NESL擁有且實際開發使用