WCSE

Design of a Big Data Accessing and Processing Architecture Using Cloud Computing Technologies

Abstract— Big Data analytics has emerged as a promising topic and gained more and more attention. In order to have scalable load capacity for data platforms, we must build them in good architecture. Some issues must be considered in order to use the cloud computing to quickly integrate big data into database for analyzing, searching, and filtering big data to obtain valuable information. In this paper we propose a design for cloud storage platform with HBase for storing and analyzing big data and improve the performance of importing data into database. It also can operates through Hadoop MapReduce for HBase database to do distributed data processing, and to provide functions, including keyword search, data filtering, and basic statistics.

Index Terms— big data, cloud computing, data access, data processing

Chao-Tung Yang, Hsin-Wen Lu
Department of Computer Science, Tunghai University, TAIWAN
Wen-Chung Shih
Department of Computer Science and Information Engineering, Asia University, TAIWAN

[Download]

Cite: Chao-Tung Yang, Hsin-Wen Lu, Wen-Chung Shih, "Design of a Big Data Accessing and Processing Architecture Using Cloud Computing Technologies," Proceedings of 2016 6th International Workshop on Computer Science and Engineering, pp. 386-389, Tokyo, 17-19 June, 2016.