WCSE 2020 Summer
ISBN: 978-981-14-4787-7 DOI: 10.18178/wcse.2020.06.070

An Artificial Intelligent and Big Data Research Platform Based on Jupyter Notebook

Ligu Zhu, Suping Wang

Abstract— In the era of data-driven artificial intelligence technology, large depth of the neur al network in the process of scientific research, the algorithm is to accelerate and improve step by step. The processing of such high performance computing and parallel computing ability are more important. This article introduces the big data intelligent science and technology system, mainly to solve the hardware sharing, users’ requirements and the cloud application problems of individuation. Platform embeds Jupyter Notebook, provides data storage, data processing and data analysis function, and it can also provide deep learning training environment and improve the efficiency of training, so as to construct big data application’s architecture of the intelligent system. Finally, the development and construction of micro-service architecture based on cloud computing infrastructure and the deployment delivery system based on Docker containerized application are realized.

Index Terms— artificial intelligence, research platform, Jupyter notebook, hardware sharing, model training,Docker

Ligu Zhu, Suping Wang
Communication University of China, Beijing Key Laboratory of Big Data in Security & Protection Industry, CHINA


Cite: Ligu Zhu, Suping Wang "An Artificial Intelligent and Big Data Research Platform Based on Jupyter Notebook " Proceedings of 2020 the 10th International Workshop on Computer Science and Engineering (WCSE 2020), pp.485-490 , Shanghai, China, 19-21 June, 2020.