Big data processing and analysis platform based on deep neural network model

Users are increasingly turning to big data processing systems to extract valuable information from massive datasets as the field of big data grows. Data analytics platforms are used by e-commerce enterprises to improve product suggestions and model business processes. In order to meet the needs of l...

Full description

Saved in:
Bibliographic Details
Main Author: Sheng Huang
Format: Article
Language:English
Published: Elsevier 2024-12-01
Series:Systems and Soft Computing
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S277294192400036X
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850249429084274688
author Sheng Huang
author_facet Sheng Huang
author_sort Sheng Huang
collection DOAJ
description Users are increasingly turning to big data processing systems to extract valuable information from massive datasets as the field of big data grows. Data analytics platforms are used by e-commerce enterprises to improve product suggestions and model business processes. In order to meet the needs of large-scale data center operation and maintenance management, Internet companies often use Flink to process log data. This paper takes the big data processing and analysis platforms built by Internet financial companies and large banks as examples, and implants a stock prediction model based on Deep Neural Network (DNN). In this context, this paper completes the following work: 1) The research status of big data processing and analysis platforms at home and abroad is introduced. 2) Drawing on the modular design idea, the commercial bank big data platform is designed and the functions of each sub-module are introduced. Then the basic principle and structure of Convolutional Neural Networks (CNN) are expounded. 3) The optimal parameters of Convolutional Neural Networks are selected through experiments, and then the trained model is used for experiments. It can be seen that the stock prediction model proposed in this article has a higher prediction accuracy compared to existing models, which also verifies the validity of the proposed model. Input the data and compare the obtained results with the actual results, and finally show that the model in this paper has a good performance on stock prediction.
format Article
id doaj-art-f51a7b291f1e4c64af1ddad9a2af0298
institution OA Journals
issn 2772-9419
language English
publishDate 2024-12-01
publisher Elsevier
record_format Article
series Systems and Soft Computing
spelling doaj-art-f51a7b291f1e4c64af1ddad9a2af02982025-08-20T01:58:30ZengElsevierSystems and Soft Computing2772-94192024-12-01620010710.1016/j.sasc.2024.200107Big data processing and analysis platform based on deep neural network modelSheng Huang0Equipment Department, Shanghai Institute of Tourism, Shanghai 201418, ChinaUsers are increasingly turning to big data processing systems to extract valuable information from massive datasets as the field of big data grows. Data analytics platforms are used by e-commerce enterprises to improve product suggestions and model business processes. In order to meet the needs of large-scale data center operation and maintenance management, Internet companies often use Flink to process log data. This paper takes the big data processing and analysis platforms built by Internet financial companies and large banks as examples, and implants a stock prediction model based on Deep Neural Network (DNN). In this context, this paper completes the following work: 1) The research status of big data processing and analysis platforms at home and abroad is introduced. 2) Drawing on the modular design idea, the commercial bank big data platform is designed and the functions of each sub-module are introduced. Then the basic principle and structure of Convolutional Neural Networks (CNN) are expounded. 3) The optimal parameters of Convolutional Neural Networks are selected through experiments, and then the trained model is used for experiments. It can be seen that the stock prediction model proposed in this article has a higher prediction accuracy compared to existing models, which also verifies the validity of the proposed model. Input the data and compare the obtained results with the actual results, and finally show that the model in this paper has a good performance on stock prediction.http://www.sciencedirect.com/science/article/pii/S277294192400036XBig data processingAnalytics platformDeep neural networkStock prediction
spellingShingle Sheng Huang
Big data processing and analysis platform based on deep neural network model
Systems and Soft Computing
Big data processing
Analytics platform
Deep neural network
Stock prediction
title Big data processing and analysis platform based on deep neural network model
title_full Big data processing and analysis platform based on deep neural network model
title_fullStr Big data processing and analysis platform based on deep neural network model
title_full_unstemmed Big data processing and analysis platform based on deep neural network model
title_short Big data processing and analysis platform based on deep neural network model
title_sort big data processing and analysis platform based on deep neural network model
topic Big data processing
Analytics platform
Deep neural network
Stock prediction
url http://www.sciencedirect.com/science/article/pii/S277294192400036X
work_keys_str_mv AT shenghuang bigdataprocessingandanalysisplatformbasedondeepneuralnetworkmodel