A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups
Deep learning-based models are ideally suited for accurately predicting electrical load in a smart grid. However, the computational overhead in training models and identifying optimal training hyperparameters are challenging problems. Two important challenges are addressed in this study. Firstly, a...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10835081/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832583980960972800 |
|---|---|
| author | A. Jayanth Balaji Binoy B. Nair D. S. Harish Ram Kuruvachan Kalluvelil George |
| author_facet | A. Jayanth Balaji Binoy B. Nair D. S. Harish Ram Kuruvachan Kalluvelil George |
| author_sort | A. Jayanth Balaji |
| collection | DOAJ |
| description | Deep learning-based models are ideally suited for accurately predicting electrical load in a smart grid. However, the computational overhead in training models and identifying optimal training hyperparameters are challenging problems. Two important challenges are addressed in this study. Firstly, a novel technique is proposed to accelerate the model training process by selecting optimal mini-batch size. The second challenge encountered is maintaining and operationalizing individual consumption forecasting models as they are not easily scalable. A methodology is proposed to generate deep learning-based models capable of forecasting energy consumption simultaneously for large user groups. The proposed methodology was empirically validated on data from 4710 individual users in ISSDA CER Dataset (approximately 25,632 datapoints/user) and 11 Feeder dataset data from NYISO (approximately 106163 datapoints/feeder). Eight deep learning algorithms trained using eleven mini-batch combinations, for two forecasting horizons resulted in 176 workflows. Training on 167 sample CER ISSDA user data resulted in 24,288 models and 75,360 individual models for the optimal mini batch. Similarly, 1,936 models were generated for the 11 NYISO Feeder datasets. A clustering approach is employed to group users with similar consumption patterns resulting in 107 models. Effectiveness of models is validated with eight deep learning algorithms trained for two forecasting horizons. Results demonstrate a 93.74% improvement on an average in convergence compared to conventional mini-batch sizes, achieving one among top three accuracy across various prediction horizons and user categories. This underscores the importance of tailored mini-batch selection methods for effective energy forecasting and management in Smart Grid systems. |
| format | Article |
| id | doaj-art-6c9c210d69364c2383c5440d132be332 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-6c9c210d69364c2383c5440d132be3322025-01-28T00:01:33ZengIEEEIEEE Access2169-35362025-01-0113150901515710.1109/ACCESS.2025.352786310835081A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer GroupsA. Jayanth Balaji0https://orcid.org/0000-0002-7379-5364Binoy B. Nair1https://orcid.org/0000-0002-9213-8319D. S. Harish Ram2https://orcid.org/0000-0001-6743-2076Kuruvachan Kalluvelil George3https://orcid.org/0009-0000-8974-3641Department of Electronics and Communication Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, IndiaDepartment of Electronics and Communication Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, IndiaDepartment of Electronics and Communication Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, IndiaNCS Pte Ltd. (Singtel Group), Ang Mo Kio, SingaporeDeep learning-based models are ideally suited for accurately predicting electrical load in a smart grid. However, the computational overhead in training models and identifying optimal training hyperparameters are challenging problems. Two important challenges are addressed in this study. Firstly, a novel technique is proposed to accelerate the model training process by selecting optimal mini-batch size. The second challenge encountered is maintaining and operationalizing individual consumption forecasting models as they are not easily scalable. A methodology is proposed to generate deep learning-based models capable of forecasting energy consumption simultaneously for large user groups. The proposed methodology was empirically validated on data from 4710 individual users in ISSDA CER Dataset (approximately 25,632 datapoints/user) and 11 Feeder dataset data from NYISO (approximately 106163 datapoints/feeder). Eight deep learning algorithms trained using eleven mini-batch combinations, for two forecasting horizons resulted in 176 workflows. Training on 167 sample CER ISSDA user data resulted in 24,288 models and 75,360 individual models for the optimal mini batch. Similarly, 1,936 models were generated for the 11 NYISO Feeder datasets. A clustering approach is employed to group users with similar consumption patterns resulting in 107 models. Effectiveness of models is validated with eight deep learning algorithms trained for two forecasting horizons. Results demonstrate a 93.74% improvement on an average in convergence compared to conventional mini-batch sizes, achieving one among top three accuracy across various prediction horizons and user categories. This underscores the importance of tailored mini-batch selection methods for effective energy forecasting and management in Smart Grid systems.https://ieeexplore.ieee.org/document/10835081/Convolutional neural networksdeep learninggated recurrent unitslong-short term memorymutual informationsmart grid |
| spellingShingle | A. Jayanth Balaji Binoy B. Nair D. S. Harish Ram Kuruvachan Kalluvelil George A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups IEEE Access Convolutional neural networks deep learning gated recurrent units long-short term memory mutual information smart grid |
| title | A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups |
| title_full | A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups |
| title_fullStr | A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups |
| title_full_unstemmed | A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups |
| title_short | A Novel Approach to Faster Convergence and Improved Accuracy in Deep Learning-Based Electrical Energy Consumption Forecast Models for Large Consumer Groups |
| title_sort | novel approach to faster convergence and improved accuracy in deep learning based electrical energy consumption forecast models for large consumer groups |
| topic | Convolutional neural networks deep learning gated recurrent units long-short term memory mutual information smart grid |
| url | https://ieeexplore.ieee.org/document/10835081/ |
| work_keys_str_mv | AT ajayanthbalaji anovelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT binoybnair anovelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT dsharishram anovelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT kuruvachankalluvelilgeorge anovelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT ajayanthbalaji novelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT binoybnair novelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT dsharishram novelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups AT kuruvachankalluvelilgeorge novelapproachtofasterconvergenceandimprovedaccuracyindeeplearningbasedelectricalenergyconsumptionforecastmodelsforlargeconsumergroups |