Gated Recurrent Unit (GRU) for Forecasting Hourly Energy Fluctuations

Aji Prasetya Wibawa, Alfiansyah Putra Pertama Triono, Andien Khansa’a Iffat Paramarta, Faradini Usha Setyaputri, Ade Kurnia Ganesh Akbari, Akhmad Fanny Fadhilla, Agung Bella Putra Utama, Leonel Hernandez

Abstract


In the current digital era, energy use undeniably supports economic growth, increases social welfare, and encourages technological progress. Energy-related information is often presented in complex time series data, such as energy consumption data per hour or in seasonal patterns. Deep learning models are used to analyze the data. The right choice of normalization method has great potential to improve the performance of deep learning models significantly. Deep learning models generally use several normalization methods, including min-max and z-score. In this research, the deep learning model chosen is Gated Recurrent Unit (GRU) because the computational load on GRU is lighter, so it doesn't require too much memory. In addition, the GRU data is easier to train, so that it can save training time. This research phase adopts the CRISP-DM methodology in data mining as a solution commonly used in business and research. This methodology involves six stages: Business Understanding, Data Understanding, Data Preparation, Modeling, Evaluation, and Deployment. In this research, the model was obtained using five attribute selection, which applied 2 normalization methods: min-max and z-score. With this normalization, the GRU model produces the best MAPE of 3.9331%, RMSE of 0.9022, and R2 of 0.9022. However, when using z-score normalization, the model performance decreases with MAPE of 10.4332%, RMSE of 0.7602, and R2 of 0.4213. Overall, min-max normalization provides better performance in multivariate time series data analysis.

Full Text:

PDF

References


Q. Al-Shetwi, “Sustainable development of renewable energy integrated power sector: Trends, environmental impacts, and recent challenges,” Sci. Total Environ., vol. 822, p. 153645, May 2022, doi: 10.1016/j.scitotenv.2022.153645.

Lim and S. Zohren, “Time-series forecasting with deep learning: A survey,” Philos. Trans. R. Soc. A Math. Phys. Eng. Sci., vol. 379, no. 2194, 2021, doi: 10.1098/rsta.2020.0209.

M. Khan, B. Jan, and H. Farman, Deep Learning: Convergence to Big Data Analytics. Singapore: Springer Singapore, 2019.

R. Gupta, D. Srivastava, M. Sahu, S. Tiwari, R. K. Ambasta, and P. Kumar, “Artificial intelligence to deep learning: machine intelligence approach for drug discovery,” Mol. Divers., vol. 25, no. 3, pp. 1315–1360, Aug. 2021, doi: 10.1007/s11030-021-10217-3.

Kadri and K. Abdennbi, “RNN-based deep-learning approach to forecasting hospital system demands: application to an emergency department,” Int. J. Data Sci., vol. 5, no. 1, p. 1, 2020, doi: 10.1504/IJDS.2020.109497.

Raju and S. Das, “CNN-Based Deep Learning Model for Solar Wind Forecasting,” Sol. Phys., vol. 296, no. 9, p. 134, Sep. 2021, doi: 10.1007/s11207-021-01874-6.

Jahangir, H. Tayarani, S. S. Gougheri, M. A. Golkar, A. Ahmadian, and A. Elkamel, “Deep Learning-Based Forecasting Approach in Smart Grids With Microclustering and Bidirectional LSTM Network,” IEEE Trans. Ind. Electron., vol. 68, no. 9, pp. 8298–8309, Sep. 2021, doi: 10.1109/TIE.2020.3009604.

A. J. Almalki and P. Wocjan, “Forecasting Method based upon GRU-based Deep Learning Model,” in 2020 International Conference on Computational Science and Computational Intelligence (CSCI), Dec. 2020, pp. 534–538, doi: 10.1109/CSCI51800.2020.00096.

S. S. Subbiah, S. K. Paramasivan, K. Arockiasamy, S. Senthivel, and M. Thangavel, “Deep Learning for Wind Speed Forecasting Using Bi-LSTM with Selected Features,” Intell. Autom. Soft Comput., vol. 35, no. 3, pp. 3829–3844, 2023, doi: 10.32604/iasc.2023.030480.

R. Hanocka and H.-T. D. Liu, “An introduction to deep learning on meshes,” in ACM SIGGRAPH 2021 Courses, Aug. 2021, pp. 1–27, doi: 10.1145/3450508.3464569.

Choi, J. Yi, C. Park, and S. Yoon, “Deep Learning for Anomaly Detection in Time-Series Data: Review, Analysis, and Guidelines,” IEEE Access, vol. 9, pp. 120043–120065, 2021, doi: 10.1109/ACCESS.2021.3107975.

S. Yang, X. Yu, and Y. Zhou, “LSTM and GRU Neural Network Performance Comparison Study: Taking Yelp Review Dataset as an Example,” in 2020 International Workshop on Electronic Communication and Artificial Intelligence (IWECAI), Jun. 2020, pp. 98–101, doi: 10.1109/IWECAI50956.2020.00027.

Biele, J. Kacprzyk, W. Kopeć, J. W. Owsiński, A. Romanowski, and M. Sikorski, Eds., Digital Interaction and Machine Intelligence, vol. 440. Cham: Springer International Publishing, 2022.

A. Sethia and P. Raut, “Application of LSTM, GRU and ICA for stock price prediction,” in Information and Communication Technology for Intelligent Systems: Proceedings of ICTIS 2018, Volume 2, 2019, pp. 479–487.

S. M. H. Rizvi, “Time Series Deep learning for Robust Steady-State Load Parameter Estimation using 1D-CNN,” Arab. J. Sci. Eng., vol. 47, no. 3, pp. 2731–2744, Mar. 2022, doi: 10.1007/s13369-021-05782-6.

S. G. K. Patro and K. K. sahu, “Normalization: A Preprocessing Stage,” Iarjset, no. April, pp. 20–22, 2015, doi: 10.17148/iarjset.2015.2305.

S. Sinsomboonthong, “Performance Comparison of New Adjusted Min-Max with Decimal Scaling and Statistical Column Normalization Methods for Artificial Neural Network Classification,” Int. J. Math. Math. Sci., vol. 2022, pp. 1–9, Apr. 2022, doi: 10.1155/2022/3584406.

N. Fei, Y. Gao, Z. Lu, and T. Xiang, “Z-Score Normalization, Hubness, and Few-Shot Learning,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Oct. 2021, pp. 142–151, doi: 10.1109/ICCV48922.2021.00021.

N. Singh and P. Singh, “Exploring the effect of normalization on medical data classification,” in 2021 International Conference on Artificial Intelligence and Machine Vision (AIMV), Sep. 2021, pp. 1–5, doi: 10.1109/AIMV53313.2021.9670938.

U. I. Arfianti, D. C. R. Novitasari, N. Widodo, M. Hafiyusholeh, and W. D. Utami, “Sunspot Number Prediction Using Gated Recurrent Unit (GRU) Algorithm,” IJCCS (Indonesian J. Comput. Cybern. Syst., vol. 15, no. 2, p. 141, Apr. 2021, doi: 10.22146/ijccs.63676.

S. Jeong, W. Ko, A. W. Mulyadi, and H.-I. Suk, “Deep Efficient Continuous Manifold Learning for Time Series Modeling,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 46, no. 1, pp. 171–184, Jan. 2024, doi: 10.1109/TPAMI.2023.3320125.

Borkowski, C. Sorini, and A. Chattopadhyay, “Recurrent neural network-based multiaxial plasticity model with regularization for physics-informed constraints,” Comput. Struct., vol. 258, p. 106678, Jan. 2022, doi: 10.1016/j.compstruc.2021.106678.

Ahmadzadeh, H. Kim, O. Jeong, N. Kim, and I. Moon, “A Deep Bidirectional LSTM-GRU Network Model for Automated Ciphertext Classification,” IEEE Access, vol. 10, pp. 3228–3237, 2022, doi: 10.1109/ACCESS.2022.3140342.

Hussain, M. K. Afzal, S. Ahmad, and A. M. Mostafa, “Intelligent Traffic Flow Prediction Using Optimized GRU Model,” IEEE Access, vol. 9, pp. 100736–100746, 2021, doi: 10.1109/ACCESS.2021.3097141.

S. Sah, B. Surendiran, R. Dhanalakshmi, S. N. Mohanty, F. Alenezi, and K. Polat, “Forecasting COVID-19 Pandemic Using Prophet, ARIMA, and Hybrid Stacked LSTM-GRU Models in India,” Comput. Math. Methods Med., vol. 2022, pp. 1–19, May 2022, doi: 10.1155/2022/1556025.

A. W. Saputra, A. P. Wibawa, U. Pujianto, A. B. P. Utama, and A. Nafalski, “LSTM-based Multivariate Time-Series Analysis : A Case of Journal Visitors Forecasting,” Ilk. J. Ilm., vol. 14, no. 1, pp. 57–62, 2022, doi: 10.33096/ilkom.v14i1.1106.57-62.

Recchia, “R-Squared Measures for Two-Level Hierarchical Linear Models Using SAS,” J. Stat. Softw., vol. 32, no. Code Snippet 2, 2010, doi: 10.18637/jss.v032.c02.

J. Becerra-Rico, M. A. Aceves-Fernández, K. Esquivel-Escalante, and J. C. Pedraza-Ortega, “Airborne particle pollution predictive model using Gated Recurrent Unit (GRU) deep neural networks,” Earth Sci. Informatics, vol. 13, no. 3, pp. 821–834, Sep. 2020, doi: 10.1007/s12145-020-00462-9.

Abo-Tabik, N. Costen, J. Darby, and Y. Benn, “Towards a Smart Smoking Cessation App: A 1D-CNN Model Predicting Smoking Events,” Sensors, vol. 20, no. 4, p. 1099, Feb. 2020, doi: 10.3390/s20041099.

B. Aditya Satrio, W. Darmawan, B. U. Nadia, and N. Hanafiah, “Time series analysis and forecasting of coronavirus disease in Indonesia using ARIMA model and PROPHET,” Procedia Comput. Sci., vol. 179, pp. 524–532, 2021, doi: 10.1016/j.procs.2021.01.036.

H. Liu, R. Ma, D. Li, L. Yan, and Z. Ma, “Machinery Fault Diagnosis Based on Deep Learning for Time Series Analysis and Knowledge Graphs,” J. Signal Process. Syst., vol. 93, no. 12, pp. 1433–1455, Dec. 2021, doi: 10.1007/s11265-021-01718-3.

S. Liu, X. Hao, Z. Meng, J. Li, T. Cui, and L. Wei, “Application of SRNN-GRU in Photovoltaic power Forecasting,” E3S Web Conf., vol. 256, p. 02001, May 2021, doi: 10.1051/e3sconf/202125602001.




DOI: http://dx.doi.org/10.17977/um049v5i1p16-25

Refbacks

  • There are currently no refbacks.


View My Stats