Wind energy prediction represents an important and active field in the renewable energy sector. Since renewable energy sources are integrated into existing grids and combined with traditional sources, knowing the amount of energy that will be produced is key in minimizing the operational cost of the wind farm and safe operation of the power grid. In this context, we propose a comparative and comprehensive study of artificial neural networks, support vector regression, random trees, and random forest, and present the pros and cons of implementing the aforementioned techniques. A step-by-step approach based on the CRISP-DM data mining framework reveals the thought process end-to-end, including feature engineering, metrics selection, model selection, or hyperparameter tuning. Using the selected metrics for model evaluation, we provide a summary highlighting the optimal results and the trade-off between performance and the resources expended to achieve these results. This research is also intended to provide guidance for wind energy professionals, filling the gap between purely academic research and real-world business use cases, providing the exact architectures and selected hyperparameters.
Barbounis, T. G., Theocharis, J. B., Alexiadis, M. C., & Dokopoulos, P. S. (2006). Long-Term Wind Speed and Power Forecasting Using Local Recurrent Neural Network Models. IEEE Transactions on Energy Conversion, 21, 273-284. https://doi.org/10.1109/TEC.2005.847954
Basak, D., Pal, S., Ch, D., & Patranabis, R. (2007). Support Vector Regression. Neural Information Processing—Letters and Reviews, 11, 203-224.
Ben Ishak, A. (2016). Variable Selection Using Support Vector Regression and Random Forests: A Comparative Study. Intelligent Data Analysis, 20, 83-104. https://doi.org/10.3233/IDA-150795
Breiman, L. (2001). Random Forests. Machine Learning, 45, 5-32. https://doi.org/10.1023/A:1010933404324
Catalao, J. P. S., Pousinho, H. M. I., & Mendes, V. M. F. (2011). Short-Term Wind Power Forecasting in Portugal by Neural Networks and Wavelet Transform. Renewable Energy, 36, 1245-1251. https://doi.org/10.1016/j.renene.2010.09.016
Damousis, I. G., & Dokopoulos, P. (2001). A Fuzzy Expert System for the Forecasting of Wind Speed and Power Generation in Wind Farms. PICA 2001. Innovative Computing for Power—Electric Energy Meets the Market. 22nd IEEE Power Engineering Society. International Conference on Power Industry Computer Applications, Sydney, 20-24 May 2001, 63-69.
De Giorgi, M. G., Campilongo, S., Ficarella, A., & Congedo, P. (2014). Comparison between Wind Power Prediction Models Based on Wavelet Decomposition with Least-Squares Support Vector Machine (LS-SVM) and Artificial Neural Network (ANN). Energies, 7, 5251-5272. https://doi.org/10.3390/en7085251
Engel, H., Hensley, R., Knupfer, S., & Sahdev, S. (2018). The Potential Impact of Electric Vehicles on Global Energy Systems. https://www.mckinsey.com/industries/automotive-and-assembly/our-insights/the-potential-impact-of-electric-vehicles-on-global-energy-systems
European Commission (2013). Renewable Energy Directive: Cooperation Mechanisms. https://ec.europa.eu/energy/en/topics/renewable-energy/renewable-energy-directive/cooperation-mechanisms
European Commission (2020). Climate Strategies and Targets: 2030 Climate & Energy Framework. https://ec.europa.eu/clima/policies/strategies/2030_en
European Parliament (2018a). Directive (EU) 2018/2001 of the European Parliament and of the Council of 11 December 2018 on the Promotion of the Use of Energy from Renewable Sources. https://eur-lex.europa.eu/eli/dir/2018/2001/oj
European Parliament (2018b). Directive (EU) 2018/844 of the European Parliament and of the Council of 30 May 2018 Amending Directive 2010/31/EU on the Energy Performance of Buildings and Directive 2012/27/EU on Energy Efficiency. https://eur-lex.europa.eu/eli/dir/2018/844/oj
Eurostat (2020). Renewable Energy Statistics. https://ec.europa.eu/eurostat/statistics-explained/index.php/Renewable_energy_statistics
Evans, R., & Gao, J. (2016). DeepMind AI Reduces Google Data Centre Cooling Bill by 40%. https://deepmind.com/blog/deepmind-ai-reduces-google-data-centre-cooling-bill-40/
Fawcett, T., & Provost, F. (2013). Data Science for Business. Newton, MA: O’Relly Media.
Flores, P., Tapia, A., & Tapia, G. (2005). Application of a Control Algorithm for Wind Speed Prediction and Active Power Generation. Renewable Energy, 30, 523-536. https://doi.org/10.1016/j.renene.2004.07.015
Focken, U., Lange, M., & Waldl, H.-P. (2001). Previento—A Wind Power Prediction System with an Innovative Upscaling Algorithm. In European Wind Energy Conference & Exhibition (pp. 826-829). Copenhagen: European Wind Energy Association.
Gani, W., Taleb, H., & Limam, M. (2010). Support Vector Regression Based Residual Control Charts. Journal of Applied Statistics, 37, 309-324. https://doi.org/10.1080/02664760903002667
Gao, G., Li, J., & Wen, Y. (2019). Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning. arXiv:1901.04693. https://arxiv.org/abs/1901.04693
Glorot, X., & Bengio, Y. (2010). Understanding the Difficulty of Training Deep Feed forward Neural Networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (pp. 249-256). Sardinia: ML Research Press.
He, D., & Liu, R. (2012). Ultra-Short-Term Wind Power Prediction Using ANN Ensemble Based on PCA. In Proceedings of the 7th International Power Electronics and Motion Control Conference (pp. 2108-2112). Harbin: IEEE.
Hinton, G., Srivastava, N., & Swersky, K. (2020). Lecture 6a: Overview of Mini-Batch Gradient Descent. https://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf
Hunter, D. K., Yu, H., Pukish, M. S., Kolbusz, J., & Wilamowski, B. M. (2012). Selection of Proper Neural Network Sizes and Architectures—A Comparative Study. IEEE Transactions on Industrial Informatics, 8, 228-240. https://doi.org/10.1109/TII.2012.2187914
International Energy Agency (2018). World Energy Outlook 2018. https://www.iea.org/weo2018/electricity/
Jain, A. K., Mao, J., & Mohiuddin, K. M. (1996). Artificial Neural Networks: A Tutorial. Computer, 29, 31-44. https://doi.org/10.1109/2.485891
Kariniotakis, G., Stavrakakis, G., & Nogaret, E. F. (1996). Wind Power Forecasting Using Advanced Neural Networks Models. IEEE Transactions on Energy Conversion, 11, 762-767. https://doi.org/10.1109/60.556376
Kingma, D. P., & Ba, J. (2014). Adam: A Method for Stochastic Optimization. 3rd International Conference for Learning Representations.
Kolhe, M., Lin, T. C., & Maunuksela, J. (2011). GA-ANN for Short-Term Wind Energy Prediction. Asia-Pacific Power and Energy Engineering Conference, Wuhan, 25-28 March 2011, 1-6. https://doi.org/10.1109/APPEEC.2011.5749029
Kotsiantis, S. (2011). Combining Bagging, Boosting, Rotation Forest and Random Subspace Methods. Artificial Intelligence Review, 35, 223-240. https://doi.org/10.1007/s10462-010-9192-8
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems. http://www.cs.toronto.edu/~hinton/absps/imagenet.pdf
Kusiak, A., & Xu, G. L. (2012). Modeling and Optimization of HVAC Systems Using Dynamic Neural Network. Energy, 42, 241-250. https://doi.org/10.1016/j.energy.2012.03.063
Lahouar, A., & Ben Hadj Slama, J. (2017). Hour-Ahead Wind Power Forecast Based on Random Forests. Renewable Energy, 109, 529-541. https://doi.org/10.1016/j.renene.2017.03.064
Landberg, L., & Watson, S. J. (1994). Short-Term Prediction of Local Wind Conditions. Boundary-Layer Meteorology, 70, 171-195. https://doi.org/10.1007/BF00712528
Liu, Y., Sun, Y., Infield, D., Zhao, Y., Han, S., & Yan, J. (2016). A Hybrid Forecasting Method for Wind Power Ramp Based on Orthogonal Test and Support Vector Machine (OT-SVM). IEEE Transactions on Sustainable Energy, 8, 451-457. https://doi.org/10.1109/TSTE.2016.2604852
Lydia, A. A., & Francis, F. S. (2019). Adagrad—An Optimizer for Stochastic Gradient Descent. International Journal of Information and Computing Science, 6, 566-568.
Madhiarasan, M., & Deepa, S. N. (2016). Comparative Analysis on Hidden Neurons Estimation in Multi Layer Perceptron Neural Networks for Wind Speed Forecasting. Artificial Intelligence Review, 48, 449-471. https://doi.org/10.1007/s10462-016-9506-6
Marsh, J. (2019). Five Types of Renewable Energy Sources: Best Alternatives to Fossil Fuels. https://news.energysage.com/five-types-of-renewable-energy-sources/
Niayifar, A., & Porté-Agel, F. (2015). A New Analytical Model for Wind Farm Power Prediction. Journal of Physics: Conference Series, 625, 012039. https://doi.org/10.1088/1742-6596/625/1/012039
Open Power System Data (2020). Open Power System Data: A Free and Open Data Platform for Power System Modelling. https://open-power-system-data.org/
Panchal, G., Ganatra, A., Kosta, Y. P., & Panchal, D. (2011). Behaviour Analysis of Multilayer Perceptrons with Multiple Hidden Neurons and Hidden Layers. International Journal of Computer Theory and Engineering, 3, 332-337. https://doi.org/10.7763/IJCTE.2011.V3.328
Perez, M. (2002). Wind Forecasting Activities. In Proceedings of the First IEA Joint Action Symposium (pp. 197-214). Norrkoping: FOI-Swedish Defence Research Agency.
Prada, J., & Dorronsoro, J. R. (2015). SVRs and Uncertainty Estimates in Wind Energy Prediction. In I. Rojas, G. Joya, & A. Catala (Eds.), International Work-Conference on Artificial Neural Networks 2015: Advances in Computational Intelligence (pp. 564-577). Palma de Mallorca: Springer. https://doi.org/10.1007/978-3-319-19222-2_47
Ritchie, H., & Roser, M. (2017). Fossil Fuels. https://ourworldindata.org/fossil-fuels
Shetty, B. (2019). Curse of Dimensionality. https://builtin.com/data-science/curse-dimensionality
Singh, V. (2016). Application of Artificial Neural Networks for Predicting Generated Wind Power. International Journal of Advanced Computer Science and Applications, 7, 250-253. https://doi.org/10.14569/IJACSA.2016.070336
Smola, A. J., & Schölkopf, B. (1998). On a Kernel-Based Method for Pattern Recognition, Regression, Approximation and Operator Inversion. Algorithmica, 22, 211-231. https://doi.org/10.1007/PL00013831
Smola, A. J., & Schölkopf, B. (2004). A Tutorial on Support Vector Regression. Statistics and Computing, 14, 199-222. https://doi.org/10.1023/B:STCO.0000035301.49549.88
Steorts, R. C. (2020). Tree Based Methods: Regression Trees. http://www2.stat.duke.edu/~rcs46/lectures_2017/08-trees/08-tree-regression.pdf
Taylor, J. (2020). Regression Trees. https://web.stanford.edu/class/stats202/notes/Tree/Regression-trees.html
Torres-Barrán, A., Alonso, á., & Dorronsoro, J. R. (2017). Regression Tree Ensembles for Wind Energy and Solar Radiation Prediction. Neurocomputing, 326-327, 151-160. https://doi.org/10.1016/j.neucom.2017.05.104
U.S. Department of Energy (2011). 2011 Buildings Energy Data Book. https://ieer.org/wp/wp-content/uploads/2012/03/DOE-2011-Buildings-Energy-DataBook-BEDB.pdf
Wang, H., Sun, J., Sun, J., & Wang, J. (2017). Using Random Forests to Select Optimal Input Variables for Short-Term Wind Speed Forecasting Models. Energies, 10, 1522. https://doi.org/10.3390/en10101522
Wei, T., Wang, Y., & Zhu, Q. (2017). Deep Reinforcement Learning for Building HVAC Control. In Proceedings of the 54th Annual Design Automation Conference (Article No. 22). New York: Association for Computing Machinery. https://doi.org/10.1145/3061639.3062224
Willuhn, M. (2019). Renewable Energy Investment to Increase by $210 Billion over Five Years. https://www.pv-magazine.com/2019/02/12/renewable-energy-investment-to-increase-by-210-billion-over-five-years/
Zhu, Z., Zhou, D., & Fan, Z. (2016). Short Term Forecast of Wind Power Generation Based on SVM with Pattern Matching. In 2016 IEEE International Energy Conference (pp. 1-6). Leuven: IEEE.