Application of Random Search Methods in the Determination of Learning Rate for Training Container Dwell Time Data Using Artificial Neural Networks — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Application of Random Search Methods in the Determination of Learning Rate for Training Container Dwell Time Data Using Artificial Neural Networks
Accra Institute of Technology, Advanced School of Systems and Data Studies (ASSDAS), Accra, Ghana
,
Accra Institute of Technology, Accra, Ghana
,
Knowledge Web Centre, Accra, Ghana
,
Department of Computer Engineering, Ghana Communication Technology University, Accra, Ghana
1 Accra Institute of Technology, Advanced School of Systems and Data Studies (ASSDAS), Accra, Ghana
2 Accra Institute of Technology, Accra, Ghana
3 Knowledge Web Centre, Accra, Ghana
4 Department of Computer Engineering, Ghana Communication Technology University, Accra, Ghana
Purpose: This study aimed to enhance the prediction of container dwell time, a crucial factor for optimizing port operations, resource allocation, and supply chain efficiency. Determining an optimal learning rate for training Artificial Neural Networks (ANNs) has remained a challenging task due to the diverse sizes, complexity, and types of data involved. Design/Method/Approach: This research used a RandomizedSearchCV algorithm, a random search approach, to bridge this knowledge gap. The algorithm was applied to container dwell time data from the TOS system of the Port of Tema, which included 307,594 container records from 2014 to 2022. Findings: The RandomizedSearchCV method outperformed standard training methods both in terms of reducing training time and improving prediction accuracy, highlighting the significant role of the constant learning rate as a hyperparameter. Research Limitations and Implications: Although the study provides promising outcomes, the results are limited to the data extracted from the Port of Tema and may differ in other contexts. Further research is needed to generalize these findings across various port systems. Originality/Value: This research underscores the potential of RandomizedSearchCV as a valuable tool for optimizing ANN training in container dwell time prediction. It also accentuates the significance of automated learning rate selection, offering novel insights into the optimization of container dwell time prediction, with implications for improving port efficiency and supply chain operations.
KeywordsContainer Dwell Time PredictionArtificial Neural Networks (ANNs)Learning Rate OptimizationRandomizedSearchCV Algorithm and Port Operations Efficiency
Obermeyer, Z. and Emanuel, E.J. (2016) Predicting the Future—Big Data, Machine Learning, and Clinical Medicine. New England Journal of Medicine , 375, 1216-1219. https://doi.org/10.1056/nejmp1606181
Rajkomar, A., Dean, J. and Kohane, I. (2019) Machine Learning in Medicine. New England Journal of Medicine , 380, 1347-1358. https://doi.org/10.1056/nejmra1814259
Mazzei, D. and Ramjattan, R. (2022) Machine Learning for Industry 4.0: A Systematic Review Using Deep Learning-Based Topic Modelling. Sensors , 22, Article 8641. https://doi.org/10.3390/s22228641
Liang, J., Xu, Y., Bao, C., Quan, Y. and Ji, H. (2019) Barzilai-Borwein-Based Adaptive Learning Rate for Deep Learning. Pattern Recognition Letters , 128, 197-203. https://doi.org/10.1016/j.patrec.2019.08.029
Takase, T., Oyama, S. and Kurihara, M. (2018) Effective Neural Network Training with Adaptive Learning Rate Based on Training Loss. Neural Networks , 101, 68-78. https://doi.org/10.1016/j.neunet.2018.01.016
Kourounioti, I., Polydoropoulou, A. and Tsiklidis, C. (2016) Development of Models Predicting Dwell Time of Import Containers in Port Container Terminals—An Artificial Neural Networks Application. Transportation Research Procedia , 14, 243-252. https://doi.org/10.1016/j.trpro.2016.05.061
Kourounioti, I. and Polydoropoulou, A. (2017) Identification of Container Dwell Time Determinants Using Aggregate Data. International Journal of Transport Economics , 44, 567-588.
Zhao, H., Liu, F., Zhang, H. and Liang, Z. (2019) Research on a Learning Rate with Energy Index in Deep Learning. Neural Networks , 110, 225-231. https://doi.org/10.1016/j.neunet.2018.12.009
López, O.A.M., López, A.M. and Crossa, J. (2022) Multivariate Statistical Machine Learning Methods for Genomic Prediction. Springer. https://doi.org/10.1007/978-3-030-89010-0
Montesinos López, O.A., Montesinos López, A. and Crossa, J. (2022) Fundamentals of Artificial Neural Networks and Deep Learning. In: Montesinos López, O.A., Montesinos López, A. and Crossa, J., Eds., Multivariate Statistical Machine Learning Methods for Genomic Prediction , Springer International Publishing, 379-425. https://doi.org/10.1007/978-3-030-89010-0_10
McCulloch, W.S. and Pitts, W. (1943) A Logical Calculus of the Ideas Immanent in Nervous Activity. The Bulletin of Mathematical Biophysics , 5, 115-133. https://doi.org/10.1007/bf02478259
Choe, Y. (2014) Hebbian Learning. In: Jaeger, D. and Jung, R., Eds., Encyclopedia of Computational Neuroscience , Springer, 1-5. https://doi.org/10.1007/978-1-4614-7320-6_672-1
Werbos, P. (1974) Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. Harvard University Press. https://www.researchgate.net/publication/35657389
Samuel, A.L. (1959) Some Studies in Machine Learning Using the Game of Checkers. IBM Journal of Research and Development , 3, 210-229. https://doi.org/10.1147/rd.33.0210
Sutton, R.S. and Barto, A.G. (2018) Reinforcement Learning: An Introduction. 2nd Edition, MIT Press. https://web.stanford.edu/class/psych209/Readings/SuttonBartoIPRLBook2ndEd.pdf
Gerstner, W. and Kistler, W.M. (2002) Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press. https://doi.org/10.1017/cbo9780511815706
Mcclelland, J.L. (2005) Hebbian Learning 1 Running Head: HEBBIAN LEARNING How Far Can You Go with Hebbian Learning, and When Does It Lead You Astray? https://www.semanticscholar.org/paper/Running-head-%3A-HEBBIAN-LEARNING-How-Far-Can-You-Go-McClelland/881ec0684974e5ee986d56bfd770f0ff7e638c50#extracted
Bergstra, J. and Bengio, Y. (2012) Random Search for Hyper-Parameter Optimization. http://scikit-learn.sourceforge.net
Liu, H., Fu, Q., Du, L., Zhang, T., Yu, G., Han, S., et al . (2022) Learning Rate Perturbation. Proceedings of the 31 st ACM International Conference on Information & Knowledge Management , Atlanta, 17-21 October 2022, 4234-4238. https://doi.org/10.1145/3511808.3557626
Cankaya, B., Eren Tokgoz, B., Dag, A. and Santosh, K.C. (2021) Development of a Machine-Learning-Based Decision Support Mechanism for Predicting Chemical Tanker Cleaning Activity. Journal of Modelling in Management , 16, 1138-1165. https://doi.org/10.1108/jm2-12-2019-0284
Shankar, S., Punia, S. and Ilavarasan, P.V. (2021) Deep Learning-Based Container Throughput Forecasting: A Triple Bottom Line Approach. Industrial Management & Data Systems , 121, 2100-2117. https://doi.org/10.1108/imds-12-2020-0704
Fabianpedregosa, F.P., et al . (2011) Scikit-Learn: Machine Learning in Python. Journal of Machine Learning Research , 12, 2825-2830. http://scikit-learn.sourceforge.net
Fabianpedregosa, F.P., et al . (n.d.) Comparing Randomized Search and Grid Search for Hyperparameter Estimation. https://scikit-learn.org/stable/auto_examples/model_selection/plot_randomized_search.html
Yoo, S. and Oh, D. (2018) An Artificial Neural Network-Based Fall Detection. International Journal of Engineering Business Management , 10, 1-7. https://doi.org/10.1177/1847979018787905
Olawoyin, A. and Chen, Y. (2018) Predicting the Future with Artificial Neural Network. Procedia Computer Science , 140, 383-392. https://doi.org/10.1016/j.procs.2018.10.300
Basheer, I.A. and Hajmeer, M. (2000) Artificial Neural Networks: Fundamentals, Computing, Design, and Application. Journal of Microbiological Methods , 43, 3-31. https://www.sciencedirect.com/journal/journal-of-microbiological-methods https://doi.org/10.1016/s0167-7012(00)00201-3
Kamiri, J. and Mariga, G. (2021) Research Methods in Machine Learning: A Content Analysis. International Journal of Computer and Information Technology (2279-0764), 10, 78-91. https://doi.org/10.24203/ijcit.v10i2.79
Jolliffe, I.T. (2002) Principal Component Analysis. 2nd Edition, Springer-Verlag. https://doi.org/10.1007/b98835
Smith, L.E. (2018) Convergence and Divergence in Statistical and Programmatic Approaches to Address Child Stunting and Wasting. The Journal of Nutrition , 148, 823-824. https://doi.org/10.1093/jn/nxy098
Bergstra, J., Bardenet, R., Bengio, Y. and Kégl, B. (2011) Algorithms for Hyper-Parameter Optimization. Proceedings of the 24th International Conference on Neural Information Processing Systems , Granada, 12-15 December 2011, 2546-2554. https://proceedings.neurips.cc/paper_files/paper/2011/file/86e8f7ab32cfd12577bc2619bc635690-Paper.pdf