Determination of the Degradation Index by Detection of Pavement Distress with Transfer Learning and Image Processing
- 1 Laboratory of Studies and Tests in Civil Engineering (L2EGC), National University of Sciences, Technologies, Engineering and Mathematics, Abomey, Benin
- 2 Laboratory of Studies and Tests in Civil Engineering (L2EGC), National University of Sciences, Technologies, Engineering and Mathematics, Abomey, Benin
- 3 Laboratory of Studies and Tests in Civil Engineering (L2EGC), National University of Sciences, Technologies, Engineering and Mathematics, Abomey, Benin
- 4 Laboratory of Applied Energetic and Mechanic (LEMA), University of Abomey-Calavi, Abomey-Calavi, Benin
- 5 Laboratory of Studies and Tests in Civil Engineering (L2EGC), National University of Sciences, Technologies, Engineering and Mathematics, Abomey, Benin
Abstract
A road network is essential to a country’s transportation and socio-economic development. Its maintenance requires regular monitoring to guide maintenance decisions. Artificial intelligence now enables the automatic detection of damage, but monitoring a roadway does not end with detection. It also involves estimating the severity and extent of damage and determining the Is index. Therefore, this study allowed the development of a digital tool based on artificial intelligence and image processing for complete monitoring. This consists of detecting the roadway damages, then estimating their severity and extent to calculate the index Is . Four databases were designed from videos of damaged roads collected on different roads in Benin. These data were used in transfer learning to train the YOLOv9 and Roboflow 3.0 Object Detection models. A script was developed to estimate the extent of the degradations, setting a collection speed of 10 km/h, a picking height of 1.20 m and a viewing angle equal to 45˚, covering the entire width of the roadway. Another script determines the index Is by estimating the cracking and deformation indices, with possible corrections depending on the repairs present. The best model obtained, ROCNN4, results from training Roboflow 3.0 Object Detection with the fourth base. It detects 19 classes of degradations with a precision P of 90.8%, a mAP of 91.8% and a recall R of 89.5%. These results pave the way for better road maintenance planning by providing managers with a reliable and automated decision-support tool. They thus help optimize intervention costs and improve the durability of the road network.
- African Union (2021) Report on the Status of Implementation of the African Road Safety Action Plan (2011-2020) towards a Post-2020 African Road Safety Strategy.
- Mubarak, A.S., Ameen, Z.S. and Al-Turjman, F. (2023) Effect of Gaussian Filtered Images on Mask RCNN in Detection and Segmentation of Potholes in Smart Cities. Mathematical Biosciences and Engineering , 20, 283-295. https://doi.org/10.3934/mbe.2023013
- Rafi, F.A., Fanggidae, A. and Polly, Y.T. (2023) Asphalt Road Damage Detection System Using Canny Edge Detection. Jurnal Komputer dan Informatika , 11, 85-90. https://doi.org/10.35508/jicon.v11i1.10100
- Guo, L., Li, R. and Jiang, B. (2021) A Road Surface Damage Detection Method Using YOLOV4 with PID Optimizer, International Journal of Innovative Computing , Information and Control , 17, 1763-1774.
- DGSI, & DERPR (2018) Benin Road Maintenance Manual. Ministry of Infrastructure and Transport.
- Kothai, R., Prabakaran, N., Srinivasa Murthy, Y.V., Reddy Cenkeramaddi, L. and Kakani, V. (2024) Pavement Distress Detection, Classification, and Analysis Using Machine Learning Algorithms: A Survey. IEEE Access , 12, 126943-126960. https://doi.org/10.1109/access.2024.3455093
- Kaddah, W. (2019) Apports de nouveaux outils de traitement d’images et de programmation pour le relevé automatique de dégradations sur chaussées. Université de Bretagne Occidentale.
- Seo, H., Shi, Y. and Fu, L. (2024) Automatic Damage Detection of Pavement through Darknet Analysis of Digital, Infrared, and Multi-Spectral Dynamic Imaging Images. Sensors , 24, Article 464. https://doi.org/10.3390/s24020464
- Laurent, J. (2010) Pavemetrics. LCMS: Laser Crack Measurement System, 1-43.
- Ullah, A., Zhaoyun, S., Tariq, U., Uddin, M.I., Khatoon, A. and Rizvi, S.S. (2022) Gray-Level Image Transformation of Paved Road Cracks with Metaphorical and Computational Analysis. Mathematical Problems in Engineering , 2022, 1-14. https://doi.org/10.1155/2022/8013474
- Dhieb, N., Ghazzai, H., Besbes, H. and Massoud, Y. (2019) A Very Deep Transfer Learning Model for Vehicle Damage Detection and Localization. 2019 31 st International Conference on Microelectronics ( ICM ), Cairo, 15-18 December 2019, 158-161. https://doi.org/10.1109/icm48031.2019.9021687
- Mirbod, M. and Shoar, M. (2023) ScienceDirect Intelligent Concrete Surface Cracks Detection Using Computer Vision, Pattern Recognition, and Artificial Neural Networks. Procedia Computer Science , 217, 52-61. https://doi.org/10.1016/j.procs.2022.12.201