Manual inspections of infrastructures such as highway bridge, pavement, dam, and multistoried garage ceiling are time consuming, sometimes can be life threatening, and costly. An automated computerized system can reduce time, faulty inspection, and cost of inspection. In this study, we developed a computer model using deep learning Convolution Neural Network (CNN), which can be used to automatically detect the crack and non-crack type structure. The goal of this research is to allow application of state-of-the-art deep neural network and Unmanned Aerial Vehicle (UAV) technologies for highway bridge girder inspection. As a pilot study of implementing deep learning in Bridge Girder, we study the recognition, length, and location of crack in the structure of the UTC campus old garage concrete ceiling slab. A total of 2086 images of crack and non-crack were taken from UTC Old Library parking garage ceiling using handheld mobile phone and drone. After training the model shows 98% accuracy with crack and non-crack types of structures.
KeywordsBridge GirderConvolution Neural NetworkCrack DetectionStructural Health MonitoringInfrared Thermography
Wu, W., Qurishee, M.A., Owino, J., Fomunung, I., Onyango, M. and Atolagbe, B. (2018) Coupling Deep Learning and UAV for Infrastructure Condition Assessment Automation. 2018 IEEE International Smart Cities Conference, Kansas City, MO, 16-19 September 2018, 1-7. https://doi.org/10.1109/ISC2.2018.8656971
ASCE (2017) Infrastructure Report Card for Pavements. https://www.infrastructurereportcard.org/wp-content/uploads/2017/01/Roads-Final.pdf
Xie, F. and Levinson, D. (2011) Evaluating the Effects of the I-35W Bridge Collapse on Road-Users in the Twin Cities Metropolitan Region. Transportation Planning and Technology, 34, 691-703. https://doi.org/10.1080/03081060.2011.602850
Deng, L., Wang, W. and Yu, Y. (2015) State-of-the-Art Review on the Causes and Mechanisms of Bridge Collapse. Journal of Performance of Constructed Facilities, 30, Article ID: 04015005. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000731
Xu, Y.-L. and He, J. (2017) Smart Civil Structures. CRC Press, London. https://doi.org/10.1201/9781315368917
Kim, P. (2017) MATLAB Deep Learning: With Machine Learning, Neural Networks and Artificial Intelligence. https://doi.org/10.1007/978-1-4842-2845-6
LeCun, Y., Bengio, Y. and Hinton, G.J.N. (2015) Deep Learning. Nature, 521, 436-444. https://doi.org/10.1038/nature14539
Tsai, Y.-C., Kaul, V. and Mersereau, R.M. (2009) Critical Assessment of Pavement Distress Segmentation Methods. Journal of Transportation Engineering, 136, 11-19. https://doi.org/10.1061/(ASCE)TE.1943-5436.0000051
Ying, L. and Salari, E. (2010) Beamlet Transform-Based Technique for Pavement Crack Detection and Classification. Computer-Aided Civil and Infrastructure Engineering, 25, 572-580. https://doi.org/10.1111/j.1467-8667.2010.00674.x
Xu, L. and Oja, E. (2009) Randomized Hough Transform. In: Encyclopedia of Artificial Intelligence, IGI Global, London, 1343-1350. https://doi.org/10.4018/978-1-59904-849-9.ch197
Leymarie, F. and Levine, M.D. (1992) Simulating the Grassfire Transform Using an Active Contour Model. IEEE Transactions on Pattern Analysis & Machine Intelligence, 14, 56-75. https://doi.org/10.1109/34.107013
Zhang, L., He, Y., Xie, X. and Chen, W. (2009) Laplacian Lines for Real-Time Shape Illustration. In: Proceedings of the 2009 symposium on Interactive 3D graphics and games, ACM, New York, 129-136. https://doi.org/10.1145/1507149.1507170
Witkin, A.P. (1987) Scale-Space Filtering. in Readings in Computer Vision. Elsevier, New York, 329-332. https://doi.org/10.1016/B978-0-08-051581-6.50036-2
Kanopoulos, N., Vasanthavada, N. and Baker, R.L. (1988) Design of an Image Edge Detection Filter Using the Sobel Operator. IEEE Journal of Solid-State Circuits, 23, 358-367. https://doi.org/10.1109/4.996
Pallotta, L., Clemente, C., De Maio, A., Soraghan, J.J. and Farina, A. (2014) Pseudo-Zernike Moments Based Radar Micro-Doppler Classification. 2014 IEEE Radar Conference, Cincinnati, OH, 19-23 May 2014, 850-854. https://doi.org/10.1109/RADAR.2014.6875709
Qu, Y.-D., Cui, C.-S., Chen, S.-B. and Li, J.-Q. (2005) A Fast Subpixel Edge Detection Method Using Sobel-Zernike Moments Operator. Image and Vision Computing, 23, 11-17. https://doi.org/10.1016/j.imavis.2004.07.003
Dong, W. and Zhou, S.S. (2008) Color Image Recognition Method Based on the Prewitt Operator. 2008 International Conference on Computer Science and Software Engineering, Hubei, 12-14 December 2008, 170-173. https://doi.org/10.1109/CSSE.2008.567
Liu, J.Z., Li, W.Q. and Tian, Y.P. (1991) Automatic Thresholding of Gray-Level Pictures Using Two-Dimension Otsu Method. China., 1991 International Conference on Circuits and Systems, Shenzhen, 16-17 June 1991, 325-327.
Farhidzadeh, A., Dehghan-Niri, E., Moustafa, A., Salamone, S. and Whittaker A. (2013) Damage Assessment of Reinforced Concrete Structures Using Fractal Analysis of Residual Crack Patterns. Experimental Mechanics, 53, 1607-1619. https://doi.org/10.1007/s11340-013-9769-7
Massaro, E. and Bagnoli, F. (2014) Epidemic Spreading and Risk Perception in Multiplex Networks: A Self-Organized Percolation Method. Physical Review E, 90, Article ID: 052817. https://doi.org/10.1103/PhysRevE.90.052817
Al Qurishee, M., Wu, W., Atolagbe, B., El Said, S. and Ghasemi, A. (2019) Non-Destructive Test Application in Civil Infrastructure.
Qurishee, M., Iqbal, I., Islam, M. and Islam, M. (2016) Use of Slag as Coarse Aggregate and Its Effect on Mechanical Properties of Concrete. In: Proceedings of International Conference on Advances in Civil Engineering, 475-479.
Qurishee, M.A. (2019) Low-Cost Deep Learning UAV and Raspberry Pi Solution to Real Time Pavement Condition Assessment.
Al Qurishee, M. (2017) Application of Geosynthetics in Pavement Design.
Hasnat, A., Qurishee, M., Iqbal, I., Zaman, M. and Wahid, M. (2018) Effectiveness of Using Slag as Coarse Aggregate and Study of Its Impact on Mechanical Properties of Concrete.
Al Qurishee, M. and Fomunung, I. (2017) Smart Materials in Smart Structural Systems.
Islam, M.A., Sisiopiku, V.P., Ramadan, O.E. and Hadi, M. (2019) A Framework for Performance-Based Traffic Operations Using Connected Vehicle Data. Simulation, 6, No. 8.
Atolagbe, B. (2019) Automatic Mesh Representation of Urban Environments.
Islam, M.A. (2019) A Literature Review on Freeway Traffic Incidents and Their Impact on Traffic Operations. Journal of Transportation Technologies, 9, 504-516. https://doi.org/10.4236/jtts.2019.94032
Al Qurishee, M., Wu, W., Atolagbe, B., El Said, S., Ghasemi, A. and Tareq, S.M. (2008) Wireless Sensor Network and Its Application in Civil Infrastructure.
Islam, M.A. (2018) Intergrading Connected Vehicle Data into the Transportation Performance Measurement Process. The University of Alabama at Birmingham, Birmingham.
Islam, M.A. (2019) Requirements and Challenges Associated with Deployment of Connected Vehicles.
Pudney, C. (1998) Distance-Ordered Homotopic Thinning: A Skeletonization Algorithm for 3D Digital Images. Computer Vision and Image Understanding, 72, 404-413. https://doi.org/10.1006/cviu.1998.0680
Fortune, S. (1987) A Sweepline Algorithm for Voronoi Diagrams. Algorithmica, 2, 153. https://doi.org/10.1007/BF01840357
Choi, W.-P., Lam, K.-M. and Siu, W.-C. (2003) Extraction of the Euclidean Skeleton Based on a Connectivity Criterion. Pattern Recognition, 36, 721-729. https://doi.org/10.1016/S0031-3203(02)00098-5
Jia, J. and Tang, C.-K. (2003) Image Repairing: Robust Image Synthesis by Adaptive nd Tensor Voting. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, 16-22 June 2003. https://doi.org/10.1109/CVPR.2003.1211414
Qurishee, M., Wu, W., Atolagbe, B., Owino, J., Fomunung, I. and Onyango, M. (2020) Creating a Dataset to Boost Civil Engineering Deep Learning Research and Application. Engineering, 12, 151-165. https://doi.org/10.4236/eng.2020.123013
Girshick, R., Donahue, J., Darrell, T. and Malik, J. (2015) Region-Based Convolutional Networks for Accurate Object Detection and Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 142-158. https://doi.org/10.1109/TPAMI.2015.2437384