A novel method for asphalt pavement crack classification based on image processing and machine learning

Engineering with Computers - Tập 35 - Trang 487-498 - 2018
Nhat-Duc Hoang1, Quoc-Lam Nguyen2
1Faculty of Civil Engineering, Institute of Research and Development, Duy Tan University, Da Nang, Vietnam
2Faculty of Civil Engineering, Duy Tan University, Da Nang, Vietnam

Tóm tắt

This study constructs an automatic model for detecting and classifying asphalt pavement crack. Image processing techniques including steerable filters, projective integral of image, and an enhanced method for image thresholding are employed for feature extraction. Different scenarios of feature selection have been attempted to create data sets from digital images. These data sets are then employed to train and verify the performance of machine learning algorithms including the support vector machine (SVM), the artificial neural network (ANN), and the random forest (RF). The feature set that consists of the properties derived from the projective integral and the properties of crack objects can deliver the most desirable outcome. Experimental results supported by the Wilcoxon signed-rank test show that SVM has achieved the highest classification accuracy rate (87.50%), followed by ANN (84.25%), and RF (70%). Accordingly, the proposed automatic approach can be helpful to assist transportation agencies and inspectors in the task of pavement condition assessment.

Tài liệu tham khảo

Li S, Cao Y, Cai H (2017) Automatic pavement-crack detection and segmentation based on steerable matched filtering and an active contour model. J Comput Civil Eng 31:04017045 Cubero-Fernandez A, Rodriguez-Lozano FJ, Villatoro R, Olivares J, Palomares JM (2017) Efficient pavement crack detection and classification. EURASIP J Image Video Process 2017:39 Liu P, Otto F, Wang D, Oeser M, Balck H (2017) Measurement and evaluation on deterioration of asphalt pavements by geophones. Measurement 109:223–232 Gopalakrishnan K, Khaitan SK, Choudhary A, Agrawal A (2017) Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr Build Mater 157:322–330 Gavilán M, Balcones D, Marcos O, Llorca DF, Sotelo MA, Parra I, Ocaña M, Aliseda P, Yarza P, Amírola A (2011) Adaptive road crack detection system by pavement classification. Sensors 11:9628 Ouma YO, Hahn M (2016) Wavelet-morphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification using circular Radon transform. Adv Eng Inform 30:481–499 Radopoulou SC, Brilakis I (2017) Automated detection of multiple pavement defects. J Comput Civil Eng 31:04016057 Koch C, Jog GM, Brilakis I (2013) Automated pothole distress assessment using asphalt pavement video data. J Comput Civil Eng 27:370–378 Tsai Y-C, Jiang C, Huang Y (2014) Multiscale crack fundamental element model for real-world pavement crack classification. J Comput Civil Eng 28:04014012 Guan H, Li J, Yu Y, Chapman M, Wang H, Wang C, Zhai R (2015) Iterative tensor voting for pavement crack extraction using mobile laser scanning data. IEEE Trans Geosci Remote Sens 53:1527–1537 Kaseko MS, Ritchie SG (1993) A neural network-based methodology for pavement crack detection and classification. Transp Res Part C Emerg Technol 1:275–291 Bishop C (2006) Pattern recognition and machine learning. Springer Science + Business Media, Singapore Cheng HD, Miyojim M (1998) Automatic pavement distress detection system. Inf Sci 108:219–240 Cheng HD, Chen J-R, Glazier C, Hu YG (1999) Novel approach to pavement cracking detection based on fuzzy set theory. J Comput Civil Eng 13:270–280 Lee H, Kim J (2005) Development of a crack type index, transportation research record. J Transp Res Board 1940:99–109 Jayaraman S, Veerakumar T, Esakkirajan S (2009) Digital image processing. Tata McGraw Hill Education, New York Oliveira H, Correia PL (2009) Automatic road crack segmentation using entropy and image dynamic thresholding. In: Proceeding of the 17th European Signal Processing Conference. Glasgow, Scotland, European Association for Signal, Speech, and Image Processing, pp 622–626. https://www.eurasip.org/Proceedings/Eusipco/Eusipco2009/contents/papers/1569192726.pdf Kamaliardakani M, Sun L, Ardakani MK (2016) Sealed-crack detection algorithm using heuristic thresholding approach. J Comput Civil Eng 30:04014110 Sun L, Kamaliardakani M, Zhang Y (2016) Weighted neighborhood pixels segmentation method for automated detection of cracks on pavement surface images. J Comput Civil Eng 30:04015021 Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Aided Civil Infrastruct Eng 27:29–47 Zalama E, Gómez-García-Bermejo J, Medina R, Llamas J (2014) Road crack detection using visual features extracted by Gabor filters. Comput Aided Civil Infrastruct Eng 29:342–358 Jiang C, Tsai YJ (2016) Enhanced crack segmentation algorithm using 3D pavement data. J Comput Civil Eng 30:04015050 Amhaz R, Chambon S, Idier J, Baltazart V (2016) Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Trans Intell Transp Syst 17:2718–2729 Zhou J, Huang PS, Chiang F-P (2003) Wavelet-aided pavement distress image processing. In: Proceedings of the SPIE, vol. 5207, The International Society for Optical Engineering, pp 728–739. https://doi.org/10.1117/12.509670 Ying L, Salari E (2010) Beamlet transform-based technique for pavement crack detection and classification. Comput Aided Civil Infrastruct Eng 25:572–580 Sun L, Qian Z (2016) Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification. Measurement 86:26–40 Mokhtari S, Wu L, Yun H-B (2016) Comparison of supervised classification techniques for vision-based pavement crack detection. Transp Res Rec J Transp Res Board 2595:119–127 Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29:196–210 Zakeri H, Nejad FM, Fahimifar A (2017) Image based techniques for crack detection, classification and quantification in asphalt pavement: a review. Arch Comput Methods Eng 24:935–977 Coenen TBJ, Golroo A (2017) A review on automated pavement distress detection methods. Cogent Eng 4:1374822 Adelson EH, Freeman WT (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906 Perona P (1995) Deformable kernels for early vision. IEEE Trans Pattern Anal Mach Intell 17:488–499 Freeman WT, Adelson EH (1990) Steerable filters for early vision, image analysis, and wavelet decomposition. In: Proceedings Third International Conference on Computer Vision, Osaka, Japan, IEEE, pp 406–415. https://doi.org/10.1109/ICCV Jacob M, Unser M (2004) Design of steerable filters for feature detection using canny-like criteria. IEEE Trans Pattern Anal Mach Intell 26:1007–1019 Braz J, Ranchordas A, Araújo H, Jorge J (2007) Advances in computer graphics and computer vision. Springer, Berlin, Heidelberg Otsu N (1979) A threshold selection method from Gray-Level histograms. IEEE Trans Syst Man Cybern 9:62–66 Talab AMA, Huang Z, Xi F, HaiMing L (2016) Detection crack in image using Otsu method and multiple filtering in image processing techniques. Opt Int J Light Electron Opt 127:1030–1033 Hoang N-D (2018) Detection of surface crack in building structures using image processing technique with an improved Otsu method for image thresholding. Adv Civil Eng 2018:10 MathWorks (2016) Image Processing Toolbox User’s Guide, The MathWorks, Inc. https://www.mathworks.com/help/pdf_doc/images/images_tb.pdf (Date of last access: 06/01/2017) Pham BT, Tien Bui D, Prakash I, Dholakia MB (2017) Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS. CATENA 149(Part 1):52–63 Breiman L (2001) Random Forests. Mach Learn 45(1):5–32. https://doi.org/10.1023/A:1010933404324 Tapas N, Lone T, Reddy D, Kuppili V (2017) Prediction of cardiac arrest recurrence using ensemble classifiers. Sādhanā 42:1135–1141 Pham BT, Khosravi K, Prakash I (2017) Application and comparison of decision tree-based machine learning methods in landside susceptibility assessment at Pauri Garhwal Area. Environmental Processes, Uttarakhand Vapnik VN (1998). Statistical Learning Theory. Wiley, New York. ISBN-10: 0471030031 Hamel LH (2009) Knowledge discovery with support vector machines. Wiley, Hoboken Hadjidemetriou GM, Vela PA, Christodoulou SE (2018) Automated pavement patch detection and quantification using support vector machines. J Comput Civil Eng 32:04017073 Duan K-B, Keerthi SS (2005) Which Is the Best Multiclass SVM Method? An empirical study. In: Multiple classifier systems: 6th International Workshop, MCS 2005, Seaside, CA, USA, June 13–15, 2005. Proceedings. Springer, Berlin, Heidelberg, pp 278–285 Heaton J (2008) Introduction to neural networks for C#. Heaton Research, Inc., Washington Hoang N-D, Tien D, Bui (2018) Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study. Bull Eng Geol Env 9:1077–1097 Tien Bui D, Hoang ND (2017) A Bayesian framework based on a Gaussian mixture model and radial-basis-function Fisher discriminant analysis (BayGmmKda V1.1) for spatial prediction of floods. Geosci Model Dev 10:3391–3409