A review on pavement distress and structural defects detection and quantification technologies using imaging approaches

Chu Chu1, Linbing Wang2, Haocheng Xiong3
1National Center for Materials Service Safety, University of Science and Technology Beijing, Beijing 100083, China
2Department of Civil & Environmental Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USA
3School of Civil and Resource Engineering, University of Science and Technology Beijing, Beijing 100083, China

Tài liệu tham khảo

Abbondati, 2021, Surface monitoring of road pavements using mobile crowdsensing technology, Measurement, 171, 108763, 10.1016/j.measurement.2020.108763 Adarkwa, 2013, Pavement crack classification based on tensor factorization, Construction and Building Materials, 48, 853, 10.1016/j.conbuildmat.2013.07.091 Adeli, 2000, An adaptive conjugate gradient neural network-wavelet model for traffic incident detection, Computer-Aided Civil and Infrastructure Engineering, 15, 251, 10.1111/0885-9507.00189 Benedetto, 2005, Reliability of signal processing technique for pavement damages detection and classification using ground penetrating radar, IEEE Sensors Journal, 5, 471, 10.1109/JSEN.2005.846176 Burtch, 2002, Lidar principles and applications Butcher, 2014, Defect detection in reinforced concrete using random neural architectures, Computer-Aided Civil and Infrastructure Engineering, 29, 191, 10.1111/mice.12039 Cha, 2017, Deep learning-based crack damage detection using convolutional neural networks, Computer-Aided Civil and Infrastructure Engineering, 32, 361, 10.1111/mice.12263 Cha, 2018, Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types, Computer-Aided Civil and Infrastructure Engineering, 33, 731, 10.1111/mice.12334 Chen, 2015 Chen, 2015, CRSM: a practical crowd sourcing-based road surface monitoring system, Wireless Networks, 22, 1 Chen, 2005, A new design for speedway road inspecting system, Electronic Measurement Technology, 2, 32 Chen, 2016, Development of distress condition index of asphalt pavements using LTPP data through structural equation modeling, Transportation Research Part C: Emerging Technologies, 68, 58, 10.1016/j.trc.2016.03.011 Cheng, 1998, Automatic pavement distress detection system, Information Sciences, 108, 219, 10.1016/S0020-0255(97)10062-7 Chu, 2019, Design of a pavement scanning system based on structured light of interference fringe, Measurement, 145, 410, 10.1016/j.measurement.2019.02.058 Chu, 2003, Design of asphalt pavement surface distress automatic survey system, Optical Technique, 29, 316 Chu, 2013, Fuzzy adaptive control of light in laser triangulation displacement measurement, Infrared and Laser Engineering, 42, 1458 Chu, 2004, Asphalt pavement surface distress image recognition based on neural network, Journal of Wuhan University of Technology: Transportation Science & Engineering, 28 Chu, 2002, Research on pavement surface distress digital image geometric rectification, Journal of Highway and Transportation Research and Development, 19, 22 Cigada, 2010, Laser-triangulation device for in-line measurement of road texture at medium and high speed, Mechanical Systems and Signal Processing, 24, 2225, 10.1016/j.ymssp.2010.05.002 Coenen, 2017, A review on automated pavement distress detection methods, Cogent Engineering, 4, 1, 10.1080/23311916.2017.1374822 Dawood, 2016, Virtual 3D city model as a priori information source for vehicle localization system, Transportation Research Part C: Emerging Technologies, 63, 1, 10.1016/j.trc.2015.12.003 De Salles, 2017, Non-destructive ultrasonic tomography for concrete pavement evaluation: signal processing and image analysis of crucial parameters, Revista de Estruturas e Materiais, 10, 1182, 10.1590/s1983-41952017000600004 Dou, 2014, Contactless metrological traceability technology of pavement texture depth, Journal of Chang’an University (Natwal Science Edition), 34, 70 Everingham, 2007 Funck, 2003, Image segmentation algorithms applied to wood defect detection, Computers and Electronics in Agriculture, 41, 157, 10.1016/S0168-1699(03)00049-8 Gao, 2020, Detection and segmentation of cement concrete pavement pothole based on image processing technology, Mathematical Problems in Engineering, 6, 1 Gao, 2007, Pavement management system, Communications Standardization, 9, 73 Gao, 2017, Automatic extraction of pavement markings on streets from point cloud data of mobile LiDAR, Measurement of Science and Technology, 28, 10.1088/1361-6501/aa76a3 Gavilan, 2011, Adaptive road crack detection system by pavement classification, Sensors, 11, 9628, 10.3390/s111009628 Girshick, 2014, Rich feature hierarchies for accurate object detection and semantic segmentation Gopalakrishnan, 2018 Gu, 1994, One-step phase shift 3-D surface profilometry with grating projection, Optics and Lasers in Engineering, 21, 61, 10.1016/0143-8166(94)90060-4 Guo, 2003, Develop and apply of detecting system in road-surface roughness by multi-function laser detector, Communications Standardization, 29 He, 2014, Spatial pyramid, pooling in deep convolutional networks for visual recognition Henry, 2000 Herold, 2005, Spectral characteristics of asphalt road aging and deterioration: implications for remote sensing applications, Applied Optics, 44, 4327, 10.1364/AO.44.004327 Hesami, 2009, Signal processing approach to road roughness analysis and measurement Hong, 2016, Application of FBG sensors for geotechnical health monitoring, a review of sensor design, implementation methods and packaging techniques, Sensors and Actuators A: Physical, 244, 184, 10.1016/j.sna.2016.04.033 Huang, 2013 Huang, 2005, A study on pavement surface distress image feature extraction based on distributive characteristics of image tiles, China Civil Engineering Journal, 38, 54 Huang, 2011, Dynamic programming and connected component analysis for an enhanced pavement distress segmentation algorithm, Transportation Research Record, 2225, 89, 10.3141/2225-10 Jahanshahi, 2013, An innovative methodology for detection and quantification of cracks through incorporation of depth perception, Machine Vision and Applications, 24, 227, 10.1007/s00138-011-0394-0 Jimenez, 2011, Improving the obstacle detection and identification algorithms of a laserscanner-based collision avoidance, Transportation Research Part C: Emerging Technologies, 19, 658, 10.1016/j.trc.2010.11.001 JTTE Editorial Office, 2021, New innovations in pavement materials and engineering: a review on pavement engineering research 2021, Journal of Traffic and Transportation Engineering (English Edition), 8, 815, 10.1016/j.jtte.2021.10.001 Jung, 2018, 3D virtual intersection sight distance analysis using lidar data, Transportation Research Part C: Emerging Technologies, 86, 563, 10.1016/j.trc.2017.12.004 Ko, 2003, Structural health monitoring and intelligent vibration control of cable-supported bridges, KSCE Journal of Civil Engineering, 7, 701, 10.1007/BF02829139 Koch, 2011, Pothole detection in asphalt pavement images, Advanced Engineering Informatics, 25, 507, 10.1016/j.aei.2011.01.002 Lally, 2010 Larson, 1996, Tire pavement noise and safety performance LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 LeCun, 1998, Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86, 2278, 10.1109/5.726791 Li, 2008 Li, 2011, Pavement crack classification via spatial distribution features, EURASIP Journal on Advances in Signal Processing, 649675, 10.1155/2011/649675 Liao, 2016, Detection of rust defects on steel bridge coatings via digital image recognition, Automation in Construction, 71, 294, 10.1016/j.autcon.2016.08.008 Lin, 2010, Potholes detection based on SVM in the pavement distress image Lu, 2020, Improving the polishing resistance of cement mortar by using recycled ceramic, Resources, Conservation and Recycling, 158, 104796, 10.1016/j.resconrec.2020.104796 Mahler, 1991, Pavement distress analysis using image processing techniques, Microcomputers in Civil Engineering, 6, 1, 10.1111/j.1467-8667.1991.tb00393.x Marecos, 2018, Evaluation of the feasibility of common mid-point approach for air-coupled GPR applied to road pavement assessment, Measurement, 128, 295, 10.1016/j.measurement.2018.06.062 Mertz, 2002, Eye-safe laser line striper for outside use Miller, 2003 Mirzaei, 2016, Imaging and machine learning techniques for diagnosis of Alzheimer disease, Reviews in the Neurosciences, 27, 857, 10.1515/revneuro-2016-0029 Nasief, 2011, Wisconsin method for probing portland cement concrete pavement for thickness statistical comparison and validation, Transportation Research Record, 2228, 99, 10.3141/2228-12 Nejad, 2011, A comparison of multi-resolution methods for detection and isolation of pavement distress, Expert Systems with Applications, 38, 2857, 10.1016/j.eswa.2010.08.079 O'Byrne, 2014, Regionally enhanced multiphase segmentation technique for damaged surfaces, Computer-Aided Civil and Infrastructure Engineering, 29, 644, 10.1111/mice.12098 O'Byrne, 2013, Texture analysis based damage detection of ageing infrastructural elements, Computer-Aided Civil and Infrastructure Engineering, 28, 162, 10.1111/j.1467-8667.2012.00790.x Okawa, 1984, Automatic inspection of the surface defects of cast metals, Computer Vision, Graphics, and Image Processing, 25, 89, 10.1016/0734-189X(84)90050-1 Peng, 2020, A triple-thresholds pavement crack detection method leveraging random structured forest, Construction and Building Materials, 263, 120080, 10.1016/j.conbuildmat.2020.120080 Pennington, 2001, Miniaturized 3-D surface profilometer using a fiber optic coupler, Optics & Laser Technology, 33, 313, 10.1016/S0030-3992(01)00023-8 Perttunen, 2011, Distributed road surface condition monitoring using mobile phones Plati, 2020, Quantification of skid resistance seasonal variation in asphalt pavements, Journal of Traffic and Transportation Engineering (English Edition), 7, 237, 10.1016/j.jtte.2018.07.003 Prabhu, 2006, Experimental investigation of effects of dowel misalignment on joint opening behavior in rigid pavements, Transportation Research Record, 1947, 15, 10.1177/0361198106194700102 Pratico, 2015, Macrotexture modeling and experimental validation for pavement surface treatments, Construction and Building Materials, 95, 658, 10.1016/j.conbuildmat.2015.07.061 Rafiei, 2017, Supervised deep restricted Boltzmann machine for estimation of concrete, ACI Materials Journal, 114, 237, 10.14359/51689560 Ragnoli, 2018, Pavement distress detection methods: a review, Infrastructures, 3, 58, 10.3390/infrastructures3040058 Ren, 2016, Faster RCNN: towards real-time object detection with region proposal networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 1137, 10.1109/TPAMI.2016.2577031 Rosati, 2009, Real-time defect detection on highly reflective curved surfaces, Optics and Lasers in Engineering, 47, 379, 10.1016/j.optlaseng.2008.03.010 Salari, 2011, Pavement distress detection and severity analysis Sayers, 1998 Schut, 2000, Responsible pavement management Sermanet, 2014, Overfeat: integrated recognition, localization and detection using convolutional networks Sheu, 1998, A new methodology for incident detection and characterization on surface streets, Transportation Research Part C: Emerging Technologies, 6, 315, 10.1016/S0968-090X(99)00002-9 Song, 2016 Sun, 2003, The real time health monitoring system of Qianjiang 4th Bridge Sun, 2005, Design and performance tests of a FBG-based accelerometer for structural vibration monitoring Sun, 2012, Pavement crack characteristic detection based on sparse representation, EURASIP Journal on Advances in Signal Processing, 1, 191, 10.1186/1687-6180-2012-191 Sun, 2009, Automated pavement distress detection using advanced image processing techniques Tai, 2010, Automatic road anomaly detection using smart mobile device Tang, 2020, Iteratively optimized patch label inference network for automatic pavement disease detection, arXiv Tong, 2020, Pavement defect detection with fully convolutional network and an uncertainty framework, Computer-Aided Civil and Infrastructure Engineering, 35, 832, 10.1111/mice.12533 Tong, 2018, Convolutional neural network for asphalt pavement surface texture analysis, Computer-Aided Civil and Infrastructure Engineering, 33, 1056, 10.1111/mice.12406 Tsai, 2006, An independent component analysis-based filter design for defect detection in low-contrast surface images, Pattern Recognition, 39, 1679, 10.1016/j.patcog.2006.03.005 Tsai, 2012, Pavement crack detection using high-resolution 3D line laser imaging technology Tsai, 2010, Critical assessment of pavement distress segmentation methods, Journal of Transportation Engineering, 136, 11, 10.1061/(ASCE)TE.1943-5436.0000051 Tsai, 2012, Critical assessment of detecting asphalt pavement cracks under different lighting and low intensity contrast conditions using emerging 3D laser technology, Journal of Transportation Engineering, 138, 649, 10.1061/(ASCE)TE.1943-5436.0000353 Uijlings, 2013, Selective search for object recognition, International Journal of Computer Vision, 104, 154, 10.1007/s11263-013-0620-5 Wang, 2004 Wang, 2011, Elements of automated survey of pavements and a 3D methodology, Journal of Southwest Jiaotong University (English Edition), 19, 51 Wang, 2018, Regional parallel structure based CNN for thermal infrared face identification, Integrated Computer-Aided Engineering, 25, 247, 10.3233/ICA-180560 Wang, 2005, Real-time automated survey system of pavement cracking in parallel environment, Journal of Infrastructure Systems, 11, 154, 10.1061/(ASCE)1076-0342(2005)11:3(154) Wang, 2010, Road three-dimensional shape measurement method with multi-laser-sensors, Journal of Wuhan University of Technology: Transportation Science & Engineering, 34, 1202 Wang, 2012 Wei, 2006, Auto-synchronized laser scanning range sensor for thermoplastic pavement marking material thickness measurement, Proceedings of SPIE—the International Society for Optical Engineering, 15 Xiao, 2004, Preliminary study of pavement surfsee distress automation recognition based on wavelet neural network, Shanghai Highways, 2, 22 Xiao, 2005, One new algorithm of automatic classification for pavement distress, Journal of Highway and Transportation Research and Development, 22, 75 Xu, 2012 Xu, 2012, Development of road surface inspection system based on computer vision with improved neural network, Highway, 9, 451 Yang, 2020, Study on the reinforcement effect and the underlying mechanisms of a bitumen reinforced with recycled glass fiber chips, Journal of Cleaner Production, 251, 119768, 10.1016/j.jclepro.2019.119768 Yang, 2020, Performance evaluation of bitumen with a homogeneous dispersion of carbon nanotubes, Carbon, 158, 465, 10.1016/j.carbon.2019.11.013 Yin, 2019, Towards perspective-free pavement distress detection via deep learning Zangenehpour, 2015, Automated classification based on video data at intersections with heavy pedestrian and bicycle traffic: methodology and application, Transportation Research Part C: Emerging Technologies, 56, 161, 10.1016/j.trc.2015.04.003 Zhang, 2018 Zhang, 2019, Automated pixel-level pavement crack detection on 3D asphalt surfaces with a recurrent neural network, Computer-Aided Civil and Infrastructure Engineering, 34, 213, 10.1111/mice.12409 Zhao, 2016, Development of an analytic approach utilizing the extended common midpoint method to estimate asphalt pavement thickness with 3-D ground-penetrating radar, NDT & E International, 78, 29, 10.1016/j.ndteint.2015.11.005 Zheng, 2020, CLMIP: cross-layer manifold invariance based pruning method of deep convolutional neural network for real-time road type recognition, Multidimensional Systems and Signal Processing, 32, 239 Zheng, 2020, PAC-Bayesian framework based drop-path method for 2D discriminative convolutional network pruning, Multidimensional Systems and Signal Processing, 31, 793, 10.1007/s11045-019-00686-z Zheng, 2020, A full stage data augmentation method in deep convolutional neural network for natural image classification, Discrete Dynamics in Nature and Society, 2, 1 Zheng, 2018, Improvement of generalization ability of deep CNN via implicit regularization in two-stage training process, IEEE Access, 6, 15844, 10.1109/ACCESS.2018.2810849 Zheng, 2012, On selecting an optimal wavelet for detecting singularities in traffic and vehicular data, Transportation Research Part C: Emerging Technologies, 25, 18, 10.1016/j.trc.2012.03.006 Zhou, 2013