Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks

Computer-Aided Civil and Infrastructure Engineering - Tập 32 Số 5 - Trang 361-378 - 2017
Young‐Jin Cha1, Wooram Choi1, Oral Büyüköztürk2
1Department of Civil Engineering, University of Manitoba, Winnipeg, MB, Canada
2Department of Civil and Environmental Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA

Tóm tắt

Abstract

A number of image processing techniques (IPTs) have been implemented for detecting civil infrastructure defects to partially replace human‐conducted onsite inspections. These IPTs are primarily used to manipulate images to extract defect features, such as cracks in concrete and steel surfaces. However, the extensively varying real‐world situations (e.g., lighting and shadow changes) can lead to challenges to the wide adoption of IPTs. To overcome these challenges, this article proposes a vision‐based method using a deep architecture of convolutional neural networks (CNNs) for detecting concrete cracks without calculating the defect features. As CNNs are capable of learning image features automatically, the proposed method works without the conjugation of IPTs for extracting features. The designed CNN is trained on 40 K images of 256 × 256 pixel resolutions and, consequently, records with about 98% accuracy. The trained CNN is combined with a sliding window technique to scan any image size larger than 256 × 256 pixel resolutions. The robustness and adaptability of the proposed approach are tested on 55 images of 5,888 × 3,584 pixel resolutions taken from a different structure which is not used for training and validation processes under various conditions (e.g., strong light spot, shadows, and very thin cracks). Comparative studies are conducted to examine the performance of the proposed CNN using traditional Canny and Sobel edge detection methods. The results show that the proposed method shows quite better performances and can indeed find concrete cracks in realistic situations.

Từ khóa


Tài liệu tham khảo

AAOSHAT, 2008, Bridging the Gap—Restoring and Rebuilding the Nation's Bridges

10.1061/(ASCE)0887-3801(2003)17:4(255)

10.3233/ICA-2010-0345

10.1016/j.ndteint.2008.06.005

10.1007/978-3-642-35289-8_26

Bengio Y., 2016, Deep Learning

10.1007/978-3-642-35289-8_25

10.1111/mice.12039

10.1111/mice.12122

10.1016/j.engstruct.2016.11.038

10.1016/j.autcon.2016.06.008

10.1016/j.compstruc.2010.12.014

10.1016/j.jsv.2015.01.024

CIFAR‐10 and CIFAR‐100 Dataset (no date) Available at:https://www.cs.toronto.edu/~kriz/cifar.html accessed July 2016.

Ciresan D. C., 2011, Flexible, high performance convolutional neural networks for image classification, in, Proceedings of International Joint Conference on Artificial Intelligence, 1234

10.1111/j.1747-1567.1999.tb01320.x

Federal Highway Administration (no date) Available at:https://www.fhwa.dot.gov/bridge/ accessed March9 2016.

10.1109/42.811279

ImageNet (no date) Available at:http://www.image-net.org/ accessed July 2016.

Ioffe S., 2015, Batch normalization: accelerating deep network training by reducing internal covariate shift, arXiv preprint arXiv:1502.03167

10.1007/s00138-011-0394-0

10.12989/sss.2010.6.5_6.439

10.1002/nme.1964

Krizhevsky A., 2012, Imagenet classification with deep convolutional neural networks, Advances in Neural Information Processing Systems, 1097

10.1061/(ASCE)ST.1943-541X.0000609

10.1038/nature14539

10.1109/5.726791

10.1007/978-3-642-35289-8_3

10.1016/S0045-7825(02)00221-9

MNIST Database (no date) Available at:http://yann.lecun.com/exdb/mnist/ accessed July2016.

Moon H., 2011, Intelligent crack detecting algorithm on the concrete crack image using neural network, Proceedings of the 28th ISARC, 1461

Nair V., 2010, Proceedings of the 27th International Conference on Machine Learning (ICML‐10), 807

10.1111/j.1467-8667.2011.00716.x

10.1111/mice.12098

10.1111/j.1467-8667.2012.00790.x

10.1002/nme.1975

10.1016/0167-2789(92)90242-F

10.1007/978-3-642-15825-4_10

10.1109/ICDAR.2003.1227801

10.1016/j.autcon.2005.02.006

10.14358/PERS.70.12.1365

Soukup D., 2014, Convolutional neural networks for steel surface defect detection from photometric stereo images, in, Proceedings of 10th International Symposium on Visual Computing, 668

Srivastava N., 2014, Dropout: a simple way to prevent neural networks from overfitting, Journal of Machine Learning Research, 15, 1929

Steinkrau D., 2005, Proceedings of 8th International Conference on Document Analysis and Recognition, 1115

10.1016/j.protcy.2016.01.014

10.1145/2733373.2807412

10.1109/IJCNN.2001.939002

Wu L., 2014, Improvement of crack‐detection accuracy using a novel crack defragmentation technique in image‐based road assessment, Journal of Computing in Civil Engineering, 30

10.1007/s13349-011-0015-7

10.1002/tee.20244

10.1111/mice.12141

Ziou D., 1998, Edge detection techniques—an overview, Pattern Recognition and Image Analysis C/C of Raspoznavaniye Obrazov I Analiz Izobrazhenii, 8, 537