Physical interpretation of machine learning-based recognition of defects for the risk management of existing bridge heritage

Mosoarca, 2020, Seismic vulnerability assessment methodology for historic masonry buildings in the near-field areas, Eng. Fail. Anal., 10.1016/j.engfailanal.2020.104662 I. Apostol, M. Mosoarca, V. Stoian, Modern Consolidation Solutions for Buildings with Historical Value. Part 1: Reinforced Concrete Structures, in: 16th National Technical-Scientific Conference on Modern Technologies for the 3rd Millennium, 2017. Miluccio, 2021, Traffic-load fragility models for prestressed concrete girder decks of existing Italian highway bridges, Eng. Struct., 249, 10.1016/j.engstruct.2021.113367 Sangiorgio, 2022, Analytical fault tree and diagnostic aids for the preservation of historical steel truss bridges, Eng. Fail. Anal., 133, 10.1016/j.engfailanal.2021.105996 Borzi, 2015, Seismic vulnerability of the Italian roadway bridge stock, Earthq. Spectr., 10.1193/070413EQS190M Nettis, 2022, Displacement-based seismic performance assessment of multi-span steel truss bridges, Eng. Struct., 254, 10.1016/j.engstruct.2021.113832 Anisha, 2022, Fragility functions for highway RC bridge under various flood scenarios, Eng. Struct., 260, 10.1016/j.engstruct.2022.114244 Peduto, 2018, Probabilistic analysis of settlement-induced damage to bridges in the city of amsterdam (The Netherlands), Transp. Geotech., 14, 169, 10.1016/j.trgeo.2018.01.002 Nettis, 2023, Satellite-based interferometry for monitoring structural deformations of bridge portfolios, Autom. Constr., 10.1016/j.autcon.2022.104707 Bertolesi, 2017, Augustus bridge in narni (Italy): Seismic vulnerability assessment of the still standing part, possible causes of collapse, and importance of the roman concrete infill in the seismic-resistant behavior, Int. J. Archit. Herit., 11, 717 Papa, 2021, Three-dimensional adaptive limit analysis of masonry arch bridges interacting with the backfill, Eng. Struct., 248, 10.1016/j.engstruct.2021.113189 Milani, 2012, 3D non-linear behavior of masonry arch bridges, Comput. Struct., 110, 133, 10.1016/j.compstruc.2012.07.008 Mezzina, 2008 Calvi, 2019, Once upon a time in Italy: The tale of the morandi bridge, Struct. Eng. Int., 29, 198, 10.1080/10168664.2018.1558033 Bazzucchi, 2018, Considerations over the Italian road bridge infrastructure safety after the polcevera viaduct collapse: past errors and future perspectives., Frattura E Integrita Strutturale, 12 Ministero delle Infrastrutture e dei Trasporti, 2020 Bertola, 2023, Risk-based methodology to assess bridge condition based on visual inspection, Struct. Infrastructure Eng., 19, 10.1080/15732479.2021.1959621 Federal Highway Administration (FHWA), 2018 Mandirola, 2021, Guidelines for the use of unmanned aerial systems for fast photogrammetry-oriented mapping in emergency response scenarios, Int. J. Disaster Risk Reduct., 58, 10.1016/j.ijdrr.2021.102207 Sun, 2021, Machine learning applications for building structural design and performance assessment: State-of-the-art review, J. Build. Eng., 33 Xie, 2020, The promise of implementing machine learning in earthquake engineering: a state-of-the-art review, Earthq. Spectr., 36, 1769, 10.1177/8755293020919419 Kiani, 2019, On the application of machine learning techniques to derive seismic fragility curves, Comput. Struct., 218, 108, 10.1016/j.compstruc.2019.03.004 Almustafa, 2022, Machine learning model for predicting structural response of RC columns subjected to blast loading, Int. J. Impact Eng., 162, 10.1016/j.ijimpeng.2021.104145 Ruggieri, 2021, Machine-learning based vulnerability analysis of existing buildings, Autom. Constr., 132, 10.1016/j.autcon.2021.103936 Cardellicchio, 2022, View VULMA: Data set for training a machine-learning tool for a fast vulnerability analysis of existing buildings, Data, 7, 4, 10.3390/data7010004 Jahanshahi, 2009, A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures, Struct. Infrastructure Eng., 5, 10.1080/15732470801945930 Lee, 2006, Automated recognition of surface defects using digital color image processing, Autom. Constr., 15, 10.1016/j.autcon.2005.08.001 Adhikari, 2014, Image-based retrieval of concrete crack properties for bridge inspection, Autom. Constr., 39, 180, 10.1016/j.autcon.2013.06.011 Yang, 2015, Thin crack observation in a reinforced concrete bridge pier test using image processing and analysis, Adv. Eng. Softw., 83, 99, 10.1016/j.advengsoft.2015.02.005 Li, 2014, Long-distance precision inspection method for bridge cracks with image processing, Autom. Constr., 41, 83, 10.1016/j.autcon.2013.10.021 Chen, 2017, A self organizing map optimization based image recognition and processing model for bridge crack inspection, Autom. Constr., 73, 58, 10.1016/j.autcon.2016.08.033 Perry, 2020, Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning, Measurement, 164, 10.1016/j.measurement.2020.108048 Potenza, 2020, A robotics and computer-aided procedure for defect evaluation in bridge inspection, J. Civil Struct. Health Monit., 10, 471, 10.1007/s13349-020-00395-3 Prasanna, 2016, Automated crack detection on concrete bridges, IEEE Trans. Autom. Sci. Eng., 13, 591, 10.1109/TASE.2014.2354314 Mohammed Abdelkader, 2020, A self-adaptive exhaustive search optimization-based method for restoration of bridge defects images, Int. J. Mach. Learn. Cybern., 11, 1659, 10.1007/s13042-020-01066-x Hoang, 2020, Image processing-based pitting corrosion detection using metaheuristic optimized multilevel image thresholding and machine-learning approaches, Math. Probl. Eng., 2020, 10.1155/2020/6765274 Montaggioli, 2021 Zhu, 2020, Vision-based defects detection for bridges using transfer learning and convolutional neural networks, Struct. Infrastructure Eng., 16, 1037, 10.1080/15732479.2019.1680709 Cardellicchio, 2022, Deep learning approaches for image-based detection and classification of structural defects in bridges, vol. 13373, 269 Bukhsh, 2021, Damage detection using in-domain and cross-domain transfer learning, Neural Comput. Appl., 33, 16921, 10.1007/s00521-021-06279-x Hüthwohl, 2019, Multi-classifier for reinforced concrete bridge defects, Autom. Constr., 105, 10.1016/j.autcon.2019.04.019 Cha, 2017, Deep learning-based crack damage detection using convolutional neural networks, Comput.-Aided Civ. Infrastruct. Eng., 32, 10.1111/mice.12263 Xu, 2018, Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images, Struct. Health Monit., 1 Yang, 2018, Automatic pixel-level crack detection and measurement using fully convolutional network, Comput.-Aided Civ. Infrastruct. Eng., 33, 10.1111/mice.12412 Deng, 2020, Vision based pixel-level bridge structural damage detection using a link ASPP network, Autom. Constr., 110, 10.1016/j.autcon.2019.102973 Cha, 2018, Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types, Comput.-Aided Civ. Infrastruct. Eng., 33, 10.1111/mice.12334 Li, 2018, Unified vision-based methodology for simultaneous concrete defect detection and geolocalization, Comput.-Aided Civ. Infrastruct. Eng., 33, 527, 10.1111/mice.12351 Liu, 2016 Redmon, 2016 Maeda, 2018, Road damage detection and classification using deep neural networks with smartphone images, Comput.-Aided Civ. Infrastruct. Eng., 33, 1127, 10.1111/mice.12387 Minh, 2022, Explainable artificial intelligence: a comprehensive review, Artif. Intell. Rev., 55, 3503, 10.1007/s10462-021-10088-y Zhou, 2019, Interpreting deep visual representations via network dissection, IEEE Trans. Pattern Anal. Mach. Intell., 41, 2131, 10.1109/TPAMI.2018.2858759 Yosinski, 2015 Payer, 2019, Integrating spatial configuration into heatmap regression based CNNs for landmark localization, Med. Image Anal., 54, 207, 10.1016/j.media.2019.03.007 Selvaraju, 2017, Grad-CAM: Visual explanations from deep networks via gradient-based localization, 618 Adebayo, 2018, Sanity checks for saliency maps, Adv. Neural Inf. Process. Syst., 31 Naser, 2021, An engineer’s guide to explainable artificial intelligence and interpretable machine learning: Navigating causality, forced goodness, and the false perception of inference, Autom. Constr., 129, 10.1016/j.autcon.2021.103821 Tapeh, 2022, Discovering graphical heuristics on fire-induced spalling of concrete through explainable artificial intelligence, Fire Technol., 58, 2871, 10.1007/s10694-022-01290-7 Somala, 2021, Time period estimation of masonry infilled RC frames using machine learning techniques, Structures, 34, 1560, 10.1016/j.istruc.2021.08.088 Mangalathu, 2020, Failure mode and effects analysis of RC members based on machine-learning-based shapley additive explanations (SHAP) approach, Eng. Struct., 219, 10.1016/j.engstruct.2020.110927 Spencer, 2019, Advances in computer vision-based civil infrastructure inspection and monitoring, Engineering, 5, 199, 10.1016/j.eng.2018.11.030 Bush, 2021 Srivastava, 2014, Dropout: a simple way to prevent neural networks from overfitting, J. Mach. Learn. Res., 15, 1929 K. He, X. Zhang, S. Ren, J. Sun, Identity mappings in deep residual networks, in: European Conference on Computer Vision, Springer, 2016, pp. 630–645. Szegedy, 2014 Krizhevsky, 2012, Imagenet classification with deep convolutional neural networks, Adv. Neural Inf. Process. Syst., 25, 1097 Chattopadhay, 2018, Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks, 839 A. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, et al., Searching for mobilenetv3, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 1314–1324. Tan, 2021 G. Huang, Z. Liu, L. Van Der Maaten, K.Q. Weinberger, Densely connected convolutional networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4700–4708. C. Szegedy, S. Ioffe, V. Vanhoucke, A. Alemi, Inception-v4, inception-resnet and the impact of residual connections on learning, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 31, No. 1, 2017. He, 2016, Identity mappings in deep residual networks, 630 F. Chollet, Xception: Deep learning with depthwise separable convolutions, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1251–1258. Kingma, 2014