Novel methodology for identifying the weight of moving vehicles on bridges using structural response pattern extraction and deep learning algorithms

He, 2019, Virtual axle method for bridge weigh-in-motion systems requiring no axle detector, J. Bridge Eng., 24, 10.1061/(ASCE)BE.1943-5592.0001474 Deng, 2018, Vehicle weight limits and overload permit checking considering the cumulative fatigue damage of bridges, J. Bridge Eng., 23, 10.1061/(ASCE)BE.1943-5592.0001267 Xia, 2020, Model updating of an existing bridge with high-dimensional variables using modified particle swarm optimization and ambient excitation data, Measurement., 159, 10.1016/j.measurement.2020.107754 Yu, 2019, Prediction of bridge maximum load effects under growing traffic using non-stationary bayesian method, Eng. Struct., 185, 171, 10.1016/j.engstruct.2019.01.085 B.F. Spencer, F. Billie, M. Fernando, et al., Campaign monitoring of railroad bridges in high-speed rail shared corridors using wireless smart sensors, Newmark Structural Engineering Laboratory (NSEL) Report Series, Report No. NSEL-040, University of Illinois at Urbana-Champaign. 2015. Huang, 2018, Measurement of the real-time deflection of cable-stayed bridge based on cable tension variations, Measurement., 119, 218, 10.1016/j.measurement.2018.01.070 Chen, 2019, Bridge influence line identification based on adaptive B-spline basis dictionary and sparse regularization, Struct Control Hlth., 26, 1, 10.1002/stc.2355 Moses, 1979, Weigh-in-motion system using instrumented bridges, Transportation, 105, 233 T. Ojio, K. Yamada, H. Shinkai, BWIM systems using truss bridges, in: 4th International Conference on Bridge Management, Thomas Telford, University of Surrey, UK, 2000, pp. 378–385. Xiao, 2006, Measurement of truck axle weight by instrumenting longitudinal ribs of orthotropic bridge, J. Bridge Eng., 11, 526, 10.1061/(ASCE)1084-0702(2006)11:5(526) A. Znidaric, I. Lavric, J. Kalin, et al., Using strips to mitigate the multiple-presence problem of BWIM systems, in: 6th International Conference on Weigh-in-Motion (ICWIM 6), Dallas Texas, United States, 2012, pp. 89–98. Gonzalez, 2012, Testing of a bridge weigh-in-motion algorithm utilising multiple longitudinal sensor locations, J. Test. Eval., 40, 10.1520/JTE104576 C.R. Buro, H. Dublin, I.A. Gonzalez, et al., Comparison of conventional and regularized bridge weigh-in-motion algorithms, in: International Conference on Heavy Vehicles, 2013, pp. 271–282. Zhao, 2014, Identification of vehicular axle weights with a bridge weigh-in-motion system considering transverse distribution of wheel loads, J. Bridge Eng., 19, 165, 10.1061/(ASCE)BE.1943-5592.0000533 Bao, 2016, Generalized method and monitoring technique for shear-strain-based bridge weigh-in-motion, J. Bridge Eng., 21, 10.1061/(ASCE)BE.1943-5592.0000782 Yu, 2016, State-of-the-art review on bridge weigh-in-motion technology, Adv. Struct. Eng., 19, 1514, 10.1177/1369433216655922 Deng, 2010, Identification of dynamic vehicular axle loads: theory and simulations, J. Vib Control., 16, 2167, 10.1177/1077546309351221 K.S. Bhachu, J.D. Baldwin, K.D. Mish, Method for vehicle identification and classification for bridge response monitoring, in: Dynamics of Bridges, Jacksonville, Florida, USA, vol. 5, 2011, pp. 93–103. E.J. O’Brien, D. Hajializadeh, N. Uddin, et al., Strategies for axle detection in bridge weigh-in-motion systems, in: 6th International Conference on Weigh-in-Motion (ICWIM 6), Dallas Texas, United States, 2012. Ma, 2014, A Wireless Accelerometer-Based Automatic Vehicle Classification Prototype System, IEEE Trans. Intell. Transport. Syst., 15, 104, 10.1109/TITS.2013.2273488 He, 2017, Novel virtual simply-supported beam method for detecting vehicle speed and axles, J. Bridge Eng., 22, 10.1061/(ASCE)BE.1943-5592.0001019 Deng, 2018, Equivalent shear force method for detecting the speed and axles of moving vehicles on bridges, J. Bridge Eng., 23, 10.1061/(ASCE)BE.1943-5592.0001278 Zhou, 2019, Research on moving load identification based on measured acceleration and strain signals, Int. J. Lifecycle Perform. Eng., 3, 257, 10.1504/IJLCPE.2019.103696 Wang, 2019, Identification of moving train loads on railway bridge based on strain monitoring, Smart Struct. Syst., 23, 263 Chen, 2015, Probabilistic neural networks based moving vehicles extraction algorithm for intelligent traffic surveillance systems, Inf. Sci., 299, 283, 10.1016/j.ins.2014.12.033 Ojio, 2016, Contactless bridge weigh-in-motion, J. Bridge Eng., 21, 10.1061/(ASCE)BE.1943-5592.0000776 H.C. Tan, Z.Y. Zhong, Y.K. Wu, et al., A deep architecture combining CNNS and GRBMS for traffic speed prediction, in: 2017 COTA International Conference of Transportation Professionals (CICTP), pp. 310–319. Zhang, 2019, A methodology for obtaining spatiotemporal information of the vehicles on bridges based on computer vision, Comput-aided. Civ. Inf., 34, 471, 10.1111/mice.12434 LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 Cha, 2017, Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks: Deep learning-based crack damage detection using CNNs, Comput-aided. Civ. Inf., 32, 361, 10.1111/mice.12263 Chen, 2018, NB-CNN: deep learning-based crack detection using convolutional neural network and naive Bayes data fusion, IEEE T. Ind. Electron., 65, 4392, 10.1109/TIE.2017.2764844 Liang, 2019, Image‐based post‐disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization, Comput-aided. Civ. Inf., 34, 415, 10.1111/mice.12425 Atha, 2018, Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection, Struct. Health Monit, 17, 1110, 10.1177/1475921717737051 Zhao, 2019, Live-load strain evaluation of the prestressed concrete box-girder bridge using deep learning and clustering, Struct. Health Monit., 1 Zhu, 2019, Vision-based defects detection for bridges using transfer learning and convolutional neural networks, Struct. Infrastruct. Eng., 1 Dung, 2019, A vision-based method for crack detection in gusset plate welded joints of steel bridges using deep convolutional neural networks, Autom. Constr., 102, 217, 10.1016/j.autcon.2019.02.013 Xu, 2019, Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network, Struct. Control Hlth., 26, 1, 10.1002/stc.2313 Jiang, 2019, Real-time crack assessment using deep neural networks with wall-climbing unmanned aerial system, Comput-aided. Civ. Inf., 1 Jang, 2019, Estimating compressive strength of concrete using deep convolutional neural networks with digital microscope images, J. Comput. Civil Eng., 33, 10.1061/(ASCE)CP.1943-5487.0000837 Ye, 2019, A review on deep learning-based structural health monitoring of civil infrastructures, Smart. Struct. Syst., 24, 567 Deng, 2009 Law, 1997, Moving force identification: a time domains method, J. Sound Vib., 201, 1, 10.1006/jsvi.1996.0774 O’Conner, 1988, Dynamic loads from bridge strains, J. Struct. Eng., 114, 1703, 10.1061/(ASCE)0733-9445(1988)114:8(1703) Chan, 1999, An interpretive method for moving force identification, J. Sound Vib., 219, 503, 10.1006/jsvi.1998.1904 Law, 1999, Moving force identification: a frequency and time domains analysis, J. Dyn. Syst., 12, 394, 10.1115/1.2802487 Cantero, 2017, Evolution of bridge frequencies and modes of vibration during truck passage, Eng. Struct., 152, 452, 10.1016/j.engstruct.2017.09.039 Fu, 2017, Machining vibration states monitoring based on image representation using convolutional neural networks, Eng. Appl. Arti. Intell., 65, 240, 10.1016/j.engappai.2017.07.024 Marchesiello, 2009, Time-dependent identification of a bridge-like structure with crossing loads, Mech. Syst. Signal Pr., 23, 2019, 10.1016/j.ymssp.2009.01.010 Staszewski, 2014, Wavelet-based frequency response function for time-variant systems: an exploratory study, Mech, Syst. Signal Pr., 47, 35, 10.1016/j.ymssp.2013.03.011 Chen, 2019, Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform, Comput. Ind., 106, 48, 10.1016/j.compind.2018.11.003 Ruzzene, 1997, Natural frequencies and dampings identification using wavelet transform: application to real data, Mech. Syst. Signal Pr., 11, 207, 10.1006/mssp.1996.0078 Yu, 1994, Short-time Fourier transform and wavelet transform with Fourier-domain processing, Appl. Opt., 33, 5262, 10.1364/AO.33.005262 Simon, 1995, Time-frequency analysis of a non-uniformly sampled signal with the Wigner-Ville transform: application to the study of the gyroscopic motion of a projectile, Mech. Syst. Signal Pr., 9, 589, 10.1006/mssp.1995.0044 Huang, 2018, Forecasting energy fluctuation model by wavelet decomposition and stochastic recurrent wavelet neural network, Neurocomputing, 309, 70, 10.1016/j.neucom.2018.04.071 Janeliukstis, 2017, Experimental structural damage localization in beam structure using spatial continuous wavelet transform and mode shape curvature methods, Measurement, 102, 253, 10.1016/j.measurement.2017.02.005 Tang, 2010, Wind turbine fault diagnosis based on Morlet wavelet transformation and Wigner-Ville distribution, Renewable Energy, 35, 2862, 10.1016/j.renene.2010.05.012 Liang, 2020, Intelligent fault diagnosis of rotating machinery via wavelet transform, generative adversarial nets and convolutional neural network, Measurement., 159, 1, 10.1016/j.measurement.2020.107768 Samantaray, 2008, Transmission line distance relaying using a variable window short-time Fourier transform, Electr. Power Syst. Res., 78, 595, 10.1016/j.epsr.2007.05.005 Rodrı́guez, 2004, Ultrasonic flaw detection in NDE of highly scattering materials using wavelet and Wigner–Ville transform processing, Ultrasonics, 42, 847, 10.1016/j.ultras.2004.01.063 Dorafshan, 2018, Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete, Constr. Build. Mater., 186, 1031, 10.1016/j.conbuildmat.2018.08.011 Xu, 2018, Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images, Struct. Health Monit., 1 He, 2019, Application of deep convolutional neural network on feature extraction and detection of wood defects, Measurement, 152, 107357, 10.1016/j.measurement.2019.107357 D. Scherer, A. Muller, S. Behnke, Evaluation of pooling operations in convolutional architectures for object recognition, in: K. Diamantaras, W. Duch, L.S. Iliadis (Eds.), Artificial Neural Networks-ICANN, 2010, pp. 92–101. A. Krizhevsky, I. Sutskever, G.E. Hinton, ImageNet classification with deep convolutional neural network, in: Advances in Neural Information Processing (NIPS 2012), Lake Tahoe, Nevada, 2012. Oquab, 2014, Learning and transferring mid-level image representations, 1717 Pan, 2010, A survey on transfer learning, IEEE Trans. Knowl. Data Eng., 22, 1345, 10.1109/TKDE.2009.191 Gopalakrishnan, 2017, Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection, Constr. Build. Mater., 157, 322, 10.1016/j.conbuildmat.2017.09.110 American Association of State Highway and Transportation Officials (AASHTO). Standard specifications for highway bridges, Washington, DC, 2002. Deng, 2009, Imagenet: a large-scale hierarchical image database, 248 Y. Bengio, Practical recommendations for gradient based training of deep architectures, in: Montavon, G.B. Orr, K.R. Muller (Eds.), Neural Networks: Tricks of the Trade, 2nd edn, 2012, pp. 437–78. Liang, 2020, Intelligent fault diagnosis of rotating machinery via wavelet transform, generative adversarial nets and convolutional neural network, Measurement, 159, 107768, 10.1016/j.measurement.2020.107768 Yuem, 2016, Acceleration-based automated vehicle classification on mobile bridges, Comput-aided. Civ. Inf., 31, 813, 10.1111/mice.12212 Zhang, 2018, Unified approach to pavement crack and sealed crack detection using preclassification based on transfer learning, J. Comput. Civ. Eng., 32, 10.1061/(ASCE)CP.1943-5487.0000736 Cha, 2017, Output-only computer vision based damage detection using phase-based optical flow and unscented Kalman filters, Eng. Struct., 132, 300, 10.1016/j.engstruct.2016.11.038 Deng, 2018, Study on vehicle model for vehicle-bridge coupling vibration of highway bridges in China, China J. Highw. Transp., 31, 92