Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection – A review
Tóm tắt
Từ khóa
Tài liệu tham khảo
Wang, 2014, Full-scale measurements and system identification on sutong cable-stayed bridge during typhoon Fung-Wong, Sci World J, 2014, 13
Feng, 2015, Model updating of railway bridge using in situ dynamic displacement measurement under trainloads, J Bridge Eng, 20, 04015019, 10.1061/(ASCE)BE.1943-5592.0000765
Wang, 2014, Establishment and application of the wind and structural health monitoring system for the runyang Yangtze River bridge, Shock Vibration, 2014, 15, 10.1155/2014/421038
Guo, 2008, Influence of ambient temperature on the fatigue damage of welded bridge decks, Int J Fatigue, 30, 1092, 10.1016/j.ijfatigue.2007.08.004
Chen, 2008, Large-scale shake table test verification of bridge condition assessment methods, J Struct Eng, 134, 1235, 10.1061/(ASCE)0733-9445(2008)134:7(1235)
Chen, 2009, Structural health monitoring by recursive Bayesian filtering, J Eng Mech, 135, 231, 10.1061/(ASCE)0733-9399(2009)135:4(231)
Carden, 2004, Vibration based condition monitoring: a review, Struct Health Monit, 3, 355, 10.1177/1475921704047500
Farrar, 2001, Vibration–based structural damage identification, Philos Trans R Soc London, A, 359, 131, 10.1098/rsta.2000.0717
Mita A, Takahira S. Risk control of smart structures using damage index sensors. Advances in Building Technology. Oxford: Elsevier; 2002. p. 521–8.
Catbas, 2008, Structural health monitoring and reliability estimation: Long span truss bridge application with environmental monitoring data, Eng Struct, 30, 2347, 10.1016/j.engstruct.2008.01.013
Xing, 2012, A substructure approach to local damage detection of shear structure, Struct Control Health Monit, 19, 309, 10.1002/stc.439
Lynch, 2006, A summary review of wireless sensors and sensor networks for structural health monitoring, Shock Vibration Digest, 38, 91, 10.1177/0583102406061499
Li, 2016, Efficient time synchronization for structural health monitoring using wireless smart sensor networks, Struct Control Health Monit, 23, 470, 10.1002/stc.1782
Sabato, 2017, Wireless MEMS-based accelerometer sensor boards for structural vibration monitoring: a review, IEEE Sens J, 17, 226, 10.1109/JSEN.2016.2630008
Li, 2007, Development of distributed long-gage fiber optic sensing system for structural health monitoring, Struct Health Monit, 6, 133, 10.1177/1475921706072078
Kim, 2007, Real-time structural health monitoring using a novel fiber-optic accelerometer system, IEEE Sens J, 7, 536, 10.1109/JSEN.2007.891988
Feng, 2006, Novel fiber optic accelerometer system using geometric moiré fringe, Sens Actuators, A, 128, 37, 10.1016/j.sna.2005.12.050
Gentile, 2010, An interferometric radar for non-contact measurement of deflections on civil engineering structures: laboratory and full-scale tests, Struct Infrastructure Eng, 6, 521, 10.1080/15732470903068557
Lee, 2007, Development and application of a vision-based displacement measurement system for structural health monitoring of civil structures, Smart Struct Syst, 3, 373, 10.12989/sss.2007.3.3.373
Stephen, 1993, Measurements of static and dynamic displacement from visual monitoring of the Humber Bridge, Eng Struct, 15, 197, 10.1016/0141-0296(93)90054-8
Park, 2010, Vision-based displacement measurement method for high-rise building structures using partitioning approach, NDT E Int, 43, 642, 10.1016/j.ndteint.2010.06.009
Ye, 2016, A review of machine vision-based structural health monitoring: methodologies and applications, J Sens, 2016, 10, 10.1155/2016/7103039
Zhang, 2016, A high-speed vision-based sensor for dynamic vibration analysis using fast motion extraction algorithms, Sensors, 16, 572, 10.3390/s16040572
Qin, 2016, Three-dimensional continuous displacement measurement with temporal speckle pattern interferometry, Sensors, 16, 2020, 10.3390/s16122020
Farzad N, Dimitrios K. Evaluation of vision-based measurements for shake-table testing of nonstructural components.
Wang, 2015, Digital image correlation in experimental mechanics and image registration in computer vision: Similarities, differences and complements, Opt Lasers Eng, 65, 18, 10.1016/j.optlaseng.2014.04.002
Ribeiro, 2014, Non-contact measurement of the dynamic displacement of railway bridges using an advanced video-based system, Eng Struct, 75, 164, 10.1016/j.engstruct.2014.04.051
Kohut, 2013, Monitoring of a civil structure’s state based on noncontact measurements, Struct Health Monit, 10.1177/1475921713487397
Lee, 2006, A vision-based system for remote sensing of bridge displacement, NDT E Int, 39, 425, 10.1016/j.ndteint.2005.12.003
Busca, 2014, Vibration monitoring of multiple bridge points by means of a unique vision-based measuring system, Exp Mech, 54, 255, 10.1007/s11340-013-9784-8
Kim, 2013, Vision-based monitoring system for evaluating cable tensile forces on a cable-stayed bridge, Struct Health Monit, 12, 440, 10.1177/1475921713500513
Ji, 2008, Nontarget image-based technique for small cable vibration measurement, J Bridge Eng, 13, 34, 10.1061/(ASCE)1084-0702(2008)13:1(34)
Song, 2014, Virtual visual sensors and their application in structural health monitoring, Struct Health Monit, 13, 251, 10.1177/1475921714522841
Zhang, 2014, SIFT flow for large-displacement object tracking, Appl Opt, 53, 6194, 10.1364/AO.53.006194
Gehle, 1998, Tracking the multi-component motion of a cable using a television camera, Smart Mater Struct, 7, 43, 10.1088/0964-1726/7/1/006
Jeon, 2011, A paired visual servoing system for 6-DOF displacement measurement of structures, Smart Mater Struct, 20, 045019, 10.1088/0964-1726/20/4/045019
Lee, 2012, An advanced vision-based system for real-time displacement measurement of high-rise buildings, Smart Mater Struct, 21, 125019, 10.1088/0964-1726/21/12/125019
Santos, 2012, Calibration methodology of a vision system for measuring the displacements of long-deck suspension bridges, Struct Control Health Monit, 19, 385, 10.1002/stc.438
Feng, 2015, Nontarget vision sensor for remote measurement of bridge dynamic response, J Bridge Eng, 04015023
Feng, 2015, Model updating of railway bridge using in situ dynamic displacement measurement under trainloads, J Bridge Eng, 04015019
Wu, 2014, Dynamic testing of a laboratory model via vision-based sensing, Eng Struct, 60, 113, 10.1016/j.engstruct.2013.12.002
Olaszek, 1999, Investigation of the dynamic characteristic of bridge structures using a computer vision method, Measurement, 25, 227, 10.1016/S0263-2241(99)00006-8
Wahbeh, 2003, A vision-based approach for the direct measurement of displacements in vibrating systems, Smart Mater Struct, 12, 785, 10.1088/0964-1726/12/5/016
Ho, 2012, A synchronized multipoint vision-based system for displacement measurement of civil infrastructures, Sci World J, 2012, 9, 10.1100/2012/519146
Myung, 2010, Paired structured light for structural health monitoring robot system, Struct Health Monit
Caetano, 2011, A vision system for vibration monitoring of civil engineering structures, Exp Tech, 35, 74, 10.1111/j.1747-1567.2010.00653.x
Feng, 2015, A vision-based sensor for noncontact structural displacement measurement, Sensors, 15, 16557, 10.3390/s150716557
Ye, 2013, A vision-based system for dynamic displacement measurement of long-span bridges: algorithm and verification, Smart Struct Syst, 12, 363, 10.12989/sss.2013.12.3_4.363
Pan, 2016, Real-time, non-contact and targetless measurement of vertical deflection of bridges using off-axis digital image correlation, NDT E Int, 79, 73, 10.1016/j.ndteint.2015.12.006
Poozesh, 2017, Large-area photogrammetry based testing of wind turbine blades, Mech Syst Signal Process, 86, 98, 10.1016/j.ymssp.2016.07.021
Pan, 2009, Two-dimensional digital image correlation for in-plane displacement and strain measurement: a review, Meas Sci Technol, 20, 062001, 10.1088/0957-0233/20/6/062001
Hild, 2006, Digital image correlation: from displacement measurement to identification of elastic properties – a review, Strain, 42, 69, 10.1111/j.1475-1305.2006.00258.x
Feng, 2016, Vision-based multipoint displacement measurement for structural health monitoring, Struct Control Health Monit, 23, 876, 10.1002/stc.1819
Feng, 2017, Experimental validation of cost-effective vision-based structural health monitoring, Mech Syst Signal Process, 88, 199, 10.1016/j.ymssp.2016.11.021
Mattoccia, 2011, Efficient template matching for multi-channel images, Pattern Recogn Lett, 32, 694, 10.1016/j.patrec.2010.12.004
Mahalakshmi, 2012, Review article: an overview of template matching technique in image processing, Res J Appl Sci, Eng Technol
Soh, 2014, A feature area-based image registration, Int J Comput Theory Eng, 6, 407, 10.7763/IJCTE.2014.V6.899
Brunelli, 2009
Zitová, 2003, Image registration methods: a survey, Image Vis Comput, 21, 977, 10.1016/S0262-8856(03)00137-9
Pratt, 2001
Yoneyama, 2012, Bridge deflection measurement using digital image correlation with camera movement correction, Mater Trans, JIM, 53, 285, 10.2320/matertrans.I-M2011843
Ye, 2016, Vision-based structural displacement measurement: System performance evaluation and influence factor analysis, Measurement, 88, 372, 10.1016/j.measurement.2016.01.024
Dworakowski, 2016, Vision-based algorithms for damage detection and localization in structural health monitoring, Struct Control Health Monit, 23, 35, 10.1002/stc.1755
Hassaballah, 2016, Image features detection, description and matching, 11
Mair, 2010, Adaptive and generic corner detection based on the accelerated segment test, 183
Bay, 2006, SURF: speeded up robust features, 404
Alcantarilla, 2012, KAZE features, 214
Mikolajczyk, 2005, A comparison of affine region detectors, Int J Comput Vision, 65, 43, 10.1007/s11263-005-3848-x
Leutenegger S, Chli M, Siegwart RY. BRISK: binary robust invariant scalable keypoints. In: Proceedings of the 2011 international conference on computer vision: IEEE computer society; 2011. p. 2548–55.
Ortiz R. FREAK: fast retina keypoint. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition (CVPR): IEEE computer society; 2012. p. 510–7.
Awad, 2016
Peng, 2012, Partial least squares and random sample consensus in outlier detection, Anal Chim Acta, 719, 24, 10.1016/j.aca.2011.12.058
Son, 2015, Vibration displacement measurement technology for cylindrical structures using camera images, Nucl Eng Technol, 47, 488, 10.1016/j.net.2015.01.011
Feng, 2015, Image-based displacement and rotation detection using scale invariant features for 6 degree of freedom ICF target positioning, Appl Opt, 54, 4130, 10.1364/AO.54.004130
Jeong, 2016, Vision based displacement detection for stabilized UAV control on cloud server, Mobile Inf Syst, 2016, 1, 10.1155/2016/8937176
Bay, 2008, Speeded-up robust features (SURF), Comput Vis Image Underst, 110, 346, 10.1016/j.cviu.2007.09.014
Cha, 2017, Output-only computer vision based damage detection using phase-based optical flow and unscented Kalman filters, Eng Struct, 132, 300, 10.1016/j.engstruct.2016.11.038
Guo, 2016, Dynamic displacement measurement of large-scale structures based on the Lucas-Kanade template tracking algorithm, Mech Syst Signal Process, 66–67, 425, 10.1016/j.ymssp.2015.06.004
Yoon, 2016, Target-free approach for vision-based structural system identification using consumer-grade cameras, Struct Control Health Monit, 23, 1405, 10.1002/stc.1850
Liu, 2016, Vision-based displacement measurement sensor using modified Taylor approximation approach, Opt Eng, 55, 114103, 10.1117/1.OE.55.11.114103
Choi, 2016, A target-less vision-based displacement sensor based on image convex hull optimization for measuring the dynamic response of building structures, Sensors, 16, 2085, 10.3390/s16122085
Bing, 2006, Performance of sub-pixel registration algorithms in digital image correlation, Meas Sci Technol, 17, 1615, 10.1088/0957-0233/17/6/045
Foroosh, 2002, Extension of phase correlation to subpixel registration, Image Process, IEEE Trans, 11, 188, 10.1109/83.988953
Berenstein, 1987, A geometric approach to subpixel registration accuracy, Comput Vision, Graphics, Image Process, 40, 334, 10.1016/S0734-189X(87)80146-9
Pilch, 2004, Measurement of whole-field surface displacements and strain using a genetic algorithm based intelligent image correlation method, J Dyn Syst Meas Contr, 126, 479, 10.1115/1.1789968
Li, 2015, Sub-pixel flood inundation mapping from multispectral remotely sensed images based on discrete particle swarm optimization, ISPRS J Photogrammetry Remote Sens, 101, 10, 10.1016/j.isprsjprs.2014.11.006
Bruck, 1989, Digital image correlation using Newton-Raphson method of partial differential correction, Exp Mech, 29, 261, 10.1007/BF02321405
Davis, 1998, Statistics of subpixel registration algorithms based on spatiotemporal gradients or block matching, Opt Eng, 37, 1290, 10.1117/1.601966
Debella-Gilo, 2011, Sub-pixel precision image matching for measuring surface displacements on mass movements using normalized cross-correlation, Remote Sens Environ, 115, 130, 10.1016/j.rse.2010.08.012
Feng, 2015, A vision-based sensor for noncontact structural displacement measurement, Sensors, 15, 16557, 10.3390/s150716557
Mas, 2016, Realistic limits for subpixel movement detection, Appl Opt, 55, 4974, 10.1364/AO.55.004974
Fukuda, 2010, Cost-effective vision-based system for monitoring dynamic response of civil engineering structures, Struct Control Health Monit, 17, 918, 10.1002/stc.360
Jong-Han, 2012, An advanced vision-based system for real-time displacement measurement of high-rise buildings, Smart Mater Struct, 21, 125019, 10.1088/0964-1726/21/12/125019
Doherty C, Carey CH, OBrien EJ, Taylor SE, Ojio T. Contactless bridge weigh-in-motion; 2016.
Zhang, 2000, A flexible new technique for camera calibration, IEEE Trans Pattern Anal Mach Intell, 22, 1330, 10.1109/34.888718
Heikkil, 2000, #228. Geometric camera calibration using circular control points, IEEE Trans Pattern Anal Mach Intell, 22, 1066, 10.1109/34.879788
Luo, 2008, Easy calibration technique for stereo vision using a circle grid, Opt Eng, 47, 033607, 10.1117/1.2897237
Park, 2015, 3D displacement measurement model for health monitoring of structures using a motion capture system, Measurement, 59, 352, 10.1016/j.measurement.2014.09.063
Brownjohn J, Hester D, Xu Y, Bassitt J, koo KY. Viability of optical tracking systems for monitoring deformations of a long span bridge. In: EACS 2016–6th European conference on structural control; 2016.
Fukuda, 2013, Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm, Sens J, IEEE, 13, 4725, 10.1109/JSEN.2013.2273309
Feng, 2015, Vision-based multipoint displacement measurement for structural health monitoring, Struct Control Health Monit, 876–90
Feng, 2016, Advanced vision-based displacement sensors for structural health monitoring, Columbia University Academic Commons
Sładek, 2013, Development of a vision based deflection measurement system and its accuracy assessment, Measurement, 46, 1237, 10.1016/j.measurement.2012.10.021
Chen, 2015, Modal identification of simple structures with high-speed video using motion magnification, J Sound Vib, 345, 58, 10.1016/j.jsv.2015.01.024
Bartilson, 2015, Target-less computer vision for traffic signal structure vibration studies, Mech Syst Signal Process, 60–61, 571, 10.1016/j.ymssp.2015.01.005
Khuc, 2016, Completely contactless structural health monitoring of real-life structures using cameras and computer vision, Struct Control Health Monit
Sutton, 2008, The effect of out-of-plane motion on 2D and 3D digital image correlation measurements, Opt Lasers Eng, 46, 746, 10.1016/j.optlaseng.2008.05.005
D’Emilia, 2013, Uncertainty analysis of high frequency image-based vibration measurements, Measurement, 46, 2630, 10.1016/j.measurement.2013.04.075
Baqersad, 2016, Photogrammetry and optical methods in structural dynamics - a review, Mech Syst Signal Process
Feng, 2016, Vision-based multipoint displacement measurement for structural health monitoring, Struct Control Health Monit, 23, 876, 10.1002/stc.1819
Kohut, 2013, Monitoring of a civil structure’s state based on noncontact measurements, Struct Health Monit, 12, 411, 10.1177/1475921713487397
Nikfar, 2016, Evaluation of vision-based measurements for shake-table testing of nonstructural components, J Comput Civil Eng, 04016050
Min, 2015, Non-contact and real-time dynamic displacement monitoring using smartphone technologies, J Life Cycle Reliability Saf Eng, 4, 40
Ozer, 2017, Hybrid motion sensing and experimental modal analysis using collocated smartphone camera and accelerometers, Meas Sci Technol, 28, 105903, 10.1088/1361-6501/aa82ac
Warren, 2011, Comparison of FRF measurements and mode shapes determined using optically image based, laser, and accelerometer measurements, Mech Syst Signal Process, 25, 2191, 10.1016/j.ymssp.2011.01.018
Shariati A, Schumacher T. Eulerian-based virtual visual sensors to measure dynamic displacements of structures. Struct Control Health Monit; 2016:e1977-n/a.
Tian, 2016, Remote bridge deflection measurement using an advanced video deflectometer and actively illuminated LED targets, Sensors (Basel, Switzerland), 16, 1344, 10.3390/s16091344
Wang, 2016, Uncertainty quantification in DIC with Kriging regression, Opt Lasers Eng, 78, 182, 10.1016/j.optlaseng.2015.09.006
Roux, 2006, Stress intensity factor measurements from digital image correlation: post-processing and integrated approaches, Int J Fract, 140, 141, 10.1007/s10704-006-6631-2
Besnard, 2006, “Finite-element” displacement fields analysis from digital images: application to Portevin–Le Châtelier bands, Exp Mech, 46, 789, 10.1007/s11340-006-9824-8
Haddadi, 2008, Use of rigid-body motion for the investigation and estimation of the measurement errors related to digital image correlation technique, Opt Lasers Eng, 46, 185, 10.1016/j.optlaseng.2007.05.008
Ferrer, 2016, Parametric study of the errors obtained from the measurement of the oscillating movement of a bridge using image processing, J Nondestruct Eval, 35, 53, 10.1007/s10921-016-0372-6
Kim, 2013, Dynamic characteristics of suspension bridge hanger cables using digital image processing, NDT E Int, 59, 25, 10.1016/j.ndteint.2013.05.002
Neal W, Frédo D, Justin GC, Oral B, William TF, Abe D. Video camera-based vibration measurement for civil infrastructure applications.
Lava, 2013, Impact of lens distortions on strain measurements obtained with 2D digital image correlation, Opt Lasers Eng, 51, 576, 10.1016/j.optlaseng.2012.12.009
Pan, 2013, Systematic errors in two-dimensional digital image correlation due to lens distortion, Opt Lasers Eng, 51, 140, 10.1016/j.optlaseng.2012.08.012
Yoneyama, 2006, Lens distortion correction for digital image correlation by measuring rigid body displacement, Opt Eng, 45, 023602, 10.1117/1.2168411
Feng, 2017, Cable tension force estimate using novel noncontact vision-based sensor, Measurement, 99, 44, 10.1016/j.measurement.2016.12.020
Choi, 2011, Structural dynamic displacement vision system using digital image processing, NDT E Int, 44, 597, 10.1016/j.ndteint.2011.06.003
Anantrasirichai, 2013, Atmospheric turbulence mitigation using complex wavelet-based fusion, IEEE Trans Image Process, 22, 2398, 10.1109/TIP.2013.2249078
Lee JW, Oh JS, Park MK, Kwon SD, Kwark JW. Bridge displacement measurement system using image processing. In: Advances in bridge maintenance, safety management, and life-cycle performance, set of book & CD-ROM: CRC Press; 2006. p. 281–2.
Mas, 2016, Methods and algorithms for video-based multi-point frequency measuring and mapping, Measurement, 85, 164, 10.1016/j.measurement.2016.02.042
Wang, 2012, Frequency response functions of shape features from full-field vibration measurements using digital image correlation, Mech Syst Signal Process, 28, 333, 10.1016/j.ymssp.2011.11.023
Yang, 2017, Blind identification of full-field vibration modes of output-only structures from uniformly-sampled, possibly temporally-aliased (sub-Nyquist), video measurements, J Sound Vib, 390, 232, 10.1016/j.jsv.2016.11.034
Yang, 2017, Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification, Mech Syst Signal Process, 85, 567, 10.1016/j.ymssp.2016.08.041
Wang, 2011, Finite element model updating from full-field vibration measurement using digital image correlation, J Sound Vib, 330, 1599, 10.1016/j.jsv.2010.10.036
Oh BK, Hwang JW, Choi SW, Kim Y, Cho T, Park HS. Dynamic displacements-based model updating with motion capture system. Struct Control Health Monit; 2016:n/a-n/a.
Wang, 2009, Mode-shape recognition and finite element model updating using the Zernike moment descriptor, Meas Sci Technol, 23, 2088
Wang, 2009, Vibration mode shape recognition using image processing, J Sound Vib, 326, 909, 10.1016/j.jsv.2009.05.024
Wang, 2011, Shape features and finite element model updating from full-field strain data, Int J Solids Struct, 48, 1644, 10.1016/j.ijsolstr.2011.02.010
Dworakowski, 2016, Vision-based algorithms for damage detection and localization in structural health monitoring, Struct Control Health Monit, 35–50
Feng, 2017, Identification of structural stiffness and excitation forces in time domain using noncontact vision-based displacement measurement, J Sound Vib, 406, 15, 10.1016/j.jsv.2017.06.008
Gandhi, 2007, Video and seismic sensor-based structural health monitoring: framework, algorithms, and implementation, IEEE Trans Intell Transp Syst, 8, 169, 10.1109/TITS.2006.888601
Tan CA, Beyene Ashebo D, Feng MQ, Fukuda Y. Integration of traffic information in the structural health monitoring of highway bridges; 2007. p. 65291D-D-10.
Catbas, 2012, Sensor networks, computer imaging, and unit influence lines for structural health monitoring: case study for bridge load rating, J Bridge Eng, 17, 662, 10.1061/(ASCE)BE.1943-5592.0000288
Yeum, 2015, Vision-based automated crack detection for bridge inspection, Comput-Aided Civil Infrastructure Eng, 30, 759, 10.1111/mice.12141
Cha, 2017, Deep learning-based crack damage detection using convolutional neural networks, Comput-Aided Civil Infrastructure Eng, 32, 361, 10.1111/mice.12263