Hệ thống ổn định video độ phân giải cao theo thời gian thực sử dụng cảm biến giật với tốc độ khung hình cao
Tóm tắt
Trong nghiên cứu này, phương pháp mới của hệ thống ổn định video theo thời gian thực sử dụng thiết bị cảm biến giật với tốc độ khung hình cao (HFR) được trình bày để hiện thực hóa kỹ thuật ổn định video kỹ thuật số hiệu quả tính toán cho các chuỗi hình ảnh độ phân giải cao. Hệ thống này bao gồm một camera tốc độ cao để trích xuất và theo dõi các điểm đặc trưng trong chuỗi hình ảnh mức xám
Từ khóa
Tài liệu tham khảo
Morimoto C, Chellappa R (1996) Fast electronic digital image stabilization. IEEE Proc ICPR 3:284–288
Scott W, Sergio R (2006) Introduction to image stabilization. SPIE Press, Bellingham. https://doi.org/10.1117/3.685011
Yang J, Schonfeld D, Mohamed M (2009) Robust video stabilization based on particle filter tracking of projected camera motion. IEEE Trans Circuits Syst Video Technol 19(7):945–954
Amanatiadis A, Gasteratos A, Papadakis S, Kaburlasos V, Ude A (2010) Image stabilization, ARVRV. IntechOpen, New York, pp 261–274
Xu J, Chang HW, Yang S, Wang D (2012) Fast feature-based video stabilization without accumulative global motion estimation. IEEE Trans Consum Electron 58(3):993–999
Kusaka H, Tsuchida Y, Shimohata T (2012) Control technology for optical image stabilization. SMPTE Motion Imag J 111:609–615
Sato K, Ishizuka S, Nikami A, Sato M (1993) Control techniques for optical image stabilizing system. IEEE Trans Consum Electron 39:461–466
Pournazari P, Nagamune R, Chiao MA (2014) Concept of a magnetically actuated optical image stabilizer for mobile applications. IEEE Trans Consum Electron 60:10–17
Hao Q, Cheng X, Kang J, Jiang Y (2015) An image stabilization optical system using deformable freeform mirrors. Sensors 15:1736–1749
Chiu CW, Chao PCP, Wu DY (2007) Optimal design of magnetically actuated optical image stabilizer mechanism for cameras in mobile phones via genetic algorithm. IEEE Trans Magn 43:2582–2584
Moon J, Jung S (2008) Implementation of an image stabilization system for a small digital camera. IEEE Trans Consum Electron 54:206–212
Song M, Hur Y, Park N, Park K, Park Y, Lim S, Park J (2009) Design of a voice-coil actuator for optical image stabilization based on genetic algorithm. IEEE Trans Magn 45:4558–4561
Song M, Baek H, Park N, Park K, Yoon T, Park Y, Lim S (2010) Development of small sized actuator with compliant mechanism for optical image stabilization. IEEE Trans Magn 46:2369–2372
Li TS, Chen C, Su Y (2012) Optical image stabilizing system using fuzzy sliding-mode controller for digital cameras. IEEE Trans Consum Electron 58(2):237–245. https://doi.org/10.1109/TCE.2012.6227418
Walrath CD (1984) Adaptive bearing friction compensation based on recent knowledge of dynamic friction. Automatica 20:717–727
Ekstrand B (2001) Equations of motion for a two-axes gimbal system. IEEE Trans Aerosp Electron Syst 37:1083–1091
Kennedy PJ, Kennedy RL (2003) Direct versus indirect line of sight (LOS) stabilization. IEEE Trans Control Syst Technol 11:3–15
Zhou X, Jia Y, Zhao Q, Yu R (2016) Experimental validation of a compound control scheme for a two-axis inertially stabilized platform with multi-sensors in an unmanned helicopter-based airborne power line inspection system. Sensors. https://doi.org/10.3390/s16030366
Jang SW, Pomplun M, Kim GY, Choi HI (2005) Adaptive robust estimation of affine parameters from block motion vectors. Image Vis Comput 23:1250–1263
Xu L, Lin X (2006) Digital image stabilization based on circular block matching. IEEE Trans Consum Electron 52(2):566–574. https://doi.org/10.1109/TCE.2006.1649681
Moshe Y, Hel-Or H (2009) Video block motion estimation based on gray-code kernel. IEEE Trans Image Process 18(10):2243–2254. https://doi.org/10.1109/TIP.2009.2025559
Chantara W, Mun JH, Shin DW, Ho YS (2015) Object tracking using adaptive template matching. IEIE SPC 4:1–9
Ko S, Lee S, Lee K (1998) Digital image stabilizing algorithms based on bit-plane matching. IEEE Trans Consum Electron 44:617–622
Ko S, Lee S, Jeon S, Kang E (1999) Fast digital image stabilizer based on Gray-coded bit-plane matching. IEEE Trans Consum Electron 45:598–603
Litvin A, Konrad J, Karl WC (2003) Probabilistic video stabilization using Kalman filtering and mosaicking. In: Proceedings SPIE 5022 image and video commununication process, pp 20–24. https://doi.org/10.1117/12.476436
Rasheed KK, Zafar T, Mathavan S, Rahman M (2015) Stabilization of 3D pavement images for pothole metrology using the Kalman filter. In: IEEE 18th international conference on intelligent transportation systems. pp 2671–2676
Erturk S (2001) Image sequence stabilisation based on Kalman filtering of frame positions. Electron Lett 37(20):1217–1219
Erturk S (2002) Real-time digital image stabilization using Kalman filters. J Real-Time Imag 8(4):317–328
Wang C, Kim JH, Byun KY, Ni J, Ko SJ (2009) Robust digital image stabilization using the Kalman filter. IEEE Trans Consum Electron 55(1):6–14. https://doi.org/10.1109/TCE.2009.4814407
Erturk S, Dennis TJ (2000) Image sequence stabilisation based on DFT filtering. IEEE Proc Vis Imag Sig Process 147(2):95–102
Junlan Y, Schonfeld D, Mohamed M (2009) Robust video stabilization based on particle filter tracking of projected camera motion. IEEE Trans Circuits Syst Video Technol 19(7):945–954
Hong S, Atkins E (2008) Moving sensor video image processing enhanced with elimination of ego motion by global registration and SIFT. In: IEEE international tools artificial intelligence. pp 37–40
Hu R, Shi R, Shen IF, Chen W (2007) Video stabilization using scale-invariant features. In: 11th international conference on Zurich information visual. pp 871–877
Shen Y, Guturu P, Damarla T, Buckles BP, Namuduri KR (2009) Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework. IEEE Trans Consum Electron 55:1714–1721
Liu S, Yuan L, Tan P, Sun J (2013) Bundled camera paths for video stabilization. ACM Trans Graphics 32(4):1–10. https://doi.org/10.1145/2461912.2461995
Kim SK, Kang SJ, Wang TS, Ko SJ (2013) Feature point classification based global motion estimation for video stabilization. IEEE Trans Consum Electron 59:267–272
Cheng X, Hao Q, Xie M (2016) A comprehensive motion estimation technique for the improvement of EIS methods based on the SURF algorithm and Kalman filter. Sensors. https://doi.org/10.3390/s16040486
Jeon S, Yoon I, Jang J, Yang S, Kim J, Paik J (2017) Robust video stabilization using particle keypoint update and l1-optimized camera path. Sensors. https://doi.org/10.3390/s17020337
Chang J, Hu W, Cheng M, Chang B (2002) Digital image translational and rotational motion stabilization using optical ow technique. IEEE Trans Consum Electron 48:108–115
Matsushita Y, Ofek E, Ge W, Tang X, Shum HY (2006) Full-frame video stabilization with motion inpainting. IEEE Trans Pattern Anal Mach Intell 28:1150–1163
Cai J, Walker R (2009) Robust video stabilization algorithm using feature point selection and delta optical flow. IET Comput Vis 3(4):176–188
Ejaz N, Kim W, Kwon SI, Baik SW (2012) Video stabilization by detecting intentional and unintentional camera motions. In: Third international conference on intelligent system modelling simulator. pp 312–316
Xu W, Lai X, Xu D, Tsoligkas NA (2013) An integrated new scheme for digital video stabilization. Adv Multimed. https://doi.org/10.1155/2013/651650
Liu S, Yuan L, Tan P, Sun J (2014) Steady flow: spatially smooth optical flow for video stabilization. In: IEEE conference computer visual pattern recogition. pp 4209–4216
Lu W, Hongying Z, Shiyi G, Ying M, Sijie L (2012) The adaptive compensation algorithm for small UAV image stabilization. In: IEEE international geoscience and remote sensing symposium. pp 4391–4394
Mayen K, Espinoza C, Romero H, Salazar S, Lizarraga M, Lozano R (2015) Real-time video stabilization algorithm based on efficient block matching for UAVs, Works. In: Workshop on research, education and development of unmanned aerial systems. pp 78–83
Hong S, Hong T, Wu Y (2010) Multi-resolution unmanned aerial vehicle video stabilization. Proc IEEE Nat Aero Elect Conf 14(16):126–131
Oh PY, Green WE (2004) Mechatronic kite and camera rig to rapidly acquire, process, and distribute aerial images. IEEE/ASME Trans Mech 9(4):671–678
Ramachandran M, Chellappa R (2006) Stabilization and mosaicing of airborne videos. In: International conference imaging process. pp 345–348
Ax M, Thamke S, Kuhnert L, Schlemper J, Kuhnert, KD (2012) Optical position stabilization of an UAV for autonomous landing. In: ROBOTIK 7th German conference robotics. pp 1–6
Ahlem W, Ali W, Adel MA (2013) Video stabilization for aerial video surveillance. AASRI Proc 4:72–77
Morimoto C, Chellappa R (1996) Fast electronic digital image stabilization for off-road navigation. J Real-Time Imag 2(5):285–296
Yao YS, Chellapa R (1997) Selective stabilization of images acquired by unmanned ground vehicles. IEEE Trans Robot Autom 13(5):693–708
Foresti GL (1999) Object recognition and tracking for remote video surveillance. In: IEEE transformation circuits system video technology. pp 1045–1062
Ferreira A, Fontaine JG (2001) Coarse/fine motion control of a teleoperated autonomous piezoelectric nanopositioner operating under a microscope. Proc IEEE/ASME Int Conf Adv Intell Mech 2:1313–1318
Zhu J, Li C, Xu J (2015) Digital image stabilization for cameras on moving platform. In: International conference on intelligent information hiding and multimedia signal processing. pp 255–258
Guestrin C, Cozman F, Godoy SM (1998) Industrial applications of image mosaicing and stabilization, 1998 Sec. Int Conf Knowl Based Intell Electron Syst 2:174–183. https://doi.org/10.1109/KES.1998.725908
Lobo J, Ferreira JF, Dias J (2009) Robotic implementation of biological bayesian models towards visuo-inertial image stabilization and gaze control. In: IEEE international conference on intelligent robots and systems. pp 443–448
Smith BM, Zhang L, Jin H, Agarwala A (2009) Light field video stabilization. In: IEEE 12th international conference on computer visual. pp 341–348
Li Z, Pundlik S, Luo G (2013) Stabilization of magnified videos on a mobile device for visually impaired. In: IEEE computer vision and pattern recognition workshop. pp 54–55
Roncone A, Pattacini U, Metta G, Natale L (2014) Gaze stabilization for humanoid robots: a comprehensive framework. In: IEEE-RAS international conference on human robotics. pp 259–264
Hansen M, Anandan P, Dana K, van der Wal G, Burt P (1994) Real-time scene stabilization and mosaic construction. Proc Sec IEEE Works Appl Comput Vis 5(7):54–62
Battiato S, Puglisi G, Bruna AR (2008) A robust video stabilization system by adaptive motion vectors filtering. In: IEEE international conference multiple exposure. pp 373–376
Shakoor MH, Dehghani AR (2010) Fast digital image stabilization by motion vector prediction. In: The 2nd international conference image analysis and recognition. pp 151–154
Araneda L, Figueroa M (2014) Real-time digital video stabilization on an FPGA, 2014. In: 17th Euromicro conference digital system design. pp 90–97. https://doi.org/10.1109/DSD.2014.26
Chang S, Zhong Y, Quan Z, Hong Y, Zeng J, Du D (2016) A real-time object tracking and image stabilization system for photographing in vibration environment using OpenTLD algorithm. In: Conference: 2016 IEEE workshop on advanced robotics and its social impacts. pp 141–145
Yang W, Zhang Z, Zhang Y, Lu X, Li J, Shi Z (2016) Real-time digital image stabilization based on regional field image gray projection. J Syst Eng Electron 27(1):224–231
Dong J, Liu H (2017) Video stabilization for strict real-time applications. IEEE Trans Circuits Syst Video Technol 27(4):716–724. https://doi.org/10.1109/TCSVT.2016.2589860
Watanabe Y, Komura T, Ishikawa M (2007) 955-fps real-time shape measurement of a moving/deforming object using high-speed vision for numerous-point analysis. In: Proceeding IEEE conference robotics and automation. pp 3192–3197
Ishii I, Taniguchi T, Sukenobe R, Yamamoto K (2009) Development of high-speed and real-time vision platform, H3 vision. In: Proceeding IEEE international conference on intelligent robots system. pp 3671–3678
Ishii I, Tatebe T, Gu Q, Moriue Y, Takaki T, Tajima K (2010) 2000 fps real-time vision system with high-frame-rate video recording. In: Proceeding IEEE conference on robot automation. pp 1536–1541
Yamazaki T, Katayama H, Uehara S, Nose A, Kobayashi M, Shida S, Odahara M, Takamiya K, Hisamatsu Y, Matsumoto S, Miyashita L, Watanabe Y, Izawa T, Muramatsu Y, Ishikawa M (2017) A 1 ms high-speed vision chip with 3D-stacked 140GOPS column-parallel PEs for spatio-temporal image processing. In: Proceeding conference on solid-state circuits. pp 82–83
Namiki A, Hashimoto K, Ishikawa M (2003) Hierarchical control architecture for high-speed visual servoing. IJRR 22:873–888
Senoo T, Namiki A, Ishikawa M (2006) Ball control in high-speed batting motion using hybrid trajectory generator. In: Proceeding IEEE conference on robot automation. pp 1762–1767
Namiki A, Ito N (2014) Ball catching in kendama game by estimating grasp conditions based on a high-speed vision system and tactile sensors. In: Proceeding IEEE conference on human robots. pp 634–639
Aoyama T, Takaki T, Miura T, Gu Q, Ishii I (2015) Realization of flower stick rotation using robotic arm. In: Proceeding IEEE international conference on intelligent robots system. pp 5648–5653
Jiang M, Aoyama T, Takaki T, Ishii I (2016) Pixel-level and robust vibration source sensing in high-frame-rate video analysis. Sensors. https://doi.org/10.3390/s16111842
Jiang M, Gu Q, Aoyama T, Takaki T, Ishii I (2017) Real-time vibration source tracking using high-speed vision. IEEE Sens J 17:1513–1527
Ishii I, Taniguchi T, Yamamoto K, Takaki T (2012) High-frame-rate optical flow system. IEEE Trans Circuit Syst Video Technol 22(1):105–112. https://doi.org/10.1109/TCSVT.2011.2158340
Ishii I, Tatebe T, Gu Q, Takaki T (2012) Color-histogram-based tracking at 2000 fps. J Electron Imaging 21(1):1–14. https://doi.org/10.1117/1.JEI.21.1.013010
Gu Q, Takaki T, Ishii I (2013) Fast FPGA-based multi-object feature extraction. IEEE Trans Circuits Syst Video Technol 23:30–45
Gu Q, Raut S, Okumura K, Aoyama T, Takaki T, Ishii I (2015) Real-time image mosaicing system using a high-frame-rate video sequence. JRM 27:12–23
Ishii I, Ichida T, Gu Q, Takaki T (2013) 500-fps face tracking system. JRTIP 8:379–388
Harris C, Stephens M (1988) A combined corner and edge detector. In: Proceeding the 4th Alvey visual conference. pp 147–151
Battiato S, Gallo G, Puglisi G, Scellato S (2007) SIFT features tracking for video stabilization. In: 14th international conference on image analysis and process. pp 825–830
Pinto B, Anurenjan PR (2011) Video stabilization using speeded up robust features. In: 2011 international conference communication and signal process. pp 527–531
Lim A, Ramesh B, Yang Y, Xiang C, Gao Z, Lin F (2017) Real-time optical flow-based video stabilization for unmanned aerial vehicles. J Real-Time Image Process. https://doi.org/10.1007/s11554-017-0699-y
https://opencv.org/