Binocular vision measurement for large-scale weakly textured ship hull plates using feature points encoding method

Manager, 2011, “IHIMU-α” a fully automated steel plate bending system for shipbuilding Yuan, 2014, Development of large plate bending machine for shipbuilding with three-dimensional numerical control, Shipbuild. China, 55, 122 Wang, 2016, An onsite inspection sensor for the formation of hull plates based on active binocular stereovision, Proc. Inst. Mech. Eng. B, 230, 279, 10.1177/0954405414545388 Shang, 2022, Measurement methods of 3D shape of large-scale complex surfaces based on computer vision: A review, Measurement, 197, 10.1016/j.measurement.2022.111302 Shin, 2004, An efficient algorithm for measurement and comparison of large-scale hull pieces in the line-heating process, J. Ship Prod., 20, 60, 10.5957/jsp.2004.20.1.60 Metronor, 2019 Hirschmuller, 2008, Stereo processing by semiglobal matching and mutual information, IEEE Trans. Pattern Anal. Mach. Intell., 30, 328, 10.1109/TPAMI.2007.1166 X. Mei, X. Sun, M. Zhou, et al., On building an accurate stereo matching system on graphics hardware, in: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011, pp. 467–474. J.-R. Chang, Y. Chen, Pyramid Stereo Matching Network, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 5410–5418. X. Gu, Z. Fan, S. Zhu, et al., Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 2492–2501. He, 2022, Deployment of a deep-learning based multi-view stereo approach for measurement of ship shell plates, Ocean Eng., 260, 10.1016/j.oceaneng.2022.111968 Chen, 2020, Three-dimensional perception of orchard banana central stock enhanced by adaptive multi-vision technology, Comput. Electron. Agric., 174, 10.1016/j.compag.2020.105508 P.-E. Sarlin, D. DeTone, T. Malisiewicz, et al., SuperGlue: Learning Feature Matching With Graph Neural Networks, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 4937–4946. J. Sun, Z. Shen, Y. Wang, et al., LoFTR: Detector-Free Local Feature Matching with Transformers, in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, pp. 8918–8927. Wei, 2019, A non-contact measurement method of ship block using image-based 3D reconstruction technology, Ocean Eng., 178, 463, 10.1016/j.oceaneng.2019.03.015 E. Heo, M. Kwon, B. Kim, Large free form measurement using slit beam, in: 2008 International Conference on Control, Automation and Systems, 2008, pp. 1224–1227. Han, 2009, Combined stereovision and phase shifting method: a new approach for 3D shape measurement Pinto, 2012, Regular mesh measurement of large free form surfaces using stereo vision and fringe projection, Opt. Lasers Eng., 50, 910, 10.1016/j.optlaseng.2012.03.003 J. Xu, N. Xi, C. Zhang, et al., Real-time 3D shape inspection system for manufacturing parts based on three-step stripe pattern, in: 2010 IEEE International Conference on Automation Science and Engineering, 2010, pp. 228–233. Mei, 2021, A topology-based stereo matching method for one shot 3D measurement using coded spot-array structured light, Sensors, 10.3390/s21196444 Wang, 2022, Accurate detection and localization of curved checkerboard-like marker based on quadratic form, IEEE Trans. Instrum. Meas., 71, 1, 10.1109/TIM.2022.3216413 Scaramuzza, 2011, Visual odometry [tutorial], IEEE Robot. Autom. Mag., 18, 80, 10.1109/MRA.2011.943233 Kovesi, 2019 Y. Deng, B. Manjunath, H. Shin, Color image segmentation, in: Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), vol. 2, 1999, pp. 446–451. Rother, 2004, “GrabCut”: Interactive foreground extraction using iterated graph cuts, ACM Trans. Graph., 23, 309, 10.1145/1015706.1015720 C.G. Harris, M.J. Stephens, A Combined Corner and Edge Detector, in: Alvey Vision Conference, 1988. J. Shi, Tomasi, Good features to track, in: 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1994, pp. 593–600. E. Rosten, T. Drummond, Machine Learning for High-Speed Corner Detection, in: European Conference on Computer Vision, 2006. A. Geiger, F. Moosmann, O. Car, et al., Automatic camera and range sensor calibration using a single shot, in: 2012 IEEE International Conference on Robotics and Automation, 2012, pp. 3936–3943. A. Duda, U. Frese, Accurate Detection and Localization of Checkerboard Corners for Calibration, in: British Machine Vision Conference, 2018. Tsai, 1987, A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses, IEEE J. Robot. Autom., 3, 323, 10.1109/JRA.1987.1087109 P.L.M. Bouttefroy, A. Bouzerdoum, S.L. Phung, et al., On the analysis of background subtraction techniques using Gaussian Mixture Models, in: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, 2010, pp. 4042–4045. A. Neubeck, L. Van Gool, Efficient Non-Maximum Suppression, in: 18th International Conference on Pattern Recognition (ICPR’06), vol. 3, 2006, pp. 850–855. Comaniciu, 2002, Mean shift: a robust approach toward feature space analysis, IEEE Trans. Pattern Anal. Mach. Intell., 24, 603, 10.1109/34.1000236 Sjanic, 2011, A nonlinear least-squares approach to the SLAM problem*, IFAC Proc. Vol., 44, 4759, 10.3182/20110828-6-IT-1002.02042 Z. Zhang, Flexible camera calibration by viewing a plane from unknown orientations, in: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, 1999, pp. 666–673. Yang, 2022, A novel load-dependent sensor placement method for model updating based on time-dependent reliability optimization considering multi-source uncertainties, Mech. Syst. Signal Process., 165, 10.1016/j.ymssp.2021.108386 Yang, 2022, A novel two-step strategy of non-probabilistic multi-objective optimization for load-dependent sensor placement with interval uncertainties, Mech. Syst. Signal Process., 176, 10.1016/j.ymssp.2022.109173 Xu, 2011, Precision evaluation of three-dimensional feature points measurement by binocular vision, J. Opt. Soc. Korea, 15, 30, 10.3807/JOSK.2011.15.1.030 S. Rusinkiewicz, M. Levoy, Efficient variants of the ICP algorithm, in: Proceedings Third International Conference on 3-D Digital Imaging and Modeling, 2001, pp. 145–152. Abbas, 2017, Improvements to the accuracy of prototype ship models measurement method using terrestrial laser scanner, Measurement, 100, 301, 10.1016/j.measurement.2016.12.053 B. Mederos, L. Velho, L. De Figueiredo, Moving least squares multiresolution surface approximation, in: 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003), 2003, pp. 19–26. Ltd., 2022