Mismatched image identification using histogram of loop closure error for feature-based optical mapping
Tóm tắt
Image registration is one of the most fundamental steps in optical mapping from mobile platforms. Lately, image registration is performed by detecting salient points in two images and matching their descriptors. Robust methods [such as Random Sample Consensus (RANSAC)] are employed to eliminate outliers and compute the geometric transformation between the coordinate frames of images, typically a homography when the images contain views of a flat area. However, the image registration pipeline can sometimes provide a sufficient number of wrong inliers within the error bounds even when images do not overlap at all. Such mismatches occur especially when the scene has repetitive texture and shows structural similarity. Such pairs prevent the trajectory (thus, a mosaic) from being estimated accurately. In this paper, we propose to utilize closed-loop constraints for identifying mismatches. Cycles appear when the camera revisits an area that was imaged before, which is a common practice especially for mapping purposes. The proposed method exploits the fact that images forming a cycle should have an identity mapping when all the homographies between images in the cycle are multiplied. Our proposal obtains error statistics for each matched image pair extracting several cycle bases. Then, by using a previously trained classifier, it identifies image pairs by comparing error histograms. We present experimental results with different image sequences.
Tài liệu tham khảo
Bay, H., Tuytelaars, T., Van Gool, L.J.: SURF: speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Graz, Austria (2006)
Davis, J.: Mosaics of scenes with moving objects. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. I, pp. 354–360. Santa Barbara, CA, USA (1998)
Fang, X., Zhu, J., Luo, B.: Image mosaic with relaxed motion. Signal Image Video Process. 6(4), 647–667 (2010)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Freund, Y., Schapire, R., et al.: Experiments with a new boosting algorithm. ICML 96, 148–156 (1996)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Harlow (2004)
Kavitha, T., Liebchen, C., Mehlhorn, K., Michail, D., Rizzi, R., Ueckerdt, T., Zweig, K.: Cycle bases in graphs characterization, algorithms, complexity, and applications. Comput. Sci. Rev. 3(4), 199–243 (2009)
Koutsoudis, A., Vidmar, B., Ioannakis, G., Arnaoutoglou, F., Pavlidis, G., Chamzas, C.: Multi-image 3d reconstruction data evaluation. J. Cult. Herit. 15(1), 73–79 (2014)
Lirman, D., Gracias, N., Gintert, B., Gleason, A., Reid, R.P., Negahdaripour, S., Kramer, P.: Development and application of a video-mosaic survey technology to document the status of coral reef communities. Environ. Monit. Assess. 159, 59–73 (2007)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Martinec, D., Pajdla, T.: Robust rotation and translation estimation in multiview reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR’07., pp. 1–8 (2007)
Marzotto, R., Fusiello, A., Murino, V.: High resolution video mosaicing with global alignment. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. I, pp. 692–698. Washington, DC, USA (2004)
Ribas, D., Palomeras, N., Ridao, P., Carreras, M., Hernandez, E.: ICTINEU AUV wins the first SAUC-E competition. In: IEEE International Conference on Robotics and Automation. Roma, Italy (2007)
Roberts, R., Sinha, S., Szeliski, R., Steedly, D.: Structure from motion for scenes with large duplicate structures. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3137–3144. IEEE (2011)
Sawhney, H., Hsu, S., Kumar, R.: Robust video mosaicing through topology inference and local to global alignment. In: European Conference on Computer Vision, vol. II, pp. 103–119. Freiburg, Germany (1998)
Skiena, S.: Implementing Discrete Mathematics: Combinatorics and Graph Theory with Mathematica. Addison-Wesley, Reading (1990)
Xu, Z.: Consistent image alignment for video mosaicing. Signal Image Video Process. 7(1), 129–135 (2013). https://doi.org/10.1007/s11760-011-0212-1
Zach, C., Irschara, A., Bischof, H.: What can missing correspondences tell us about 3d structure and motion? In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)
Zach, C., Klopschitz, M., Pollefeys, M.: Disambiguating visual relations using loop constraints. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1426–1433 (2010)