Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization
Tóm tắt
This paper describes a novel system for mobile robot localization in an indoor environment, using concepts like homography and matching borrowed from the context of stereo and content-based image retrieval techniques (CBIR). To deal with variations with respect to viewpoint and camera positions, a group of points of interest (POI) is extracted to represent the image for robust matching. To cope with illumination changes, we propose to produce a contrast image for each video frame by using the root mean square strategy, thus all the POIs are extracted from the corresponding contrast images to provide perceptually consistent measurement of image content. To achieve effective image matching, modeling of robot behavior for model constrained matching is proposed, where normalized cross correlation is employed for local matching to determine corresponding POI pairs followed by homography based global optimization using RANSAC. Meanwhile, application of specific constraints also helps to exclude irrelevant frames in the training set to further improve the efficiency and robustness. The proposed approach has been successfully applied to the Robot Vision task for the ImageCLEF workshop, and the experimental results have fully demonstrated the high-quality performance of our approaches in terms of both precision and robustness. The system and approach outlined in this paper was ranked the second best in the optional task group in ImageCLEF 2009. In addition to demonstrating the merits of our approach in isolation, we also illustrate the benefits of our proposed approach in comparison with other submissions.
Tài liệu tham khảo
ImageCLEF (Robot vision task), http://www.imageclef.org/2009/robot
Desouza G.N., Kak A.C.: Vision for mobile robot navigation: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(2), 237–267 (2002). doi:10.1109/34.982903
Kim J., Jun H.: Vision-based location positioning using augmented reality for indoor navigation. IEEE Trans. Consumer Electron. 54(3), 954–962 (2008). doi:10.1109/TCE.2008.4637573
Rubin M.A., Freeman W.T., Murphy K.P., Torralba A.: Context-Based Vision System for Place and Object Recognition. In Proc. Int’l Conf. Computer Vision 1, 273–280 (2003)
Oliva A., Torralba A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int’J. Comput. Vis. 42, 145–175 (2001)
Ohya I., Kosaka A., Kak A.: Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing. IEEE Trans. Robotics Autom. 14(6), 969–978 (1998)
Hashima, M., Hasegawa, F., Kanda, S., Maruyama, T., Uchiyama, T.: Localization and obstacle detection for robots for carrying food trays. In Proc. the IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS ’97), vol. 1, pp. 345–351, 7–11 Sep. 1997
Althaus P., Christensen H.I.: Behavior coordination in structured environments. Adv. Robotics 17(7), 657–674 (2003)
Pronobis, A., Caputo, B.: Confidence-based cue integration for visual place recognition. In Proc. the IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS’07), pp. 2394–2401, Oct. 29– Nov. 2 2007
Harris, C., Stephens, M.: A combined corner and edge detector. In Proc. 4th Alvey Vision Conference, pp. 147–152 (1988)
Moravec, H.P.: Visual Mapping by a Robot Rover. Int. Joint Conf. Artificial Intelligence, pp. 598–600 (1979)
Gevrekci M., Gunturk B.K.: Illumination robust interest point detection. Comput. Vis. Image Underst. 113, 565–571 (2009)
Michelson A.: Studies in Optics. University of Chicago Press, USA (1927)
Lu L., Dai X., Hager G.: Efficient particle filtering using RANSAC with application to 3D face tracking. Image Vis. Comput. 24(6), 581–592 (2006)
Pronobis, A., Mozos, O.M., Caputo, B.: SVM-based discriminative accumulation scheme for place recognition. Proc. the IEEE Int. Conf. Robotics and Automation, pp. 522–529. Pasadena, USA (2008)
Liu, J., Wan, M., Zhang, J.: Monocular robot navigation using invariant natural features. In Proc. 7th World Congress on Intelligent Control and Automation (WCICA’08), pp. 5733–5738. Chongqing, China, June 2008
Yen J., Pfluger N.: A fuzzy logic based extension to Payton and Rosenblatt’s command fusion method for mobile robot navigation. IEEE Trans. Sys. Man Cybern. 25(6), 971–978 (1995)
Cipolla R., Giblin P.J.: Visual Motion of Curves and Surfaces. Cambridge Univ. Press, Cambridge (2000)
Pronobis, A., Xing, L., Caputo, B.: Overview of the CLEF 2009 robot vision track. Lecture Notes in Computer Science, vol. 6242, pp. 110–119 (2010)
Castellanos, J.A., Martinez, J.M., Neira, J., Tardos, J.D.: Simultaneous map building and localization for mobile robots: a multisensor fusion approach. In Proc. IEEE Int. Conf. Robotics and Automation, vol. 2, pp. 1244–1249, 16–20 May 1998
Yamauchi, B., Schultz, A., Adams, W.: Mobile robot exploration and map-building with continuous localization. In Proc. IEEE Int. Conf. Robotics and Automation, vol. 4, pp. 3715–3720, 16–20 May 1998
Sim, R., Dudek, G.: Mobile robot localization from learned landmarks. In Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, vol. 2, pp. 1060–1065, 13–17 Oct. 1998
Se S., Lowe D., Little J.: Mobile robot localization and mapping with uncertainty using scale-invariant visual landmarks. Int. J. Robot. Res. 21, 735–758 (2002)
Lowe, D.G.: Object recognition from local scale-invariant features. In Proc. 7th IEEE Int. Conf. Computer Vision, vol. 2, pp. 1150–1157 (1999)
Wang, L., Li, H., Hartley, R.: Video Local Pattern based Image Matching for Visual Mapping. In Proc. 18th Int. Conf. Pattern Recognition (ICPR), vol. 3, pp. 67–70 (2006)
Katsura, H., Miura, J., Hild, M., Shirai, Y.: A view-based outdoor navigation using object recognition robust to changes of weather and seasons. In Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS’03), vol. 3, pp. 2974–2979, 27–31 Oct. 2003
Luo, J., Pronobis, A., Caputo, B., Jensfelt, P.: Incremental learning for place recognition in dynamic environments. In Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS’07), pp. 721–728, San Diego, USA, Oct. 2007
Pronobis A., Caputo B., Jensfelt P., Christensen H.I.: A realistic benchmark for visual indoor place recognition. Robot. Auton. Syst. 58(1), 81–96 (2010)
Feng Y., Halvey M., Jose J.M.: University of Glasgow at Image CLEF 2009 robot vision task. LNCS 6242, 295–298 (2010)
Pavel M., Sperling G., Riedl T., Vanderbeek A.: Limits of visual communication: the effect of signal-to-noise ratio on the intelligibility of American Sign Language. J. Opt. Soc. Am. (JOSA) 4(12), 2355–2365 (1987)
Briechle, K., Hanebeck, U.D.: Template matching using fast normalized cross correlation. In Proc. SPIE (Optical Pattern Recognition XII), vol. 4387, pp. 95–102, March 2001
Martinez-Gomez, J., Jimenez-Picazo, A., Garcia-Varea, I.: A particle-filter-based self-localization method using invariant features as visual information. In Proc. CLEF workshop, Corfu, Greece (SIMD) (2009)
Pronobis, A., Martínez Mozos, O., Caputo, B.: SVM-based discriminative accumulation scheme for place recognition. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA’08), Pasadena (IDIAP), May 2008
Gao, Y., Li, Y.: Topological localization of mobile robots using probabilistic support vector classification. Lecture Notes in Computer Science (CVIU), vol. 6242, pp. 255–260 (2010)
Zou, A.-M., Hou, Z.-G., Fu, S.-H., Tan, M.: Neural networks for mobile robot navigation: a survey. Lecture Notes in Computer Science, vol. 3972, pp. 1218–1226 (2006)
Filliat D., Meyer J.-A.: map-based navigation in mobile robots. I. a review of localization strategies. Cogn. Syst. Res. 4(4), 243–282 (2003)
Lowe D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. (IJCV) 60(2), 91–110 (2004)
Schmid C., Mohr R., Bauckhage C.: Evaluation of interest point detectors. Int. J. Comput. Vis. (IJCV) 37(2), 151–172 (2000)
Pedreiras, P., Teixeira, F., Ferreira, N., et al.: Enhancing the reactivity of the vision subsystem in autonomous mobile robots using real-time techniques. RoboCup Symposium: Papers and Team Description Papers; also In: Noda, I., Jacoff, A., Bredenfeld, A., Takahashi, Y. (eds.) RoboCup-2005: Robot Soccer World Cup IX, LNAI, Springer, Berlin (2006)