A sensor-based SLAM algorithm for camera tracking in virtual studio
Tóm tắt
This paper addresses a sensor-based simultaneous localization and mapping (SLAM) algorithm for camera tracking in a virtual studio environment. The traditional camera tracking methods in virtual studios are vision-based or sensor-based. However, the chroma keying process in virtual studios requires color cues, such as blue background, to segment foreground objects to be inserted into images and videos. Chroma keying limits the application of vision-based tracking methods in virtual studios since the background cannot provide enough feature information. Furthermore, the conventional sensor-based tracking approaches suffer from the jitter, drift or expensive computation due to the characteristics of individual sensor system. Therefore, the SLAM techniques from the mobile robot area are first investigated and adapted to the camera tracking area. Then, a sensor-based SLAM extension algorithm for two dimensional (2D) camera tracking in virtual studio is described. Also, a technique called map adjustment is proposed to increase the accuracy and efficiency of the algorithm. The feasibility and robustness of the algorithm is shown by experiments. The simulation results demonstrate that the sensor-based SLAM algorithm can satisfy the fundamental 2D camera tracking requirement in virtual studio environment.
Tài liệu tham khảo
K. Cornelis, M. Pollefeys, L. V. Gool. Tracking Based Structure and Motion Recovery for Augmented Vdeo Productions. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, ACM, Alberta, Canada, pp. 17–24. 2001.
M. I. Lourakis, A. A. Argyros. Efficient, Causal Camera Tracking in Unprepared Environments. Computer Vision and Image Understanding, vol. 99, no. 2, pp. 259–290, 2005.
M. A. Livngston, A. State. Magnetic Tracker Calibration for Improved Augmented Reality Registration. Teleoperators and Virtual Enviroment, vol. 6, no. 5, pp. 532–546, 1997.
F. Madritsch. Optical Beacon Tracking for Human-computer Interfaces, Ph. D. dissertation, Technical University Graz, Austria, 1996.
R. Want. A. Hopper. V. Falcao, I. Gibbons. The Active Badge Location System. ACM Transactions on Information Systems, vol. 10, no. 1, pp. 91–102, 1992.
C. Randell, H. Muller. Low Cost Indoor Positioning System. Ubicomp 2001: Ubiquitous Computing, G. D. Abowd (ed.), Springer-Verlag, Berlin, Germany, pp. 42–48. 2001.
S. Gibbs, C. Arapis, C. Breiteneder, V. Lalioti, S. Mostafaway, J. Speier. Virtual Studios: An Overview. IEEE Multimedia, vol. 5, no.1, pp. 18–35, 1998.
A. Wojdala. Challenges of Virtual Set Technology. IEEE Multimedia, vol. 5, no. 1, pp. 50–57, 1998.
Y. Yamanouchi, H. Mitsumine, T. Fukaya, M. Kawakita, N. Yagi, S. Inoue. Real Space-based Virtual Studio-Seamless Synthesis of a Real Set Image with a Virtual Set Image. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, ACM, HongKong, PRC, pp. 194–200, 2002.
D. Scharstein, R. Szeliski. A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms. International Journal of Computer Vision, vol. 47, no. 1–3, pp. 7–42, 2002.
R. Yang, M. Pollefeys, H. Yang, G. Welch. A Unified Approach to Real-time, Multi-resolution, Multi-baseline 2D View Synthesis and 3D Depth Estimation Using Commodity and Graphics Hardware. International Journal of Image and Graphics, vol. 4, no. 4, pp. 627–651, 2004.
A. Ward, A. Jones, A. Hopper. A New Location Technique for the Active Office. IEEE Personal Communications, vol. 4, no. 5, pp. 42–47, 1997.
R. A. Brooks. A Robot That Walks: Emergent Behavior from a Carefully Evolved Network. Neural Computation, vol. 1, no. 2, pp. 253–262, 1989.
S. Thrun, D. Fox, W, Burgard, F. Dellaert. Robust Monte Carlo Localization for Mobile Robots. Artificial Intelligence, vol. 128, no. 1–2, pp. 99–141. 2001.
M. Pupilli, A. Calway. Real-time Camera Tracking Using a Particle Filter. In Proceedings of British Machine Vision Conference, Oxford, UK, pp. 519–528, 2005.
A. J. Davison. Real-time Simultaneous Localisation and Mapping with a Single Camera. In Proceedings of IEEE International Conference on Computer and Vision, IEEE Press, Washington D.C., USA, vol. 2, pp. 1403–1410, 2003.
A. J. Davison, D. W. Murray. Simultaneous Localization and Map-building Using Active Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 865–880 2002.
M. H. Degroot, M. J. Schervish. Probability and Statistics, 3rd ed., Addison-Wesley, USA, 2002.
A. Doucet, D. Freitas, K. Murphy, S. Russell. Rao-blackwellised Particle Filtering for Dynamic Bayesian Networks. In Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence, Stanford, USA, pp. 176–183, 2000.
M. C. Deans, M. Hebert. Experimental Comparison of Techniques for Localization and Mapping Using a Bearing-only Sensor. Lecture Notes in Control and Information Sciences, Experimental Robotics VII, Springer-Verlag, London, UK, vol. 271, pp. 395–404, 2002.
S. B. Williams, G. Dissanayake, H. Durrant-Whyte. Constrained Initialisation of the Simultaneous Localization and Mapping Algorithm. In Proceedings of International Conference on Field and Service Robotics, Helsinki, Finland, pp. 315–330, 2001.
J. R. Spletzer. A New Approach to Range-only SLAM for Wireless Sensor Networks, Techniqucal Report, Lehigh University Bethlehem, PA, USA, 2003
J. J. Leonard, R. J. Rikoski. Incorporation of Delayed Decision Making into Stochastic Mapping. Lecture Notes in Control and Information Sciences, Springer-Verlag, Berlin, Germany, Volume 271, pp. 533–542, 2000.
J. M. Buhmann, W. Burgard, A. B. Cremers, D. Fox, T. Hofmann, F. E. Schneider, J. Strikos, S. Thrun. The Mobile Robot Rhino. AI Magazine, vol. 16, no. 2, pp. 31–38, 1995.