Multiple narrow-baseline system for immersive teleconferencing

E. Cooke1, P. Kauff1, O. Schreer1
1Image Processing Department, Heinrich-Hertz-Institut, Berlin, Germany

Tóm tắt

An important aim of immersive teleconferencing systems is to create realistic 3D virtual views of remote conferees. Hence, systems should be able to deal with hand gestures as well as occluded areas in reference images required in derived views. The quality of such derived views is dependent not only on the analysis and synthesis process but also the multiview camera set-up. Often the popular convergent wide-baseline stereo approach aspires to achieve too much through a single camera pair: maximum information and reliable disparity maps. We identify how this dichotomy leads to problems in the analysis and synthesis process, often leading to a restrictive system specific solution. We then define a new approach, a multiple narrow-baseline set-up, designed to overcome the limitations of the wide-baseline set-up, being modular, both in terms of system requirements as well as algorithmically, and scalable, with respect to the number of conferees.

Từ khóa

#Teleconferencing #Cameras #Image converters #Image processing #Algorithm design and analysis #Interpolation #Virtual environment #Video sharing #Rendering (computer graphics) #Two dimensional displays

Tài liệu tham khảo

zhang, 1996, Epipolar Geometry in Stereo Motion and Object Recognition 10.1109/2945.765324 cooke, 2002, Image-based rendering for teleconference systems, WSC '02 mcmillan, 1997, An image-based approach to three-dimensional computer graphics, 45 ohm, 1997, An object-based system for stereoscopic viewpoint synthesis, IEEE Trans Circ Syst Video Tech, csvt 7, 801 10.1109/ICCV.1995.466831 lei, 2001, Middle view stereo representation, IEEE Int Conf Image Processing kauff, 2001, Advanced Incomplete 3D Representation of video objects using trilinear warping for novel view synthesis, Proc PCS '01 schreer, 2001, Hybrid recursive matching and segmentation-based postprocessing in real-time immersive video conferencing, Vision Modeling and Visualization 10.1109/ICCV.1998.710802 10.1145/166117.166153 schreer, 2001, An immersive 3D videoconferencing system based on a shared virtual table environment, Int Conf Media Futures wu, 2001, Hand modeling, analysis, and recognition for vision-based human computer interaction, IEEE Signal Processing Magazine, 51