Dynamically reconfigurable vision-based user interfaces

Machine Vision and Applications - Tập 16 - Trang 6-12 - 2004
Rick Kjeldsen1, Anthony Levas2, Claudio Pinhanez2
1IBM T. J. Watson Research Center, Yorktown Heights, USA
2IBM T.J. Watson Research Center, Yorktown Heights, USA

Tóm tắt

We describe a system that supports practical, vision-based user interfaces, addressing the issues of a usable interaction paradigm, support for application developers, and support for application deployment in real-world environments. Interfaces are defined as configurations of predefined interactive widgets that can be moved from one surface to another. Complex interfaces can be dynamically reconfigured, changing both form and location on the fly, because the functional definition of the interface is decoupled from the specification of its location in the environment. We illustrate the power of such an architecture in the context of projected interactive displays.

Tài liệu tham khảo

Davis L (ed) (2002) In: Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG 2002), IEEE Computer Society, Washington DC Ishii H, Ullmer B (1997) Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms. In: Proc. of CHI’97, Atlanta, GA pp. 234-241 Kjeldsen F (1997) Visual Recognition of Hand Gesture as a Practical Interface Modality. PhD dissertation, Columbia University, New York, NY Kjeldsen F, Hartman J (2001) Design Issues for Vision-based Computer Interaction Systems. In: Proc. of the Workshop on Perceptual User Interfaces. Orlando, FL Kjeldsen F(2002) Interacting with Steerable Projected Displays. In: Proc. of the 5th International Conference on Automatic Face and Gesture Recognition (FG’02), Washington DC Pingali G(2002) User-Following Displays. In: Proc. of the IEEE International Conference on Multimedia and Expo 2002 (ICME’02), Lausanne, Switzerland Pinhanez C (2001) The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In: Proc. of Ubiquitous Computing 2001 (Ubicomp’01). Atlanta, GA Pinhanez CS, Bobick AF (2002) “It/”: A Theater Play Featuring an Autonomous Computer Character. In: Presence: Teleoperators and Virtual Environments 11(5):536-548 Starner T(1997) Augmented Reality through Wearable Computing. In: Presence: Teleoperators and Virtual Environments 6(4):386-398 Sukaviriya N, Podlaseck M, Kjeldsen R, Levas A, Pingali G, Pinhanez C (2003) Embedding Interactions in a retail Store Environment: The Design and Lessons Learned. In:Proc. of the 9th IFIP TC13 International Conference on Human-Computer Interaction (INTERACT03), September 2003 Turk M (ed) (2001) Proc. of the Workshop on Perceptual/Perceptive User Interfaces. Orlando, FL Wolberg G (1994) Digital Image Warping, IEEE Press, New York, NY Wu Y, Huang T (1999) Vision-Based Gesture Recognition: A Review. Lecture Notes in Artificial Intelligence, vol 1739. Springer, Berlin Heidelberg New York Ye G, Corsco J, Burschka D, Hager G (2003), VICs: A Modular Vision-Based HCI Framework. In: Proc. of the 3rd International Conference on Vision Systems, Graz, Austria. pp 257-267 Zhang Z(2001) Visual Panel: Virtual Mouse, Keyboard, and 3D Controller with an Ordinary Piece of Paper. In: Proc. of the ACM Workshop on Perceptual/Perceptive User Interfaces (PUI’01), Orlando, FL