SEAR: towards a mobile and context-sensitive speech-enabled augmented reality

S. Goose1, S. Sudarsky2, X. Zhang1, N. Navab1
1Siemens Corporate Research, Princeton, New Jersey, USA
2Siemens Corporate Research, New Jersey, USA

Tóm tắt

A maintenance engineer who talks to pumps and pipes may not seem like the ideal person to entrust with keeping a factory running smoothly, but we hope that our mobile speech-enabled augmented reality (SEAR) framework will enable such behavior in the future to be anything but suspicious. We describe how the SEAR framework uses our flexible and scalable vision-based localization techniques to offer the engineer a seamless multi-modal user interface. This interface juxtaposes a graphical augmented reality view with a context-sensitive speech dialog concerning the industrial equipment located in the immediate vicinity.

Từ khóa

#Augmented reality #Speech synthesis #Production facilities #Manufacturing automation #User interfaces #Navigation #Speech recognition #Containers #Virtual environment #Educational institutions

Tài liệu tham khảo

0, VoiceXMLForum 10.1109/WACV.2000.895425 10.1109/ICCV.1999.791289 ressler, 1998, Making VRML Accessible for People with Disabilities ASSETS 98, 50 smailagic, 1997, Wireless and mobile computing in training maintenance and diagnosis, IEEE Vehicular Technology Conference press, 1992, Numerical Recipes in C The Art of Scientific Computing 10.1145/354666.354667 10.1007/978-3-642-46847-6 arons, 1992, A review of the cocktail party effect, Journal of the American Voice I/O Society, 12, 35 aalburg, 2002, Single and two-channel noise reduction for robust speech recognition, Submitted to ISCA Workshop Multi-Modal Dialogue in Mobile Environments 10.1109/ACV.1998.732905 10.1007/978-3-642-87512-0_18 10.1109/IWAR.1999.803809 10.1145/300520.300521 goose, 1999, A 3d audio only interactive web browser: Using spatialization to convey hypermedia document structure, Proceedings of the ACM International Conference on Multimedia, 363 10.1109/IWAR.1999.803813 mynatt, 1998, Designing Audio Aura ACM International Conference on Computer Human Interaction, 566