Gesture-based interaction via finger tracking for mobile augmented reality

Multimedia Tools and Applications - Tập 62 Số 1 - Trang 233-258 - 2013
Wolfgang Hürst1, Casper van Wezel1
1Department of Information and Computing Sciences, Utrecht University, Princetonplein 5, De Uithof, 3584 CC, Utrecht, The Netherlands

Tóm tắt

Từ khóa


Tài liệu tham khảo

Andel M, Petrovski A, Henrysson A, Ollila M (2006) Interactive collaborative scene assembly using AR on mobile phones. In: Pan Z et al. (Eds.): ICAT 2006, LNCS 4282, Springer-Verlag Berlin Heidelberg, 1008–1017

Atchison DA, Smith G (2000) Optics of the human eye, Vol. 1, Butterworth-Heinemann

Baldauf M, Zambanini S, Fröhlich P, Reichl P (2011) Markerless visual fingertip detection for natural mobile device interaction. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 539–544

Bergig O, Hagbi N, El-Sana J, Billinghurst M (2009) In-place 3D sketching for authoring and augmenting mechanical systems. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09). IEEE Computer Society, Washington, DC, USA, 87–94

Billinghurst M, Kato H, Myojin S (2009) Advanced interaction techniques for augmented reality applications. In Proceedings of the 3rd International Conference on Virtual and Mixed Reality: Held as Part of HCI International 2009 (VMR '09), Randall Shumaker (Ed.). Springer-Verlag, Berlin, Heidelberg, 13–22

Caballero ML, Chang T-R, Menéndez M, Occhialini V (2010) Behand: augmented virtuality gestural interaction for mobile phones. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI '10). ACM, New York, NY, USA, 451–454

Callahan J, Hopkins D, Weiser M, Shneiderman B (1988) An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Carmigniani J, Furht B, Anisetti M, Ceravolo P, Damiani E, Ivkovic M (2011) Augmented reality technologies, systems and applications. Multimed Tools Appl 51(1):341–377

Chehimi F, Coulton P (2008) Motion controlled mobile 3D multiplayer gaming. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (ACE '08)

Chehimi F, Coulton P, Edwards R (2008) 3D motion control of connected augmented virtuality on mobile phones. In Proceedings of the 2008 International Symposium on Ubiquitous Virtual Reality (ISUVR '08). IEEE Computer Society, Washington, DC, USA, 67–70

Crowley JL, Bérard F, Coutaz J (1995) Finger tracking as an input device for augmented reality. In Proceedings of the International Workshop on Face and Gesture Recognition, Zurich, Switzerland, 195–200

Dorfmüller-Ulhaas K, Schmalstieg D (2001) Finger tracking for interaction in augmented environments. In Proceedings of IEEE and ACM International Symposium on Augmented Reality, 2001, 55–64

EyeSight’s Touch Free Interface Technology Software: http://www.eyesight-tech.com/technology/

Gilbertson P, Coulton P, Chehimi F, Vajk T (2008) Using “tilt” as an interface to control “no-button” 3-D mobile games. Comput. Entertain. 6, 3, Article 38 (November 2008)

Grandhi SA, Joue G, Mittelberg I (2011) Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11). ACM, New York, NY, USA, 821–824

Ha T, Woo W (2010) An empirical evaluation of virtual hand techniques for 3D object manipulation in a tangible augmented reality environment. In Proceedings of the 2010 IEEE Symposium on 3D User Interfaces (3DUI '10). IEEE Computer Society, Washington, DC, USA, 91–98

Hagbi N, Bergig O, El-Sana J, Billinghurst M (2009) Shape recognition and pose estimation for mobile augmented reality. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09). IEEE Computer Society, Washington, DC, USA, 65–71

Henrysson A, Billinghurst M, Ollila M (2005) Virtual object manipulation using a mobile phone. In Proceedings of the 2005 international conference on Augmented tele-existence (ICAT '05). ACM, New York, NY, USA, 164–171

Henrysson A, Billinghurst M (2007) Using a mobile phone for 6 DOF mesh editing. In Proceedings of the 7th ACM SIGCHI New Zealand chapter’s international conference on Computer-human interaction: design centered HCI (CHINZ '07). ACM, New York, NY, USA, 9–16

Henrysson A, Ollila M, Billinghurst M (2005) Mobile phone based AR scene assembly. In Proceedings of the 4th international conference on Mobile and ubiquitous multimedia (MUM '05). ACM, New York, NY, USA, 95–102

Huynh DT, Raveendran K, Xu Y, Spreen K, MacIntyre B (2009) Art of defense: a collaborative handheld augmented reality board game. In Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games (Sandbox '09), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, 135–142

Hürst W, van Wezel C (2011) Multimodal interaction concepts for mobile augmented reality applications. In Proceedings of the 17th international conference on Advances in multimedia modeling—Volume Part II (MMM’11), Kuo-Tien Lee, Jun-Wei Hsieh, Wen-Hsiang Tsai, Hong-Yuan Mark Liao, and Tsuhan Chen (Eds.), Vol. Part II. Springer-Verlag, Berlin, Heidelberg, 157–167

Jung J, Cho K, Yang HS (2009) Real-time robust body part tracking for augmented reality interface. In Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI '09), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, 203–207

Kato H, Billinghurst M, Poupyrev I, Imamoto K, Tachibana K (2000) Virtual object manipulation on a table-top AR environment. International Symposium on Augmented Reality, IEEE and ACM International Symposium on Augmented Reality (ISAR'00), 2000, p. 111

Kinect - Xbox.com, http://www.xbox.com/kinect

Koike H, Sato Y, Kobayashi Y (2001) Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans Comput-Hum Interact 8(4):307–322

Kumar A, Waldron K (1981) The workspace of a mechanical manipulator. Trans ASME J Mech Des 103:665–672

Lee M, Green R, Billinghurst M (2008) 3D natural hand interaction for AR applications. Lincoln, New Zealand: 23rd International Conference Image and Vision Computing New Zealand, 26–28 Nov 2008

Mistry P, Maes P (2009) SixthSense: a wearable gestural interface. In ACM SIGGRAPH ASIA 2009 Sketches (SIGGRAPH ASIA '09). ACM, New York, NY, USA, Article 11, 1 pages

Mistry P, Maes P, Chang L (2009) WUW—wear Ur world: a wearable gestural interface. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09). ACM, New York, NY, USA, 4111–4116

Niikura T, Hirobe Y, Cassinelli A, Watanabe Y, Komuro T, Ishikawa M (2010) In-air typing interface for mobile devices with vibration feedback. In ACM SIGGRAPH 2010 Emerging Technologies (SIGGRAPH '10). ACM, New York, NY, USA, Article 15, 1 pages

Rico J, Brewster S (2010) Usable gestures for mobile interfaces: evaluating social acceptability. In Proceedings of the 28th international conference on Human factors in computing systems (CHI '10). ACM, New York, NY, USA, 887–896

Rohs M (2004) Real-world interaction with camera-phones. In Proceedings of 2nd International Symposium on Ubiquitous Computing Systems (UCS 2004), Springer, 74–89

Rohs M (2005) Visual code widgets for marker-based interaction. In Proceedings of the Fifth International Workshop on Smart Appliances and Wearable Computing—Volume 05 (ICDCSW '05), Vol. 5. IEEE Computer Society, Washington, DC, USA, 506–513

Rohs M, Oulasvirta A, Suomalainen T (2011) Interaction with magic lenses: real-world validation of a Fitts’ Law model. In Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11). ACM, New York, NY, USA, 2725–2728

Ruiz J, Li Y. DoubleFlip: a motion gesture delimiter for interaction. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 449–450

Ruiz J, Li Y (2011) DoubleFlip: a motion gesture delimiter for mobile interaction. In Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11). ACM, New York, NY, USA, 2717–2720

Schmalstieg D, Wagner D (2007) Experiences with handheld augmented reality. In Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '07). IEEE Computer Society, Washington, DC, USA, 1–13

Seo B-K, Choi J, Han J-H, Park H, Park J-I (2008) One-handed interaction with augmented virtual objects on mobile devices. In Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI '08). ACM, New York, NY, USA, Article 8, 6 pages

Shaer O, Hornecker E (2010) Tangible user interfaces: past, present, and future directions. Found Trends Hum-Comput Interact 3(1&2):1–137

Terajima K, Komuro T, Ishikawa M (2009) Fast finger tracking system for in-air typing interface. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA '09). ACM, New York, NY, USA, 3739–3744

Wagner D, Langlotz T, Schmalstieg D (2008) Robust and unobtrusive marker tracking on mobile phones. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '08). IEEE Computer Society, Washington, DC, USA, 121–124

Wagner D, Schmalstieg D, Bischof H (2009) Multiple target detection and tracking with guaranteed framerates on mobile phones. In Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '09). IEEE Computer Society, Washington, DC, USA, 57–64

Wagner D, Schmalstieg D (2009) Making augmented reality practical on mobile phones, part 1. IEEE Comput Graph Appl 29(3):12–15

Wagner D, Schmalstieg D (2009) Making augmented reality practical on mobile phones, part 2. IEEE Comput Graph Appl 29(4):6–9

Wang R, Paris S, Popović J (2011) 6D hands: markerless hand-tracking for computer aided design. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 549–558

Wright M, Lin C-J, O’Neill E, Cosker D, Johnson P (2011) 3D gesture recognition: an evaluation of user and system performance. In Proceedings of the 9th international conference on Pervasive computing (Pervasive'11), Kent Lyons, Jeffrey Hightower, and Elaine M. Huang (Eds.). Springer-Verlag, Berlin, Heidelberg, 294–313

Yousefi S, Kondori FA, Li H (2011) 3D gestural interaction for stereoscopic visualization on mobile devices. In Proceedings of the 14th international conference on Computer analysis of images and patterns—Volume Part II (CAIP’11), Ainhoa Berciano, Daniel Diaz-Pernil, Helena Molina-Abril, Pedro Real, and Walter Kropatsch (Eds.), Vol. Part II. Springer-Verlag, Berlin, Heidelberg, 555–562