Hand-as-a-prop: using the hand as a haptic proxy for manipulation in virtual reality

Virtual Reality - 2023
Sebastián Marichal1, Iñigo Ezcurdia1, Rafael Morales2, Amalia Ortiz1, Asier Marzo1, Óscar Ardaiz1
1Institute of Smart Cities, Public University of Navarre, Pamplona, Spain
2Ultraleap Ltd, Bristol, UK

Tóm tắt

AbstractHaptic feedback can be almost as important as visual information in virtual reality environments. On the one hand, in Active Haptic Feedback, specialized devices such as vibrotactile gloves are employed; however, these solutions can be expensive, vendor-specific or cumbersome to setup. On the other hand, Passive Haptic Feedback approaches use inexpensive objects as proxies for the virtual entities; but mapping virtual objects to real props is not scalable nor flexible. We propose the Hand-as-a-Prop technique, which consists in using human hands as object props. We implemented two modalities: Self, where the user’s non-dominant hand act as the virtual object while the dominant hand grabs, translates and releases it; and External, where the hand of another person is used. Hand-as-a-Prop can represent multiple shapes with a single prop and does not require extra hardware. We performed an evaluation comparing both Self and External Hand-as-a-Prop with traditional Object Props in terms of user experience (goodness, ease, realism, fatigue, and preference) and performance (task completion time and translation time). Results showed that Hand-as-a-Prop was rated as neutral tending to positive, and in some cases, the performance was similar to Object Props. Users preferred Self Hand-as-a-Prop over External Hand-as-a-Prop and also obtained better results.

Từ khóa


Tài liệu tham khảo

Abtahi P, Follmer S (2018) Visuo-Haptic illusions for improving the perceived performance of shape displays. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp 1–13. https://doi.org/10.1145/3173574.3173724

Aguerreche L, Duval, T, and Lécuyer A (2010) Reconfigurable tangible devices for 3D virtual object manipulation by single or multiple users. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, pp 227–230. https://doi.org/10.1145/1889863.1889913

Araujo B, Jota R, Perumal V, Yao JX, Singh K, Wigdor D (2016) Snake charmer: physically enabling virtual objects. In: Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, pp 218–226. https://doi.org/10.1145/2839462.2839484

Arif AS (2021) Statistical grounding. Intelligent Computing for Interactive System Design: Statistics, Digital Signal Processing, and Machine Learning in Practice (1st ed). Association for Computing Machinery, New York, NY, USA, pp 59–99. https://doi.org/10.1145/3447404.3447410

Azmandian M, Hancock M, Benko H, Ofek E, Wilson AD (2016) Haptic retargeting: dynamic repurposing of passive haptics for enhanced virtual reality experiences. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp 1968–1979. https://doi.org/10.1145/2858036.2858226

Ban Y, Narumi T, Tanikawa T, Hirose M (2015) Air haptics: displaying feeling of contact with AR object using visuo-haptic interaction. ACM SIGGRAPH 2015 Emerging Technologies, 1. https://doi.org/10.1145/2782782.2792498

Bergström J, Dalsgaard TS, Alexander J, Hornbæk K (2021) How to evaluate object selection and manipulation in VR? Guidelines from 20 years of studies. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. CHI ’21: CHI Conference on Human Factors in Computing Systems, Yokohama Japan. https://doi.org/10.1145/3411764.3445193

Bovet S, Debarba HG, Herbelin B, Molla E, Boulic R (2018) The critical role of self-contact for embodiment in virtual reality. IEEE Trans Visual Comput Graphics 24(4):1428–1436. https://doi.org/10.1109/TVCG.2018.2794658

Burns E, Razzaque S, Whitton MC, Brooks FP (2007) MACBETH: the avatar which I see before me and its movement toward my hand. IEEE Virtual Reality Conf 2007:295–296. https://doi.org/10.1109/VR.2007.352509

Cao P (1993) Rent-a-body. http://www.pacocao.com/rent_a_body.html

Cheng LP, Lühne P, Lopes P, Sterz C, Baudisch P (2014) Haptic turk: a motion platform based on people. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp 3463–3472. https://doi.org/10.1145/2556288.2557101

Cheng LP, Roumen T, Rantzsch H, Köhler S, Schmidt P, Kovacs R, Jasper J, Kemper J, Baudisch P (2015) TurkDeck: physical virtual reality based on people. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology, pp 417–426. https://doi.org/10.1145/2807442.2807463

Cheng LP, Marwecki S, Baudisch P (2017a) Mutual human actuation. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pp 797–805. https://doi.org/10.1145/3126594.3126667

Cheng LP, Ofek E, Holz C, Benko H, Wilson AD (2017b) Sparse haptic proxy: touch feedback in virtual environments using a general passive prop. In: Proceedings of the 2017b CHI Conference on Human Factors in Computing Systems, pp 3718–3728. https://doi.org/10.1145/3025453.3025753

Cheng LP, Chang L, Marwecki S, Baudisch P (2018) iTurk: turning passive haptics into active haptics by making users reconfigure props in virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–10). Association for Computing Machinery. https://doi.org/10.1145/3173574.3173663

Choi I, Hawkes EW, Christensen DL, Ploch CJ, Follmer S (2016) Wolverine: a wearable haptic interface for grasping in virtual reality. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). https://doi.org/10.1109/iros.2016.7759169

Cohen J (1988). Statistical power analysis for the behavior sciences (2nd ed). Lawrence Erlbaum, Hillsdale, NJ, USA, 283

Colman AM (2015) A dictionary of psychology. Oxford University Press. https://play.google.com/store/books/details?id=UDnvBQAAQBAJ

Fang CM Harrison C (2021) Retargeted self-haptics for increased immersion in VR without instrumentation. In: The 34th Annual ACM Symposium on User Interface Software and Technology (pp 1109–1121). Association for Computing Machinery. https://doi.org/10.1145/3472749.3474810

Gibson JJ (1933) Adaptation, after-effect and contrast in the perception of curved lines. Journal of Experimental Psychology, 16(1), 1. https://psycnet.apa.org/journals/xge/16/1/1/

Grotowski J, Wiewiorowski TK, Morris K (1967) Towards the poor theatre. Tulane Drama Rev 11(3):60–65. https://doi.org/10.2307/1125118

Hecht D, Reiner M (2009) Sensory dominance in combinations of audio, visual and haptic stimuli experimental brain research experimentelle hirnforschung. Exp Cerebrale 193(2):307–314. https://doi.org/10.1007/s00221-008-1626-z

Hinckley K, Pausch R, Goble JC, Kassell NF (1994) Passive real-world interface props for neurosurgical visualization. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp 452–458. https://doi.org/10.1145/191666.191821

Hoffman HG (1998) Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In: Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180), pp 59–63. https://doi.org/10.1109/VRAIS.1998.658423

Hoppe M, Knierim P, Kosch T, Funk M, Futami L, Schneegass S, Henze N, Schmidt A, Machulla T (2018). VRHapticDrones: providing haptics in virtual reality through quadcopters. In: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia, pp 7–18. https://doi.org/10.1145/3282894.3282898

Insko BE (2001) Passive haptics significantly enhances virtual environments. In: The University of North Carolina at Chapel Hill. ProQuest Dissertations Publishing (Vol. 3007820). https://search.proquest.com/openview/2b43afef0d0711642d36bf836a207a5a/1?pq-origsite=gscholar&cbl=18750&diss=y

Knierim P, Kosch T, Schwind V, Funk M, Kiss F, Schneegass S, Henze N (2017) Tactile drones-providing immersive tactile feedback in virtual reality through quadcopters. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp 433–436. https://doi.org/10.1145/3027063.3050426

Knierim P, Kosch T, Achberger A, Funk M (2018) Flyables: exploring 3d interaction spaces for levitating tangibles. In: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction, pp 329–336. https://doi.org/10.1145/3173225.3173273

Kohli L, Whitton M (2005) The haptic hand: providing user interface feedback with the non-dominant hand in virtual environments. In: Proceedings of Graphics Interface 2005, pp 1–8. http://graphics.hallym.ac.kr/teach/2009/tcg/src/GI05Koh.pdf

Kohli L, Whitton MC, Brooks FP (2012) Redirected touching: the effect of warping space on task performance. In: 2012 IEEE Symposium on 3D User Interfaces (3DUI), pp 105–112. https://doi.org/10.1109/3DUI.2012.6184193

Kohli L, Whitton MC, Brooks FP (2013). Redirected touching: training and adaptation in warped virtual spaces. In: Proceedings. IEEE Symposium on 3D User Interfaces, 2013, pp 79–86. https://doi.org/10.1109/3DUI.2013.6550201

Kyriakou P, Hermon S (2019) Can i touch this? Using natural interaction in a museum augmented reality system. Digit Appl Archaeol Cult Heritage 12:e00088. https://doi.org/10.1016/j.daach.2018.e00088

MacKenzie IS (2013) Designing HCI Experiments. Human-computer interaction: an empirical research perspective. Morgan Kaufmann, Waltham, MA, USA, pp 157–189

Massie TH, Salisbury JK, Others (1994) The phantom haptic interface: A device for probing virtual objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 55, 295–300. http://ai.stanford.edu/~jks/pubs/1994-Massie-salisbury-asme-sohi.pdf

McClelland JC, Teather RJ, Girouard A (2017) Haptobend: shape-changing passive haptic feedback in virtual reality. In: Proceedings of the 5th Symposium on Spatial User Interaction, pp 82–90. https://doi.org/10.1145/3131277.3132179

McNeely WA (2013) Robotic graphics: a new approach to force feedback for virtual reality. In: Proceedings of IEEE Virtual Reality Annual International Symposium. https://doi.org/10.1109/vrais.1993.380761

Mercado VR, Marchal M, Lecuyer A (2021) Haptics on-demand: a survey on encountered-type haptic displays. IEEE Trans Haptics 14:449–464. https://doi.org/10.1109/toh.2021.3061150

Rock I, Victor J (1964) Vision and touch: an experimentally created confict between the two senses. Science 143:594–596

Sra M, Garrido-Jurado S, Schmandt C, Maes P (2016) Procedurally generated virtual reality from 3D reconstructed physical space. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp 191–200. https://doi.org/10.1145/2993369.2993372

Taylor JL (2009) Proprioception. In: Encyclopedia of Neuroscience (pp 1143–1149). https://doi.org/10.1016/b978-008045046-9.01907-0

Wobbrock JO, Morris MR, Wilson AD (2009) User-defined gestures for surface computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp 1083–1092. https://doi.org/10.1145/1518701.1518866

Zenner A, Kruger A (2017) Shifty: a weight-shifting dynamic passive haptic proxy to enhance object perception in virtual reality. IEEE Trans Visual Comput Graphics 23(4):1285–1294. https://doi.org/10.1109/TVCG.2017.2656978

Zhao Y, Follmer S (2018) A functional optimization based approach for continuous 3D retargeted touch of arbitrary, complex boundaries in haptic virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp 1–12. https://doi.org/10.1145/3173574.3174118

Thông tin
Thông tin xuất bản

Virtual Reality

Thông tin tác giả