Large eye–head gaze shifts measured with a wearable eye tracker and an industrial camera
Springer Science and Business Media LLC - Trang 1-14 - 2024
Tóm tắt
We built a novel setup to record large gaze shifts (up to 140
$$^\circ $$
). The setup consists of a wearable eye tracker and a high-speed camera with fiducial marker technology to track the head. We tested our setup by replicating findings from the classic eye–head gaze shift literature. We conclude that our new inexpensive setup is good enough to investigate the dynamics of large eye–head gaze shifts. This novel setup could be used for future research on large eye–head gaze shifts, but also for research on gaze during e.g., human interaction. We further discuss reference frames and terminology in head-free eye tracking. Despite a transition from head-fixed eye tracking to head-free gaze tracking, researchers still use head-fixed eye movement terminology when discussing world-fixed gaze phenomena. We propose to use more specific terminology for world-fixed phenomena, including gaze fixation, gaze pursuit, and gaze saccade.
Tài liệu tham khảo
Ayala, N., Mardanbegi, D., Duchowski, A., Niechwiej Szwedo, E., Cao, S., Kearns, S., & Irving, E. (2023). On the visibility of fiducial markers for mobile eye tracking. In: Proceedings of the 2023 symposium on eye tracking research and applications (pp. 1–7)
Aziz, S., Lohr, D. J., & Komogortsev, O. (2022). Synchroneyes: A novel, paired data set of eye movements recorded simultaneously with remote and wearable eye-tracking devices. In 2022 symposium on eye tracking research and applications (pp. 1–6)
Bahill, A. T., Brockenbrough, A., & Troost, B. T. (1981). Variability and development of a normative data base for saccadic eye movements. Investigative Ophthalmology & Visual Science, 21(1), 116–125.
Bahill, A. T., Kallman, J. S., & Lieberman, J. E. (1982, Aug 01). Frequency limitations of the two-point central difference differentiation algorithm. Biological Cybernetics, 45 (1), 1–4. Retrieved from https://doi.org/10.1007/BF00387207
Barabas, J., Goldstein, R. B., Apfelbaum, H., Woods, R. L., Giorgi, R. G., & Peli, E. (2004). Tracking the line of primary gaze in a walking simulator: Modeling and calibration. Behavior Research Methods, Instruments, & Computers, 36(4), 757–770.
Bartz, A. (1966). Eye and Head Movements in Peripheral Vision: Nature of Compensatory Eye Movements. Science, 152(3729), 1644–1645.
Bischof, W. F., Anderson, N. C., & Kingstone, A. (2023). Eye and head movements while encoding and recognizing panoramic scenes in virtual reality. Plos One, 18(2), e0282030.
Boulanger, M., Galiana, H. L., & Guitton, D. (2012). Human eye-head gaze shifts preserve their accuracy and spatiotemporal trajectory profiles despite long-duration torque perturbations that assist or oppose head motion. Journal Neurophysiol, 108(1), 39–56.
Burggraaf, R., van der Geest, J. N., Frens, M., & Hooge, I. T. C. (2018). Visual search accelerates during adolescence. Journal of Vision, 18(5), 3–3.
Ch’ng, S.-F., Sogi, N., Purkait, P., Chin, T.-J., & Fukui, K. (2020). Resolving marker pose ambiguity by robust rotation averaging with clique constraints. In: 2020 IEEE international conference on robotics and automation (icra) (pp. 9680-9686)
Clauser, C. E., McConville, J. T., & Young, J. W. (1969). Weight, volume, and center of mass of segments of the human body (Tech Rep). Anti-och Coll Yellow Springs OH
Collewijn, H. (2001). Interocular timing differences in the horizontal components of human saccades. Vision Research, 41(25–26), 3413–3423.
Collewijn, H., Erkelens, C. J., & Steinman, R. M. (1988). Binocular co-ordination of human horizontal saccadic eye movements. The journal of Physiology, 404(1), 157–182. https://doi.org/10.1113/jphys-iol.1988.sp017284
Collewijn, H., Steinman, R. M., Erkelens, C. J., Pizlo, Z., & Van Der Steen, J. (1992). Effect of freeing the head on eye movement characteristics during three-dimensional shifts of gaze and tracking. The head-neck sensory motor system, 412–418
Collewijn, H., Van der Mark, F., & Jansen, T. (1975). Precise recording of human eye movements. Vision research
Collewijn, H., Van der Steen, J., Ferman, L., & Jansen, T. (1985). Human ocular counterroll: Assessment of static and dynamic properties from electromagnetic scleral coil recordings. Experimental Brain Research, 59, 185–196.
Doshi, A., & Trivedi, M. M. (2009). On the roles of eye gaze and head dynamics in predicting driver’s intent to change lanes. IEEE Transactions on Intelligent Transportation Systems, 10(3), 453–462.
Dunn, M. J., Alexander, R. G., Amiebenomo, O. M.,Arblaster, G., Atan, D., Erichsen, J. T., . . . Sprenger, A. (2023). Minimal reporting guideline for research involving eye tracking (2023 edition). Behavior Research Methods
Epelboim, J., Kowler, E., Edwards, M., Collewijn, H., Erkelens, C. J., Pizlo, Z., & Steinman, R. M (2019). Natural oculomotor performance in looking and tapping tasks. In: Proceedings of the sixteenth annual conference of the cognitive science society: Atlanta, Georgia, 1994 (p. 272)
Epelboim, J., Steinman, R. M., Kowler, E., Edwards, M., Pizlo, Z., Erkelens, C. J., & Collewijn, H. (1995). The function of visual search and memory in sequential looking tasks. Vision Research, 35(23–24), 3401–3422.
Epelboim, J., Steinman, R. M., Kowler, E., Pizlo, Z., Erkelens, C. J., & Collewijn, H. (1997). Gaze-shift dynamics in two kinds of sequential looking tasks. Vision Research, 37(18), 2597–2607.
Evinger, C., Manning, K. A., Pellegrini, J. J., Basso, M. A., Powers, A. S., & Sibony, P. A. (1994). Not looking while leaping: The linkage of blinking and saccadic gaze shifts. Experimental Brain Research, 100, 337–344.
Fang, Y., Nakashima, R., Matsumiya, K., Kuriki, I., & Shioiri, S. (2015). Eye-head coordination for visual cognitive processing. PloS One, 10(3), e0121035.
Freedman, E. G. (2008). Coordination of the eyes and head during visual orienting. Exp Brain Res, 190, 369–387.
Fuller, J. H. (1992). Head movement propensity. Exp Brain Res, 92, 152–164.
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., & Marín-Jiménez, M. J. (2014). Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition, 47(6), 2280–2292.
Goossens, H. H. L. M., & van Opstal, A. J. (1997). Human eye-head coordination in two dimensions under different sensorimotor conditions. Exp Brain Res, 114, 542–560.
Gresty, M. A. (1973). The relationship between head and eye movements. Agressologie, 14A, 7–10.
Guitton, D., & Volle, M. (1987). Gaze control in humans: eye-head coordination during orienting movements to targets within and beyond the oculomotor range. Journal Neurophysiol, 58, 427–459.
Harrington, D. (1981). The Visual Fields: A Textbook and Atlas of Clinical Perimetry
Hayhoe, M. M., Shrivastava, A., Mruczek, R., & Pelz, J. B. (2003). Visual memory and motor planning in a natural task. Journal of vision, 3(1), 6–6.
Hessels, R. S., Hooge, I. T. C., & Kemner, C. (2016). An in-depth look at saccadic search in infancy. Journal of Vision, 16(8), 10–10.
Hessels, R. S., Niehorster, D. C., Nyström, M., Andersson, R., & Hooge, I. T. C. (2018). Is the eye-movement field confused about fixations and saccades? A survey among 124 researchers. Royal Society Open Science, 5(8), 180502. https://doi.org/10.1098/rsos.180502
Hessels, R. S., Teunisse, M., Niehorster, D. N., Nyström, M., Benjamins, J. S., Senju, A., & Hooge, I. T. C. (2023). Task-related gaze behavior in face-to-face dyadic collaboration: Toward an interactive theory? Visual Cognition, 31(4), 291–313
Hessels, R. S., van Doorn, A. J., Benjamins, J. S., Holleman, G. A., & Hooge, I. T. C. (2020). Task-related gaze control in human crowd navigation. Attention, Perception, & Psychophysics, 82, 2482–2501.
Hooge, I. T. C., & Erkelens, C. J. (1996). Control of fixation duration in a simple search task. Perception & Psychophysics, 58, 969–976.
Hooge, I. T. C., & Erkelens, C. J. (1999). Peripheral vision and oculomotor control during visual search. Vision Research, 39(8), 1567–1575.
Hooge, I. T. C., Niehorster, D. C., Hessels, R. S., Benjamins, J. S., & Nyström, M. (2022). How robust are wearable eye trackers to slow and fast head and body movements? Behavior Research Methods, 1–15
Hooge, I. T. C., Niehorster, D. C., Hessels, R. S., Cleveland, D., & Nyström, M. (2021). The pupil-size artefact (PSA) across time, viewing direction, and different eye trackers. Behavior Research Methods. https://doi.org/10.3758/s13428-020-01512-2
Hooge, I. T. C., Niehorster, D. C., Nyström, M., Andersson, R., & Hessels, R. S. (2018). Is human classification by experienced untrained observers a gold standard in fixation detection? Behavior Research Methods, 50, 1864–1881.
Hutton, S. B. (2019). Eye tracking methodology (pp. 277–308). Eye movement research: An introduction to its scientific foundations and applications.
Kalaitzakis, M., Cain, B., Carroll, S., Ambrosi, A., Whitehead, C., & Vitzilaios, N. (2021). Fiducial markers for pose estimation: Overview, applications and experimental comparison of the artag, apriltag, aruco and stag markers. Journal of Intelligent & Robotic Systems, 101, 1–26.
Kasai, R., & Zee, D. S. (1978). Eye-head coordination in labyrinthine defective human beings. Brain Res, 144, 123–141.
Kishita, Y., Ueda, H., & Kashino, M. (2020). Eye and head movements of elite baseball players in real batting. Frontiers in Sports and Active Living, 2, 3.
Kothari, R., Yang, Z., Kanan, C., Bailey, R., Pelz, J. B., & Diaz, G. J. (2020). Gaze-in-wild: A dataset for studying eye and head coordination in everyday activities. Scientific Reports, 10(1), 2539.
Kowler, E., Pizlo, Z., Zhu, G.-L., Erkelens, C. J., Steinman, R. M., & Collewijn, H. (1992). Coordination of head and eyes during the performance of natural (and unnatural) visual tasks. The head-neck sensory motor system, 419–426
Land, M. F. (2004). The coordination of rotations of the eyes, head and trunk in saccadic turns produced in natural situations. Exp Brain Res, 159, 151–160.
Land, M. F., & Hayhoe, M. (2001). In what ways do eye movements contribute to everyday activities? Vision research, 41(25–26), 3559–3565.
Land, M. F., Mennie, N., & Rusted, J. (1999). The roles of vision and eye movements in the control of activities of daily living. Perception, 28(11), 1311–1328.
Land, M. F., & Tatler, B. W. (2001). Steering with the head: The visual strategy of a racing driver. Current Biology, 11(15), 1215–1220.
Macdonald, R. G., & Tatler, B. W. (2018). Gaze in a real-world social interaction: A dual eye-tracking study. Quarterly Journal of Experimental Psychology, 71(10), 2162–2173.
Malpeli, J. G. (1998). Measuring eye position with the double magnetic induction method. Journal of Neuroscience Methods, 86(1), 55–61.
Matthis, J. S., Yates, J. L., & Hayhoe, M. M. (2018). Gaze and the control of foot placement when walking in natural terrain. Current Biology, 28(8), 1224–1233.
Morasso, P., Bizzi, E., & Dichgans, J. (1973). Adjustment of saccade characteristics during head movements. Exp Brain Res, 16, 492–500.
Moschner, C., & Zangemeister, W. (1993). Preview control of gaze saccades: efficacy of prediction modulates eye-head interaction during human gaze saccades. Neurological Research, 15(6), 417–432.
Nazarahari, M., & Rouhani, H. (2021). 40 years of sensor fusion for orientation tracking via magnetic and inertial measurement units: Methods, lessons learned, and future challenges. Information Fusion, 68, 67–84.
Niehorster, D. C., Li, L., & Lappe, M. (2017). The accuracy and precision of position and orientation tracking in the htc vive virtual reality system for scientific research. i Perception, 8 (3), 2041669517708205. https://doi.org/10.1177/2041669517708205
Nyström, M., Niehorster, D. C., Andersson, R., Hessels, R. S., & Hooge, I. T. (2023). The amplitude of small eye movements can be accurately estimated with video-based eye trackers. Behavior Research Methods, 55(2), 657–669.
Pelisson, D., Prablanc, C., & Urquizar, C. (1987). Vestibuloocular reflex inhibition and gaze saccade control characteristics during eye-head orientation in humans. Journal Neurophysiol, 59, 997–1013.
Poroykov, A., Kalugin, P., Shitov, S., & Lapitskaya, I. (2020). Modeling aruco markers images for accuracy analysis of their 3d pose estimation. In: 30th international conference on computer graphics and machine vision (graphicon 2020). part (vol. 2)
Radau, P., Tweed, D., & Vilis, T. (1994). Three-dimensional eye, head, and chest orientations after large gaze shifts and the underlying neural strategies. Journal Neurophysiol, 72(6), 2840–2852.
Sağlam, M., Lehnen, N., & Glasauer, S. (2011). Optimal control of natural eye-head movements minimizes the impact of noise. Journal Neurophysiol, 31, 16185–16193.
Sarkar, N. (2020). System and method for resonant eye-tracking. Google Patents. (US Patent 10,824,229)
Sidenmark, L., & Gellersen, H. (2019). Eye, head and torso coordination during gaze shifts in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI), 27(1), 1–40.
Simpson, M. J. (2017). Mini-review: Far peripheral vision. Vision research, 140, 96–105.
Spakov, O., Istance, H., Räihä, K.-J., Viitanen, T., & Siirtola, H. (2019). Eye gaze and head gaze in collaborative games. In: Proceedings of the 11th acm symposium on eye tracking research & applications (pp. 1–9)
Stahl, J. S. (1999). Amplitude of human head movements associated with horizontal saccades. Exp Brain Res, 126, 41–54.
Steinman, R. M. (1996). Moveo ergo video: natural retinal image motion and its effect on vision. In: Exploratory vision: the active eye (pp. 3–49) Springer
Strasburger, H. (2020). Seven myths on crowding and peripheral vision. i-Perception, 11 (3), 2041669520913052
Sugie, N., & Wakakuwa, M. (1970). Visual target tracking with active head rotation. IEEE Transactions on Systems Science and Cybernetics, 6(2), 103–109.
Sullivan, B., Ludwig, C. J., Damen, D., Mayol-Cuevas, W., & Gilchrist, I. D. (2021). Look-ahead fixations during visuomotor behavior: Evidence from assembling a camping tent. Journal of Vision, 21(3), 13–13.
Tomasi, M., Pundlik, S., Bowers, A. R., Peli, E., & Luo, G. (2016). Mobile gaze tracking system for out-door walking behavioral studies. Journal of Vision, 16(3), 27–27.
Tweed, D., Glenn, B., & Vilis, T. (1995). Eye-head coordination during large gaze shifts. Journal Neurophysiol, 73, 766–779.
Zangemeister, W. H., & Stark, L. (1982). Types of gaze movement: variable interactions of eye and head movements. Experimental Neurology, 77(3), 563–577.