Investigating gaze interaction to support children’s gameplay

Akkil, 2017, Little bear–a gaze aware learning companion for early childhood learners, 415 Akkil, 2017, Gaze awareness in agent-based early-childhood learning application, 447 Amos, 2016, Openface: A general-purpose face recognition library with mobile applications, CMU School of Computer Science, 6, 2 Barrett, 2019, Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements, Psychological Science in the Public Interest, 20, 1, 10.1177/1529100619832930 Bates, R., & Istance, H. (2002). Zooming interfaces! Enhancing the performance of eye controlled pointing devices. In Proceedings of the fifth international ACM conference on assistive technologies (pp. 119–126). Bednarik, 2009 Besançon, L., Issartel, P., Ammi, M., & Isenberg, T. (2017). Mouse, tactile, and tangible input for 3D manipulation. In Proceedings of the 2017 CHI conference on human factors in computing systems (pp. 4727–4740). Blanco-Ruiz, 2020, Emotion elicitation under audiovisual stimuli reception: Should artificial intelligence consider the gender perspective?, International Journal of Environmental Research and Public Health, 17, 8534, 10.3390/ijerph17228534 Cherney, 2008, Sex differences in Nintendo Wii™ performance as expected from hunter-gatherer selection, Psychological Reports, 102, 745, 10.2466/pr0.102.3.745-754 Cockburn, A., Kristensson, P. O., Alexander, J., & Zhai, S. (2007). Hard lessons: Effort-inducing interfaces benefit spatial learning. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1571–1580). Cowie, 2003, Describing the emotional states that are expressed in speech, Speech Communication, 40, 5, 10.1016/S0167-6393(02)00071-7 Crescenzi-Lanna, 2020, Multimodal learning analytics research with young children: A systematic review, British Journal of Educational Technology, 51, 1485, 10.1111/bjet.12959 Dalgleish, 2000 Dorr, M., Böhme, M., Martinetz, T., & Barth, E. (2007). Gaze beats mouse: A case study. In Proceedings of COGAIN (pp. 16–19). Ekman, 2002, 77 Frutos-Pascual, 2015, Assessing visual attention using eye tracking sensors in intelligent cognitive therapies based on serious games, Sensors, 15, 11092, 10.3390/s150511092 Fuld, 2018, Autism spectrum disorder: The impact of stressful and traumatic life events and implications for clinical practice, Clinical Social Work Journal, 46, 210, 10.1007/s10615-018-0649-6 Giannakos, 2013, Enjoy and learn with educational games: Examining factors affecting learning performance, Computers & Education, 68, 429, 10.1016/j.compedu.2013.06.005 Giannakos, 2020, Monitoring children’s learning through wearable eye-tracking: The case of a making-based coding activity, IEEE Pervasive Computing, 2020, 12 Goodwin, 2019, Predicting aggression to others in youth with autism using a wearable biosensor, Autism Research, 12, 1286, 10.1002/aur.2151 Gowases, 2008 Gunes, 2010, Automatic, dimensional and continuous emotion recognition, International Journal of Synthetic Emotions (IJSE), 1, 68, 10.4018/jse.2010101605 Hall, 2016, Five degrees of happiness: Effective smiley face likert scales for evaluating with children, 311 Harada, 2002, Cold-stress tests involving finger skin temperature measurement for evaluation of vascular disorders in hand-arm vibration syndrome: Review of the literature, International Archives of Occupational and Environmental Health, 75, 14, 10.1007/s004200100273 Harley, 2019, Emotion regulation tendencies, achievement emotions, and physiological arousal in a medical diagnostic reasoning simulation, Instructional Science, 47, 151, 10.1007/s11251-018-09480-z Heaven, 2020, Why faces don’t always tell the truth about feelings, Nature, 578, 502, 10.1038/d41586-020-00507-5 Heidrich, F., Ziefle, M., Röcker, C., & Borchers, J. (2011). Interacting with smart walls: A multi-dimensional analysis of input technologies for augmented environments. In Proceedings of the 2nd Augmented Human International Conference (pp. 1–8). Herborn, 2015, Skin temperature reveals the intensity of acute stress, Physiology & Behavior, 152, 225, 10.1016/j.physbeh.2015.09.032 Holz, 2021, Interaction styles in context: Comparing drag-and-drop, point-and-touch, and touch in a mobile spelling game, International Journal of Human–Computer Interaction, 1 Hopp, 2017, Examination of the relationship between gender, performance, and enjoyment of a first-person shooter game, Simulation & Gaming, 48, 338, 10.1177/1046878117693397 Hornbæk, 2013, Some whys and hows of experiments in human–computer interaction, Foundations and Trends in Human-Computer Interaction, 5, 299 Hornof, A. J., & Cavender, A. (2005). EyeDraw: Enabling children with severe motor impairments to draw with their eyes. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 161–170). Hourcade, J. P. (2015). Child-computer interaction. Self, Iowa City, Iowa. Inkpen, 2001, Drag-and-drop versus point-and-click mouse interaction styles for children, ACM Transactions on Computer-Human Interaction, 8, 1, 10.1145/371127.371146 Isokoski, P., Hyrskykari, A., Kotkaluoto, S., & Martin, B. (2007). Gamepad and eye tracker input in FPS games: Data for the first 50 min. In Proc. of the 3rd conference on communication by gaze interaction (pp. 78–81). Isokoski, 2009, Gaze controlled games, Universal Access in the Information Society, 8, 323, 10.1007/s10209-009-0146-3 Isokoski, P., & Martin, B. (2006). Eye tracker input in first person shooter games. In Proceedings of the 2nd conference on communication by gaze interaction: Communication by gaze interaction: Gazing into the future (pp. 78–81). Istance, 2009, For your eyes only: Controlling 3d online games by eye-gaze, 314 Jacob, R. J. (1990). What you look at is what you get: Eye movement-based interaction techniques. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 11–18). Jacob, 2003, Eye tracking in human–computer interaction and usability research: Ready to deliver the promises, 573 Jacob, 2016, What you look at is what you get: Gaze-based user interfaces, Interactions, 23, 62, 10.1145/2978577 Jeno, 2019, Testing the novelty effect of an m-learning tool on internalization and achievement: A Self-Determination Theory approach, Computers & Education, 128, 398, 10.1016/j.compedu.2018.10.008 Jimenez, 2008, Gaze-based interaction for virtual environments, Journal of Universal Computer Science, 14, 3085 Koch, 2018, The novelty effect in large display deployments–Experiences and lessons-learned for evaluating prototypes Kourakli, 2017, Towards the improvement of the cognitive, motoric and academic skills of students with special educational needs using kinect learning games, International Journal of Child-Computer Interaction, 11, 28, 10.1016/j.ijcci.2016.10.009 Lankes, M., Newn, J., Maurer, B., Velloso, E., Dechant, M., & Gellersen, H. (2018). EyePlay revisited: Past, present and future challenges for eye-based interaction in games. In Proceedings of the 2018 annual symposium on computer-human interaction in play companion extended abstracts (pp. 689–693). Lankes, 2016, GazeAR: Mobile gaze-based interaction in the context of augmented reality games, 397 Lazar, 2017 Leiner, 2012, EDA positive change: A simple algorithm for electrodermal activity to measure general audience arousal during media exposure, Communication Methods and Measures, 6, 237, 10.1080/19312458.2012.732627 Leite, 2009, As time goes by: Long-term evaluation of social presence in robotic companions, 669 Lieberman, 2009, Digital games for young children ages three to six: From research to design, Computers in the Schools, 26, 299, 10.1080/07380560903360178 Lu, 1992, Mastering the machine: A comparison of the mouse and touch screen for children’s use of computers, 417 MacKenzie, I. S., Kauppinen, T., & Silfverberg, M. (2001). Accuracy measures for evaluating computer pointing devices. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 9–16). Majaranta, 2014, Eye tracking and eye-based human–computer interaction, 39 Markopoulos, 2021, Design of digital technologies for children Maurer, 2018, Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games, Entertainment Computing, 27, 47, 10.1016/j.entcom.2018.02.009 McKnight, L., & Fitton, D. (2010). Touch-screen technology for children: giving the right instructions and getting the right responses. In Proceedings of the 9th international conference on interaction design and children (pp. 238–241). Munoz, 2011, Towards gaze-controlled platform games, 47 Nacke, 2010 Nacke, 2011, LAIF: A logging and interaction framework for gaze-based interfaces in virtual entertainment environments, Entertainment Computing, 2, 265, 10.1016/j.entcom.2010.09.004 Neumann, 2014, Touch screen tablets and emergent literacy, Early Childhood Education Journal, 42, 231, 10.1007/s10643-013-0608-3 Nielsen, A. M., Petersen, A. L., & Hansen, J. P. (2012). Gaming with gaze and losing with a smile. In Proceedings of the symposium on eye tracking research and applications (pp. 365–368). Nizam, 2021, Derivation of young children’s interaction strategies with digital educational games from gaze sequences analysis, International Journal of Human-Computer Studies, 146 Noroozi, 2019, Multimodal data to design visual learning analytics for understanding regulation of learning, Computers in Human Behavior, 100, 298, 10.1016/j.chb.2018.12.019 O’Donovan, J., Ward, J., Hodgins, S., & Sundstedt, V. (2009). Rabbit run: Gaze and voice based game interaction. In Eurographics ireland workshop. Orlov, 2015, The effectiveness of gaze-contingent control in computer games, Perception, 44, 1136, 10.1177/0301006615594910 Orlov, P., & Gorshkova, K. (2016). Gaze-based interactive comics. In Proceedings of the 9th nordic conference on human-computer interaction (pp 1–6). Ouherrou, 2019, Comparative study on emotions analysis from facial expressions in children with and without learning disabilities in virtual learning environment, Education and Information Technologies, 24, 1777, 10.1007/s10639-018-09852-5 Pai, 2019, Assessing hands-free interactions for VR using eye gaze and electromyography, Virtual Reality, 23, 119, 10.1007/s10055-018-0371-2 Papamitsiou, 2020, Utilizing multimodal data through fsQCA to explain engagement in adaptive learning, IEEE Transactions on Learning Technologies, 10.1109/TLT.2020.3020499 Papavlasopoulou, 2017, Empirical studies on the Maker Movement, a promising approach to learning: A literature review, Entertainment Computing, 18, 57, 10.1016/j.entcom.2016.09.002 Pappas, 2021, Fuzzy-set qualitative comparative analysis (fsQCA): Guidelines for research practice in information systems and marketing, International Journal of Information Management, 58, 10.1016/j.ijinfomgt.2021.102310 Pérez-Espinosa, 2018, Analyzing children’s affective reactions and preferences towards social robots using paralinguistic and self-reported information, Journal of Intelligent & Fuzzy Systems, 34, 3313, 10.3233/JIFS-169513 Pfeuffer, K., Alexander, J., & Gellersen, H. (2016). GazeArchers: Playing with individual and shared attention in a two-player look & shoot tabletop game. In Proceedings of the 15th international conference on mobile and ubiquitous multimedia (pp. 213–216). Picard, 2016, Multiple arousal theory and daily-life electrodermal activity asymmetry, Emotion Review, 8, 62, 10.1177/1754073914565517 Rahman, 2015, IOT enabled sensor in multimodal intelligent applications for children with special needs, 352 Ramirez Gomez, A., & Gellersen, H. (2019). Looking outside the box: Reflecting on gaze interaction in gameplay. In Proceedings of the annual symposium on computer-human interaction in play (pp. 625–637). Reimann, 2014, e-R esearch and learning theory: What do sequence and process mining methods contribute?, British Journal of Educational Technology, 45, 528, 10.1111/bjet.12146 Romeo, 2003, Touching the screen: Issues related to the use of touchscreen technology in early childhood education, British Journal of Educational Technology, 34, 329, 10.1111/1467-8535.00330 Royston, 1982, An extension of Shapiro and Wilk’s W test for normality to large samples, Journal of the Royal Statistical Society. Series C. Applied Statistics, 31, 115 Sharma, 2020, Multimodal data capabilities for learning: What can multimodal data tell us about learning?, British Journal of Educational Technology, 51, 1450, 10.1111/bjet.12993 Sharma, 2019, Joint emotional state of children and perceived collaborative experience in coding activities, 133 Sibert, L. E., & Jacob, R. J. (2000). Evaluation of eye gaze interaction. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 281–288). Sidenmark, L., & Gellersen, H. (2019). Eye & head: Synergetic eye and head movement for gaze pointing and selection. In Proceedings of the 32nd annual ACM symposium on user interface software and technology (pp. 1161–1174). Skovsgaard, H., Mateo, J. C., Flach, J. M., & Hansen, J. P. (2010). Small-target selection with gaze alone. In Proceedings of the 2010 symposium on eye-tracking research & applications (pp. 145–148). Smith, J. D., & Graham, T. N. (2006). Use of eye movements for video game control. In Proceedings of the 2006 ACM SIGCHI international conference on advances in computer entertainment technology (pp. 20-es). Stellmach, S., & Dachselt, R. (2012). Look & touch: Gaze-supported target acquisition. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 2981–2990). Tkalčič, 2012, Emotion-aware recommender systems–a framework and a case study, 141 Tsai, T.-W., Lo, H. Y., & Chen, K.-S. (2012). An affective computing approach to develop the game-based adaptive learning material for the elementary students. In Proceedings of the 2012 joint international conference on human-centered computer environments (pp. 8–13). Tsay, 2020, Overcoming the novelty effect in online gamified learning systems: An empirical evaluation of student engagement and performance, Journal of Computer Assisted Learning, 36, 128, 10.1111/jcal.12385 Turner, J., Velloso, E., Gellersen, H., & Sundstedt, V. (2014). EyePlay: Applications for gaze in games. In Proceedings of the first ACM SIGCHI annual symposium on computer-human interaction in play (pp. 465–468). Uludağli, 2018, User interaction in hands-free gaming: A comparative study of gaze-voice and touchscreen interface control, Turkish Journal Electrical Engineering and Computer Sciences, 26, 1967, 10.3906/elk-1710-128 Van Den Bosch, 2013, Familiarity mediates the relationship between emotional arousal and pleasure during music listening, Frontiers in Human Neuroscience, 7, 534, 10.3389/fnhum.2013.00534 Velloso, E., & Carter, M. (2016). The emergence of eyeplay: A survey of eye interaction in games. In Proceedings of the 2016 annual symposium on computer-human interaction in play (pp. 171–185). Velloso, E., Oechsner, C., Sachmann, K., Wirth, M., & Gellersen, H. (2015). Arcade+ a platform for public deployment and evaluation of multi-modal games. In Proceedings of the 2015 annual symposium on computer-human interaction in play (pp. 271–275). Venkatesh, 2002, User acceptance enablers in individual decision making about technology: Toward an integrated model, Decision Sciences, 33, 297, 10.1111/j.1540-5915.2002.tb01646.x Vickers, S., Istance, H., & Smalley, M. (2010). EyeGuitar: Making rhythm based music video games accessible using only eye movements. In Proceedings of the 7th international conference on advances in computer entertainment technology (pp. 36–39). Vidal, M., Bulling, A., & Gellersen, H. (2013). Pursuits: Spontaneous interaction with displays based on smooth pursuit eye movement and moving targets. In Proceedings of the 2013 ACM international joint conference on pervasive and ubiquitous computing (pp. 439–448). Špakov, 2005, EyeChess: The tutoring game with visual attentive interface, Alternative Access: Feelings & Games, 5 Wang, 2019, Design and implementation of children’s games based on mixed reality, 176 Welch, 1951, On the comparison of several mean values: an alternative approach, Biometrika, 38, 330, 10.1093/biomet/38.3-4.330 Wetzel, S., Spiel, K., & Bertel, S. (2014). Dynamically adapting an AI game engine based on players’ eye movements and strategies. In Proceedings of the 2014 ACM SIGCHI symposium on engineering interactive computing systems (pp. 3–12). Zhai, S., Morimoto, C., & Ihde, S. (1999). Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 246–253).