Leveraging eye tracking to understand children’s attention during game-based, tangible robotics activities

Jennifer K. Olsen1, Arzu Guneysu Ozgur2,3, Kshitij Sharma4, Wafa Johal5
1Department of Computer Science, University of San Diego, 5998 Alcala Park, San Diego, CA 92110, United States of America
2CHILI Lab, Ecole Polytechnique Federale de Lausanne, EPFL IC IINFCOM CHILI, RLC D1 740 (Rolex Learning Center), Station 20, CH-1015, Lausanne, Switzerland
3KTH Royal Institute of Technology, Kungliga Tekniska Högskolan, SE-100 44 Stockholm Sweden
4Department of Computer Science, University of Science and Technology, IT-bygget, 142, Gløshaugen, Trondheim, Norway
5Faculty of Engineering, University of New South Wales, UNSW Sydney, NSW 2052, Australia

Tài liệu tham khảo

Abrahamson, 2015, Eye-tracking piaget: Capturing the emergence of attentional anchors in the coordination of proportional motor action, Human Development, 58, 218, 10.1159/000443153 Al-Shathri, 2013, Eye-controlled games for behavioral therapy of attention deficit disorders, 574 Bannert, 2014, Process mining techniques for analysing patterns and strategies in students’ self-regulated learning, Metacognition and Learning, 9, 161, 10.1007/s11409-013-9107-6 Bartoli, L., Garzotto, F., Gelsomini, M., Oliveto, L., & Valoriani, M. (2014). Designing and evaluating touchless playful interaction for asd children. In Proceedings of the 2014 conference on Interaction design and children (pp. 17–26). Beery, K. E. Beery vmi: The beery-buktenica developmental test of visualmotor integration. Minneapolis, MN: Pearson. Bekele, 2014, Pilot clinical application of an adaptive robotic system for young children with autism, Autism, 18, 598, 10.1177/1362361313479454 Bekele, 2013, Understanding how adolescents with autism respond to facial expressions in virtual reality environments, IEEE Transactions on Visualization and Computer Graphics, 19, 711, 10.1109/TVCG.2013.42 Boccanfuso, 2016, Emotional robot to examine different play patterns and affective responses of children with and without asd, 19 Cameron, 2016, How are motor skills linked to children’s school performance and academic achievement?, Child Development Perspectives, 10, 93, 10.1111/cdep.12168 Cassar, 2010, Investigating the effects of a game-based approach in teaching word recognition and spelling to students with reading disabilities and attention deficits, Australian Journal of Learning Difficulties, 15, 193, 10.1080/19404151003796516 Chen, 2019, Development and evaluation of a 3-d virtual pronunciation tutor for children with autism spectrum disorders, Plos One, 14, 10.1371/journal.pone.0210858 Conati, 2013, Understanding attention to adaptive hints in educational games: an eye-tracking study, International Journal of Artificial Intelligence in Education, 23, 136, 10.1007/s40593-013-0002-8 de Greef, 2013, Designing kinect games to train motor skills for mixed ability players, 197 Dowthwaite, L., Creswick, H., Portillo, V., Zhao, J., Patel, M., & Vallejos, E. P., et al. (2020). it’s your private information. it’s your life. young people’s views of personal data use by online technologies. In Proceedings of the interaction design and children conference (pp. 121–134). Duchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., & Kiefer, P., et al. (2018). The index of pupillary activity: Measuring cognitive load vis-‘a-vis task difficulty with pupil oscillation. In Proceedingsof the 2018 CHI conference on human factors in computing systems (pp. 1–13). Edwards, 2017, Does playing a sports active video game improve object control skills of children with autism spectrum disorder?, Journal of Sport and Health Science, 6, 17, 10.1016/j.jshs.2016.09.004 Fabiano, 2009, A meta-analysis of behavioral treatments for attention-deficit/hyperactivity disorder, Clinical Psychology Review, 29, 129, 10.1016/j.cpr.2008.11.001 Frutos-Pascual, 2015, Assessing visual attention using eyetracking sensors in intelligent cognitive therapies based on serious games, Sensors, 15, 11092, 10.3390/s150511092 Frutos-Pascual, 2014, Adaptive tele-therapies based on serious games for health for people with time-management and organisational problems: preliminary results, International Journal of Environmental Research and Public Health, 11, 749, 10.3390/ijerph110100749 Gallagher, 2013, The devil is in the distribution: Refining an act-r model of a continuous motor task Goodwin, 2008, Enhancing and accelerating the pace of autism research and treatment: The promise of developing innovative technology, Focus on Autism and other Developmental Disabilities, 23, 125, 10.1177/1088357608316678 Grant, 2003, Eye movements and problem solving: Guiding attention guides thought, Psychological Science, 14, 462, 10.1111/1467-9280.02454 Guneysu, 2014, Auto-evaluation of motion imitation in a child-robot imitation game for upper arm rehabilitation, 199 Guneysu Ozgur, 2020, Iterative design and evaluation of a tangible robot-assisted handwriting activity for special education, Frontiers in Robotics and AI, 7, 29, 10.3389/frobt.2020.00029 Guneysu Ozgur, 2020, Iterative design and evaluation of a tangible robot-assisted handwriting activity for special education, Frontiers in Robotics and AI, 7, 29, 10.3389/frobt.2020.00029 Guneysu Ozgur, 2018, Iterative design of an upper limb rehabilitation game with tangible robots, 241 Guneysu Ozgur, 2020, Gamified motor training with tangible robots in older adults: a feasibility study and comparison with the young, Frontiers in aging neuroscience, 12 Gun̈ther, 2007, Fuzzy mining–adaptive process simplification based on multi-perspective metrics, 328 Harbluk, 2007, An on-road assessment of cognitive distraction: Impacts on drivers’ visual behavior and braking performance, Accident Analysis and Prevention, 39, 372, 10.1016/j.aap.2006.08.013 Hart, 1988, Development of nasa-tlx (task load index):Results of empirical and theoretical research, 139, 10.1016/S0166-4115(08)62386-9 Hostettler, 2016, Real-time high-accuracy 2d localization with structured patterns, 4536 Hsu, 2011, The potential of kinect in education, International Journal of Information and Education Technology, 1, 365, 10.7763/IJIET.2011.V1.59 2015, 230 Johal, 2016, Child-robot spatial arrangement in a learning by teaching activity, 533 Kaiser, 2016, Design and learnability of vortex whistles for managing chronic lung function via smartphones, 569 Kaller, 2009, Eye movements and visuospatial problem solving: Identifying separable phases of complex cognition, Psychophysiology, 46, 818, 10.1111/j.1469-8986.2009.00821.x Kawas, S., Yuan, Y., DeWitt, A., Jin, Q., Kirchner, S., & Bilger, A., et al. (2020). Another decade of idc research: Examining and reflecting on values and ethics. In Proceedings of the interaction design and children conference (pp. 205–215). Knoblich, 2001, An eye movement study of insight problem solving, Memory & Cognition, 29, 1000, 10.3758/BF03195762 Kosmas, 2017, Using embodied learning technology to advance motor performance of children with special educational needs and motor impairments, 111 Kosmas, 2018, Moving bodies to moving minds: A study of the use of motion-based games in special education, TechTrends, 62, 594, 10.1007/s11528-018-0294-5 Kourakli, 2017, Towards the improvement of the cognitive, motoric and academic skills of students with special educational needs using kinect learning games, International Journal of Child-Computer Interaction, 11, 28, 10.1016/j.ijcci.2016.10.009 Lemaignan, 2016, From real-time attention assessment to with-me-ness in human–robot interaction, 157 Lemaignan, 2016, Learning by teaching a robot: The case of handwriting, IEEE Robotics & Automation Magazine, 23, 56, 10.1109/MRA.2016.2546700 Malik, 2014, Development of imitation learning through physical therapy using a humanoid robot, Procedia Computer Science, 42, 191, 10.1016/j.procs.2014.11.051 Malinverni, L., Mora, J., Padillo, V., Hervas, A., & Pares, N. (2014). Pico? s adventure: A kinect game to promote social initiation in children with autism spectrum disorder. In Proceedings of the ITASD international conference (IDC’16). Markopoulos, 2021, Design of digital technolo915 gies for children Matarić, 2007, Socially assistive robotics for post-stroke rehabilitation, Journal of Neuro Engineering and Rehabilitation, 4, 5, 10.1186/1743-0003-4-5 McClelland, 2015, Enhanced academic performance using a novel classroom physical activity intervention to increase awareness, attention and self-control: putting embodied cognition into practice, Improving Schools, 18, 83, 10.1177/1365480214562125 Neto, I., Johal, W., Couto, M., Nicolau, H., Paiva, A., & Guneysu, A. (2020). Using tabletop robots to promote inclusive classroom experiences. In Proceedings of the interaction design and children conference (pp. 281–292). Ozgur̈, 2018 Paas, 2003, Cognitive load measurement as a means to advance cognitive load theory, Educational Psychologist, 38, 63, 10.1207/S15326985EP3801_8 Pagani, 2012, Links between motor skills and indicators of school readiness at kindergarten entry in urban disadvantaged children, Journal of Educational and Developmental Psychology, 2, 95, 10.5539/jedp.v2n1p95 Palinko, 2016, Robot reading human gaze: Why eye tracking is better than head tracking for human–robot collaboration, 5048 Petko, 2020, Pacing in serious games: Exploring theeffects of presentation speed on cognitive load, engagement and learning gains, Simulation & Gaming, 51, 258, 10.1177/1046878120902502 Prieto, 2017, Orchestration load indicators and patterns: In-the-wild studies using mobile eye-tracking, IEEE Transactions on Learning Technologies, 216 Qian, 2016, Game-based learning and 21st century skills: A review of recent research, Computers in Human Behavior, 63, 50, 10.1016/j.chb.2016.05.023 Rabiner, 2016, Attention problems and academic achievement: Do persistent and earlier-emerging problems have more adverse long-term effects?, Journal of Attention Disorders, 20, 946, 10.1177/1087054713507974 Reimann, 2009, Time is precious: Variable-and event-centred approachesto process analysis in cscl research, International Journal of Computer-Supported Collaborative Learning, 4, 239, 10.1007/s11412-009-9070-z Reimann, 2013, Using process mining for understanding learning, 472 Reingold, 2001, Visual span inexpert chess players: Evidence from eye movements, Psychological Science, 12, 48, 10.1111/1467-9280.00309 Renshaw, T., Stevens, R., & Denton, P. D. Towards understanding engagement in games: an eye-tracking study. On the Horizon. Romero, 2010 Rubin, 2007, Process mining framework for software processes, 169 Salvucci, D. D., & Goldberg, J. H. (2000). Identifying fixations and saccades in eyetracking protocols. In Proceedings of the 2000 symposium on Eye trackingresearch & applications (pp. 71–78). Sansone, 2000, Interest and self-regulation: The relation between having to and wanting to, 341 Schadenberg, 2017, Personalising game difficulty to keep children motivated to play with a social robot: A bayesian approach, Cognitive Systems Research, 43, 222, 10.1016/j.cogsys.2016.08.003 Schleicher, 2008, Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?, Ergonomics, 51, 982, 10.1080/00140130701817062 Sharma, 2021, Sensing technologies and childcomputer interaction: Opportunities, challenges and ethical considerations, International Journal of Child Computer Interaction, 10.1016/j.ijcci.2021.100331 Shattuck, 2012, Postsecondary education and employment among youth with an autism spectrum disorder, Pediatrics, 129, 1042, 10.1542/peds.2011-2864 Stern, 1994, Blink rate: a possible measure of fatigue, Human Factors, 36, 285, 10.1177/001872089403600209 Thomas, 2007, Moving eyes and moving thought: On the spatial compatibility between eye movements and cognition, Psychonomic Bulletin & Review, 14, 663, 10.3758/BF03196818 Trcka, 2010, Process mining from educational data, 123 Van Gog, 2011, Effects of concurrent monitoring on cognitive load and performance as a function of task complexity, Applied Cognitive Psychology, 25, 584, 10.1002/acp.1726 Van Mechelen, M., Baykal, G. E., Dindler, C., Eriksson, E., & Iversen, O. S. (2020). 18 years of ethics in child-computer interaction research: a systematic literature review. In Proceedings of the interaction design and children conference (pp. 161–183). Van Merrienboer, 2002, Redirecting learners’ attention during training: Effects on cognitive load, transfer test performance and training efficiency, Learning and Instruction, 12, 11, 10.1016/S0959-4752(01)00020-2 Wang, Q., Celebi, F. M., Flink, L., Greco, G., Wall, C., & Prince, E., et al. (2015). Interactive eye tracking for gaze strategy modification. In Proceedings of the 14th international conference on interaction design and children (pp. 247–250). Wilson, 2002, Six views of embodied cognition, Psychonomic Bulletin & Review, 9, 625, 10.3758/BF03196322 Wilson, 2013, The mediating role of social skills in the relationship between motor ability and internalizing symptoms in pre-primary children, Infant and Child Development, 22, 151, 10.1002/icd.1773 Yannakakis, 2009, Real-time game adaptation for optimizingplayer satisfaction, IEEE Transactions on Computational Intelligence and AI in Games, 1, 121, 10.1109/TCIAIG.2009.2024533