Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study

Ognjen Rudovic1, Jaeryoung Lee2, Lea Mascarell-Maricic3, Björn Schüller4,5, Rosalind W. Picard1
1MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
2Department of Robotic Science and Technology, Chubu University, Kasugai, Japan
3Laboratory X, Je Klinik fur Psychiatrie and Psychotherapy, Charite Universitatsmedizin, Berlin, Germany
4Chair of Complex and Intelligent Systems, Universität Passau, Passau, Germany
5Department of Computing, Imperial College London, London, United Kingdom

Tóm tắt

Từ khóa


Tài liệu tham khảo

Adolph, 2010, Valence and arousal: a comparison of two sets of emotional facial expressions, Am. J. Psychol., 123, 209, 10.5406/amerjpsyc.123.2.0209

An, 2017, Two sides of emotion: exploring positivity and negativity in six basic emotions across cultures, Front. Psychol., 8, 610, 10.3389/fpsyg.2017.00610

Anzalone, 2015, Evaluating the engagement with social robots, Int. J. Soc. Robot., 7, 465, 10.1007/s12369-015-0298-7

Appleton, 2006, Measuring cognitive and psychological engagement: validation of the student engagement instrument, J. Sch. Psychol., 44, 427, 10.1016/j.jsp.2006.04.002

Baird, 2001, Screening and surveillance for autism and pervasive developmental disorders, Arch. Dis. Child., 84, 468, 10.1136/adc.84.6.468

Baron-Cohen, 1985, Does the autistic child have a “theory of mind”?, Cognition, 21, 37, 10.1016/0010-0277(85)90022-8

Belpaeme, 2013, Multimodal child-robot interaction: building social bonds, J. Hum. Robot Interact., 1, 33, 10.5898/JHRI.1.2.Belpaeme

Breazeal, 2001, “Affective interaction between humans and robots,”, Advances in Artificial Life, 582, 10.1007/3-540-44811-X_66

Breazeal, 2003, Emotion and sociable humanoid robots, Int. J. Hum. Comput. Stud., 59, 119, 10.1016/S1071-5819(03)00018-1

Breazeal, 2004, Designing Sociable Robots, 10.7551/mitpress/2376.001.0001

Brewer, 2016, Can neurotypical individuals read autistic facial expressions? atypical production of emotional facial expressions in autism spectrum disorders, Autism Res., 9, 262, 10.1002/aur.1508

Broughton, 2008, “Continuous self-report of engagement to live solo marimba performance,”, 366

Buckley, 2004, Affective Engagement: A Person-Centered Approach to Understanding the Structure of Subjective Learning Experiences, 1

Carmines, 1979, Reliability and Validity Assessment, 17, 10.4135/9781412985642.n2

Cascio, 2015, Cross-cultural autism studies, neurodiversity, and conceptualizations of autism, Cult. Med. Psychiatry, 39, 207, 10.1007/s11013-015-9450-y

Castellano, , “Multimodal affect recognition for naturalistic human-computer and human-robot interactions,”, The Oxford Handbook of Affective Computing, 246

Castellano, , Context-sensitive affect recognition for a robotic game companion, ACM Trans. Interact. Intell. Syst., 4, 1, 10.1145/2622615

Chen, 2012, Harnessing repetitive behaviours to engage attention and learning in a novel therapy for autism: an exploratory analysis, Front. Psychol., 3, 12, 10.3389/fpsyg.2012.00012

Cohen, 1993, “From attention-goal psychology to belief-desire psychology: The development of a theory of mind and its dysfunction,”, Understanding Other Minds: Perspectives from Autism, 59

Connell, 1990, Context, self, and action: a motivational analysis of self-system processes across the life span, Self Trans. Infancy Child., 8, 61

Conti, 2015, “A cross-cultural study of acceptance and use of robotics by future psychology practitioners,”, IEEE Int’l Symposium on Robot and Human Interactive Communication (RO-MAN), 555

Daley, 2002, The need for cross-cultural research on the pervasive developmental disorders, Transcult. Psychiatry, 39, 531, 10.1177/136346150203900409

Dautenhahn, 2004, Towards interactive robots in autism therapy: background, motivation and challenges, Pragmat. Cogn., 12, 1, 10.1075/pc.12.1.03dau

De Silva, 2009, “Therapeutic-assisted robot for children with autism,”, 3561

Diehl, 2012, The clinical use of robots for individuals with autism spectrum disorders: a critical review, Res. Autism Spectr. Disord., 6, 249, 10.1016/j.rasd.2011.05.006

2013, Diagnostic and Statistical Manual of Mental Disorders: DSM-5

Dyches, 2004, Multicultural issues in autism, J. Autism Dev. Disord., 34, 211, 10.1023/B:JADD.0000022611.80478.73

Dziuk, 2007, Dyspraxia in autism: association with motor, social, and communicative deficits, Dev. Med. Child Neurol., 49, 734, 10.1111/j.1469-8749.2007.00734.x

Ekman, 1972, “Universals and cultural differences in facial expressions of emotion,”, Nebraska Symposium on Motivation, 207

Ekman, 2005, Facial Expressions

Eldevik, 2012, Outcomes of behavioral intervention for children with autism in mainstream pre-school settings, J. Autism Dev. Disord., 42, 210, 10.1007/s10803-011-1234-9

Elfenbein, 2002, On the universality and cultural specificity of emotion recognition: a meta-analysis, Psychol. Bull., 128, 203, 10.1037/0033-2909.128.2.203

Engelmann, 2013, Emotion perception across cultures: the role of cognitive mechanisms, Front. Psychol., 4, 118, 10.3389/fpsyg.2013.00118

Fong, 2003, A survey of socially interactive robots, Rob. Auton. Syst., 42, 143, 10.1016/S0921-8890(02)00372-X

Fournier, 2010, Motor coordination in autism spectrum disorders: a synthesis and meta-analysis, J. Autism Dev. Disord., 40, 1227, 10.1007/s10803-010-0981-3

François, 2009, A long-term study of children with autism playing with a robotic pet: taking inspirations from non-directive play therapy to encourage children’s proactivity and initiative-taking, Interact. Studies, 10, 324, 10.1075/is.10.3.04fra

Fredricks, 2004, School engagement: potential of the concept, state of the evidence, Rev. Educ. Res., 74, 59, 10.3102/00346543074001059

Freitag, 2007, Quantitative assessment of neuromotor function in adolescents with high functioning autism and Asperger syndrome, J. Autism Dev. Disord., 37, 948, 10.1007/s10803-006-0235-6

Ge, 2016, “Identifying engagement from joint kinematics data for robot therapy prompt interventions for children with autism spectrum disorder,”, 531

Gross, 2004, The perception of four basic emotions in human and nonhuman faces by children with autism and other developmental disabilities, J. Abnorm. Child Psychol., 32, 469, 10.1023/B:JACP.0000037777.17698.01

Gunes, 2011, “Emotion representation, analysis and synthesis in continuous space: A survey,”, 827

Habib, 2014, Handbook of Research on Advancements in Robotics and Mechatronics

Happé, 2006, Time to give up on a single explanation for autism, Nat. Neurosci., 9, 1218, 10.1038/nn1770

Hedman, 2012, “Measuring autonomic arousal during therapy,”, 11

Hernandez, 2014, “Using electrodermal activity to recognize ease of engagement in children during social interactions,”, 307

Hernandez, 2013, “Analysis and visualization of longitudinal physiological data of children with ASD,”, The Extended Abstract of IMFAR, 2

Hilton, 2012, Motor impairment in sibling pairs concordant and discordant for autism spectrum disorders, Autism, 16, 430, 10.1177/1362361311423018

Howlin, 1999, Teaching Children with Autism to Mind-Read: A Practical Guide for Teachers and Parents

Immordino-Yang, 2016, Cultural modes of expressing emotions influence how emotions are experienced, Emotion, 16, 1033, 10.1037/emo0000201

Isenhower, 2012, Rhythmic bimanual coordination is impaired in young children with autism spectrum disorder, Res. Autism Spectr. Disord., 6, 25, 10.1016/j.rasd.2011.08.005

Jones, 2016, Increased eye contact during conversation compared to play in children with autism, J. Autism Dev. Disord., 47, 607, 10.1007/s10803-016-2981-4

Kanda, 2007, A two-month field trial in an elementary school for long-term human-robot interaction, IEEE Trans. Robot., 23, 962, 10.1109/TRO.2007.904904

Keen, 2009, Engagement of children with autism in learning, Aust. J. Spec. Educ., 33, 130, 10.1375/ajse.33.2.130

Kemp, 2013, The effect of activity type on the engagement and interaction of young children with disabilities in inclusive childcare settings, Early Child. Res. Q., 28, 134, 10.1016/j.ecresq.2012.03.003

Kim, 2012, Bridging the research gap: making HRI useful to individuals with autism, J. Hum. Robot Interact., 1, 26, 10.5898/JHRI.1.1.Kim

Kishida, 2009, The engagement and interaction of children with autism spectrum disorder in segregated and inclusive early childhood center-based settings, Topics Early Child. Spec. Educ., 29, 105, 10.1177/0271121408329172

Kitzhaber, 2012, Interventions for multicultural children with autism, Master Soc. Work Clin. Res. Papers, 118, 1

Kopp, 2010, Developmental coordination disorder and other motor control problems in girls with autism spectrum disorder and/or attention-deficit/hyperactivity disorder, Res. Dev. Disabil., 31, 350, 10.1016/j.ridd.2009.09.017

Kozima, 2007, Children–robot interaction: a pilot study in autism therapy, Prog. Brain Res., 164, 385, 10.1016/S0079-6123(07)64021-7

Krause, 1987, Universals and cultural differences in the judgments of facial expressions of emotion, J. Pers. Soc. Psychol., 5, 4

Le Couteur, 2008, Diagnosing autism spectrum disorders in pre-school children using two standardised assessment instruments: the ADI-R and the ADOS, J. Autism Dev. Disord., 38, 362, 10.1007/s10803-007-0403-3

Lemaignan, 2016, “From real-time attention assessment to with-me-ness in human-robot interaction,”, 157

Libin, 2004, Person-robot interactions from the robopsychologists’ point of view: the robotic psychology and robotherapy approach, Proc. IEEE, 92, 1789, 10.1109/JPROC.2004.835366

Lim, 2016, Cultural differences in emotion: differences in emotional arousal level between the east and the west, Integr. Med. Res., 5, 105, 10.1016/j.imr.2016.03.004

Liu, 2008, Physiology-based affect recognition for computer-assisted intervention of children with autism spectrum disorder, Int. J. Hum. Comput. Stud., 66, 662, 10.1016/j.ijhsc.2008.04.003

Lo, 2016, Angry versus furious: a comparison between valence and arousal in dimensional models of emotions, J. Psychol., 150, 949, 10.1080/00223980.2016.1225658

Mandell, 2005, The role of culture in families’ treatment decisions for children with autism spectrum disorders, Ment. Retard. Dev. Disabil. Res. Rev., 11, 110, 10.1002/mrdd.20061

Marsh, 2013, Autism and social disconnection in interpersonal rocking, Front. Integr. Neurosci., 7, 4, 10.3389/fnint.2013.00004

McDonald, 2009, Handbook of Biological Statistics, 2

McDuff, 2017, Large-scale observational evidence of cross-cultural differences in facial behavior, J. Nonverbal Behav., 41, 1, 10.1007/s10919-016-0244-x

McWilliam, 1992, Promoting engagement and mastery, Teach. Infants Preschool. Disabil., 2, 230

McWilliam, 1995, Effects of classroom social structure and disability on engagement, Topics Early Child. Spec. Educ., 15, 123, 10.1177/027112149501500201

Meece, 1988, Students’ goal orientations and cognitive engagement in classroom activities, J. Educ. Psychol., 80, 514, 10.1037/0022-0663.80.4.514

Nicolaou, 2011, Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space, IEEE Trans. Affect. Comput., 2, 92, 10.1109/T-AFFC.2011.9

Odom, 2002, Widening the Circle: Including Children with Disabilities in Preschool Programs. Early Childhood Education Series

Olsen, 2014, A continuous measure of musical engagement contributes to prediction of perceived arousal and valence, Psychomusicology, 24, 147, 10.1037/pmu0000044

Perepa, 2014, Cultural basis of social ‘deficits’ in autism spectrum disorders, Eur. J. Spec. Needs Educ., 29, 313, 10.1080/08856257.2014.908024

Picard, 1997, Affective Computing, 252

Picard, 2009, Future affective technology for autism and emotion communication, Philos. Trans. R. Soc. B, 364, 3575, 10.1098/rstb.2009.0143

Picard, 2008, Innovative technology: the future of personalized autism research and treatment, Autism, 50, 32

Pierno, 2008, Robotic movement elicits visuomotor priming in children with autism, Neuropsychologia, 46, 448, 10.1016/j.neuropsychologia.2007.08.020

Pietro, 2014, The pursuit of happiness measurement: a psychometric model based on psychophysiological correlates, Sci. World J., 2014, 1, 10.1155/2014/139128

Ponitz, 2009, Kindergarten classroom quality, behavioral engagement, and reading achievement, School Psych. Rev., 38, 102, 10.1080/02796015.2009.12087852

Robins, 2005, Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills?, Univ. Access Inform. Soc., 4, 105, 10.1007/s10209-005-0116-3

Robins, 2006, Does appearance matter in the interaction of children with autism with a humanoid robot?, Interact. Stud., 7, 509, 10.1075/is.7.3.16rob

Robins, 2008, “Developing scenarios for robot assisted play,”, 180

Robins, 2010, Human-centred design methods: developing scenarios for robot assisted play informed by user panels and field trials, Int. J. Hum. Comput. Stud., 68, 873, 10.1016/j.ijhcs.2010.08.001

Russell, 1994, Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies, Psychol. Bull., 115, 102, 10.1037/0033-2909.115.1.102

Russell, 1980, A description of the affective quality attributed to environments, J. Pers. Soc. Psychol., 38, 311, 10.1037/0022-3514.38.2.311

Russell, 2005, Student motivation and engagement, School. Issues Digest, 2, 1

Salam, 2017, Fully automatic analysis of engagement and its relationship to personality in human-robot interactions, IEEE Access, 5, 705, 10.1109/ACCESS.2016.2614525

Salam, , “Engagement detection based on mutli-party cues for human robot interaction,”, 341

Salam, , “A multi-level context-based modeling of engagement in human-robot interaction,”, 1

Scassellati, 2007, “How social robots will help us to diagnose, treat, and understand autism,”, In Robotics Research, 552, 10.1007/978-3-540-48113-3_47

Scassellati, 2012, Robots for use in autism research, Annu. Rev. Biomed. Eng., 14, 275, 10.1146/annurev-bioeng-071811-150036

Scherer, 1994, Evidence for universality and cultural variation of differential emotion response patterning, J. Pers. Soc. Psychol., 66, 310, 10.1037/0022-3514.66.2.310

Shen, 2015, “Sentiment apprehension in human-robot interaction with NAO,”, 867

Stanton, 2008, “Robotic animals might aid in the social development of children with autism,”, 271

Suzuki, 2017, “Nao-dance therapy for children with ASD,”, 295

Thill, 2012, Robot-assisted therapy for autism spectrum disorders with (partially) autonomous control: challenges and outlook, Paladyn, 3, 209

Tielman, 2014, “Adaptive emotional expression in robot-child interaction,”, 407

Tincani, 2009, Race, culture, and autism spectrum disorder: understanding the role of diversity in successful educational interventions, Res. Pract. Pers. Sev. Disabil., 34, 81, 10.2511/rpsd.34.3-4.81

Uchida, 2004, Cultural constructions of happiness: theory and empirical evidence, J. Happiness Stud., 5, 223, 10.1007/s10902-004-8785-9

Vivanti, 2014, Mechanisms of imitation impairment in autism spectrum disorder, J. Abnorm. Child Psychol., 42, 1395, 10.1007/s10802-014-9874-9

Volkmar, 2005, Handbook of Autism and Pervasive Developmental Disorders, Diagnosis, Development, Neurobiology, and Behavior

Wainer, 2014, A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism, Int. J. Soc. Robot., 6, 45, 10.1007/s12369-013-0195-x

Wainer, 2010, The effectiveness of using a robotics class to foster collaboration among groups of children with autism in an exploratory study, Pers. Ubiquit. Comput., 14, 445, 10.1007/s00779-009-0266-z

Welch, 1947, The generalization of student’s problem when several different population variances are involved, Biometrika, 34, 28, 10.2307/2332510

Wong, 2012, Play and joint attention of children with autism in the preschool special education classroom, J. Autism Dev. Disord., 42, 2152, 10.1007/s10803-012-1467-2

Zeng, 2009, A survey of affect recognition methods: audio, visual, and spontaneous expressions, IEEE Trans. Pattern Anal. Mach. Intell., 31, 39, 10.1109/TPAMI.2008.52