Mimicry and expressiveness of an ECA in human-agent interaction: familiarity breeds content!
Tóm tắt
Two experiments investigated the effect of features of human behaviour on the quality of interaction with an Embodied Conversational Agent (ECA). In Experiment 1, visual prominence cues (head nod, eyebrow raise) of the ECA were manipulated to explore the hypothesis that likeability of an ECA increases as a function of interpersonal mimicry. In the context of an error detection task, the ECA either mimicked or did not mimic a head nod or brow raise that humans produced to give emphasis to a word when correcting the ECA’s vocabulary. In Experiment 2, presence versus absence of facial expressions on comprehension accuracy of two computer-driven ECA monologues was investigated. In Experiment 1, evidence for a positive relationship between ECA mimicry and lifelikeness was obtained. However, a mimicking agent did not elicit more human gestures. In Experiment 2, expressiveness was associated with greater comprehension and higher ratings of humour and engagement. Influences from mimicry can be explained by visual and motor simulation, and bidirectional links between similarity and liking. Cue redundancy and minimizing cognitive load are potential explanations for expressiveness aiding comprehension.
Tài liệu tham khảo
Bailenson, J. N., & Yee, N. (2005). Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science, 16(10), 814–819.
Bevacqua, E., Pammi, S., Hyniewska, S. J., Schröder, M., & Pelachaud, C. (2010). Multimodal backchannels for embodied conversational agents. In J. Allbeck et al. (Eds.), IVA 2010, Lecture Notes in Artificial Intelligence 6356 (pp. 194–200). Berlin: Springer.
Bourgeois, P., & Hess, U. (2008). The impact of social context on mimicry. Biological Psychology, 77, 343–352.
Burnham, D., Abrahamyan, A., Cavedon, L., Davis, C., Hodgins, A., Kim, J., Kroos, C., Kuratate, T., Lewis, T., Luerssen, M., Paine, G., Powers, D., Riley, M., Stelarc, & Stevens, K. (2008). From talking to thinking heads: Report 2008. Queensland: Proceedings of the International Conference on Auditory-Vsual Speech Processing (AVSP).
Campano, S., Langlet, C., Glas, N., Clavel, C., Pelachaud, C. (2015). An ECA expressing appreciations. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (pp. 962–967). IEEE.
Caridakis, G., Raouzaiou, A., Bevacqua, E., Mancini, M., Karpouzis, K., Malatesta, L., Pelacahud, C.. (2007). Virtual agent multimodal mimicry of humans. Language Resources & Evaluation, 41, 367–388.
Castellano, G., Mancini, M., Peters, C., McOwan, PW. (2012). Expressive copying behaviour for social agents: A perceptual analysis. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 42(3), 776-783.
Castelli, L., Pavan, G., Ferrari, E., & Kashima, Y. (2009). The stereotyper and the chameleon: the effects of stereotype use on perceivers' mimicry. Journal of Experimental Social Psychology, 45(4), 835–839.
Cavedon, L., Kroos, C., Herath, D., Burnham, D., Bishop, L., Leung, Y., Stevens, C. J. (2015). “C’Mon dude!”: users adapt their behaviour to a robotic agent with an attention model. International Journal of Human-Computer Studies, 80, 14–23.
Chartrand, T. L., & Bargh, J. A. (1999). The chameleon effect: the perception–behavior link and social interaction. Journal of Personality and Social Psychology, 76(6), 893–910.
Conrad, F. G., Schober, M. F., Jans, M., Orlowski, R. A., Nielsen, D., & Levenstein, R. (2015). Comprehension and engagement in survey interviews with virtual agents. Frontiers in Psychology, 6, 1578. doi:10.3389/fpsyg.2015.01578.
Cvejic, E., Kim, J., & Davis, C. (2010). Prosody off the top of the head: Prosodic contrasts can be discriminated by head motion. Speech Communication, 52(6), 555–564.
DeSteno, D., Brezaeal, C., Frank, R. H., Pizarro, D., Baumann, J., Dickens, L., Lee, J. J. (2012). Detecting the trustworthiness of novel partners in economic exchange. Psychological Science, 23, 1549–1556.
Doumanis, I., & Smith, S. (2013). An empirical study on the effects of Embodied Conversational Agents on user retention performance and perception in a simulated mobile environment. In JA Botía & D Charitos (Eds.), Proceedings of the 9 th International Conference on Intelligent Environments. IOS Press.
Flecha-Garcia, M. L. (2010). Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English. Speech Communication, 52(6), 542–554.
Granstrom, B., & House, D. (2005). Audiovisual representation of prosody in expressive speech communication. Speech Communication, 46(3–4), 473–484.
Guéguen, N., & Martin, A. l. (2009). Incidental similarity facilitates behavioral mimicry. Social Psychology, 40(2), 88–92.
Heine, S. J., Foster, J.-A. B., & Spina, R. (2009). Do birds of a feather universally flock together? Cultural variation in the similarity-attraction effect. Asian Journal of Social Psychology, 12, 247–258.
Heyselaar, E., Hagoort, O., & Segaert, K. (2015). In dialogue with an avatar, language behavior is identical to dialogue with a human partner. Behavioral Research Methods. in press.
Höök, K. (2004). User-centred design and evaluation of affective interfaces: A two-tiered model. In Z. Ruttkay & C. Pelachaud (Eds.), From brows to trust: evaluating embodied conversational agents (pp. 127–160). Dordrecht: Kluwer Academic Publishers.
IEEE Subcommittee on Subjective Measurements. (1969). IEEE recommended practices for speech quality measurements. IEEE Trans. Audio Electroacoust., 17, 227–246.
Kahl, S., & Kopp, S. (2015). Modeling a social brain for interactive agents: integrating mirroring and mentalizing. Intelligent Virtual Agents, Vol. 9238 Lecture Notes in Computing Science (pp.77-86). Switzerland: Springer.
Kang, S.-H., & Watt, J. H. (2013). The impact of avatar realism and anonymity on effective communication via mobile devices. Computers in Human Behavior, 29, 1169–1181.
Krahmer, E., & Swerts, M. (2004). More about brows. In Z. Ruttkay & C. Pelachaud (Eds.), From brows to trust: evaluating embodied conversational agents (pp. 191–216). Dordrecht: Kluwer Academic Publishers.
Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you – The effects of a virtual agent’s smile on users’ evaluation and behavior. International Journal of Human-Computer Studies, 71, 335–349.
Lakin, J. L., Jefferis, V. E., Cheng, C. M., & Chartrand, T. L. (2003). The chameleon effect as social glue: Evidence for the evolutionary significance of nonconscious mimicry. Journal of Nonverbal Behavior, 27(3), 145–162.
Ledge, K., Castillo, S., & Cunningham, D. W. (2015). Multimodal affect: perceptually evaluating an affective talking head. ACM Transactions on Applied Perception, 12(4), Article 17.
Lee, J. K., & Brezeal, C. (2010). Human social response toward humanoid robot’s head and facial features (Proceedings of Computer Human Interaction CHI 2010). Atlanta: ACM.
Lisetti, C., & Hudlicka, E. (2014). Why and how to build emotion-based agent architectures. In R Calvo, S D’Mello, J Gratch, & A Kappas (Eds.) Handbook of Affective Computing. Oxford University Press, in press.
Luo, P., Ng-Thow-Hing, V., Neff, M. (2013). An examination of whether people prefer agents whose gestures mimic their own. In R. Aylett, B. Krenn, C. Pelachaud, & H. Shimodaira (Eds.) Intelligent Virtual Agents: Proc 13th International Conference, IVA 2013. Lecture Notes in Computer Science, Vol. 8108, Springer.
Mattheij, R., Postma-Nilsenová, M., & Postma, E. (2015). Mirror mirror on the wall: Is there mimicry in you all? Journal of Ambient Intelligence and Smart Environments, 7, 121–132.
Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility: head movement improves auditory speech perception. Psychological Science, 15, 133–137.
Nass, C., & Moon, Y. (2000). Machines and mindlessness: Social responses to computers. Journal of Social Issues, 56(1), 81–103.
Nunamaker, J. F., Derrick, D. C., Elkins, A. C., Burgoon, J. K., & Patton, M. W. (2011). Embodied conversational agent-based kiosk for automated interviewing. Journal of Management Information Systems, 28(1), 17–48.
Payne, J., Szymkowiak, A., Robertson, P., & Johnson, G. (2013). Gendering the machine: Preferred virtual assistant gender and realism in self-service. Intelligent Virtual Agents, Lecture Notes in Computer Science, 8108, 106–115. Springer.
Pinchbeck, B. (2010). Investigating the reciprocal relationship between non-conscious mimicry and liking using an ECA. Unpublished Honours thesis, School of Psychology, University of Western Sydney.
Powers, DMW., Luerssen, M., Lewis, T., Abrahamyan, A., Stevens, K. (2008). Language teaching in a mixed reality games environment. 1st International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) Workshop on “Gaming Design and Experience: Design for Engaging Experience and Social Interaction”, Athens, Greece, Article 70 (7 pp).
Riek, LD., & Robinson, P. (2008). ‘Real-time empathy: Facial mimicry on a robot’, in Workshop on Affective Interaction in Natural Environments (AFFINE) at the International ACM Conference on Multimodal Interfaces (ICMI 08). ACM: 2008
Ruttkay, Z., Dormann, C., & Noot, H. (2004). Embodied conversational agents on a common ground: A framework for design and evaluation. In Z. Ruttkay & C. Pelachaud (Eds.), From brows to trust: evaluating embodied conversational agents (pp. 27–66). Dordrecht: Kluwer Academic Publishers.
Stenzel, A., Chinellato, E., Tirado Bou, M. A., del Pobil, A. O. P., Lappe, M., & Liepelt, R. (2012). When humanoid robots become human-like interaction partners: corepresentation of robotic actions. Journal of Experimental Psychology: Human Perception and Performance, 38, 1073–1077.
Stevens, C. J., Gibert, G., Leung, Y., & Zhang, Z. (2013). Evaluating a synthetic talking head using a dual task: modality effects on speech understanding and cognitive load. International Journal of Human-Computer Studies, 71(4), 440–454.
Tindall-Ford, S., Chandler, P., & Sweller, J. (1997). When two sensory modes are better than one. Journal of Experimental Psychology: Applied, 3(4), 257–287.
Yabar, Y., Johnston, L., Miles, L., & Peace, V. (2006). Implicit Behavioral Mimicry: Investigating the Impact of Group Membership. Journal of Nonverbal Behavior, 30(3), 97–113.
Yaghoubzadeh, T., Buschmeier, H., Kopp, S. (2015). Socially cooperative behavior for artificial companion for elderly and cognitively impaired people. 1 st International Symposium on Companion-Technology ISCT 2015 (pp. 15–19).
Zajonc, R. B. (1968). Attitudinal effects of mere exposure [Monograph]. Journal of Personality and Social Psychology, 9, 1–27.