Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment

Tze Wei Liew1,2, Nor Azan Mat Zin1, Noraidah Sahari1
1Multimedia & Usability Research Group, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, Bangi, Malaysia
2Center for Consumer Research & Education (CeCORE), Faculty of Business, Multimedia University, Melaka, Malaysia

Tóm tắt

In a traditional classroom environment, instructor enthusiasm has been shown to enhance student’s emotion, affective perceptions, intrinsic motivation, and cognitive outcome. Additionally, emotional response theory argues that enthusiastic verbal and nonverbal cues of an instructor will induce positive emotional states in learners, which in turn, enact learners’ approach behaviours in the learning process. Therefore, should a pedagogical agent convey enthusiastic behaviours in a multimedia learning environment? Literature and theoretical reviews offer two competing views. The first view, based on emotional response theory, predicts that enthusiastic verbal and nonverbal cues of a pedagogical agent can induce higher positive emotions in learners, which in turn, enhance affective perceptions, intrinsic motivation, and cognitive outcome. However, the second view, based on cognitive load theory, suggests that pedagogical agent enthusiasm may increase extraneous cognitive load (additional processing in the mind), which negatively impact emotion, affective perceptions, intrinsic motivation, and cognitive outcome. To investigate the effects of agent enthusiasm, seventy-two university freshmen interacted with either an enthusiastic agent or a neutral agent (operationalized through vocal tones, facial expression, gestures, and remarks) that simulates the instructional role of a virtual tutor that delivers narrative demonstrations on how to predict the outputs of C-Programming algorithms. The results of our study showed that pedagogical agent enthusiasm significantly enhanced emotion, intrinsic motivation, affective perceptions, and cognitive outcome. Moreover, mediation analyses revealed that the facilitating effects of agent enthusiasm on intrinsic motivation, affective perceptions of the learning environment, and affective perceptions of the pedagogical agent were fully mediated by a learner’s positive emotion, thus demonstrating that the framework of emotional response theory can be applied to learner-agent interaction in a multimedia learning environment. Implications and suggestions for future research related to pedagogical agent enthusiasm are discussed in this paper.

Tài liệu tham khảo

Guo Y, Goh D (2015) Affect in embodied pedagogical agents. J Educ Comput Res 53:124–149 Kim Y, Baylor A (2015) Research-based design of pedagogical agent roles: a review, progress, and recommendations. Int J Artif Intell Educ 26:160–169 Schroeder N, Adesope O, Gilbert R (2013) How effective are pedagogical agents for learning? A meta-analytic review. J Educ Comput Res 49:1–39 Qu C, Brinkman W, Ling Y et al (2014) Conversations with a virtual human: synthetic emotions and human responses. Comput Hum Behav 34:58–68 Krämer N (2010) Psychological research on embodied conversational agents: the case of pedagogical agents. J Media Psychol 22:47–51 Beale R, Creed C (2009) Affective interaction: how emotional agents affect users. Int J Hum Comput Stud 67:755–776 Mayer R, Sobko K, Mautone P (2003) Social cues in multimedia learning: role of speaker’s voice. J Educ Psychol 95:419–425 Atkinson R, Mayer R, Merrill M (2005) Fostering social agency in multimedia learning: examining the impact of an animated agent’s voice. Contemp Educ Psychol 30:117–139 Kunter M, Tsai Y, Klusmann U et al (2008) Students’ and mathematics teachers’ perceptions of teacher enthusiasm and instruction. Learn Instr 18:468–482 Johnson W, Rickel J, Lester J (2000) Animated pedagogical agents: face-to-face interaction in interactive learning environments. Int J Artif Intell Educ 11:47–78 Baylor A, Kim Y (2005) Simulating instructional roles through pedagogical agents. Int J Artif Intell Educ 15:95–115 Lane H, Cahill C, Foutz S et al (2013) The effects of a pedagogical agent for informal science education on learner behaviors and self-efficacy. In: Yacef K, Mostow J, Pavlik P (eds) Artificial intelligence in education. Springer, Berlin, pp 309–318 Dehn D, Van Mulken S (2000) The impact of animated interface agents: a review of empirical research. Int J Hum Comput Stud 52:1–22 Clark R, Choi S (2005) Five design principles for experiments on the effects of animated pedagogical agents. J Educ Comput Res 32:209–225 Frechette C, Moreno R (2010) The roles of animated pedagogical agents’ presence and nonverbal communication in multimedia learning environments. J Media Psychol 22:61–72 Woo H (2009) Designing multimedia learning environments using animated pedagogical agents: factors and issues. J Comput Assist Learn 25:203–218 Horan S, Martin M, Weber K (2012) Understanding emotional response theory: the role of instructor power and justice messages. Commun Q 60:210–233 Mottet T, Beebe S (2002) Relationships between teacher nonverbal immediacy, student emotional response, and perceived student learning. Commun Res Rep 19:77–88 Pogue L, Ahyun K (2006) The effect of teacher nonverbal immediacy and credibility on student motivation and affective learning. Commun Educ 55:331–344 Keller M, Hoy A, Goetz T, Frenzel A (2015) Teacher enthusiasm: reviewing and redefining a complex construct. Educ Psychol Rev. doi:10.1007/s10648-015-9354-y Kunter M, Frenzel A, Nagy G et al (2011) Teacher enthusiasm: dimensionality and context specificity. Contemp Educ Psychol 36:289–301 Kunter M, Klusmann U, Baumert J, Richter D, Voss T, Hachfeld A (2013) Professional competence of teachers: effects on instructional quality and student development. J Educ Psychol 105:805–820 Patrick H, Turner J, Meyer D, Midgley C (2003) How teachers establish psychological environments during the first days of school: associations with avoidance in mathematics. Teach Coll Rec 105:1521–1558 Richmond V, McCroskey J, Johnson A (2003) Development of the nonverbal immediacy scale (NIS): measures of self-and other-perceived nonverbal immediacy. Commun Q 51:504–517 Mehrabian A (1972) Nonverbal communication. Aldine-Atherton, Chicago Richmond V, McCroskey J (2000) Nonverbal communication in interpersonal relations, 1st edn. Allyn and Bacon, Boston Heidig S, Müller J, Reichelt M (2015) Emotional design in multimedia learning: differentiation on relevant design features and their effects on emotions and learning. Comput Hum Behav 44:81–95 Saariluoma P, Jokinen J (2014) Emotional dimensions of user experience: a user psychological analysis. Int J Hum Comput Interact 30:303–320 Liew T, Tan S (2016) The effects of positive and negative mood on cognition and motivation in multimedia learning environment. J Educ Technol Soc 19:104–115 Moè A (2015) Does displayed enthusiasm favour recall, intrinsic motivation and time estimation? Cogn Emot 30:1361–1369 Isen A, Reeve J (2005) The influence of positive affect on intrinsic and extrinsic motivation: facilitating enjoyment of play, responsible work behavior, and self-control. Motiv Emot 29:295–323 Patrick B, Hisley J, Kempler T (2000) “What’s everybody so excited about?”: the effects of teacher enthusiasm on student intrinsic motivation and vitality. J Exp Educ 68:217–236 Um E, Plass J, Hayward E, Homer B (2012) Emotional design in multimedia learning. J Educ Psychol 104:485–498 Plass J, Heidig S, Hayward E, Homer B, Um E (2014) Emotional design in multimedia learning: effects of shape and color on affect and learning. Learn Instr 29:128–140 Kelley D, Gorham J (1988) Effects of immediacy on recall of information. Commun Educ 37:198–207 Lang A, Dhillon K, Dong Q (1995) The effects of emotional arousal and valence on television viewers’ cognitive capacity and memory. J Broadcast Electron Media 39:313–327 Fredrickson Branigan C (2005) Positive emotions broaden the scope of attention and thought-action repertoires. Cogn Emot 19:313–332 Norman D (2008) Emotional design. TPB, Enskede Darves C, Oviatt S, Coulston R (2002) The impact of auditory embodiment on animated character design. In: Proceedings of the international joint conference on autonomous agents and multi-agent systems, embodied agents workshop Sweller J (1994) Cognitive load theory, learning difficulty, and instructional design. Learn Instr 4:295–312. doi:10.1016/0959-4752(94)90003-5 Miller G (1956) Human memory and the storage of information. IEEE Trans Inf Theory 2:129–137. doi:10.1109/tit.1956.1056815 Huang Y, Lin K, Yu X, Hung J (2015) Comparison of different approaches on example-based learning for novice and proficient learners. Hum Centric Comput Inf Sci. doi:10.1186/s13673-015-0048-8 Kalyuga S, Chandler P, Sweller J (2000) Incorporating learner experience into the design of multimedia instruction. J Educ Psychol 92:126–136 Theodoridou K (2011) Learning Spanish with Laura : the effects of a pedagogical agent. Educ Media Int 48:335–351 Veletsianos G (2012) How do learners respond to pedagogical agents that deliver social-oriented non-task messages? Impact on student learning, perceptions, and experiences. Comput Hum Behav 28:275–283 Moreno R, Flowerday T (2006) Students’ choice of animated pedagogical agents in science learning: a test of the similarity-attraction hypothesis on gender and ethnicity. Contemp Educ Psychol 31:186–207 Mori M, MacDorman K, Kageki N (2012) The Uncanny Valley [from the Field]. IEEE Robot Autom Mag 19:98–100 Liew T, Zin N, Sahari N, Tan S (2016) The effects of a pedagogical agent’s smiling expression on the learner’s emotions and motivation in a virtual learning environment. Int Rev Res Open Distrib Learn. doi:10.19173/irrodl.v17i5.2350 Tinwell A, Grimshaw M, Nabi D, Williams A (2011) Facial expression of emotion and perception of the Uncanny Valley in virtual characters. Comput Hum Behav 27:741–749 de Sao Jose E (2012) A methodology for computer programming teaching based on bloom’s taxonomy of educational objectives and apllied through the pair programming. IEEE Latin America Trans 10:1589–1594 Watson D, Clark L, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54:1063–1070 Preacher K, Hayes A (2008) Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav Res Methods 40:879–891 Cohen L, Manion L, Morrison K (2003) Research methods in education. Routledge Falmer, London Magner U, Schwonke R, Aleven V, Popescu O, Renkl A (2014) Triggering situational interest by decorative illustrations both fosters and hinders learning in computer-based learning environments. Learn Instr 29:141–152 Yusoff M, Zin N (2013) Exploring suitable emotion-focused strategies in helping students to regulate their emotional state in a tutoring system: Malaysian case study. Electron J Res Educ Psychol 11:717–742. doi:10.14204/ejrep.31.13055 Leutner D (2014) Motivation and emotion as mediators in multimedia learning. Learn Instr 29:174–175