The Influence of Systems Thinking on Immersive Learning Design Decisions

Akinlofa, O. R., Holt, P. O., & Elyan, E. (2014). The cognitive benefits of dynamic representations in the acquisition of spatial navigation skills. Computers in Human Behavior, 30, 238–248. https://doi.org/10.1016/j.chb.2013.09.009 Alamäki, A. V., Dirin, A., Suomala, J., & Rhee, C. (2021). Students’ experiences of 2D and 360° videos with or without a low-cost VR headset: An experimental study in higher education. Journal of Information Technology Education: Research, 20, 309–329. Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6, 355–385. http://www.cs.unc.edu/~azumaW Bacca-Acosta, J., Tejada, J., Fabregat, R., Kinshuk, & Guevara, J. (2022). Scaffolding in immersive virtual reality environments for learning English: An eye tracking study. Educational Technology Research and Development, 70(1), 339–362. https://doi.org/10.1007/s11423-021-10068-7 Baceviciute, S., Lucas, G., Terkildsen, T., & Makransky, G. (2022). Investigating the redundancy principle in immersive virtual reality environments: An eye-tracking and EEG study. Journal of Computer Assisted Learning, 38(1), 120–136. https://doi.org/10.1111/jcal.12595 Baran, B., Yecan, E., Kaptan, B., & Pasayigit, O. (2020). Using augmented reality to teach fifth grade students about electrical circuits. Education and Information Technologies, 25(2), 1371–1385. https://doi.org/10.1007/s10639-019-10001-9 Baukal, Jr, C. E., & Ausburn, L. J. (2016). Multimedia category preferences of working engineers. European Journal of Engineering Education, 41(5), 482–503. https://doi.org/10.1080/03043797.2015.1095161 Baydas, O., Karakus, T., Topu, F. B., Yilmaz, R., Ozturk, M. E., & Goktas, Y. (2015). Retention and flow under guided and unguided learning experience in 3D virtual worlds. Computers in Human Behavior, 44, 96–102. https://doi.org/10.1016/j.chb.2014.11.041 Blashki, K., Nichol, S., Jia, D., & Prompramote, S. (2007). ‘The future is old’: Immersive learning with Generation Y engineering students. European Journal of Engineering Education, 32(4), 409–420. https://doi.org/10.1080/03043790701334228 Bøg Petersen, G., Klingenberg, S., & Makransky, G. (2022). Pipetting in virtual reality can predict real-life pipetting performance. Technology, Mind, and Behavior, 3(3). https://doi.org/10.1037/tmb0000076 Bohné, T., Heine, I., Gürerk, Ö., Rieger, C., Kemmer, L., & Cao, L. Y. (2021). Perception engineering learning with virtual reality. IEEE Transactions on Learning Technologies, 14(4), 500–514. https://doi.org/10.1109/TLT.2021.3107407 Booth, P., & Henderson-Begg, S. (2011). A comparison between flash and second life programs as aids in the learning of basic laboratory procedures. Journal of Interactive Learning Research, 22(3), 445–465. Brenner, C., DesPortes, K., Ochoa Hendrix, J., & Holford, M. (2021). GeoForge: Investigating integrated virtual reality and personalized websites for collaboration in middle school science. Information and Learning Sciences, 122(7–8), 546–564. Brown, T. (2008). Design thinking. Harvard Business Review, 86(6), 84–92. Buchner, J., & Hofmann, M. (2022). The more the better? Comparing two SQD-based learning designs in a teacher training on augmented and virtual reality. International Journal of Educational Technology in Higher Education, 19, 1–17. https://doi.org/10.1186/s41239-022-00329-7 Cabrera, D., & Cabrera, L. (2019). What is systems thinking? In M. J. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–28). Springer. Cai, S., Chiang, F.-K., Sun, Y., Lin, C., & Lee, J. J. (2017). Applications of augmented reality based natural interactive learning in magnetic field instruction. Interactive Learning Environments, 25(6), 778–791. https://doi.org/10.1080/10494820.2016.1181094 Carmigniani, J., & Furht, B. (2011). Augmented reality: An overview. In B. Furht (Ed.), Handbook of augmented reality. Springer. Chang, C.-Y., Panjaburee, P., & Chang, S.-C. (2022). Effects of integrating maternity vr-based situated learning into professional training on students’ learning performances. Interactive Learning Environments. https://doi.org/10.1080/10494820.2022.2141263 Chen, C.-H. (2020). Impacts of augmented reality and a digital game on students’ science learning with reflection prompts in multimedia learning. Educational Technology Research and Development, 68(6), 3057–3076. https://doi.org/10.1007/s11423-020-09834-w de Back, T. T., Tinga, A. M., Nguyen, P., & Louwerse, M. M. (2020). Benefits of immersive collaborative learning in CAVE-based virtual reality. International Journal of Educational Technology in Higher Education, 17. https://doi.org/10.1186/s41239-020-00228-9 Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323(5910), 66–69. https://doi.org/10.1126/science.1167311 Delamarre, A., Shernoff, E., Buche, C., Frazier, S., Gabbard, J., & Lisetti, C. (2021). The interactive Virtual Training for Teachers (IVT-T) to practice classroom behavior management. International Journal of Human-Computer Studies, 152. https://doi.org/10.1016/j.ijhcs.2021.102646 deNoyelles, A., & Kyeong-Ju Seo, K. (2012). Inspiring equal contribution and opportunity in a 3d multi-user virtual environment: Bringing together men gamers and women non-gamers in Second Life®. Computers & Education, 58(1), 21–29. https://doi.org/10.1016/j.compedu.2011.07.007 Diaz-Noguera, M. D., Hervas-Gomez, C., & De-la-Calle, A. M. (2019). Professional action competences through experiences with augmented reality. Journal of Turkish Science Education, 16(4), 554–568. Frick, W. C. (1993). A systems view of restructuring education. Educational Administration Quarterly, 29(4), 474–495. https://doi.org/10.1007/978-3-642-58035-2_20 Garrett, B. M., Jackson, C., & Wilson, B. (2015). Augmented reality m-learning to enhance nursing skills acquisition in the clinical skills laboratory. Interactive Technology and Smart Education, 12(4), 298–314. Gonzalez, E. A., Grotzer, T. A., McGivney, E., & Reilly, J. (2022). Details matter: How contrasting design features in two MUVEs impact learning outcomes. Technology, knowledge and learning: Learning mathematics, science and the arts in the context of digital technologies, 27(3), 801–821. https://doi.org/10.1007/s10758-021-09513-6 Harley, J. M., Lajoie, S. P., Tressel, T., & Jarrell, A. (2020). Fostering positive emotions and history knowledge with location-based augmented reality and tour-guide prompts. Learning and Instruction, 70. https://doi.org/10.1016/j.learninstruc.2018.09.001 Harper, B. (2018). Technology and teacher-student interactions: A review of empirical research. Journal of Research on Technology in Education, 50(3), 214–225. https://doi.org/10.1080/15391523.2018.1450690 Hartstein, A. J., Verkuyl, M., Zimney, K., Yockey, J., & Berg-Poppe, P. (2022). Virtual reality instructional design in orthopedic physical therapy education: A mixed-methods usability test. Simulation & Gaming, 53(2), 111–134. https://doi.org/10.1177/10468781211073646 Hauptman, H. (2010). Enhancement of spatial thinking with virtual spaces 1.0. Computers & Education, 54(1), 123–135. https://doi.org/10.1016/j.compedu.2009.07.013 Helsel, S. (1992). Virtual reality and education. Technology, 32(5), 38–42. Holly, M., Pirker, J., Resch, S., Brettschuh, S., & Gütl, C. (2021). Designing VR experiences – Expectations for teaching and learning in VR. Educational Technology & Society, 24(2), 107–119. Hsu, H.-P., Wenting, Z., & Hughes, J. E. (2019). Developing elementary students’ digital literacy through augmented reality creation: Insights from a longitudinal analysis of questionnaires, interviews, and projects. Journal of Educational Computing Research, 57(6), 1400–1435. Huang, H.-M., Rauch, U., & Liaw, S.-S. (2010). Investigating learners’ attitudes toward virtual reality learning environments: Based on a constructivist approach. Computers & Education, 55(3), 1171–1182. https://doi.org/10.1016/j.compedu.2010.05.014 Hwang, G.-J., Chang, S.-C., Chen, P.-Y., & Chen, X.-Y. (2018). Effects of integrating an active learning-promoting mechanism into location-based real-world learning environments on students’ learning performances and behaviors. Educational Technology Research and Development, 66(2), 451–474. https://doi.org/10.1007/s11423-017-9567-5 Ip, H. H. S., Li, C., Leoni, S., Chen, Y., Ma, K.-F., Wong, C. H., & Li, Q. (2019). Design and evaluate immersive learning experience for Massive Open Online Courses (MOOCs). IEEE Transactions on Learning Technologies, 12(4), 503–515. Johnson, L., Adams Becker, S., Estrada, V., & Freeman, A. (2016). NMC/CoSN Horizon Report: 2016 K-12 Edition. The new media consortium. https://files.eric.ed.gov/fulltext/ED570463.pdf Joshi, S., Hamilton, M., Warren, R., Faucett, D., Tian, W., Wang, Y., & Ma, J. (2021). Implementing Virtual Reality technology for safety training in the precast/prestressed concrete industry.Applied Ergonomics, 90. https://doi.org/10.1016/j.apergo.2020.103286 Keskitalo, T. (2012). Students’ expectations of the learning process in virtual reality and simulation-based learning environments. Australasian Journal of Educational Technology, 28(5), 841–856. https://doi.org/10.14742/ajet.820 Kim, H., & Ke, F. (2016). OpenSim-supported virtual learning environment: Transformative content representation, facilitation, and learning activities. Journal of Educational Computing Research, 54(2), 147–172. Kim, K. G., Oertel, C., Dobricki, M., Olsen, J. K., Coppi, A. E., Cattaneo, A., & Dillenbourg, P. (2020). Using immersive virtual reality to support designing skills in vocational education. British Journal of Educational Technology, 51(6), 2199–2213. https://doi.org/10.1111/bjet.13026 Kowch, E. G. (2019). Introduction to systems thinking and change. In M. J. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–14). Springer. Lai, A.-F., Chen, C.-H., & Lee, G.-Y. (2019). An augmented reality-based learning approach to enhancing students’ science reading performances from the perspective of the cognitive load theory. British Journal of Educational Technology, 50(1), 232–247. https://doi.org/10.1111/bjet.12716 Lee, S. W.-Y., Hsu, Y.-T., & Cheng, K.-H. (2022). Do curious students learn more science in an immersive virtual reality environment? Exploring the impact of advance organizers and epistemic curiosity. Computers & Education, 182. https://doi.org/10.1016/j.compedu.2022.104456 Liberman, L., & Dubovi, I. (2023). The effect of the modality principle to support learning with virtual reality: An eye-tracking and electrodermal activity study. Journal of Computer Assisted Learning, 39(23), 547–567. https://doi.org/10.1111/jcal.12763 Liu, R., Wang, L., Koszalka, T. A., & Wan, K. (2022). Effects of immersive virtual reality classrooms on students’ academic achievement, motivation and cognitive load in science lessons. Journal of Computer Assisted Learning, 38(5), 1422–1433. https://doi.org/10.1111/jcal.12688 Liu, R., Wang, L., Lei, J., Wang, Q., & Ren, Y. (2020). Effects of an immersive virtual reality-based classroom on students’ learning performance in science lessons. British Journal of Educational Technology, 51(6), 2034–2049. https://doi.org/10.1111/bjet.13028 Lorenzo, G., Pomares, J., & Lledo, A. (2013). Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with Asperger Syndrome. Computers & Education, 62(3), 88–101. https://doi.org/10.1016/j.compedu.2012.10.028 Luealamai, S., & Panijpan, B. (2012). Learning about the unit cell and crystal lattice with computerized simulations and games: A pilot study. Simulation & Gaming, 43(1), 67–84. Meadows, D. H. (2008). Thinking in systems: A primer. Chelsea Green Publishing. Milgram, P. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems, 12. http://vered.rose.utoronto.ca/people/paul_dir/IEICE94/ieice.html Nadolny, L. (2017). Interactive print: The design of cognitive tasks in blended augmented reality and print documents. British Journal of Educational Technology, 48(3), 814–823. https://doi.org/10.1111/bjet.12462 Nadolny, L., Woolfrey, J., Pierlott, M., & Kahn, S. (2013). SciEthics interactive: Science and ethics learning in a virtual environment. Educational Technology Research and Development, 61(6), 979–999. https://doi.org/10.1007/s11423-013-9319-0 Nortvig, A.-M., Petersen, A. K., Helsinghof, H., & Brænder, B. (2020). Digital expansions of physical learning spaces in practice-based subjects—Blended learning in art and craft & design in teacher education. Computers & Education, 159. https://doi.org/10.1016/j.compedu.2020.104020 Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., ... & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906 Patterson, T., & Han, I. (2019). Learning to teach with virtual reality: Lessons from one elementary teacher. TechTrends, 63(4), 463–469. https://doi.org/10.1007/s11528-019-00401-6 Saldaña, J. (2015). The coding manual for qualitative researchers. Sage. Shin, D., & Park, S. (2019). 3D learning spaces and activities fostering users’ learning, acceptance, and creativity. Journal of Computing in Higher Education, 31(1), 210–228. https://doi.org/10.1007/s12528-019-09205-2 Skulmowski, A., & Rey, G. D. (2021). Realism as a retrieval cue: Evidence for concreteness-specific effects of realistic, schematic, and verbal components of visualizations on learning and testing. Human Behavior and Emerging Technologies, 3(2), 283–295. https://doi.org/10.1002/hbe2.209 Slezaka, R. J., Keren, N., Gilbert, S. B., Harvey, M. E., Ryan, S. J., & Wiley, A. J. (2022). Examining virtual reality as a platform for developing mental models of industrial systems. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12731 Speicher, M., Hall, B. D., & Nebeling, M. (2019). What is mixed reality? In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). https://doi.org/10.1145/3290605.3300767 Steele, P., Burleigh, C., Kroposki, M., Magabo, M., & Bailey, L. (2020). Ethical considerations in designing virtual and augmented reality products–Virtual and augmented reality design with students in mind: Designers’ perceptions. Journal of Educational Technology Systems, 49(2), 219–238. Sterman, J. D. (2000). Business dynamics: Systems thinking and modeling for a complex world. McGraw-Hill Education. Sun, K.-T., Lin, C.-L., & Wang, S.-M. (2010). A 3-D virtual reality model of the sun and the moon for e-learning at elementary schools. International Journal of Science and Mathematics Education, 8(4), 689–710. https://doi.org/10.1007/s10763-009-9181-z Tacgin, Z. (2020). Immersive virtual reality as an action: Measuring approach and learning status of learners after planning myVOR. Educational Media International, 57(4), 353–371. Tarng, W., Ou, K.-L., Tsai, W.-S., Lin, Y.-S., & Hsu, C.-K. (2010). An instructional design using the virtual ecological pond for science education in elementary schools. Journal of Educational Technology Systems, 38(4), 385–406. Tomara, M., & Gouscos, D. (2019). A case study: Visualizing Coulomb forces with the aid of augmented reality. Journal of Educational Computing Research, 57(7), 1626–1642. Tsai, C.-C. (2020). The effects of augmented reality to motivation and performance in EFL vocabulary learning. International Journal of Instruction, 13(4), 987–1000. Quintana, M. G. B., & Fernández, S. M. (2015). A pedagogical model to develop teaching skills. The collaborative learning experience in the Immersive Virtual World TYMMI. Computers in Human Behavior, 51(Part B), 594–603. https://doi.org/10.1016/j.chb.2015.03.016 Villanueva, A., Liu, Z., Kitaguchi, Y., Zhu, Z., Peppler, K., Redick, T., & Ramani, K. (2021). Towards modeling of human skilling for electrical circuitry using augmented reality applications. International Journal of Educational Technology in Higher Education, 18. https://doi.org/10.1186/s41239-021-00268-9 Wen, Y. (2018). Chinese character composition game with the augment paper. Educational Technology & Society, 21(3), 132–145. Wen, Y. (2021). Augmented reality enhanced cognitive engagement: Designing classroom-based collaborative learning activities for young language learners. Educational Technology Research and Development, 69(2), 843–860. https://doi.org/10.1007/s11423-020-09893-z Wu, C. H., Tang, Y. M., Tsang, Y. P., & Chau, K. Y. (2021). Immersive learning design for technology education: A soft systems methodology. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.745295 Wu, P.-H., Hwang, G.-J., Yang, M.-L., & Chen, C.-H. (2018). Impacts of integrating the repertory grid into an augmented reality-based learning design on students’ learning achievements, cognitive load and degree of satisfaction. Interactive Learning Environments, 26(2), 221–234. https://doi.org/10.1080/10494820.2017.1294608 Yang, F., & Stefaniak, J. (2023). A systematic review of studies exploring help-seeking strategies in online learning environments. Online Learning, 27(1), 106–126. https://doi.org/10.24059/olj.v27i1.3400 Yang, J. C., Chen, C. H., & Jeng, M. C. (2010). Integrating video-capture virtual reality technology into a physically interactive learning environment for English learning. Computers & Education, 55(3), 1346–1356. Yoon, S. A., Elinich, K., Wang, J., Steinmeier, C., & Tucker, S. (2012). Using augmented reality and knowledge-building scaffolds to improve learning in a science museum. International Journal of Computer-Supported Collaborative Learning, 7(4), 519–541. https://doi.org/10.1007/s11412-012-9156-x Zarraonandia, T., Aedo, I., Díaz, P., & Montero, A. (2013). An augmented lecture feedback system to support learner and teacher communication. British Journal of Educational Technology, 44(4), 616–628. https://doi.org/10.1111/bjet.12047 Zimmerman, H. T., & Land, S. M. (2022). Supporting children’s place-based observations and explanations using collaboration scripts while learning-on-the-move outdoors. International Journal of Computer-Supported Collaborative Learning, 17(1), 107–134. https://doi.org/10.1007/s11412-022-09366-w