What do we do when we analyse the temporal aspects of computer-supported collaborative learning? A systematic literature review

Bakeman, 1997 Bannert, 2014, Process mining techniques for analysing patterns and strategies in students' self-regulated learning, Metacognition and Learning, 9, 161, 10.1007/s11409-013-9107-6 Bridges, 2020, Dialogic intervisualizing in multimodal inquiry, International Journal of Computer-Supported Collaborative Learning, 15, 283, 10.1007/s11412-020-09328-0 Chang, 2017, An analysis of student collaborative problem solving activities mediated by collaborative simulations, Computers & Education, 114, 222, 10.1016/j.compedu.2017.07.008 Chang, 2017, An analysis of collaborative problem‐solving activities mediated by individual‐based and collaborative computer simulations, Journal of Computer Assisted Learning, 33, 649, 10.1111/jcal.12208 Chen, 2017, Two tales of time: Uncovering the significance of sequential patterns among contribution types in knowledge-building discourse, Interactive Learning Environments, 25, 162, 10.1080/10494820.2016.1276081 Chen, 2018, The role of collaboration, computer use, learning environments, and supporting strategies in CSCL: A meta-analysis, Review of Educational Research, 88, 799, 10.3102/0034654318791584 Chiang, 2014, Students' online interactive patterns in augmented reality-based inquiry activities, Computers & Education, 78, 97, 10.1016/j.compedu.2014.05.006 Chiu, 2005, A new method for analyzing sequential processes, Small Group Research, 36, 600, 10.1177/1046496405279309 Cicchetti, 1994, Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology, Psychological Assessment, 6, 284, 10.1037/1040-3590.6.4.284 Cohen, 1960, A coefficient of agreement for nominal scales, Educational and Psychological Measurement, 20, 37, 10.1177/001316446002000104 Cress, 2019, Investigating the complexity of computer-supported collaborative learning in action, International Journal of Computer-Supported Collaborative Learning, 14, 137, 10.1007/s11412-019-09305-2 Dado, 2017, A review of methodological applications of social network analysis in computer-supported collaborative learning, Educational Research Review, 22, 159, 10.1016/j.edurev.2017.08.005 Daradoumis, 2006, A layered framework for evaluating on-line collaborative learning interactions, International Journal of Human-Computer Studies, 64, 622, 10.1016/j.ijhcs.2006.02.001 de Laat, 2007, Investigating patterns of interaction in networked learning and computer-supported collaborative learning: A role for social network analysis, International Journal of Computer-Supported Collaborative Learning, 2, 87, 10.1007/s11412-007-9006-4 Ding, 2015, Using epistemic synchronization index (ESI) to measure students' knowledge elaboration process in CSCL, Computers & Education, 80, 122, 10.1016/j.compedu.2014.08.004 Eagan, 2020, Testing the reliability of inter-rater reliability, 454 Eagan Eagan, 2017, Can we rely on IRR? Testing the assumptions of inter-rater reliability, Vol. 2, 529 Eryilmaz, 2013, Enhancing student knowledge acquisition from online learning conversations, International Journal of Computer-Supported Collaborative Learning, 8, 113, 10.1007/s11412-012-9163-y Hämäläinen, 2011, Theoretical and pedagogical perspectives on orchestrating creativity and collaborative learning, Educational Research Review, 6, 169, 10.1016/j.edurev.2011.08.001 Hew, 2019, Where is the “theory” within the field of educational technology research?, British Journal of Educational Technology, 50, 956, 10.1111/bjet.12770 Hou, 2011, Analyzing the social knowledge construction behavioral patterns of an online synchronous collaborative discussion instructional activity using an instant messaging tool: A case study, Computers & Education, 57, 1459, 10.1016/j.compedu.2011.02.012 Jahng, 2010, Collaborative learning in an online course: A comparison of communication patterns in small and whole group activities, The Journal of Distance Education, 24, 39 Järvelä, 2016, Recognizing socially shared regulation by using the temporal sequences of online chat and logs in CSCL, Learning and Instruction, 42, 1, 10.1016/j.learninstruc.2015.10.006 Jeong, 2014, An examination of CSCL methodological practices and the influence of theoretical frameworks 2005–2009, International Journal of Computer-Supported Collaborative Learning, 9, 305, 10.1007/s11412-014-9198-3 Jeong, 2019, Ten years of computer-supported collaborative learning: A meta-analysis of CSCL in STEM education during 2005–2014, Educational Research Review, 28, 100284, 10.1016/j.edurev.2019.100284 Kapur, 2011, Temporality matters: Advancing a method for analyzing problem-solving processes in a computer-supported collaborative environment, International Journal of Computer-Supported Collaborative Learning, 6, 39, 10.1007/s11412-011-9109-9 Kapur, 2008, Sensitivities to early exchange in synchronous computer-supported collaborative learning (CSCL) groups, Computers & Education, 51, 54, 10.1016/j.compedu.2007.04.007 Khanlari, 2017, Productive knowledge building discourse through student-generated questions, 585 Knight, 2017, Time for change: Why learning analytics needs temporal analysis, Journal of Learning Analytics, 4, 7, 10.18608/jla.2017.43.2 Lämsä, 2018, Games for enhancing basic reading and maths skills: A systematic review of educational game design in supporting learning by people with learning disabilities, British Journal of Educational Technology, 49, 596, 10.1111/bjet.12639 Lämsä, 2018, Visualising the temporal aspects of collaborative inquiry-based learning processes in technology-enhanced physics learning, International Journal of Science Education, 40, 1697, 10.1080/09500693.2018.1506594 Langley, 1999, Strategies for theorizing from process data, Academy of Management Review, 24, 691, 10.5465/amr.1999.2553248 Lemke, 2000, Across the scales of time: Artifacts, activities, and meanings in ecosocial systems, Mind, Culture and Activity, 7, 273, 10.1207/S15327884MCA0704_03 Lin, 2013, An investigation of learners' collaborative knowledge construction performances and behavior patterns in an augmented reality simulation system, Computers & Education, 68, 314, 10.1016/j.compedu.2013.05.011 Lin, 2016, Analyzing the social knowledge construction and online searching behavior of high school learners during a collaborative problem solving learning activity: A multi-dimensional behavioral pattern analysis, The Asia-Pacific Education Researcher, 25, 893, 10.1007/s40299-016-0317-y Lin, 2013, Analyzing knowledge dimensions and cognitive process of a project-based online discussion instructional activity using Facebook in an adult and continuing education course, Computers & Education, 60, 110, 10.1016/j.compedu.2012.07.017 Lin, 2015, Peer interaction and social network analysis of online communities with the support of awareness of different contexts, International Journal of Computer-Supported Collaborative Learning, 10, 139, 10.1007/s11412-015-9212-4 Liu, 2017, A social network analysis on elementary student engagement in the networked creation community, Computers & Education, 115, 114, 10.1016/j.compedu.2017.08.002 Lu, 2011, Collaborative argumentation and justifications: A statistical discourse analysis of online discussions, Computers in Human Behavior, 27, 946, 10.1016/j.chb.2010.11.021 Ludvigsen, 2018, Developing understanding beyond the given knowledge and new methodologies for analyses in CSCL, International Journal of Computer-Supported Collaborative Learning, 13, 359, 10.1007/s11412-018-9291-0 Ludvigsen, 2019, Reflections and looking ahead for CSCL: Digital infrastructures, digital tools, and collaborative learning, International Journal of Computer-Supported Collaborative Learning, 14, 1, 10.1007/s11412-019-09312-3 Lund, 2019, Building and regulating cognitive, linguistic, and interactional aspects of knowledge between the individual and the group, Computers in Human Behavior, 100, 370, 10.1016/j.chb.2019.04.013 Malmberg, 2015, Promoting socially shared regulation of learning in CSCL: Progress of socially shared regulation among high- and low-performing groups, Computers in Human Behavior, 52, 562, 10.1016/j.chb.2015.03.082 Mansur, 2016, The analysis of student collaborative work inside social learning network analysis based on degree and eigenvector centrality, International Journal of Electrical and Computer Engineering, 6, 2488 Medina, 2013, Inscriptions becoming representations in representational practices, The Journal of the Learning Sciences, 22, 33, 10.1080/10508406.2012.737390 Mercer, 2008, The seeds of time: Why classroom dialogue needs a temporal analysis, The Journal of the Learning Sciences, 17, 33, 10.1080/10508400701793182 Moher, 2009, Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement, PLoS Medicine, 6, 1, 10.1371/journal.pmed.1000097 Molenaar, 2014, Advances in temporal analysis in learning and instruction, Frontline Learning Research, 2, 15 Molenaar, 2014, Dissecting sequences of regulation and cognition: Statistical discourse analysis of primary school children's collaborative learning, Metacognition and Learning, 9, 137, 10.1007/s11409-013-9105-8 Molenaar, 2017, Effects of sequences of cognitions on group performance over time, Small Group Research, 48, 131, 10.1177/1046496416689710 Oner, 2013, Analyzing group coordination when solving geometry problems with dynamic geometry software, International Journal of Computer-Supported Collaborative Learning, 8, 13, 10.1007/s11412-012-9161-0 Rasmussen, 2017, Heterochrony through moment-to-moment interaction: A micro-analytical exploration of learning as sense making with multiple resources, International Journal of Educational Research, 84, 79, 10.1016/j.ijer.2016.04.003 Reimann, 2021, Methodological progress in the study of self-regulated learning enablestheory advancement, Learning and Instruction, 72, 101269, 10.1016/j.learninstruc.2019.101269 Reimann, 2009, Time is precious: Variable- and event-centred approaches to process analysis in CSCL research, International Journal of Computer-Supported Collaborative Learning, 4, 239, 10.1007/s11412-009-9070-z Reychav, 2018, Centrality Measures and Academic Achievement in Computerized Classroom Social Networks: An Empirical Investigation, Journal of Educational Computing Research, 56, 589, 10.1177/0735633117715749 Saqr, 2018, How the study of online collaborative learning can guide teachers and predict students’ performance in a medical course, BMC medical education, 18, 1 Saqr, 2020, Capturing the participation and social dimensions of computer-supported collaborative learning through social network analysis: Which method and measures matter?, International Journal of Computer-Supported Collaborative Learning, 15, 227, 10.1007/s11412-020-09322-6 Schneider, 2014, Toward collaboration sensing, International Journal of Computer-Supported Collaborative Learning, 9, 371, 10.1007/s11412-014-9202-y Shaffer, 2017 Shaffer, 2016, A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data, Journal of Learning Analytics, 3, 9, 10.18608/jla.2016.33.3 Shaffer, 2009, Epistemic network analysis: A prototype for 21st-century assessment of learning, International Journal of Learning and Media, 1, 33, 10.1162/ijlm.2009.0013 Shamseer, 2015, Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation, BMJ, 349, 1 Sharma, 2016, Examining patterns of participation and meaning making in student blogs: A case study in higher education, American Journal of Distance Education, 30, 2, 10.1080/08923647.2016.1119605 Shukor, 2014, Exploring students' knowledge construction strategies in computer-supported collaborative learning discussions using sequential analysis, Educational Technology & Society, 17, 216 Siebert-Evenstone, 2017, In search of conversational grain size: Modelling semantic structure using moving stanza windows, Journal of Learning Analytics, 4, 123, 10.18608/jla.2017.43.7 Sobocinski, 2017, Exploring temporal sequences of regulatory phases and associated interactions in low- and high-challenge collaborative learning sessions, Metacognition and Learning, 12, 275, 10.1007/s11409-016-9167-5 Stahl, 2017, Group practices: A new way of viewing CSCL, International Journal of Computer-Supported Collaborative Learning, 12, 113, 10.1007/s11412-017-9251-0 Stepanyan, 2014, Culture, role and group work: A social network analysis perspective on an online collaborative course, British Journal of Educational Technology, 45, 676, 10.1111/bjet.12076 Su, 2018, Exploring college English language learners' self and social regulation of learning during wiki-supported collaborative reading activities, International Journal of Computer-Supported Collaborative Learning, 13, 35, 10.1007/s11412-018-9269-y Swigger, 2012, The temporal communication behaviors of global software development student teams, Computers in Human Behavior, 28, 384, 10.1016/j.chb.2011.10.008 Tirado, 2015, The effect of centralization and cohesion on the social construction of knowledge in discussion forums, Interactive Learning Environments, 23, 293, 10.1080/10494820.2012.745437 Traxler, 2018, Networks identify productive forum discussions, Physical Review Physics Education Research, 14, 020107, 10.1103/PhysRevPhysEducRes.14.020107 Valero Haro, 2019, First- and second-order scaffolding of argumentation competence and domain-specific knowledge acquisition: A systematic review, Technology, Pedagogy and Education, 28, 329, 10.1080/1475939X.2019.1612772 Van Laer, 2018, Towards a methodological framework for sequence analysis in the field of self-regulated learning, Frontline Learning Research, 6, 228, 10.14786/flr.v6i3.367 van Leeuwen, 2019, A systematic review of teacher guidance during collaborative learning in primary and secondary education, Educational Research Review, 27, 71, 10.1016/j.edurev.2019.02.001 Vieira, 2018, Visual learning analytics of educational data: A systematic literature review and research agenda, Computers & Education, 122, 119, 10.1016/j.compedu.2018.03.018 Wang, 2017, Analyzing the knowledge construction and cognitive patterns of blog-based instructional activities using four frequent interactive strategies (problem solving, peer assessment, role playing and peer tutoring): A preliminary study, Educational Technology Research & Development, 65, 301, 10.1007/s11423-016-9471-4 Weinberger, 2006, A framework to analyze argumentative knowledge construction in computer-supported collaborative learning, Computers & Education, 46, 71, 10.1016/j.compedu.2005.04.003 Wise, 2011, Analyzing temporal patterns of knowledge construction in a role-based online discussion, International Journal of Computer-Supported Collaborative Learning, 6, 445, 10.1007/s11412-011-9120-1 Wise, 2017, Visions of CSCL: Eight provocations for the future of the field, International Journal of Computer-Supported Collaborative Learning, 12, 423, 10.1007/s11412-017-9267-5 Wu, 2013, Analysis of learning behavior in problem-solving-based and project-based discussion activities within the seamless online learning integrated discussion (SOLID) system, Journal of Educational Computing Research, 49, 61, 10.2190/EC.49.1.c Wu, 2014, A case study of social network analysis of a discussion area of a virtual learning platform, World Transactions on Engineering and Technology Education, 12, 458 Wu, 2020, Incorporation of Collaborative Problem Solving and Cognitive Tools to Improve Higher Cognitive Processing in Online Discussion Environments, Journal of Educational Computing Research, 58, 249, 10.1177/0735633119828044 Zhang, 2017, Interactive networks and social knowledge construction behavioral patterns in primary school teachers’ online collaborative learning activities, Computers & Education, 104, 1, 10.1016/j.compedu.2016.10.011