The efficacy of learning analytics interventions in higher education: A systematic review
Tóm tắt
Educational institutions are increasingly turning to learning analytics to identify and intervene with students at risk of underperformance or discontinuation. However, the extent to which the current evidence base supports this investment is currently unclear, and particularly so in relation to the effectiveness of interventions based on predictive models. The aim of the present paper was to conduct a systematic review and quality assessment of studies on the use of learning analytics in higher education, focusing specifically on intervention studies. Search terms identified 689 papers, but only 11 studies evaluated the effectiveness of interventions based on learning analytics. These studies highlighted the potential of such interventions, but the general quality of the research was moderate, and left several important questions unanswered. The key recommendation based on this review is that more research into the implementation and evaluation of scientifically driven learning analytics is needed to build a solid evidence base for the feasibility, effectiveness and generalizability of such interventions. This is particularly relevant when considering the increasing tendency of educational institutions around the world to implement learning analytics interventions with only little evidence of their effectiveness.
What is already known about this topic?
Drop‐out rates and underachivement is a significant issue at most Western universities. Learning analytics have been shown to predict student performance and risk of dropping out. Interventions based on learning analytics have emerged in recent years, some reportedly successful. What this paper adds
The paper also reviews and synthesizes the evidence on the effectiveness of learning analytics interventions targeting student underperformance, experience and discontinuation. The paper compares and contrasts past and current learning analytics methods and foci, and makes recommendations for the future research and practice. It critically synthesizes the current evidence base on learning analytics interventions, which is a field that is in constant flux and development. Implications for practice and/or policy
The paper focuses on an increasing part of higher education with the goal of validating learning analytics methods and usefulness. The paper makes evidence‐based recommendations for institutions wishing to implement learning analytics programs and/or interventions. The paper makes evidence‐based recommendations for instructors as well as researchers in the field.
Từ khóa
Tài liệu tham khảo
Agnihotri L., 2014, Building a student at‐risk model: an end‐to‐end perspective, Proceedings of the 7th International Conference on Educational Data Mining Conference (EDM), 209
Arnold K. E., 2012, Course signals at Purdue: Using learning analytics to increase student success, Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, 267
Bienkowski M., 2012, Enhancing teaching and learning through educational data mining and learning analytics: An Issue Brief
2013 IEEE U. Bin Mat N. Buniyamin P. M. Arsad R. Kassim An overview of using academic learning analytics to predict and improve students’ achievement: A proposed proactive intelligent intervention 126 130
Cambruzzi W. L., 2015, Dropout prediction and reduction in distance education courses with the learning analytics multitrail approach, Journal of Universal Computer Science, 21, 23
Davis D., 2015, Altis consulting: HE information management specialists
Day M.(2015 February 20).NTU student dashboard.Learning Analytics Network University of East London. Retrieved fromhttps://analytics.jiscinvolve.org/wp/files/2015/02/Jisc-LA-Network-Mike-Day.pdf
Dekker G., 2009, Predicting students drop out: A case study, Educational Data Mining
Fancsali S. E., 2018, Using embedded formative assessment to predict state summative test scores, LAK ’18 Proceedings of the 8th International Conference on Learning Analytics and Knowledge, 161, 10.1145/3170358.3170392
Ferguson R., 2012, The state of learning analytics in 2012: A review and future challenges
Ferguson R., 2016, Joint research centre science for policy report; EUR 28294 EN, 1
Ferguson R., 2017, LAK 2017 Proceedings of the Seventh International Learning Analytics & Knowledge Conference, ACM International Conference Proceedings Series, 56
Harrak F., 2018, Profiling students from their questions in a blended learning environment, LAK ’18 Proceedings of the 8th International Conference on Learning Analytics and Knowledge, 102, 10.1145/3170358.3170389
Higher Education Statistics Agency (HESA), 2013, UKPIs: Non‐continuation rates (including projected outcomes) (tables T3, T4, T5)
Milliron M. D., 2014, Insight and action analytics: Three case studies to consider, Research and Practice in Assessment, 9, 70
2017 IEEE K. S. Na Z. Tasir Identifying at‐risk students in online learning by analyzing learning behavior: A systematic review 118 123
Papamitsiou Z., 2014, Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence, Educational Technology & Society, 17, 49
Rienties B., 2016, Analytics4Action evaluation framework: A review of evidence‐based learning analytics interventions at the Open University UK, Journal of Interactive Media in Education, 2016, 2, 1
2017 P. Saunders E. Gharaie A. Chester C. Leahy Improving the student experience with learning analytics in construction project management courses 754 765
Sclater N., 2016, Learning analytics in higher education: A review of UK and international practice
Sclater N., 2016, Learning analytics and student success: Assessing the evidence
Shapiro D., 2016, Completing College: A State‐Level View of Student Attainment Rates
Vossensteyn H., 2015, Dropout and completion in higher education in Europe: Main report
Whitmer J. Fernandes K. &Allen W. R.(2012 August 13).Analytics in progress: Technology use student characteristics and student achievement.Educause Review. Retrieved fromhttps://er.educause.edu/articles/2012/8/analytics-in-progress-technology-use-student-characteristics-and-student-achievement