The impact of COVID-19 on student learning in New South Wales primary schools: an empirical study

The Australian Educational Researcher - Tập 48 Số 4 - Trang 605-637 - 2021
Jennifer Gore1, Leanne Fray1, Andrew Miller1, Jessica Harris1, Wendy Taggart1
1Teachers and Teaching Research Centre, School of Education, University of Newcastle, Newcastle, Australia

Tóm tắt

AbstractThe COVID-19 pandemic produced widespread disruption to schooling, impacting 90% of the world’s students and moving entire school systems to remote and online learning. In the state of New South Wales, Australia, most students engaged in learning from home for at least eight weeks, with subsequent individual and intermittent school closures. However, while numerous claims have circulated in the popular media and in think tank reports, internationally, about the negative impacts on learning, there is limited empirical evidence of decreased student achievement. Drawing on data from more than 4800 Year 3 and 4 students from 113 NSW government schools, this paper compares student achievement during 2019 and 2020 in a sample of matched schools to examine the effects of the system-wide disruption. Somewhat surprisingly, our analysis found no significant differences between 2019 and 2020 in student achievement growth as measured by progressive achievement tests in mathematics or reading. A more nuanced picture emerges when the sample is examined by dis/advantage (ICSEA) and Year level. The Year 3 cohort in the least advantaged schools (ICSEA < 950) achieved 2 months less growth in mathematics, while the Year 3 students in mid-ICSEA schools (950–1050) achieved 2 months’ additional growth. No significant differences were identified for Indigenous students or students located in regional locations. These results provide an important counter-narrative to widespread speculation about alarming levels of ‘learning loss’ for all students. While the lower achievement growth in mathematics for Year 3 students in lower ICSEA schools must be addressed as a matter of urgency to avoid further inequities, most students are, academically, where they are expected to be. Our findings are a testament to the dedicated work of teachers during the 2020 pandemic to ensure that learning for most students was not compromised, despite unusually trying circumstances.

Từ khóa


Tài liệu tham khảo

AC Del Re. (2013). compute.es: Compute Effect Sizes. R package version 02.2. https://cran.r-project.org/web/packages/compute.es/. Accessed 11 June 2020.

Alvarez, D. (2010). “I Had To Teach Hard”: Traumatic conditions and teachers in post-Katrina classrooms. The High School Journal, 94(1), 28–39. https://doi.org/10.1353/hsj.2010.0007.

Australian Council of Educational Research [ACER]. (2011). Interpreting ACER test results. https://www.acer.org/files/PATM-Interpreting-Scores.pdf. Accessed 19 May 2020

Australian Government Department of Health. (2020, April 17). Australian Health Protection Principal Committee (AHPPC) advice on reducing the potential risk of COVID-19 transmission in schools. https://www.health.gov.au/news/australian-health-protection-principal-committee-ahppc-advice-on-reducing-the-potential-risk-of-covid-19-transmission-in-schools. Accessed 9 December 2020.

Baker, J. (2020, August 9). Coronavirus Australia: COVID-19 pandemic is taking its toll on students. The Sydney Morning Herald. https://www.smh.com.au/education/restless-and-unsettled-the-pandemic-is-taking-its-toll-on-students-20200807-p55jqm.html. Accessed 12 August 2020.

Baytiyeh, H. (2019). Mobile learning technologies as a means of maintaining education delivery in crisis situations. International Journal of Information and Communication Technology Education, 15(3), 1–10. https://doi.org/10.4018/IJICTE.2019070101.

Brown, N., te Riele, K., Shelley, B., & Woodroffe, J. (2020). Learning at home during COVID-19: Effects on vulnerable young Australians. Hobart. https://www.dese.gov.au/system/files/doc/other/learning_at_home_during_covid_30042020.pdf. Accessed 3 June 2020.

Burgess, S., & Sievertsen, H. H. (2020). Schools, skills, and learning: The impact of COVID-19 on education. VOX, CEPR Policy Portal. https://voxeu.org/article/impact-covid-19-education. Accessed 3 June 2020

Carr-Chellman, A. A., Beabout, B., Alkandari, K. A., Almeida, L. C., Gursoy, H. T., Ma, Z., et al. (2008). Change in chaos: seven lessons learned from Katrina. Educational Horizons, 87(1), 26–39. https://files.eric.ed.gov/fulltext/EJ815369.pdf. Accessed 14 August 2020.

CIRES, & Mitchell Institute. (2020). Brief assessment to the Australian Government, Department of Education, Skills and Employment: Impact of learning from home on educational outcomes for disadvantaged children. Melbourne. https://www.vu.edu.au/sites/default/files/impact-of-learning-from-home-federal-government-brief-mitchell-institute.pdf. Accessed 1 December 2020.

Clinton, J. (2020). Supporting Vulnerable Children in the Face of a Pandemic: A paper prepared for the Australian Government Department of Education, Skills and Employment. Centre for Program Evaluation, Melbourne Graduate School of Education, The University of Melbourne. https://apo.org.au/node/303563.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, New Jersey: Lawrence Erlbaum Associates.

Convery, I., Balogh, R., & Carroll, B. (2010). ‘Getting the kids back to school’: Education and the emotional geographies of the 2007 Hull floods. Journal of Flood Risk Management, 3(2), 99–111. https://doi.org/10.1111/j.1753-318X.2010.01060.x.

Curriculum Associates LLC. (2020). i-Ready Diagnostic Results Understanding Student Needs Paper 2020.

Dorn, E., Hancock, B., Sarakatsannis, J., & Viruleg, E. (2020). COVID-19 and learning loss—disparities grow and students need help. https://www.mckinsey.com/industries/public-and-social-sector/our-insights/covid-19-and-learning-loss-disparities-grow-and-students-need-help. Accessed 16 December 2020.

Education Endowment Foundation. (2018). The EEF’s months of additional progress measure. https://educationendowmentfoundation.org.uk/modals/help/projects/the-eefs-months-progress-measure/. Accessed 18 December 2020.

Engzell, P., Frey, A., & Verhagen, M. (2020, November 9). The collateral damage to children’s education during lockdown. VOXeu CEPR Policy Portal. https://voxeu.org/article/collateral-damage-children-s-education-during-lockdown. Accessed 26 November 2020.

Ezaki, N. (2018). Impact of the 2015 Nepal earthquakes on children’s schooling: Focusing on individual children’s enrolment flow. Education, 46(7), 867–878. https://doi.org/10.1080/03004279.2017.1383502.

Finkel, A. (2020). Differential learning outcomes for online versus in-class education. Canberra. https://www.science.org.au/sites/default/files/rrif-q005-covid19-online-vs-in-class-education.pdf. Accessed 14 August 2020.

Gore, J. M., Miller, A., Fray, L., Harris, J., & Prieto, E. (2021). Improving student achievement through professional development : Results from a randomised controlled trial of Quality Teaching Rounds. Teaching and Teacher Education. https://doi.org/10.1016/j.tate.2021.103297.

Gulosino, C., & Miron, G. (2017). Growth and performance of fully online and blended K-12 public schools. Education Policy Analysis Archives, 25(124), 1–38.

Hampshire, A. (2020). Youth poverty in COVID-19 Australia. Committee for Economic Development of Australia. https://www.ceda.com.au/Digital-hub/Blogs/CEDA-Blog/April-2020/Youth-poverty-in-COVID-19-Australia. Accessed 3 June 2020.

Hargreaves, A., & Fullan, M. (2020). Professional capital after the pandemic: revisiting and revising classic understandings of teachers’ work. Journal of Professional Capital and Community. https://doi.org/10.1108/JPCC-06-2020-0039.

Hattie, J. (2020). Visible Learning effect sizes when schools are closed: What matters and what does not. Corwin Connect. https://corwin-connect.com/2020/04/visible-learning-effect-sizes-when-schools-are-closed-what-matters-and-what-does-not/. Accessed 3 June 2020.

Hedges, L. V, & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press. https://idostatistics.com/hedges-olkin-1985-statistical-methods-for-meta-analysis/. Accessed 12 June 2020.

Henebery, B. (2020, May 26). Report reveals lockdown’s toll on learning. The Educator. https://www.theeducatoronline.com/k12/news/report-reveals-lockdowns-toll-on-learning/271568. Accessed 12 August 2020.

Hinson, J. M., LaPrairie, K., & Carroll, E. (2007). Emergency preparedness and E-Learning: recommendations for readiness. Journal of Interactive Instruction Development, 20(2), 3–7. http://eds.b.ebscohost.com/eds/pdfviewer/pdfviewer?vid=0&sid=9144bcc4-d27f-4d67-8da2-60a4c5a48401%40sessionmgr101. Accessed 3 June 2020.

Ho, R. T. H., Fan, F., Lai, A. H. Y., Lo, P. H. Y., Potash, J. S., Kalmanowitz, D. L., et al. (2012). An expressive arts-based and strength-focused experiential training program for enhancing the efficacy of teachers affected by earthquake in China. Creative Education, 3(01), 67–74. https://doi.org/10.4236/ce.2012.31011.

Institute for Social Science Research [ISSR]. (2020). Learning through COVID-19: Maximising educational outcomes for Australia’s children and young people experiencing disadvantage. https://issr.uq.edu.au/Learning-through-COVID-19. Accessed 31 August 2020.

Joseph, B., & Fahey, G. (2020). Pain without gain: Why school closures are bad policy. Policy Paper (Vol. 28). https://www.cis.org.au/publications/policy-papers/pain-without-gain-why-school-closures-are-bad-policy/. Accessed 12 August 2020.

Miller, A., Gore, J. M., Wallington, C., Harris, J., Prieto-rodriguez, E., & Smith, M. (2019). Improving student outcomes through professional development: Protocol for a cluster randomised controlled trial of quality teaching rounds. International Journal of Educational Research, 98(May), 146–158. https://doi.org/10.1016/j.ijer.2019.09.002.

Norman, P. (2020, August 10). The shock of dealing with COVID-19 has made teachers even stronger and better at their craft. EduResearch Matters. https://www.aare.edu.au/blog/?p=7103. Accessed 1 December 2020.

NSW Department of Education. (2020a). Lessons from the COVID-19 Pandemic January – July 2020.

NSW Department of Education. (2020b). Check-in assessments - Years 3, 5 and 9. https://www.cese.nsw.gov.au/images/stories/PDF/Check-in-assessment-AA.pdf. Accessed 25 January 2021.

NSW Government. (2020, November 10). Free tutoring to support students | NSW Government. Ministerial Media Releases. https://www.nsw.gov.au/media-releases/free-tutoring-to-support-students. Accessed 17 December 2020.

OECD. (2020, August 11). Combatting COVID-19’s effect on children. OECD Policy Responses to Coronavirus (COVID-19). http://www.oecd.org/coronavirus/policy-responses/combatting-covid-19-s-effect-on-children-2e1f3b2f/. Accessed 15 December 2020.

Ofsted. (2020a). Ofsted: Children hardest hit by COVID-19 pandemic are regressing in basic skills and learning. Ofsted COVID-19 series. https://www.gov.uk/government/news/ofsted-children-hardest-hit-by-covid-19-pandemic-are-regressing-in-basic-skills-and-learning. Accessed 18 November 2020.

Ofsted. (2020b). COVID-19 series: briefing on schools, October 2020. www.gov.uk/government/publications/covid-19-series-briefing-on-schools-. Accessed 14 December 2020.

Pedro Azevedo, J., Hasan, A., Geven, K., Goldembert, D., & Aroob Iqbal, S. (2020, September 10). Learning losses due to COVID19 could add up to $10 trillion. World Bank Blogs. https://blogs.worldbank.org/education/learning-losses-due-covid19-could-add-10-trillion. Accessed 24 November 2020.

Potts Rosevear, M. (2020, November 22). Disadvantage and the digital divide in education. The Sydney Morning Herald. Sydney. https://www.smh.com.au/national/disadvantage-and-the-digital-divide-in-education-20200930-p560tx.html. Accessed 23 November 2020.

Psacharopoulos, G., Parinos, H. A., Collis, V., & Vegas, E. (2020). The COVID-19 cost of school closures. World Bank. Education for Global Development. https://blogs.worldbank.org/education/covid-19-cost-school-closures. Accessed 3 June 2020.

R Core Team. (2019). R: The R Project for Statistical Computing. https://www.r-project.org/. Accessed 11 June 2020.

Sawchuk, S. (2020, August 19). Overcoming COVID-19 learning loss. Education Week. https://www.edweek.org/ew/issues/reopening-schools/overcoming-covid-19-learning-loss.html. Accessed 24 November 2020.

Schleicher, A. (2020). The impact of COVID-19 on education insights from education at a glance 2020. OECD.

Slavin, R. (2020, December 17). Large-scale tutoring could fail. Here’s how to ensure it does not. Robert Slavin’s Blog. Routledge. https://robertslavinsblog.wordpress.com/. Accessed 21 December 2020.

Sonnemann, J., & Goss, P. (2020). COVID catch-up: Helping disadvantaged students close the equity gap. http://www.grattan.edu.au/. Accessed 23 October 2020.

Storen, R., & Corrigan, N. (2020, October 22). COVID-19: a chronology of state and territory government announcements (up until 30 June 2020)—Parliament of Australia. Parliament of Australia. https://www.aph.gov.au/About_Parliament/Parliamentary_Departments/Parliamentary_Library/pubs/rp/rp2021/Chronologies/COVID-19StateTerritoryGovernmentAnnouncements#_Toc52275796. Accessed 21 December 2020.

Thompson, B., Jerome, A. M., Payne, H. J., Mazer, J. P., Kirby, E. G., & Pfohl, W. (2017). Analyzing postcrisis challenges and strategies associated with school shootings: An application of discourse of renewal theory. Communication Studies, 68(5), 533–551. https://doi.org/10.1080/10510974.2017.1373370.

Trethowan, V., & Nursey, J. (2015). Helping children and adolescents recover from disaster: A review of teacher-based support programs in Victorian schools. The Australian Journal of Emergency Management, 30(4), 17–20.

UNESCO. (2020a). School closures caused by Coronavirus (COVID-19). Education: From disruption to recovery. https://en.unesco.org/covid19/educationresponse. Accessed 14 August 2020.

UNESCO. (2020b). Reopening schools: When, where and how? https://en.unesco.org/news/reopening-schools-when-where-and-how. Accessed 12 August 2020.

United Nations. (2020). Policy brief: Education during COVID-19 and beyond. https://www.un.org/development/desa/dspd/wp-content/uploads/sites/22/2020/08/sg_policy_brief_covid-19_and_education_august_2020.pdf. Accessed 24 November 2020.

Thông tin
Thông tin xuất bản

The Australian Educational Researcher

Tập 48 Số 4

605-637

Thông tin tác giả