Examining Changing Assessment Practices in Online Teaching: A Multiple-Case Study of EFL School Teachers in China
Tóm tắt
This paper reports on the results from a multiple-case study of how EFL school teachers in China coped with online assessment for 10 weeks caused by the Covid-19 pandemic. We looked into the online assessment practices of seven teachers from seven regions of China, through individual interview, teachers’ journals, instructional designs for online teaching, and online classroom observation. The findings reveal that the participants went through a transition from neglecting assessment to overdoing assessment in their online teaching process. Whilst they used a range of online assessment methods, they did not systematically incorporate online assessment into their online curricula. Analysis shows that this issue is most likely to result from teachers’ lack of understanding of the nature of online assessment as an intrinsic component of curriculum and a major means of enhancing students’ learning. Implications will be discussed.
Tài liệu tham khảo
Akimov, A., & Malin, M. (2020). When old becomes new: A case study of oral examination as an online assessment tool. Assessment and Evaluation in Higher Education. https://doi.org/10.1080/02602938.2020.1730301
Akimov, A., Kobinger, S., & Malin, M. (2018). Determinants of student success in finance courses. Journal of Financial Education, 44(2), 223–245.
Benson, A. D. (2003). Assessing participant learning in online environments. New Directions for Adult and Continuing Education, 100, 69–78.
Burch, C. B. (1999). Inside the portfolio experience: The student’s perspective. English Education, 32(1), 34–49.
Challis, D. (2005). Committing to quality learning through adaptive online assessment. Assessment and Evaluation in Higher Education, 30(5), 519–527.
Chang, C.-C., Tseng, K.-H., Chou, P.-N., & Chen, Y.-H. (2011). Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school’s students taking computer course. Computers and Education, 57, 1306–1316.
Chang, C.-C., Tseng, K.-H., & Liang, C. (2014). Is reflection performance correlated to the learning effect in a Web-based portfolio assessment environment for middle school students? The Asia-Pacific Education Researcher, 23, 73–82.
Cheng, L., Rogers, T., & Hu, H. (2004). ESL/EFL instructors’ classroom assessment practices: Purposes, methods, and procedures. Language Testing, 21(3), 360–389.
Cheng, A.-C., Jordan, M. E., Schallert, D. L., & The D-Team. (2013). Reconsidering assessment in online/hybrid courses: Knowing versus learning. Computers and Education, 68, 51–59.
Dabbagh, N., & Bannan-Ritland, B. (2005). Online learning: Concepts, strategies and application. Pearson Prentice Hall.
de Lima, M., & Zorrilla, M. E. (2017). Social networks and the building of learning communities: An experimental study of a social MOOC. International Review of Research in Open and Distance Learning, 18(1), 40–64.
Ebadi, S., & Rahimi, M. (2019). Mediating EFL learners’ academic writing skills in online dynamic assessment using Google Docs. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2018.1527362
Fluck, A. E. (2019). An international review of eExam technologies and impact. Computers and Education, 132, 1–15.
Gaytan, J., & McEwen, B. (2007). Effective online instructional and assessment strategies. American Journal of Distance Education, 21(3), 117–132.
Gikandi, J., Morrow, D., & Davis, N. (2011). Online formative assessment in higher education: A review of the literature. Computers and Education, 57(4), 2333–2351.
Gu, P. Y. (2014). The unbearable lightness of the curriculum: What drives the assessment practices of a teacher of English as a foreign language in a Chinese secondary school? Assessment in Education: Principles, Policy and Practice, 21(3), 286–305.
Hargreaves, E. (2007). The validity of collaborative assessment for learning. Assessment in Education: Principles, Policy and Practice, 14(2), 185–199.
Hricko, M., & Howell, S. (2006). Online assessment and measurement: Foundations and challenges. Information Science Publishing.
Jung, Y., & Lee, J. (2018). Learning engagement and persistence in massive open online courses (MOOCs). Computers and Education, 122, 9–22.
Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 161–197.
Lee, Y. (2019). Using self-organizing map and clustering to investigate problem-solving patterns in the massive open online course: An exploratory study. Journal of Educational Computing Research, 57(2), 471–490.
MacIntyre, P. D., Gregersen, T., & Mercer, S. (2020). Language teachers’ coping strategies during the Covid-19 conversion to online teaching: Correlations with stress, wellbeing and negative emotions. System, 94, 1–13.
Moffitt, R. L., Padgett, C., & Grieve, R. (2020). Accessibility and emotionality of online assessment feedback: Using emoticons to enhance student perceptions of marker competence and warmth. Computers and Education, 143, 1–11.
Moser, K. M., Wei, T., & Brenner, D., (2020). Remote teaching during Covid-19: Implications from a national survey of language educators. System, https://doi.org/10.1016/j.system.2020.102431.
Ng, O.-L., Ting, F., Lam, W.-H., & Liu, M. (2020). Active learning in undergraduate mathematics tutorials via cooperative problem-based learning and peer assessment with interactive online whiteboards. The Asia-Pacific Education Researcher, 29, 285–294.
Oosterhof, A., Conrad, R., & Ely, D. (2008). Assessing learners online. Pearson.
Qi, L. (2007). Is testing an efficient agent for pedagogical change? Examining the intended washback of the writing task in a high-stakes English test in China. Assessment in Education: Principles, Policy and Practice, 14, 51–74.
Robles, M., & Braathen, S. (2002). Online assessment techniques. Delta Pi Epsilon Journal, 44(1), 39–49.
Rovai, A. P. (2000). Online and traditional assessments: What is the difference? Internet and Higher Education, 3(3), 141–151.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327.
Speck, B. W. (2002). Learning-teaching-assessment paradigms and the online classroom. New Directions for Teaching and Learning, 91, 5–18.
Stiggins, R., & Chappuis, J. (2005). Using student-involved classroom assessment to close achievement gaps. Theory into Practice, 44(1), 11–18.
UNESCO. (2020). Education: From disruption to recovery. Retrieved from https://en.unesco.org/covid19/educationresponse. Accessed 3 Oct 2021.
Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers and Education, 163, 1–24.
Xu, H. (2017). Exploring novice EFL teachers’ classroom assessment literacy development: A three-year longitudinal study. The Asia-Pacific Education Researcher, 26(3–4), 219–226.
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162.
Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Thousand Oaks, CA: Sage.
Yu, F.-Y., Wu, C.-P., & Hung, C.-C. (2014). Are there any joint effects of online student question generation and cooperative learning? The Asia-Pacific Education Researcher, 23, 367–378.