Standardized proficiency tests in a campus-wide English curriculum: a washback study
Tóm tắt
Washback refers to the influence of tests on learning and teaching. To date, a number of studies have revealed that tests affect teaching content, course design, and classroom practices. However, in Asian higher education contexts, little research has examined the washback of proficiency tests on English learning in comparison with the efforts on teaching. Thus, the current study bridged this research gap by exploring the washback effects of a proficiency test on student learning in a campus-wide English curriculum, uncovering relationships between washback and learner characteristics such as major, gender, and proficiency level. A total of 694 students from engineering-, business-, and foreign language-related disciplines at a national university in Taiwan were surveyed. The results revealed washback effects on such aspects as personal image, learning motivation, emotion, and future job opportunities were especially salient. In addition, the relationship between washback and proficiency level was found to be statistically significant. However, male and female students did not differ statistically in washback nor was there a statistically significant difference in washback among different majors. With detailed information and consideration of different aspects of washback, stakeholders, including instructors, school administrators, and language policymakers, can make informed decisions when formulating language-related policies.
Tài liệu tham khảo
Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A case study. Language Testing, 13, 280–297.
Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14, 115–129.
Allen, D. (2016). Investigating washback to the learner from the IELTS test in the Japanese tertiary context. Language Testing in Asia, 6, 1–20.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford: Oxford University Press.
Bailey, K. (1996). Working for washback: A review of the washback concept in language testing. Language Testing, 13, 257–279.
Biggs, J. B. (Ed.). (1996). Testing: To educate or to select? Education in Hong Kong at the cross-roads. Hong Kong: Hong Kong Educational Publishing.
Cheng, L. (2004). The washback effect of a public examination change on teachers’ perceptions toward their classroom teaching. In L. Cheng, Y. Watanabe, & A. Curtis (Eds.), Washback in language testing: Research contexts and methods (pp. 147–170). Mahwah, New Jersey: Lawrence Erlbaum Associations, Inc..
Cheng, L. (2005). Changing language teaching through language testing: A washback study. In M. Milanovic & C. Weir (Eds), Studies in language testing. Cambridge, UK: Cambridge University Press.
Cheng, L. (2007). What does washback look like? Selected Papers of the 16th International Symposium on English Teaching. November 9-11, 2007 (pp. 1-6). Taiwan: EnglishTeachers’ Association/Republic of China (ETA-ROC).
Vongpumivitch, V.* (2010) “The General English Proficiency Test” In L. Cheng & A. Curtis (Eds.) English language assessment and the Chinese learner (pp.158-172). New York: Routledge.
Cheng, L., & Curtis, A. (2012). Test impact and washback: Implications for teaching and learning. In C. Coombe, Davidson, P. O’Sullivan, & Stoynoff, S (Eds), The Cambridge guide to second language assessment. New York, NY: Cambridge University Press.
Cheng, L., Klinger, D., Fox, J., Doe, C., Jin, Y., & Wu, J. (2014). Motivation and Test Anxiety in Test Performance Across Three Testing Contexts: The CAEL, CET, and GEPT. TESOL Quarterly, 48(2), 300–330.
Cheng, L., Klinger, D., & Zheng, Y. (2007). The challenges of the Ontario Secondary School Literacy Test for second language students. Language Testing, 24(2), 185–208.
Field, A. (2009). Discovering statistics using SPSS (3rd ed.). London: Sage.
Gan, Z., Humpherys, G., & Hamp-Lyons, L. (2004). Understanding successful and unsuccessful EFL students in Chinese university. The Modern Language Journal, 88(2), 227–244.
Garson, G. D. (2013). Factor analysis. Asheboro: Statistical Associates Publishers.
Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education. Cambridge: Cambridge University Press.
Hayes, D. (2014). The value of learning English in Thailand and its impact on Thai: Perspectives from university students. Asia Pacific Journal of Education, 36(1), 73–91.
Hughes, A. (1989). Testing for language teachers. New York: Cambridge University Press.
Karami, H. (2011). Detecting gender bias in a language proficiency test. International Journal of Language Studies, 5(2), 167–178.
Karami, H. (2012a). The relative impact of persons, items, subtests, and academic background on performance on a language proficiency test. Psychological Test and Assessment Modeling, 54(3), 211–226.
Karami, H. (2012b). The quest for fairness in language testing. Educational Research and Evaluation, 19(2&3), 158–169.
Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press.
Kunnan, A. J., & Wu, R. W. (2010). The language training and testing center, Taiwan: Past, present, and future. In L. Cheng & A. Curtis (Eds.), English language assessment and the Chinese learner (pp. 77–92). New York: Routledge.
LTTC newsletter (2016). LTTC newsletter. Retrieved September 11th, 2017, from https://www.lttc.ntu.edu.tw/enewsletter.htm. Accessed 15 Dec 2019.
Lumley, T., & O’Sullivan, B. (2005). The effect of test-taker gender, audience and topic on task performance in tape- mediated assessment of speaking. Language Testing, 22(4), 415–437.
Munoz, A., & Alvarez, M. (2010). Washback of an oral assessment system in the EFL classroom. Language Testing, 27(1), 33–49.
O’Loughlin, K. (2002). The impact of gender in oral proficiency testing. Language Testing, 19(2), 169–192.
O’Sullivan, B. (2000). Exploring gender and oral proficiency interview performance. System, 28(3), 373–386.
Pae, T. (2004). DIF for learners with different academic backgrounds. Language Testing, 21(1), 53–73.
Pan, Y. C. (2009). The impact of test design on teaching. The international journal of educational and psychological assessment, 3, 94–103.
Pan, Y. C. (2012). Tertiary EFL proficiency graduation requirements in Taiwan: A study of washback on learning. Electronic Journal of Foreign Language Teaching, 9(1), 108–122.
Purpura, J. (2009). The impact of large-scale and classroom-based language assessments on the individual. In L. Taylor & C. Weir (Eds.), Language testing matter (pp. 301–325). Cambridge: Cambridge University Press.
Qi, L. (2004). Has a high-stakes test produced the intended changes? In L. Cheng, Y. Watanabe & A. Curtis (Eds), Washback in language testing: Research contexts and methods (pp. 171-190). Mahwah, New Jersey: Lawrence Erlbaum Associations, Inc.
Read, J. & Hayes, B. (2003). The impact of IELTS on preparation for academic study in New Zealand. In R. Tulloh (ed.), International English Language Testing System Research Reports, 4, Canberra, Australia: ITLTS.
Shih, C. M. (2007). A new washback model of students’ learning. Canadian Modern Language Review, 64, 135–162.
Shih, C. M. (2010). The washback of the General English Proficiency Test on university policies: A Taiwan case study. Language Assessment Quarterly, 7(3), 234–254.
Takala, S., & Kaftandjieva, F. (2000). Test fairness: A DIF analysis of an L2 vocabulary test. Language Testing, 17(3), 323–340.
Wall, D. (1998). Impact and washback in language testing. In C. M. Clapham & D. Corson (Eds.), Language testing and assessment. Encyclopedia of language and education, Vol. 7 (pp. 291–302). Dordrecht: Kluwer Academic.
Wall, D. (2005). The impact of high-stakes testing on classroom teaching: A case study using insights from testing and innovation theory. In Studies in Language Testing (Vol. 22). Cambridge: Cambridge University Press.
Watanabe, Y. (1996). Does grammar translation come from the entrance examination? Preliminary findings from classroom-based research, Language Testing, 13, 318–333.
Watanabe, Y. (2001). Does the university entrance examination motivate learners? A case study of learner interview. In A. Murakami (Ed.), Trans-equator exchanges: A collection of academic papers in honor of Professor David E. Ingram (pp. 100–110). Akita: Akita University.
Wu, J., & Lee, C. L. (2017). The relationships between test performance and students’ perceptions of learning motivation, test value, and test anxiety in the context of the English benchmark requirement for graduation in Taiwan’s universities. Language Testing in Asia, 7, 9.
Wu, R. W., & Chin, J. (2006). An impact study of the Intermediate level GEPT. In Proceedings of the Ninth International Conference on English Language Testing in Asia, Taipei (pp. 41–65).
Wu, R. Y. F., Wu, J., & Dunlea, J. (2015). Glocalization in English language examinations: Aptis and GEPT comparison study. Paper presented at 2015 LTTC International Conference, Taipei.