The Effects of Item Exposure Control on Measurement Precision of Vocabulary Size Estimates in Computerized Adaptive Testing

English Teaching and Learning - Tập 45 Số 2 - Trang 217-236 - 2021
Wen‐Ta Tseng1
1Department of Applied Foreign Languages, National Taiwan University of Science and Technology, Taipei, Taiwan, Republic of China

Tóm tắt

Từ khóa


Tài liệu tham khảo

Rudner, Lawrence (1998). Item banking. Practical Assessment, Research & Evaluation, 6. Available online:

Weiss, D. J. (1985). Adaptive testing by computer. Journal of Consulting and Clinical Psychology, 53, 774–789.

Weiss, D. J. (2004). Computerized adaptive testing for effective and efficient measurement in counseling and education. Measurement and Evaluation in Counseling and Development, 37, 70–84.

Mizumoto, A., Sasao, Y., & Webb, S. A. (2019). Developing and evaluating a computerized adaptive testing version of the word part levels test. Language Testing, 36, 101–123.

Santos, V. D. O. (2017). A computer-adaptive test of productive and contextualized academic vocabulary breadth in English (CAT-PAV): development and validation. In Graduate Theses and Dissertations (p. 16292). Ames: Iowa State University.

Tseng, W. T. (2016). Measuring English vocabulary size via computerized adaptive testing. Computers & Education, 97, 69–85.

Wainer, H. (2000). Computerized adaptive testing: a primer (2nd ed.). New York: Routledge/Taylor and Francis.

Alderson, J. C. (2005). Diagnosing foreign language proficiency: the interface between learning and assessment. London: Continuum.

Nation, I. S. P. (2013). Learning vocabulary in another language. Cambridge: Cambridge University Press.

Milton, J. (2009). Measuring second language vocabulary acquisition. Bristol: Multilingual Matters.

Webb, S., & Nation, P. (2017). How vocabulary is learned. Oxford: Oxford University Press.

Anderson, R. C., & Freebody, P. (1981). Vocabulary knowledge. In T. Guthrie (Ed.), Comprehension and teaching: research reviews (pp. 77–117). Newark: DE: International Reading Association.

González-Fernández, B., & Schmitt, N. (2017). Vocabulary acquisition. In S. Loewen & M. Sato (Eds.), The Routledge handbook of instructed second language acquisition (pp. 280–298). New York: Routledge.

Goulden, R., Nation, I. S. P., & Read, J. (1990). How large can a receptive vocabulary be? Applied Linguistics, 11, 341–363.

Hazenberg, S., & Hulstijn, J. H. (1996). Defining a minimal receptive second language vocabulary for non-native university students: an empirical investigation. Applied Linguistics, 17, 145–163.

Laufer, B. (1988). What percentage of text-lexis is essential for comprehension? In C. Laurén & M. Nordmann (Eds.), Special language: from humans to thinking machines (pp. 316–323). Clevedon: Multilingual Matters.

Laufer, B., & Ravenhorst-Kalovski, G. C. (2010). Lexical threshold revisited: lexical text coverage, learners' vocabulary size and reading comprehension. Reading in a Foreign Language, 22, 15–30.

Schmitt, N., & Schmitt, D. (2014). A reassessment of frequency and vocabulary size in L2 vocabulary teaching. Language Teaching, 47, 484–503.

Cobb, T. (2007). Computing the vocabulary demands of L2 reading. Language Learning & Technology, 11, 38–63.

Nation, I. S. P. (2006). How large a vocabulary is needed for reading and listening? The Canadian Modern Language Review, 63, 59–81.

Meara, P., & Milton, J. (2003). X_Lex, The Swansea levels test. Newbury: Express.

Alderson, J. C., & Huhta, A. (2005). The development of a suite of computer-based diagnostic tests based on the Common European Framework. Language Testing, 22, 301–320.

Nation, I. S. P. (1990). Teaching and learning vocabulary. Boston: Newbury House.

Huhta, A., Alderson, J. C., Nieminen, L., & Ullakonoja, R. (2011). Diagnosing reading in L2 – predictors and vocabulary profiles. Provo: Paper presented at ACTFL CEFR Alignment Conference 2011.

Vispoel, W. P. (1993). Computerized adaptive and fixed-item versions of the ITED vocabulary subtest. Educational and Psychological Measurement, 53, 779–788.

Vispoel, W. P. (1998). Psychometric characteristics of computer-adaptive and self-adaptive vocabulary tests: the role of answer feedback and test anxiety. Journal of Educational Measurement, 35, 155–167.

Vispoel, W. P., Rocklin, T. R., & Wang, T. (1994). Individual differences and test administration procedures: a comparison of fixed-item, computerized-adaptive, and self-adapted testing. Applied Measurement in Education, 7, 53–79.

Kremmel, B. (2018). Development and initial validation of a diagnostic computer-adaptive profiler of vocabulary knowledge Unpublished doctoral dissertation. UK: University of Nottingham.

Laufer, B., & Nation, P. (1999). A vocabulary-size test of controlled productive ability. Language Testing, 16, 33–51.

Thompson, N. A., & Weiss, D. J. (2011). A framework for the development of computerized adaptive tests. Practical Assessment, Research & Evaluation, 16(1), available online: http://pareonline.net/getvn.asp?v=16&n=1.

Veldkamp, B. P., & van der Linden, W. J. (2008). Implementing Sympson-Hetter item-exposure control in a shadow-test approach to constrained adaptive testing. International Journal of Testing, 8(3), 272–289.

Mills, C. N., & Stocking, M. L. (1996). Practical issues in computerized adaptive testing. Applied Psychological Measurement, 9, 287–304.

Tseng, W. T. (2013). Validating a pictorial vocabulary size test via the 3PL-IRT model. Vocabulary Learning and Instruction, 2, 64–73.

Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum Associates.

Hetter, R. D., & Sympson, J. B. (1997). Item exposure control in CAT-ASVAB. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.), Computerized adaptive testing: from inquiry to operation (pp. 141–144). Washington, DC: American Psychological Association.

Sympson, J. B., & Hetter, R. D. (1985). Controlling item-exposure rates in computerized adaptive testing. In Proceedings of the 27th annual meeting of the Military Testing Association (pp. 973–977). San Diego: Navy Personnel Research and Development Center.

van der Linden, W. J. (2003). Some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 28(3), 249–265.

Wise, S. L., & Kingsbury, G. G. (2000). Practical issues in developing and. maintaining a computerized adaptive testing program. Psicológica, 21, 135–155.

Nation, I. S. P. (2016). Making and using word lists for language learning and testing. Amsterdam: John Benjamins.