Examining differential item functioning trends for English language learners in a reading test: A meta-analytical approach

Language Testing - Tập 31 Số 1 - Trang 89-109 - 2014
Jin Koo1, Betsy Jane Becker1, Youngsuk Kim2
1Florida State University USA
2Florida State University and Florida Center for Reading Research, USA

Tóm tắt

In this study, differential item functioning (DIF) trends were examined for English language learners (ELLs) versus non-ELL students in third and tenth grades on a large-scale reading assessment. To facilitate the analyses, a meta-analytic DIF technique was employed. The results revealed that items requiring knowledge of words and phrases in context favored non-ELLs in grade 3, whereas items requiring evaluation skills favored ELLs in grade 10. However, inconsistent patterns were found across gender and ethnicity. Educational implications are discussed.

Từ khóa


Tài liệu tham khảo

Abedi J., Bailey A. L., Butler F., Castellon-Wellington M., Leon S., Mirocha J. (2005). The validity of administering large-scale content assessments to English language learners: An investigation from three perspectives. CSE Report 663. Retrieved from http://cse.ucla.edu/products/reports/r663.pdf#page=87.

10.1207/S15324818AME1403_2

10.1002/j.2333-8504.1981.tb01251.x

10.1037/a0014698

Anderson R. C., 1983, Advances in reading research, 231

10.1177/002221949903200204

10.1002/9780470743386

10.1515/9783112414941

Carnine D. W., 2010, Direct instruction reading, 5

Dorans N. J., 1993, Differential item functioning, 35

Erickson J., 1983, Issues in language testing research, 280

10.2307/3586562

Florida Department of Education. (2004). Assessment & accountability briefing book. Tallahassee, FL: Florida Department of Education. Retrieved from http://fcat.fldoe.org/pdf/fcataabb.pdf.

Florida Department of Education. (2009). Understanding FCAT reports. Tallahassee, FL: Florida Department of Education. Retrieved from http://fcat.fldoe.org/fcatUnderstandReports.asp.

Francis D. J., Rivera M., Lesaux N., Kieffer M. (2006). Research-based recommendations for instruction and academic interventions. Practical guidelines for the education of English language learners: Research-based recommendations for instruction and academic interventions. (Under cooperative agreement grant S283B050034 for U.S. Department of Education). Portsmouth, NH: RMC Research Corporation, Center on Instruction. Available online at www.centeroninstruction.org/files/ELL1-Interventions.pdf.

Hale S. (1988). Developmental trends in speed of information processing across the lifespan. Unpublished doctoral dissertation, University of Wisconsin-Milwaukee.

10.3102/10769986017004279

10.1016/B978-0-08-057065-5.50010-5

10.1037/1082-989X.3.4.486

Herber H. L., 1970, Teaching reading in content areas

Holland P. W., 1988, Test validity, 129

Holland P. W., 1993, Differential item functioning

Howard K., 1997, Earth, 6, 20

10.1080/10705519909540118

10.1111/j.1467-9922.2009.00527.x

10.1016/j.lindif.2012.06.009

Koo J. (2012). Meta-analysis of the Mantel-Haenszel index for the detection of differential item functioning. Unpublished doctoral dissertation, Florida State University.

Lesaux N. K., Geva E., Koda K., Siegel L. S., Shanahan T. (2008). In August D., Shanahan T. (Eds.), Developing reading and writing in second language learners, (pp. 27–59). New York: Center for Applied Linguistics and International Reading Association.

10.1037/0012-1649.39.6.1005

10.1037/a0019135

10.1080/10888430802378526

National Center for Education Statistics. (2003). Average scale scores for reading by status as English language learner. Retrieved March 21, 2013, from http://nces.ed.gov/nationsreportcard/naepdata.

National Center for Education Statistics. (2011). Average scale scores for reading by status as English language learner. Retrieved March 21, 2013, from http://nces.ed.gov/nationsreportcard/naepdata.

10.1002/j.2330-8516.1988.tb00282.x

10.2307/3586774

10.2307/2531052

10.1177/0013164407310129

10.1177/00222194050380050901

10.2307/3586830

10.1097/00011363-200307000-00009

10.1002/j.2333-8504.1980.tb01229.x

Wagner R. K., 2009, Paper presented at the Scientific Studies of Reading Conference

10.1080/10627190903425883

10.1111/j.1745-3984.1989.tb00318.x