Discriminant Validity of the WISC-IV Culture-Language Interpretive Matrix

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington: American Psychiatric Association. Aziz, N. (2011). Patterns of cognitive performance for culturally and linguistically diverse individuals with global cognitive impairment (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3441046). Borsuk, E. R., Watkins, M. W., & Canivez, G. L. (2006). Long-term stability of membership in a Wechsler Intelligence Scale for Children-Third Edition (WISC-III) subtest core profile taxonomy. Journal of Psychoeducational Assessment, 24, 52–68. doi:10.1177/0734282905285225. Braden, J. P., & Athanasiou, M. S. (2013). Psychological assessment in school settings. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology: Assessment psychology (2nd ed., Vol. 10, pp. 291–314). Hoboken: Wiley. Canivez, G. L., & Watkins, M. W. (1998). Long-term stability of the Wechsler Intelligence Scale for Children-Third Edition. Psychological Assessment, 10, 285–291. Cantor, S. B., & Kattan, M. W. (2000). Determining the area under the ROC curve for a binary diagnostic test. Medical Decision Making, 20, 468–470. Centor, R. M., & Schwartz, J. S. (1985). An evaluation of methods for estimating the area under the receiver operating characteristic (ROC) curve. Medical Decision Making, 5, 149–158. doi:10.1177/0272989X8500500204. Chen, H., & Zhu, J. (2008). Factor invariance between genders of the Wechsler Intelligence Scale for Children-Fourth Edition. Personality and Individual Differences, 45, 260–266. doi:10.1016/j.paid.2008.04.008. Chen, H., & Zhu, J. (2012). Measurement invariance of WISC-IV across normative and clinical samples. Personality and Individual Differences, 52, 161–166. doi:10.1016/j.paid.2011.10.006. Dawes, R. M., & Corrigan, B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95–106. Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science, 243, 1668–1674. Devena, S. E., & Watkins, M. W. (2012). Diagnostic utility of WISC-IV General Abilities Index and Cognitive Proficiency Index difference scores among children with ADHD. Journal of Applied School Psychology, 28, 133–154. doi:10.1080/15377903.2012.669743. Dhaniram-Beharry, E. (2008). Cultural and linguistic influences on test performance: Evaluation of alternative variables (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3336081). Durandisse, M. (2013). The effect of English language proficiency and acculturation on the Woodcock-Johnson Tests of Cognitive Abilities-Third Edition performance: In a Haitian-Creole sample (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3569999). Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. Flanagan, D. P. (2014, January 15). Re: Testing EAL Students [Online forum comment]. Retrieved from http://school-psych-talk.freeforums.net/post/29/quote/27 Flanagan, D. P., & Ortiz, S. O. (2001). How to apply CHC cross-battery assessment to culturally and linguistically diverse individuals. In A. S. Kaufman & N. L. Kaufman (Eds.), Essentials of cross-battery assessment (pp. 213–270). Hoboken: Wiley. Flanagan, D. P., Ortiz, S. O., & Alfonso, V. C. (2007). Use of the cross-battery approach in the assessment of diverse individuals. In A. S. Kaufman & N. L. Kaufman (Eds.), Essentials of cross-battery assessment second edition (2nd ed., pp. 146–205). Hoboken: Wiley. Flanagan, D. P., Ortiz, S. O., & Alfonso, V. C. (2013). Cross-battery assessment of individuals from culturally and linguistically diverse backgrounds. In A. S. Kaufman & N. L. Kaufman (Eds.), Essentials of cross-battery assessment (3rd ed., pp. 287–350). Hoboken: Wiley. Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a Receiver Operating Characteristic (ROC) curve. Radiology, 143, 29–36. Individuals with Disabilities Education Improvement Act of 2004, 20 U.S.C. § 1400. Kaufman, A. S., & Kaufman, N. L. (2004). Kaufman Assessment Battery for Children, Second Edition, manual. Circle Pines: American Guidance Service. Kraemer, H. C., Frank, E., & Kupfer, D. J. (2011). How to assess the clinical impact of treatments on patients, rather than the statistical impact of treatments on measures. International Journal of Methods in Psychiatric Research, 20, 63–72. doi:10.1002/mpr.340. Kranzler, J. H., Flores, C. G., & Coady, M. (2010). Examination of the cross-battery approach for the cognitive assessment of children and youth from diverse linguistic and cultural backgrounds. School Psychology Review, 39, 431–446. Lilienfeld, S. O., Lynn, S. J., & Lohr, J. M. (2003). Science and pseudoscience in clinical psychology. New York: Guilford. Lilienfeld, S. O., Ammirati, R., & David, M. (2012). Distinguishing science from pseudoscience in school psychology: Science and scientific thinking as safeguards against human error. Journal of School Psychology, 50, 7–36. doi:10.1016/j.jsp.2011.09.006. McDermott, P. A., Glutting, J. J., Jones, J. N., & Noonan, J. V. (1989a). Typology and prevailing composition of core profiles in the WAIS-R standardization sample. Psychological Assessment. A Journal of Consulting and Clinical Psychology, 1, 118–125. McDermott, P. A., Glutting, J. J., Jones, J. N., Watkins, M. W., & Kush, J. (1989b). Core profile types in the WISC-R national sample: Structure, membership, and applications. Psychological Assessment. A Journal of Consulting and Clinical Psychology, 1, 292–299. McDermott, P. A., Glutting, J. J., Watkins, M. W., & Baggaley, A. R. (1992). Illusions of meaning in the ipsative assessment of children’s ability. The Journal of Special Education, 25, 504–526. McDermott, P. A., Watkins, M. W., & Rhoad, A. M. (2013). Whose IQ is it? Assessor bias variance in high-stakes psychological assessment. Psychological Assessment, 26, 207–214. doi:10.1037/a0034832. McFall, R. M., & Treat, T. A. (1999). Quantifying the information value of clinical assessments with signal detection theory. Annual Review of Psychology, 50, 215–241. Meehl, P. E., & Rosen, A. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194–216. Meyer, E. X. (2013). Diagnostic accuracy of the Culture-Language Interpretive Matrix with the WJ-III NU: A comparison of Spanish speaking English language learners and monolingual English-speaking students (Unpublished doctoral dissertation). The Pennsylvania State University, College Station, PA. Nieves-Brull, A. I. (2006). Evaluation of the culture-language matrix: A validation study of test performance in monolingual English speaking and bilingual English/Spanish speaking populations (Doctoral dissertation). Retrieved from ProQuest. (Accession No. 3286026). Oriz, S. O., & Dynda, A. M. (2005). Use of intelligence tests with culturally and linguistically diverse populations. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment (2nd ed., pp. 545–556). New York: Guilford. Oriz, S. O., Ochoa, H. S., & Dynda, A. M. (2012). Testing with culturally and linguistically diverse populations: Moving beyond the verbal-performance dichotomy into evidence-based practice. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment (3rd ed., pp. 526–552). New York: Guilford. Ortiz, S. O. (2011). Separating cultural and linguistic differences (CLD) from specific learning disability (SLD) in the evaluation of diverse students: Difference or disorder? In D. P. Flanagan & V. C. Alfonso (Eds.), Essentials of specific learning disability identification (pp. 299–325). Hoboken, NJ: Wiley. Ortiz, S. O. (2013). Sample interpretive statements for use with the Culture-Language Interpretive Matrix (C-LIM). Retrieved from http://www.crossbattery.com/ Ortiz, S. O., & Ochoa, S. H. (2005). Cognitive assessment of culturally and linguistically diverse individuals, an integrated approach. In R. L. Rhodes, S. H. Ochoa, & S. O. Ortiz (Eds.), Assessing culturally and linguistically diverse students: a practical guide (pp. 168–201). New York, NY: Guilford. Platt, J. R. (1964). Strong inference. Science, 146, 347–353. Popper, K. (2002). Conjectures and refutations: the growth of scientific knowledge. New York: Routledge. R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from: http://www.R-project.org/ Reschly, D. J., & Hosp, J. L. (2004). State SLD identification policies and practices. Learning Disabilities Quarterly, 27, 197–213. Smith, C. B., & Watkins, M. W. (2004). Diagnostic utility of the Bannatyne WISC-IV pattern. Learning Disabilities Practice, 19, 46–56. Sotello-Dynega, M. (2007). Cognitive performance and the development of English language proficiency (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3282715). Sotello-Dynega, M., Ortiz, S. O., Flanagan, D. P., & Chaplin, W. F. (2013). English language proficiency and test performance: an evaluation of bilingual students with the Woodcock-Johnson III Tests of Cognitive abilities. Psychology in the Schools, 50, 781–797. doi:10.1002/pits.21706. Souravlis, S. A. L. (2010). Evaluating speech-language and cognitive impairment patterns via the Culture-Language Interpretive Matrix (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3435601). Streiner, D. L., & Cairney, J. (2007). What’s under the ROC? An introduction to receiver operating characteristics curves. Canadian Journal of Psychiatry, 52, 121–128. Styck, K. M., & Watkins, M. W. (2013). Diagnostic utility of the Culture-Language Interpretive Matrix for the WISC-IV among referred students. School Psychology Review, 42, 367–382. Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240, 1285–1293. Templeton, M. M. (2012). An examination of the effects of culture and language on the executive functioning of Spanish-speaking English learners according to the Delis-Kaplan Executive Function System (Doctoral dissertation). Retrieved from ProQuest (Accession No. 3505517). Tychanska, J. (2009). Evaluation of speech and language impairment using the culture-language test classification and interpretive matrix (Doctoral dissertation). Retrieved from ProQuest. (Accession No. 3365687). Van Deth, L. X. (2013). Validity of the KABC-II Culture-Language Interpretive Matrix: A comparison of native English speakers and Spanish-speaking English language learners (Unpublished doctoral dissertation). The Pennsylvania State University, College Station, PA. Verderosa, F. A. (2007). Examining the effects of language and culture on the differential ability scales with bilingual preschoolers (Doctoral dissertation). Retrieved from ProQuest. (Accession No. 3286027). Watkins, M. W., & Smith, L. G. (2013). Long-term stability of the Wechsler Intelligence Scale for Children-Fourth edition. Psychological Assessment, 25, 477–483. doi:10.1037/a0031653. Watkins, M. W., Kush, J. C., & Schaefer, B. A. (2002). Diagnostic utility of the learning disability index. Journal of Learning Disabilities, 35, 98–103. Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., & Babula, T. (2006). Factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition among referred students. Educational and Psychological Measurement, 66, 976–983. doi:10.1177/0013164406288168. Wechsler, D. (2003a). Wechsler Intelligence Scale for Children-Fourth Edition. San Antonio: Psychological Corporation. Wechsler, D. (2003b). WISC-IV technical and interpretive manual. San Antonio: Psychological Corporation. Weiner, I. B. (2003). Prediction and postdiction in clinical decision making. Clinical Psychology: Science and Practice, 10, 335–338. doi:10.1037//1082-989X.7.1.19. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III. Itasca: Riverside.