A Systematic Review of the Impact of Derived Relational Responding Technology in Raising Intelligence Scores
Tóm tắt
The current review summarizes the literature on the impact of derived relational responding (DRR) technology on raising intelligence scores. We conducted a systematic review of peer-reviewed studies in PsycINFO, ERIC, and Web of Science between 1985 and 2021. Fourteen publications involving 15 experiments were identified. For studies meeting inclusion criteria, information was extracted on participant characteristics, design, settings, assessments conducted, intervention protocol and trained relations, mean intelligence quotient (IQ) scores before and after training, and outcomes. We assessed risk of bias using a revised Cochrane risk-of-bias tool for randomized trials (RoB2), the Risk of Bias in Nonrandomized Studies of Interventions (ROBINS-I), and the What Works Clearinghouse (WWC). Overall, the results suggest that interventions using DRR procedures improve intelligence scores regardless of initial participant ability, diagnosis, or age level. Furthermore, eight of the reviewed studies used the Strengthening Mental Abilities with Relational Training (SMART), whereas two studies implemented the Promoting the Emergence of Advanced Knowledge (PEAK) protocol. Additional training procedures were identified, for example, multiple-exemplar training, fluency training, and relational flexibility training. The quality assessment showed high risk for seven randomized controlled trials, and low to moderate risk for five nonrandomized trials. Three studies used a type of single case design; one study meets standards according to the WWC protocol. The limitations and future directions are discussed.
Tài liệu tham khảo
Amd, M., & Roche, B. (2018). Assessing the effects of a relational training intervention on fluid intelligence among a sample of socially disadvantaged children in Bangladesh. The Psychological Record, 68(2), 141–149. https://doi.org/10.1007/s40732-018-0273-4
Barnes-Holmes, D., & Harte, C. (2022). Relational frame theory 20 years on: The Odysseus voyage and beyond. Journal of the Experimental Analysis of Behavior, 117(2), 240–266. https://doi.org/10.1002/jeab.733
Belisle, J., & Dixon, M. R. (2020). Rational skepticism: A scientific review of Witts’ (2018) criticisms of the PEAK relational training system. Journal of Applied Behavior Analysis, 53, 620–634. https://doi.org/10.1002/jaba.654
Belisle, J., Dixon, M. R., Munoz, B. E., & Fricke-Steuber, K. (2021). The convergent validity of the PEAK-E-PA and two common assessments of language development: The ABLLS-R and the TOLD 1: 4. Journal of Behavioral Education, 31, 699–717. https://doi.org/10.1007/s10864-020-09426-x
Beaujean, A. A., & Farmer, R. L. (2020). Conceptual and methodological concerns: A commentary on “Randomized controlled trial evaluation of aba content on IQ gains in children with autism.” Journal of Behavioral Education, 30, 479–488. https://doi.org/10.1007/s10864-020-09408-z
Cassidy, S., Roche, B., & O’Hora, D. (2010). Relational frame theory and human intelligence. European Journal of Behavior Analysis, 11(1), 37–51. https://doi.org/10.1080/15021149.2010.11434333
Cassidy, S., Roche, B., & Hayes, S. C. (2011). A relational frame training intervention to raise intelligence quotients: A pilot study. The Psychological Record, 61, 173–198. https://doi.org/10.1007/BF03395755
Cassidy, S., Roche, B., Colbert, D., Stewart, I., & Grey, I. M. (2016). A relational frame skills training intervention to increase general intelligence and scholastic aptitude. Learning & Individual Differences, 47, 222–235. https://doi.org/10.1016/j.lindif.2016.03.001
Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), 213–220. https://doi.org/10.1037/h26256
Colbert, D., Dobutowitsch, M., Roche, B., & Brophy, C. (2017). The proxy-measurement of intelligence quotients using a relational skills abilities index. Learning & Individual Differences, 57, 114–122. https://doi.org/10.1016/j.lindif.2017.03.010
Colbert, D., Tyndall, I., Roche, B., & Cassidy, S. (2018). Can SMART training really increase intelligence? A replication study. Journal of Behavioral Education, 27(1), 509–531. https://doi.org/10.1007/s10864-018-9302-2
Colbert, D., Malone, A., Barrett, S., & Roche, B. (2020). The relational abilities index+: Initial validation of a functionally understood proxy measure for intelligence. Perspectives on Behavior Science, 43(1), 189–213. https://doi.org/10.1007/s40614-019-00197-z
Cummins, J., Nevejans, M., Colbert, D., & De Houwer, J. (2023). On the structure of relational responding. Journal of Contextual Behavioral Science, 27, 16–25. https://doi.org/10.1016/j.jcbs.2022.11.006
de Souza, D. J., Robertson, C. L., & Ré, T. C. (2022). A cultural generalization: An effective training for staff integrity on DTT in the application of the PEAK in Brazil. Behavior Analysis in Practice. https://doi.org/10.1007/s40617-022-00745-1
Dennis, M., Francis, D. J., Cirino, P. T., Schachar, R., Barnes, M. A., & Fletcher, J. M. (2009). Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders. Journal of the International Neuropsychological Society, 15(3), 331–343. https://doi.org/10.1017/S1355617709090481
Dixon, M. R. (2014a). The PEAK relational training system: Direct training module. Shawnee Scientific Press.
Dixon, M. R. (2014b). The PEAK relational training system: Generalization module. Shawnee Scientific Press.
Dixon, M. R. (2015). The PEAK relational training system: Equivalence module. Shawnee Scientific Press.
Dixon, M. R. (2016). PEAK relational training system: Transformation module. Shawnee Scientific Press.
Dixon, M. R. (2019). PEAK comprehensive assessment. Shawnee Scientific Press.
Dixon, M. R., Carman, J., Tyler, P. A., Whiting, S. W., Enoch, M. R., & Daar, J. H. (2014a). PEAK relational training system for children with autism and developmental disabilities: Correlations with Peabody picture vocabulary test and assessment reliability. Journal of Developmental & Physical Disabilities, 26, 603–614. https://doi.org/10.1007/s10882-014-9384-2
Dixon, M. R., Whiting, S. W., Rowsey, K., & Belisle, J. (2014b). Assessing the relationship between intelligence and the PEAK relational training system. Research in Autism Spectrum Disorders, 8, 1208–1213. https://doi.org/10.1016/j.rasd.2014.05.005
Dixon, M. R., Belisle, J., McKeel, A., Whiting, S., Speelman, R., Daar, J. H., & Rowsey, K. (2017). An internal and critical review of the PEAK relational training system for children with autism and related intellectual disabilities: 2014–2017. The Behavior Analyst, 40(2), 493–521. https://doi.org/10.1007/s40614-017-0119-4
Dixon, M. R., Paliliunas, D., Barron, B. F., Schmick, A., & Stanley, C. (2021). Randomized controlled trial evaluation of ABA content on IQ gains in children with autism. Journal of Behavioral Education, 30, 455–477. https://doi.org/10.1007/s10864-019-09344-7
Dixon, M. R., Yi, Z., & Chastain, A. N. (2022). PEAK relational training system. In J. B. Leaf, J. H. Cihon, J. L. Ferguson, & M. J. Weiss (Eds.), Handbook of applied behavior analysis interventions for autism: Integrating research into practice (pp. 341–360). Springer.
Goddard, M. J. (2018). Extending BF Skinner’s selection by consequences to personality change, implicit theories of intelligence, skill learning, and language. Review of General Psychology, 22(4), 421–426. https://doi.org/10.1037/gpr0000168
Golijani-Moghaddam, N., Dawson, D. L., Evangelou, N., Turton, J., Hawton, A., Law, G. R., … Das Nair, R. (2022). Strengthening mental abilities with relational training (SMART) in multiple sclerosis (MS): Study protocol for a feasibility randomised controlled trial. Pilot & Feasibility Studies, 8(1), 1–14.
Gore, N. J., Barnes-Holmes, Y., & Murphy, G. (2010). The relationship between intellectual functioning and relational perspective-taking. International Journal of Psychology & Psychological Therapy, 10(1), 1–17.
Hayes, J., & Stewart, I. (2016). Comparing the effects of derived relational training and computer coding on intellectual potential in school-age children. British Journal of Educational Psychology, 86(3), 397–411. https://doi.org/10.1111/bjep.12114
Hayes, S., Barnes-Holmes, D., & Roche, B. (2001). Relational frame theory: A post-Skinnerian account of human language and cognition. Kluwer Academic/ Plenum.
Hayes, S. C., Law, S., Assemi, K., Falletta-Cowden, N., Shamblin, M., Burleigh, K., Olla, R., Forman, M., & Smith, P. (2021). Relating is an operant: A fly over of 35 years of RFT research. Perspectivas Em Análise Do Comportamento, 12(1), 005–032. https://doi.org/10.18761/PAC.2021.v12.RFT.02
Kaufman, A. S., & Kaufman, N. L. (2005). Kaufman tests of educational achievement: Brief form (2nd ed.). Pearson.
Lanovaz, M. J. (2022). Some characteristics and arguments in favor of a science of machine behavior analysis. Perspectives on Behavior Science, 45(2), 399–419. https://doi.org/10.1007/s40614-022-00332-3
Ledford, J. R., & Gast, D. L. (Eds.). (2018). Single case research methodology: Applications in special education and behavioral sciences. Routledge.
McCarthy, D. (1988). Escalas McCarthy de aptitudes y psicomotricidad para niños (3rd ed.). TEA.
May, B. K., & St. Cyr, J. (2021). The impact of the PEAK curriculum on standardized measures of intelligence: A systems level randomized control trial. Advances in Neurodevelopmental Disorders, 5, 245–255. https://doi.org/10.1007/s41252-021-00199-6
May, R. J., Tyndall, I., McTiernan, A., Roderique-Davies, G., & McLoughlin, S. (2022). The impact of the SMART program on cognitive and academic skills: A systematic review and meta-analysis. British Journal of Educational Technology, 53, 1244–1261. https://doi.org/10.1111/bjet.13192
McLoughlin, S. (2023). RFT and intelligence. In T. Mulhern (Ed.), Relational frame theory: Made simple (pp. 211–227). Springer.
McLoughlin, S., Tyndall, I., & Pereira, A. (2018). Piloting a brief relational operant training program: Analyses of response latencies and intelligence test performance. European Journal of Behavior Analysis, 19(2), 228–246. https://doi.org/10.1080/15021149.2018.1507087
McLoughlin, S., Tyndall, I., & Pereira, A. (2020). Convergence of multiple fields on a relational reasoning approach to cognition. Intelligence, 83, 101491. https://doi.org/10.1016/j.intell.2020.101491
McLoughlin, S., Tyndall, I., Pereira, A., & Mulhern, T. (2021). Non-verbal IQ gains from relational operant training explain variance in educational attainment: An active-controlled feasibility study. Journal of Cognitive Enhancement, 5(1), 35–50. https://doi.org/10.1007/s41465-020-00187-z
McLoughlin, S., Tyndall, I., & Pereira, A. (2022). A relational operant skills training increases standardized matrices scores in adolescents: A stratified active-controlled trial. Journal of Behavioral Education, 31, 298–325. https://doi.org/10.1007/s10864-020-09399-x
Murphy, C., Lyons, K., Kelly, M., Barnes-Holmes, Y., & Barnes-Holmes, D. (2019). Using the teacher IRAP (T-IRAP) interactive computerized programme to teach complex flexible relational responding with children with diagnosed autism spectrum disorder. Behavior Analysis in Practice, 12(1), 52–65. https://doi.org/10.1007/s40617-018-00302-9
O’Hora, D., Pelaez, M., & Barnes-Holmes, D. (2005). Derived relational responding and performance on verbal subtests of the WAIS-III. The Psychological Record, 55(1), 155–175. https://doi.org/10.1007/BF03395504
O’Hora, D., Peláez, M., Barnes-Holmes, D., Rae, G., Robinson, K., & Chaudhary, T. (2008). Temporal relations and intelligence: Correlating relational performance with performance on the WAIS-III. The Psychological Record, 58(4), 569–584. https://doi.org/10.1007/BF03395638
O’Toole, C., & Barnes-Holmes, D. (2009). Three chronometric indices of relational responding as predictors of performance on a brief intelligence test: The importance of relational flexibility. The Psychological Record, 59(1), 119–132. https://doi.org/10.1007/BF03395652
O’Toole, C., Barnes-Holmes, D., Murphy, C., O’Connor, J., & Barnes-Holmes, Y. (2009). Relational flexibility and human intelligence: Extending the remit of Skinner’s Verbal Behavior. International Journal of Psychology & Psychological Therapy, 9(1), 1–17.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372(71). https://doi.org/10.1136/bmj.n71
Parra, I., & Ruiz, F. (2016). The effect on intelligence quotient of training fluency in relational frames of coordination. International Journal of Psychology and Psychological Therapy, 16(1), 1–12.
Raven, J., Raven, J. C., & Court, J. H. (2000). Standard progressive matrices. Psychology Press.
Ribes, E. (1989). Intelligence as behavior: A conceptual analysis. Mexican Journal of Behavior Analysis, 15(3), 51–68.
Rosales, R., & Garcia, Y. (2022). Verbal behavior and applied behavior analysis. In J. Matson & P. Sturmey (Eds.), Handbook of autism and pervasive developmental disorders (pp. 899–918). Springer.
Schlinger, H. D. (2003). The myth of intelligence. Psychological Record, 53(1), 15–32.
Sidman, M. (1994). Equivalence relations and behavior: A research story. Authors Cooperative.
Sidman, M., & Tailby, W. (1982). Conditional discrimination vs. matching to sample: An expansion of the testing paradigm. Journal of the Experimental Analysis of Behavior, 37(1), 5–22. https://doi.org/10.1901/jeab.1982.37-5
Skinner, B. F. (1957). Verbal behavior. Copley Publishing Group.
Spearman, C. (1904). “General intelligence”: Objectively determined and measured. American Journal of Psychology, 15, 201–293. https://doi.org/10.2307/1412107
Sterne, J. A., Hernan, M. A., Reeves, B. C., Savovi c, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., Carpenter, J. R., Chan, A.-W., Churchill, R., Deeks, J. J., Hrobjartsson, A., Kirkham, J., Jüni, P., Loke, Y. K., Pigott, T. D., … Higgins, J. P. (2016). ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ, 355, i4919. https://doi.org/10.1136/bmj.i4919
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H. Y., Corbett, M. S., Eldridge, S. M., Emberson, J. R., Hernán, M. A., Hopewell, S., Hróbjartsson, A., Junqueira, D. R., Jüni, P., Kirkham, J. J., Lasserson, T., Li, T., … Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ, 366, I4898. https://doi.org/10.1136/bmj.l4898
Sutton, A., Pikula, A., Yi, Z., & Dixon, M. R. (2022). Evaluating the convergent validity of the PEAK comprehensive assessment (PCA): Intelligence, behavior challenges, and autism symptom severity. Journal of Developmental & Physical Disabilities, 34, 549–570. https://doi.org/10.1007/s10882-021-09814-9
Thirus, J., Starbrink, M., & Jansson, B. (2016). Relational frame theory, mathematical, and logical skills: A multiple exemplar training intervention to enhance intellectual performance. International Journal of Psychology & Psychological Therapy, 16(2), 141–155.
Vizcaíno-Torres, R., Ruiz, R., Luciano, C., López-López, J., Barbero-Rubio, A., & Gil, E. (2015). The effect of relational training on intelligence quotient: A case study. Psicothema, 27(2), 120–127. https://doi.org/10.7334/psicothema2014.149
Wasserman, J. D. (2018). A history of intelligence assessment: The unfinished tapestry. In D. P. Flanagan & E. M. McDonough (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (4th ed., pp. 3–55). Guilford.
Wechsler, D. (2003). Wechsler intelligence scale for children-fourth edition. Psychological Corporation.
Wechsler, D. (2012). Wechsler preschool and primary scale of intelligence (4th ed.). Pearson.
What Works Clearinghouse. (2020). What Works Clearinghouse standards handbook, Version 4.1. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation & Regional Assistance. https://ies.ed.gov/ncee/wwc/handbooks
Williams, B., Myerson, J., & Hale, S. (2008). Individual differences, intelligence, and behavior analysis. Journal of the Experimental Analysis of Behavior, 90(2), 219–231. https://doi.org/10.1901/jeab/2008.90-219
Witts, B. N. (2018). An external review of the conclusions regarding the PEAK direct training module. Journal of Applied Behavior Analysis, 51(3), 719–737. https://doi.org/10.1002/jaba.491
Yi, Z., Schreiber, J. B., Paliliunas, D., Barron, B., & Dixon, M. R. (2020). P <.05 is in the eye of the beholder: A response to Beaujean and Farmer (2020). Journal of Behavior Education, 30, 489–511. https://doi.org/10.1007/s10864-021-09435-4