Evaluation of Telehealth Training for Behavior Technicians to Implement Common Behavioral Protocols

Joseph Robertson1, Kendra Thomson1, Mary Hume2, Carly Magnacca1, Amanda Marcinkiewicz1, Jessica Cauchi2
1Department of Applied Disability Studies, Brock University, St. Catharines, Canada
2Atlas Behaviour Consultation Inc., Oakville, Canada

Tóm tắt

Behavioral skills training (BST) delivered synchronously via telecommunication (telehealth) has been shown to be effective for training mediators supporting children with autism. A limitation in the literature is that many published training protocols are evaluated under analogue or highly controlled conditions; therefore, further evaluation is needed to assess generalization of training outcomes to other settings, with service recipients, and to untrained skills. Further, most studies have focused on reducing challenges vs. promoting skill acquisition. Using a concurrent multiple-baseline design, we assessed the efficacy of virtually delivered, synchronous BST with additional coaching (if mastery was not met) for training three behavior technicians (BTs) to implement two common behavioral protocols (i.e., errorless learning and paired stimulus preference assessment). Treatment integrity was assessed with the BTs implementing the protocols with an actor role playing a child with autism and with a child with autism receiving services in the same agency where the BTs were employed. Results indicated that the training was effective for increasing treatment integrity for all three BTs with their performance maintaining at follow-up; however, generalization outcomes were mixed. The findings have timely implications for conducting virtual behavioral training and add to the limited training research conducted in real-world settings.

Tài liệu tham khảo

Almenary, F. M., Wallace, M., Symon, J. B. G., & Barry, L. M. (2015). Using international videoconferencing to provide staff training on functional behaviour assessments. Behavioural Interventions, 30(1), 73–86. https://doi.org/10.1002/bin.1403 Artman-Meeker, K., Rosenberg, N., Badgett, N., Yang, X., & Penney, A. (2017). The effects of bug-in-ear coaching on pre-service behavior analysts’ use of functional communication training. Behavior Analysis in Practice, 10(3), 228–241. https://doi.org/10.1007/s40617-016-0166-4 Barkaia, A., Stokes, T. F., & Mikiashvili, T. (2017). Intercontinental telehealth coaching of therapists to improve verbalizations by children with autism. Journal of Applied Behavior Analysis, 50(3), 582–589. https://doi.org/10.1002/jaba.391 Barretto, A., Wacker, D. P., Harding, J., Lee, J., & Berg, W. K. (2006). Using telemedicine to conduct behavioral assessments. Journal of Applied Behavior Analysis, 39(3), 333–340. https://doi.org/10.1901/jaba.2006.173-04 Blackman, A. L., Jimenez-Gomez, C., & Shvarts, S. (2020). Comparison of the efficacy of online versus in-vivo behavior analytic training for parents of children with autism spectrum disorder. Behavior Analysis: Research and Practice, 20(1), 13–23. https://doi.org/10.1037/bar0000163 Cooper, J. O., Heron, T. E., & Heward, W. L. (2020). Applied behavior analysis (3rd ed.). Pearson Education. Davis, S., Thomson, K., & Connolly, M. (2019). A component analysis of behavioral skills training with volunteers teaching motor skills to individuals with developmental disabilities. Behavioral Interventions, 34(4), 431–450. https://doi.org/10.1002/bin1688 de Nocker, Y. L., & Toolan, C. K. (2021). Using telehealth to provide interventions for children with autism: A systematic review. Journal of Autism and Developmental Disorders. https://doi.org/10.1007/s40489-021-00278-3 Ferguson, J., Craig, E. A., & Dounavi, K. (2019). Telehealth as a model for providing behavior analytic interventions to individuals with autism spectrum disorder: A systematic review. Journal of Autism and Developmental Disorders, 49(2), 582–616. https://doi.org/10.1007/s10803-018-3724-5 Fisher, W. W., Piazza, C. C., Bowman, L. G., & Amari, A. (1996). Integrating caregiver report with a systematic choice assessment. American Journal on Mental Retardation, 101(1), 15–25. Hansard, C., & Kazemi, E. (2018). Evaluation of video self-instruction for implementing paired-stimulus preference assessments. Journal of Applied Behavior Analysis, 51(3), 675–680. https://doi.org/10.1002/jaba.476 Hassan, M., Simpson, A., Danahar, K., Haesen, J., Makela, T., & Thomson, K. M. (2017). An evaluation of behavioral skills training for teaching caregivers how to support social skill development in their child with autism spectrum disorder. Journal of Autism and Developmental Disorders, 48(6), 1957–1970. https://doi.org/10.1007/s10803-017-3455-z Higgins, W. J., Luczynski, K. C., Carroll, R. A., Fisher, W. W., & Mudford, O. C. (2017). Evaluation of a telehealth training package to remotely train staff to conduct a preference assessment. Journal of Applied Behavior Analysis, 50(2), 239–251. https://doi.org/10.1002/jaba.370 Hogan, A., Knez, N., & Kahng, S. (2015). Evaluating the use of behavioral skills training to improve school staffs’ implementation of behavior intervention plans. Journal of Behavioural Education, 24(2), 242–254. https://doi.org/10.1007/s10864-014-9213-9 Knowles, C., Massar, M., Raulston, T. J., & Machalicek, W. (2017). Telehealth consultation in a self-contained classroom for behavior: A pilot study. Preventing School Failure, 61(1), 28–38. https://doi.org/10.1080/1045988XX.2016.1167012 Lerman, D. C., O’Brien, M. J., Neely, L., Call, N. A., Tsami, L., Schieltz, K. M., Berg, W. K., Graber, J., Huang, P., Kopelman, T., & Cooper-Brown, L. J. (2020). Remote coaching of caregiver via telehealth: Challenges and potential solutions. Journal of Behavior Education, 29, 195–221. https://doi.org/10.1007/s10864-020-09378-2 Lindgren, S., Wacker, D., Suess, A., Schieltz, K., Pelzel, K., Kopelman, T., Lee, J., Romani, P., & Waldron, D. (2016). Telehealth and autism: Treating challenging behavior at lower cost. Pediatrics, 137(2), S167–S175. https://doi.org/10.1542/peds.2015-2851O Liptak, G. S., Benzoni, L. B., Mruzek, D. W., Nolan, K., Thingvoll, M., Wade, C. M., & Fryer, E. G. (2008). Disparities in diagnosis and access to health services for children with autism: Data from the National Survey of Children’s Health. Journal of Developmental and Behavioral Pediatrics, 29(3), 152–160. https://doi.org/10.1097/DBP.0b013e318165c7a0 Machalicek, W., O’Reilly, M., Chan, J. M., Rispoli, M., Lang, R., Davis, T., Shogren, K., Sorrells, A., Lanciono, G., Sigafoos, J., Green, V., & Langthorne, P. (2009). Using videoconferencing to support teachers to conduct preference assessments with student with autism and developmental disabilities. Research in Autism Spectrum Disorders, 3(1), 32–41. Machalicek, W., O’Reilly, M. F., Rispoli, M., Davis, T., Lang, R., & Franco, J. H. (2010). Training teachers to assess the challenging behaviors of students with autism using video tele-conferencing. Education and Training in Autism and Developmental Disabilities, 45(2), 203–215. Neely, L., Rispoli, M., Boles, M., Morin, K., Gregori, E., Ninci, J., & Hagan-Burke, S. (2019). Interventionist acquisition of incidental teach using pyramidal training via telehealth. Behaviour Modification, 43(5), 711–733. https://doi.org/10.1177/0145445518781770 Neely, L., Rispoli, M., Gerow, S., Hong, E. R., & Hagan-Burke, S. (2017). Fidelity outcomes for autism-focused interventionists coached via telepractice: A systematic literature review. Journal Developmental and Physical Disabilities, 29, 849–874. https://doi.org/10.1007/s10882-017-9550-4 Nohelty, K., Bradford, C. B., Hirschfield, L., Miyake, C. J., & Novack, M. N. (2021). Effectiveness of a telehealth direct therapy for individuals with autism spectrum disorder. Behavior Analysis in Practice, 6, 66. https://doi.org/10.1007/s40617-021-00603-6 Oliver, P., & Brady, M. P. (2014). Effects of covert audio coaching on parents’ interaction with young children with autism. Behavior Analysis in Practice, 7(2), 112–116. https://doi.org/10.1007/s40617-014-0015-2 Parsons, M. B., Rollyson, J. H., & Reid, D. H. (2012). Evidence-based staff training: A guide for practitioners. Behavior Analysis in Practice, 5(2), 211. https://doi.org/10.1007/BF03391819 Reichow, B., Volkmar, F. R., & Cicchetti, D. V. (2008). Development of the evaluative method for evaluating and determining evidence based practices in autism. Journal of Autism and Developmental Disorders, 38, 1311–1319. https://doi.org/10.1007/s10803-007-0517-7 Richling, S. M., Williams, W. L., & Carr, J. E. (2019). The effects of different mastery criteria on the skill maintenance of children with developmental disabilities. Journal of Applied Behavior Analysis, 52(3), 701–717. https://doi.org/10.1002/jaba.580 Rios, D., Kazemi, E., & Peterson, S. M. (2018). Best practices and considerations for effective service provision via remote technology. Behavior Analysis: Research and Practice, 18(3), 277–287. https://doi.org/10.1037/bar0000072 Rios, D., Schenk, Y. A., Eldridge, R. R., & Peterson, S. M. (2020). The effects of remote behavioral skills training on conducting functional analyses. Journal of Behavioral Education, 29, 449–468. https://doi.org/10.1007/s10864-020-09385-3 Rispoli, M., & Machalicek, W. (2020). Advances in telehealth and behavioral assessment and intervention in education: Introduction to the special issue. Journal of Behavioral Education, 29, 189–194. https://doi.org/10.1007/s10864-020-09383-5 Rosenberg, N. E., Artmam-Meeker, K., Kelly, E., & Yang, X. (2020). The effects of bug-in-ear coaching package on implementation of incidental teaching by paraprofessionals in a K-12 school. Journal of Behavioral Education, 29, 409–432. https://doi.org/10.1007/s10864-020-09379-1 Simmons, C. A., Ford, K. R., Salvatore, G. L., & Moretti, A. E. (2021). Acceptability and feasibility of virtual behavior analysis supervision. Behavior Analysis in Practice, 14(4), 927–943. https://doi.org/10.1007/s40617-021-00622-3 St. Peter Pipkin, C., Vollmer, T. R., & Sloman, K. N. (2010). Effects of treatment integrity failures during differential reinforcement of alternative behavior: A translational model.Journal of Applied Behavior Analysis, 43(1), 47–70. https://doi.org/10.1901/jaba.2010.43-47 Suess, A. N., Wacker, D. P., Schwartz, J. E., Lustig, N., & Detrick, J. (2016). Preliminary evidence on the use of telehealth in an outpatient behavior clinic. Journal of Applied Behavior Analysis, 49(3), 686–692. https://doi.org/10.1002/jaba.305 Sump, L. A., Richman, D. M., Schaefer, A. M., Grubb, L. M., & Brewer, A. T. (2018). Telehealth and in-person training outcomes for novice discrete trial training therapists. Journal of Applied Behaviour Analysis, 51(3), 466–481. https://doi.org/10.1002/jaba.461 Tomlinson, S. R. L., Gore, N., & McGill, P. (2018). Training individuals to implement applied behavior analytic procedures via telehealth: A systematic review of the literature. Journal of Behavioral Education, 27, 172–222. https://doi.org/10.1007/s10864-018-9292-0 Unholz-Bowden, E., McComas, J. J., McMaster, K. L., Girtler, S. N., Kolb, R. R. L., & Shipchandler, A. (2020). Caregiver training via telehealth on behavioral procedures: A systematic review. Journal of Behavior Education, 29, 246–281. https://doi.org/10.1007/s10862-020-09381-7 Van Oorsouw, W. M. W. J., Embregts, P. J. C. M., Bosman, A. M. T., & Jahoda, A. (2009). Training staff serving clients with intellectual disabilities: A meta-analysis of aspects of determining effectiveness. Research in Developmental Disabilities, 30(3), 503–511. https://doi.org/10.1016/j.ridd.2008.07.011 Wacker, D. P., Lee, J. F., Padilla Dalmau, Y. C., Kopelman, T. G., Lindgren, S. D., Kuhle, J., Pelzel, K. E., Dyson, S., Schieltz, K. M., & Waldron, D. B. (2013a). Conducting functional communication training via telehealth to reduce problem behavior of young children with autism. Journal of Developmental and Physical Disabilities, 25(1), 35–48. https://doi.org/10.1007/s10882-012-9314-0 Wacker, D. P., Lee, J. F., Padilla Dalmau, Y. C., Kopelman, T. G., Lindgren, S. D., Kuhle, J., Pelzel, K. E., & Waldron, D. B. (2013b). Conducting functional analyses of problem behavior via telehealth. Journal of Applied Behavior Analysis, 46(1), 31–46. https://doi.org/10.1002/jaba.29 Wainer, A. L., & Ingersoll, B. R. (2015). Increasing access to an ASD imitation intervention via a telehealth parent training program. Journal of Autism and Developmental Disorders, 12, 3877–3890. https://doi.org/10.1007/s10803-014-2186-7