The Evidence-Based Practice (EBP) Instrument (School Version): Development and Initial Psychometrics of a New Interdisciplinary Scale

Contemporary School Psychology - Tập 27 - Trang 581-592 - 2022
Lindsay G. Flegge1,2
1Mary Free Bed Rehabilitation Hospital, Grand Rapids, USA
2Ball State University Teachers College, Muncie, USA

Tóm tắt

This article presents the psychometric properties of the evidence-based practice (EBP) instrument (School Version), a new interdisciplinary measure for understanding and measuring EBP use that can be understood and used across the three professions who provide the most mental health services in schools. The instrument was developed based on theory, review of the literature, expert review (N = 12), pilot study (N = 20), and national study (N = 303). While the measure may have applicability for other groups of mental health providers in other settings, this study focused on the perspectives of mental health providers in schools, specifically school psychologists, school counselors, and social workers. Initial psychometric examination resulted in a 13-item, one factor model and indicated preliminary evidence for strong validity and internal reliability. No significant difference in total score among groups of mental health professionals was found, suggesting similarities of comprehension and application of EBP regardless of professional discipline. This instrument is the only one of its kind and provides a helpful first step towards common language and common goals when conceptualizing what it means for mental health providers to use best practice. Implications for school professionals and future research are offered.

Tài liệu tham khảo

Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331–339. https://doi.org/10.1037//0022-006X.68.2.331 American Psychological Association. (2005). Report of the 2005 presidential task force on evidence-based practice. Author. American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents. (2008). Disseminating evidence-based practice for children and adolescents: A systems approach to enhancing care. American Psychological Association. American Psychological Association. (2017). Multicultural guidelines: An ecological approach to context, identity, and intersectionality. Retrieved from: http://www.apa.org/about/policy/multicultural-guidelines.pdf American Psychological Association (2018). About APA. Retrieved November 2, 2018 from https://www.apa.org/about/ American School Counselor Association (2018). Role of the school counselor. Retrieved November 2, 2018 from https://www.schoolcounselor.org/administrators/role-of-the-school-counselor.aspx American School Counselor Association. (2020). School counseling during COVID-19: Online lessons and resources. Author. Retrieved June 6, 2020 from https://www.schoolcounselor.org/school-counselors/professional-development/learn-more/coronavirus-resources Anderson, E. M., & Bronstein, L. R. (2012). Examining interdisciplinary collaboration within an Expanded School Mental Health framework: A community-university initiative. Advances in School Mental Health Promotion, 5(1), 23–37. Ardito, R. B., & Rabellino, D. (2011). Therapeutic alliance and outcome of psychotherapy: Historical excursus, measurements, and prospects for research. Frontiers in Psychology, 2, 270. Bacon, V.L. (2008). A new vision for school counseling: Evidence-based practice. [Review of the book Evidence-based school counseling: Making a difference with data-driven practices. C. Dimmitt, J. C. Carey & T. Hatch]. PsycCRITIQUES, 53(9). https://doi.org/10.1037/a0010165 Bagalman, E., & Cornell, A.S. (2018). Prevalence of mental illness in the United States: Data sources and estimates. Congressional Research Service. Retrieved from www.crs.gov. Barrio Minton, C. A., Wachter Morris, C. A., & Yaites, L. D. (2014). Pedagogy in counselor education: A 10-year content analysis of journals. Counselor Education and Supervision, 53, 162–177. https://doi.org/10.1002/j.1556-6978.2014.00055.x Baskin, T. W., Slaten, C. D., Sorenson, C., Glover-Russell, J., & Merson, D. N. (2010). Does youth psychotherapy improve academically related outcomes? A Meta-Analysis. Journal of Counseling Psychology, 57(3), 290–296. Baumann, B. L., Kolko, D. J., Collins, K., & Herschell, A. D. (2006). Understanding practitioners’ characteristics and perspectives prior to the dissemination of an evidence-based intervention. Child Abuse and Neglect, 30, 771–787. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. Bellamy, J., Bledsoe, S. E., & Traube, D. (2006). The current state of evidence based practice in social work: A review of the literature and qualitative analysis of expert interviews. Journal of Evidence-Based Social Work, 3, 23–38. https://doi.org/10.1300/J394v03n01_02 Breslau, J., Miller, E., Breslau, N., Bohnert, K., Lucia, V., & Schweitzer, J. (2009). The impact of early behavior disturbances on academic achievement in high school. Pediatrics, 123, 1472–1476. Bronfenbrenner, U. (1979). The ecology of human development. Harvard University Press. Centers for Disease Control and Prevention. (2014). The social-ecological model: A framework for prevention. Retrieved November 14, 2018 from https://www.cdc.gov/violenceprevention/overview/social-ecologicalmodel.html Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum. Connelly, L. M. (2008). Pilot studies. MEDSURG Nursing, 17(6), 411–412. DeVellis, R. F. (2012). Scale development: Theory and applications (3rd ed.). SAGE Publications Inc. Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., & Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. Drisko, J. (2014). Split or synthesis: The odd relationship between clinical practice and research in social work and in social work education. Clinical Social Work Journal, 42, 182–192. https://doi.org/10.1007/s10615-014-0493-2 Drisko, J., & Grady, M. (2015). Evidence-based practice in social work: A contemporary perspective. Clinical Social Work Journal, 43(3), 274–282. Dziuban, C. D., & Shirkey, E. C. (1974). When is a correlation matrix appropriate for factor analysis? Some Decision Rules. Psychological Bulletin, 81(6), 358–361. https://doi.org/10.1037/h0036316 Eiraldi, R., Wolk, C. B., Locke, J., & Beidas, R. (2015). Clearing hurdles: The challenges of implementation of mental health evidence-based practices in under-resourced schools. Advances in School Mental Health Promotion, 8(3), 124–145. https://doi.org/10.1080/1754730X.2015.1037848 Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4(1), 1–14. Essock, S. M., Goldman, H. H., & Van Tosh, L. (2003). Evidence-based practices: Setting the context and responding to concerns. Psychiatric Clinics of North America, 26, 919–938. Evans, S. W., & Weist, M. D. (2004). Implementing empirically supported treatments in the schools: What are we asking? Clinical Child and Family Psychology Review, 7, 263–267. https://doi.org/10.1007/s10567-004-6090-0. Fabiano, G. A., & Pyle, K. (2019). Best practices in school mental health for attention-deficit/hyperactivity disorder: A framework for intervention. School Mental Health: A Multidisciplinary Research and Practice Journal, 11(1), 72–91. https://doi.org/10.1007/s12310-018-9267-2 Hicks, T. B., Shahidullah, J. D., Carlson, J. S., & Palejwala, M. H. (2014). Nationally certified school psychologists’ use and reported barriers to using evidence-based interventions in schools: The influence of graduate program training and education. School Psychology Quarterly, 29(4), 469–487. Hill, R. (1998). What sample size is “enough” in Internet survey research? Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6, 3–4. Hoover, S.A. (2018). When we know better, we don’t always do better: Facilitating the research to practice and policy gap in school mental health. School Mental Health 10. https://doi.org/10.1007/s12310-018-9271-6 Ikart, E. M. (2019). Survey questionnaire survey pretesting method: An evaluation of survey questionnaire via expert review technique. Asian Journal of Social Science Studies, 4(2), 1–17. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Author. Isaac, S., & Michael, W.B. (1995). Handbook in research and evaluation. San Diego, CA: Educational and Industrial Testing Services. Jensen, P. S., & Foster, M. (2010). Closing the research to practice gap in children’s mental health: Structures, solutions, and strategies. Administration and Policy in Mental Health, 37, 111–119. Karekla, M., Lundgren, J., & Forsyth, J. (2004). A survey of graduate training in empirically supported and manualized treatments: A preliminary report. Cognitive and Behavioral Practice, 11, 230–242. Kelley, K., Clark, B., Brown, V., & Sitzia, J. (2003). Good practice in the conduct and reporting of survey research. International Journal for Quality in Health Care, 15(3), 261–266. https://doi.org/10.1093/intqhc/mzg031 Locke, J., Beidas, R. S., & Marcus, S. (2016). A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implementation Science, 11, 135. Lyon, A. R., & Bruns, E. J. (2019). User-centered redesign of evidence-based psychosocial interventions to enhance implementation—Hospitable soil or better seeds? Journal of the American Medical Association Psychiatry, 76, 3–4. https://doi.org/10.1001/jamapsychiatry.2018.3060. Markle, R.S., Splett, J.W., Maras, M.A., Weston, K.J. (2014). Effective school teams: Benefits, barriers, and best practices. In M.D. Weist, N.A. Lever, C.P. Bradshaw, and J.S. Owens, (Eds.). Handbook of school mental health: Research, training, practice, and policy. New York, NY: Springer. McCance-Katz, E. (2019). Guidance to states and school systems on addressing mental health and substance use issues in schools: Joint informational bulletin. Substance Abuse and Mental Health Services Administration (SAMHSA). Centers for Medicare & Medicaid Services (CMS). McIntyre, L. L., Gresham, F. M., DiGennaro, F. D., & Reed, D. D. (2007). Treatment integrity of school-based interventions with children in the Journal of Applied Behavior Analysis 1991–2005. Journal of Applied Behavior Analysis, 40, 659–672. https://doi.org/10.1901/jaba.2007.659-672 Mellin, E. A., Taylor, L., & Weist, M. D. (2014). The Expanded School Mental Health Collaboration Instrument [School Version]: Development and initial psychometrics. School Mental Health, 6, 151–162. https://doi.org/10.1007/s12310-013-9112-6 Mullen, E. J., Bledsoe, S. E., & Bellamy, J. L. (2008). Implementing evidence-based social work practice. Research on Social Work Practice, 18(4), 325–338. https://doi.org/10.1177/1049731506297827 Mullen, P. R., Stevens, H., & Chae, N. (2019).School counselors’ attitudes toward evidence-based practices. Professional School Counseling, 22. https://doi.org/10.1177/2156759X18823690 National Association of School Psychologists. (2017a). Who are school psychologists. Author. Retrieved January 18, 2018 from https://www.nasponline.org/about-school-psychology/who-are-school-psychologists National Association of School Psychologists. (2017b). NASP Practice Model 10 Domains. Author. Retrieved January 18, 2018 from https://www.nasponline.org/standards-and-certification/nasp-practice-model/nasp-practice-model-implementation-guide/section-i-nasp-practice-model-overview/nasp-practice-model-10-domains National Association of School Psychologists. (2020). COVID-19: Resource center. Guidance and Supports. Author. Retrieved June 1, 2020 from https://www.nasponline.org/resources-and-publications/resources-and-podcasts/covid-19-resource-center National Association of School Psychologists. (2021). Comprehensive school-based mental and behavioral health services and school psychologists [handout]. Author. National Association of Social Workers. (2017). Why choose the social work profession? Author. Retrieved January 18, 2018 from https://www.socialworkers.org/Careers/Career-Center/Explore-Social-Work/Why Choose-the-Social-Work-Profession National Association of Social Workers. (2020). Social work is grappling with two pandemics: COVID-19 and racism. Author. Retrieved June 6, 2020 from http://www.socialworkblog.org/advocacy/2020/06/two-pandemics/ Owens, P. L., Hoagwood, K., Horwitz, S. M., Leaf, P. J., Poduska, J. M., Kellam, S. G., & Ialongo, N. S. (2002). Barriers to children’s mental health services. Journal of the American Academy of Child and Adolescent Psychiatry, 41(6), 731–738. Parrish, D. E. (2018). Evidence-based practice: A common definition matters. Journal of Social Work Education, 54(3), 407–411. https://doi.org/10.1080/10437797.2018.1498691 Patalay, P., Giese, L., Stankovic, M., Curtin, C., Moltrecht, B., & Gondek, D. (2016). Mental health provision in schools: Priority, facilitators and barriers in 10 European countries. Child and Adolescent Mental Health, 21(3), 139–147. Payton, J., Weissberg, R. P., Durlak, J. A., Dymnicki, A. B., Taylor, R. D., Schellinger, K. B., & Pachan, M. (2008). The positive impact of social and emotional learning for kindergarten to eighth-grade students: Findings from three scientific reviews. Collaborative for Academic, Social, and Emotional Learning. Plemmons, G., Hall, M., Doupnik, S., Gay, J., Brown, C., Browning, W., & Williams, D. (2018). Hospitalization for suicide ideation or attempt: 2008–2015. Pediatrics, 141(6), e20172426. https://doi.org/10.1542/peds.2017-2426 President's New Freedom Commission on Mental Health. (2003, April). Retrieved January 31, 2018 from http://www.mentalhealthcommission.gov/mission.html Reddy, L. A., Forman, S. G., Stoiber, K. C., & Gonzalez, J. E. (2017). A national investigation of school psychology trainers’ attitudes and beliefs about evidence-based practices. Psychology in the Schools, 54(3), 261–278. Rubin, A., & Parrish, D. (2007). Views of evidence-based practice among faculty in master of social work programs: A national survey. Research on Social Work Practice, 17, 110–122. Schaeffer, C. M., Bruns, E., Weist, M., Stephan, S. H., Goldstein, J., & Simpson, Y. (2005). Overcoming challenges to using evidence-based interventions in schools. Journal of Youth and Adolescence, 34(1), 15–22. https://doi.org/10.1007/s10964-005-1332-0 Shernoff, E. S., Bearman, S. K., & Kratochwill, T. R. (2017). Training the next generation of school psychologists to deliver evidence-based mental health practices: Current challenges and future directions. School Psychology Review, 46(2), 219–232. Spiel, C. F., Evans, S. W., & Langberg, J. M. (2014). Evaluating the content of individualized education programs and 504 plans of young adolescents with attention deficit/hyperactivity disorder. School Psychology Quarterly, 29(4), 452–468. https://doi.org/10.1037/spq0000101 Substance Abuse and Mental Health Services Administration. (2020). Key substance use and mental health indicators in the United States: Results from the 2019 National Survey on Drug Use and Health (HHS Publication No. PEP20–07–01–001, NSDUH Series H-55). Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration. Retrieved from https://www.samhsa.gov/data/ Swick, D., & Powers, J. D. (2018). Increasing access to care by delivering mental health services in schools: The school-based support program. School Community Journal, 28(1), 129–144. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). MA Pearson. Teich, J. L., Robinson, G., & Weist, M. D. (2008). What kinds of mental health services do schools in the United States provide? Mental Health Promotion, 1(1), 13–22. https://doi.org/10.1080/1754730X.2008.9715741 Weist, M. D. (2005). Fulfilling the promise of school-based mental health: Moving toward a Public Mental Health Promotion approach. Journal of Abnormal Child Psychology, 33(6), 735–741. Weist, M. D., Hoover, S., Lever, N., Youngstrom, E. A., George, M., McDaniel, H. L., & Hoagwood, K. (2019). Testing a package of evidence-based practices in school mental health. School Mental Health, 11, 692–706. Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60(6), 628–648. https://doi.org/10.1037/0003-066X.60.6.628 Wike, T. L., Grady, M., Massey, M., Bledsoe, S. E., Bellamy, J. L., Stim, H., & Putzu, C. (2019). Newly educated MSW social workers’ use of evidence-based practice and evidence-supported interventions: Results from an online survey. Journal of Social Work Education, 55(3), 504–518.