A minimum evaluation protocol and stepped-wedge cluster randomized trial of ACCESS Open Minds, a large Canadian youth mental health services transformation project
Tóm tắt
Many Canadian adolescents and young adults with mental health problems face delayed detection, long waiting lists, poorly accessible services, care of inconsistent quality and abrupt or absent inter-service transitions. To address these issues, ACCESS Open Minds, a multi-stakeholder network, is implementing and systematically evaluating a transformation of mental health services for youth aged 11 to 25 at 14 sites across Canada. The transformation plan has five key foci: early identification, rapid access, appropriate care, the elimination of age-based transitions between services, and the engagement of youth and families. The ACCESS Open Minds Research Protocol has multiple components including a minimum evaluation protocol and a stepped-wedge cluster randomized trial, that are detailed in this paper. Additional components include qualitative methods and cost-effectiveness analyses. The services transformation is being evaluated at all sites via a minimum evaluation protocol. Six sites are participating in the stepped-wedge trial whereby the intervention (a service transformation along the key foci) was rolled out in three waves, each commencing six months apart. Two sites, one high-population and one low-population, were randomly assigned to each of the three waves, i.e., randomization was stratified by population size. Our primary hypotheses pertain to increased referral numbers, and reduced wait times to initial assessment and to the commencement of appropriate care. Secondary hypotheses pertain to simplified pathways to care; improved clinical, functional and subjective outcomes; and increased satisfaction among youth and families. Quantitative measures addressing these hypotheses are being used to determine the effectiveness of the intervention. Data from our overall research strategy will help test the effectiveness of the ACCESS Open Minds transformation, refine it further, and inform its scale-up. The process by which our research strategy was developed has implications for the practice of research itself in that it highlights the need to actively engage all stakeholder groups and address unique considerations in designing evaluations of complex healthcare interventions in multiple, diverse contexts. Our approach will generate both concrete evidence and nuanced insights, including about the challenges of conducting research in real-world settings. More such innovative approaches are needed to advance youth mental health services research. Clinicaltrials.gov,
ISRCTN23349893
(Retrospectively registered: 16/02/2017).
Tài liệu tham khảo
Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):593–602.
Copeland WE, Wolke D, Shanahan L, Costello EJ. Adult functional outcomes of common childhood psychiatric problems: a prospective, longitudinal study. JAMA Psychiatry. 2015;72(9):892–9.
Lee TY, Lee J, Kim M, Choe E, Kwon JS. Can we predict psychosis outside the clinical high-risk state? A systematic review of non-psychotic risk syndromes for mental disorders. Schizophr Bull. 2018;44(2):276–85.
Bloom D, Cafiero E, Jane-Llopis E, Abrahams-Gessel S, Bloom LR, Fathima S, et al. The global economic burden of noncommunicable diseases. Geneva: World Economic Forum; 2011.
Ormel J, Oerlemans AM, Raven D, Laceulle OM, Hartman CA, Veenstra R, et al. Functional outcomes of child and adolescent mental disorders. Current disorder most important but past psychiatric history matters as well. Psychol Med. 2017;47(7):1271–82.
Erskine HE, Moffit TE, Copeland WE, Costello EJ, Ferrari AJ, Patton G, et al. A heavy burden on young minds: the global burden of mental and substance use disorders in children and youth. Psychol Med. 2015;45(7):1551–63.
Navaneelan T. Suicide rates: an overview. Statistics Canada: Canada; 2012.
Nelson SE, Wilson K. The mental health of indigenous peoples in Canada: a critical review of research. Soc Sci Med. 2017;176:93–112.
Canada H. Acting on what we know: preventing youth suicide in first nations. Health Canada: Ottawa; 2003.
McGorry PD, Hartmann JA, Spooner R, Nelson B. Beyond the “at risk mental state” concept: transitioning to transdiagnostic psychiatry. World Psychiatry. 2018;17(2):133–42.
Mcgorry PD, Mei C. Early intervention in youth mental health: Progress and future directions. Evid Based Ment Health. 2018;21(4):182–4.
Wang PS, Berglund P, Olfson M, Pincus HA, Wells KB, Kessler RC. Failure and delay in initial treatment contact after first onset of mental disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62(6):603–13.
Dell’osso B, Altamura AC. Duration of untreated psychosis and duration of untreated illness: new vistas. CNS Spectr. 2010;15(4):238–46.
Penttila M, Jasskelainen E, Hirvonen N, Isohanni M, Miettuenen J. Duration of untreated psychosis as predictor of long-term outcome in schizophrenia: systematic review and meta-analysis. Br J Psychiatry. 2014;205(2):88–94.
Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54(1):60–6.
Pearson C, Janz T, Ali J. Mental and substance use disorders in Canada. Canada: Statistics Canada; 2013.
Urbanoski K, Inglis D, Veldhuizen S. Service use and unmet needs for substance use and mental disorders in Canada. Can J Psychiatr. 2017;62(8):551–9.
MacDonald K, Fainman-Adelman N, Anderson KK, Iyer SN. Pathways to mental health services for young people: a systematic review. Soc Psychiatry Psychiatr Epidemiol. 2018;53(10):1005–38.
Kowalewski K, McLennan JD, McGrath PJ. A preliminary investigation of wait times for child and adolescent mental health services in Canada. J Can Acad Child Adolesc Psychiatry. 2011;20(2):112–9.
Jordan G, Kinkaid M, Iyer SN, Joober R, Goldberg K, Malla A, et al. Baby or bathwater? Referrals of “non-cases” in a targeted early identification intervention for psychosis. Soc Psychiatry Psychiatr Epidemiol. 2018;53(7):757–61.
Malla A, Shah J, Iyer S, Boksa P, Joober R, Andersson N, et al. Youth mental health should be a top priority for health care in Canada. Can J Psychiatr. 2018;63(4):216–22.
Iyer SN, Boksa P, Lal S, Shah J, Marandola G, Jordan G, et al. Transforming youth mental health: a Canadian perspective. Ir J Psychol Med. 2015;32(1):51–60.
Repper J, Simpson A, Grimshaw G. Good practice guidance for involving carers and family members and close friends of service users in research. UK: NIHR Clinical Research Network: Mental Health; 2014. Available at: http://openaccess.city.ac.uk/id/eprint/7245/6/Good_practice_guidance_draft%201%281%29.pdf
Canadian Institutes of Health Research. Canada’s Strategy for Patient-Orientated Research. Improving health outcomes through evidence-informed care. Ottawa: Canadian Institutes of Health Research; 2011. Available at: http://www.cihr-irsc.gc.ca/e/documents/P-O_Research_Strategy-eng.pdf
Perestelo-Perez L, Gonzalez-Lorenzo M, Perez-Ramos J, Rivero-Santana A, Serrano-Aguilar P. Patient involvement and shared decision-making in mental health care. Curr Clin Pharmacol. 2011;6(2):83–90.
Tambuyzer E, Van Audenhove C. Is perceived patient involvement in mental health care associated with satisfaction and empowerment? Health Expect. 2015;18(4):516–26.
Malla A, Iyer S, McGorry P, Cannon M, Coughlan H, Singh S, et al. From early intervention in psychosis to youth mental health reform: a review of the evolution and transformation of mental health services for young people. Soc Psychiatry Psychiatr Epidemiol. 2016;51(3):319–26.
McGorry P, Bates T, Birchwood M. Designing youth mental health services for the 21st century: examples from Australia, Ireland and the UK. Br J Psychiatry Suppl. 2013;54:s30–5.
McGorry PD, Tanti C, Stokes R, Hickie IB, Carnell K, Littlefield LK, et al. Headspace: Australia’s National Youth Mental Health Foundation-where young minds come first. Med J Aust. 2007;187(7 Suppl):S68–70.
Malla A, Iyer S, Shah J, Joober R, Boksa P, Lal S, et al. Canadian response to need for transformation of youth mental health services: ACCESS Open Minds (Esprits ouverts). Early Interv Psychiatry. 2019;13(3):697–706. https://doi.org/10.1111/eip.12772.
Canadian Psychiatric Association. Wait time benchmarks for patients with serious psychiatric illnesses. Canada: Canadian Psychiatric Association; 2006.
Statistics Canada. Aboriginal Peoples in Canada: First Nations People, Metis and Inuit. National Household Survey, 2011. Canada: Statistics Canada;2013.
Sawchuk J. Social conditions of indigenous peoples in Canada. The Canadian Encyclopedia. 2011; Available at: https://www.thecanadianencyclopedia.ca/en/article/native-people-social-conditions.
Baskin C. Structural determinants as the cause of homelessness for aboriginal youth. Crit Soc Work. 2007;8(1) Available at: http://www1.uwindsor.ca/criticalsocialwork/structural-determinants-as-the-cause-of-homelessness-for-aboriginal-youth.
Levin R, Herbert M. The experience of urban aboriginals with health care services in Canada: implications for social work practice. Soc Work Health Care. 2004;39(1–2):165–79.
ACCESS Open Minds. Early identification: An evidence-based practical guide. (English and French). Montreal: ACCESS Open Minds; 2017. Available at: http://accessopenminds.ca/resources-guides-downloads/.
University of Kansas. Community Tool Box: Chapter 3, Section 8: Identifying Community Assets and Resources. Available at: https://ctb.ku.edu/en/community-tool-box-toc/community-assessment/chapter-3-assessing-community-needs-and-resources-32.
Fawcett SB, Schultz JA, Holt CM, Collie-Akers V, Watson-Thompson J. Participatory research and capacity building for community health and development. J Prev Interv Community. 2013;41(3):139–41.
Holt CM, Fawcett SB, Schultz JA, Jones JA, Berkowitz B, Wolff TJ, et al. Disseminating online tools for building capacity among community practitioners. J Prev Interv Community. 2013;41(3):201–11.
ACCESS Open Minds. Community mapping guide: Conducting community mapping within the ACCESS Open Minds framework of youth mental health care. (English and French). Montreal: ACCESS Open Minds; 2017. Available at: http://accessopenminds.ca/resources-guides-downloads/.
Fortney JC, Unutzer J, Wrenn G, Pyne JM, Smith GR, Schoenbaum M, et al. A tipping point for measurement-based care. Psychiatr Serv. 2017;68(2):179–88.
Knaup C, Koesters M, Schoefer D, Becker T, Puschner B. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatry. 2009;195(1):15–22.
Zimmerman M, McGlinchey JB. Why don’t psychiatrists use scales to measure outcome when treating depressed patients? J Clin Psychiatry. 2008;69(12):1916–9.
Statistics Canada. Canadian community health survey (CCHS) – mental health user guide. Ottawa: Statistics Canada; 2013.
Statistics Canada. Aboriginal peoples survey (APS). Ottawa: Statistics Canada; 2012.
Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91.
Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.
Andersson N, Shea B, Amaratunga C, McGuire P, Sioui G. Rebuilding from resilience: research framework for a randomized control trial of community-led interventions to prevent domestic violence in aboriginal communities. Pimatisiwin. 2010;8(2):61–88.
Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6:54.
Haines TP, Hemming K. Stepped-wedge cluster-randomised trials: level of evidence, feasibility and reporting. J Physiother. 2018;64(1):63–6.
Grayling MJ, Wason JM, Mander AP. Stepped wedge cluster randomized controlled trial designs: a review of reporting quality and design features. Trials. 2017;18(1):33.
Barker D, McElduff P, D’Este C, Campbell MJ. Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Med Res Methodol. 2016;16:69.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.
ACCESS Open Minds. ACCESS Open Minds- A transformation in youth mental health;2017. Available at: https://youtu.be/nBmOu-YUzuk
ACCESS Open Minds. ACCESS Open Minds- Informed consent (English);2017. Available at: https://youtu.be/M9bpPoZJK9s
ACCESS Open Minds. ACCESS Esprits ouverts- Consentement informé (French);2017. Available at: https://youtu.be/KHCEmOyH-Es
Bhui K, Mohamud S, Warfa N, Craig TJ, Stansfeld SA. Cultural adaptation of mental health measures: improving the quality of clinical practice and research. Br J Psychiatry. 2003;183:184–6.
World Health Organization. Management of substance abuse. Process of translation and adaptation of instruments;2019. Available at: https://www.who.int/substance_abuse/research_tools/translation/en/
Statistics Canada. Visible minority and population group reference guide, National Household Survey, 2011. Ottawa: Ministry of Industry; 2013.
Dennis ML, Chan YF, Funk RR. Development and validation of the GAIN short screener (GSS) for internalizing, externalizing and substance use disorders and crime/violence problems among adolescents and adults. Am J Addict. 2006;15(Suppl 1):80–91.
Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168(12):1266–77.
Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959–76.
Fleishman JA, Zuvekas SH. Global self-rated mental health: associations with other mental health measures and with role functioning. Med Care. 2007;45(7):602–9.
Zajacova A, Dowd JB. Reliability of self-rated health in US adults. Am J Epidemiol. 2011;174(8):977–83.
Mawani FN, Gilmour H. Validation of self-rated mental health. Health Rep. 2010;21(3):61–75.
Rickwood DJ, Mazzer KR, Telford NR, Parker AG, Tanti CJ, McGorry PD. Changes in psychological distress and psychosocial functioning in young people visiting headspace centres for mental health problems. Med J Aust. 2015;202(10):537–42.
Hilferty F, Cassells R, Muir K, Duncan A, Christensen D, Mitrou F, et al. Is headspace making a difference to young people’s lives? Final report of the independent evaluation of the headspace program. Sydney: Social Policy Research Centre, UNSW Australia; 2015.
Berk M, Ng F, Dodd S, Callaly T, Campbell S, Bernardo M, et al. The validity of the CGI severity and improvement scales as measures of clinical effectiveness suitable for routine clinical use. J Eval Clin Pract. 2008;14(6):979–83.
Bunlop BW, Gray J, Rapaport MH. Transdiagnostic clinical global impression scoring for routine clinical settings. Behav Sci (Basel). 2017;7(3):40.
Hilsenroth MJ, Ackerman SJ, Blagys MD, Baumann BD, Baity MR, Smith SR, et al. Reliability and validity of DSM-IV axis V. Am J Psychiatry. 2000;157(11):1858–63.
Miller SD, Duncan SL, Brown J, Sparks JA, Claud DA. The outcome rating scale: a preliminary study of reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy. 2003;2:91–100.
Skevington SM, Lofty M, O’Connell KA. WHOQOL group. The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res. 2004;13(2):299–310.
Law D, Jacob J. Goals and goal based outcomes (GBOs) some useful information. 3rd ed. London: CAMHS Press; 2015.
Abrines-Jaume N, Midgley N, Hopkins K, Hoffman J, Martin K, Law D, et al. A qualitative analysis of implementing shared decision making in child and adolescent mental health services in the United Kingdom: stages and facilitators. Clin Child Psychol Psychiatry. 2016;21(1):19–31.
Wolpert M, Ford T, Trustam E, Law D, Deighton J, Flannery H, et al. Patient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measures. J Ment Health. 2012;21(2):165–73.
Jacob J, De Francesco D, Deighton J, Law D, Wolpert M, Edbrooke-Childs J. Goal formulation and tracking in child mental heath settings: when is it more likely and is it associated with satisfaction with care? Eur Child Adolesc Psychiatry. 2017;26(7):759–70.
Rush B, Hannson E, Cvetanova Y, Rotondi N, Furlong A, Behrooz R. Development of a client perception of care tool for mental health and addictions: Qualitative, quantitative, and psychometric analysis. Final Report for Ministry of Health and Long-Term Care. Toronto: Health Systems and Health Equity Research, Centre for Addiction and Mental Health; 2013.
Walker JS, Powers LE. Introduction to the youth self-efficacy scale/mental health and the youth participation in planning scale. Portland: Research and Training Centre on Family Support and Children’s Mental Health, Portland State University; 2007.
Campbell A, Hemsley S. Outcome rating scale and session rating scale in psychological practice: clinical utility of ultra-brief measures. Clin Psychol. 2009;13:1–9.
Reid RJ. Embedding research in the learning health system. HealthcarePapers 16:30–35;doi: https://doi.org/10.12927/hcpap.2016.24724
U.S. Food and Drug Administration. Regulations: Good Clinical Practice and Clinical Trials. Washington: U.S. Food and Drug Administration. Available at: https://www.fda.gov/science-research/clinical-trials-and-human-subject-protection/regulations-good-clinical-practice-and-clinical-trials
Royal Commission on Aboriginal Peoples. Report of the Royal Commission on Aboriginal Peoples. Ottawa: Canada Communication Group—Publishing; 1996. Available at: http://www.bac-lac.gc.ca/eng/discover/aboriginal-heritage/royal-commission-aboriginal-peoples/Pages/final-report.aspx
The First Nations Information Governance Centre. Ownership, Control, Access and Possession (OCAP™): The Path to First Nations Information Governance. May 2014. (Ottawa: The First Nations Information Governance Centre, May 2014)..Available at www.fnigc.ca
Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada, Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans; December 2014. Chapter 9: Research Involving the First Nations, Inuit and Metis People of Canada. Available at: http://www.pre.ethics.gc.ca/eng/policy-politique/initiatives/tcps2-eptc2/chapter9-chapitre9/
Government of Canada. Jordan’s Principle. Ottawa: Government of Canada. Available at: https://www.canada.ca/en/indigenous-services-canada/services/jordans-principle.html
Statistics Canada. Table 105-1101-mental health profile, Canadian community health survey- mental health (CCHS), by age group and sex, Canada and provinces, occasional (number unless otherwise noted), CANSIM (database). Ottawa: Statistics Canada Available at: https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1310046501
Statistics Canada. Census profile, 2016 census. Ottawa: Statistics Canada; 2017. Available at: https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/index.cfm?Lang=E
Iyer SN, Boksa P, Joober R. How youth mental healthcare is being transformed in diverse settings across Canada: Reflections on the experience of the ACCESS Open Minds network. Early Interv Psychiatry. 2019;13(S1):8–11. https://doi.org/10.1111/eip.12811
Abdel-Baki A, Aubin D, Morisseau-Guillot R, Dupont ME, Bauco P, Lal S, Shah J, Joober R, Boksa P, Malla A, Iyer SN. Improving Mental Health Services for Homeless Youth in Downtown Montreal, Canada: Partnership between a Local Network and ACCESS Open Minds, a National Service Transformation Research Initiative. Early Interv Psychiatry. 2019;13(S1):20–28. https://doi.org/10.1111/eip.12814
Hutt-MacLeod D, Rudderham H, Sylliboy A, Sylliboy-Denny M, Liebenberg L, Denny JF, Gould MR, Gould N, Nossal M, Iyer S, Malla A, Boksa P. Eskasoni First Nation’s transformation of youth mental healthcare: Partnership between a Mi’kmaq community and the ACCESS Open Minds research project in implementing innovative practice and service evaluation. Early Interv Psychiatry. 2019;13(S1):42–47. https://doi.org/10.1111/eip.12817
Reaume-Zimmer P, Chandrasena R, Malla A, Joober R, Boksa P, Shah JL, Iyer SN, Lal S. Transforming Youth Mental Health Services in a Semi-Urban and Rural Region of Canada: ACCESS Open Minds Chatham-Kent. Early Interv Psychiatry. 2019;13(S1):48–55. https://doi.org/10.1111/eip.12818
Etter M, Goose A, Nossal M, Chishom-Nelson J, Heck C, Joober R, Boksa P, Lal S, Shah J, Andersson N, Iyer S, Malla A (2019). Improving youth mental wellness services in an Indigenous context in Ulukhaktok, Northwest Territories: ACCESS Open Minds project. Early Interv Psychiatry. 2019;13(S1):35–41. https://doi.org/10.1111/eip.12816
Abba-Aji A, Hay K, Kelland J, Mummery C, Urichuk L, Snaterse M, Chue P, Lal S, Boksa P, Joober R, Malla A, Iyer S, Shah JL. Youth mental health service transformation in a large urban centre: ACCESS Open Minds Edmonton. Early Interv Psychiatry. 2019;13(S1):14–19. https://doi.org/10.1111/eip.12813
Vallianatos H, Friese K, Perez JM, Slessor J, Thind R, Dunn J, Lal S, Boksa P, Joober R, Malla A, Iyer SN, Shah JL. ACCESS Open Minds University of Alberta: Transforming student mental health services across a large post-secondary educational institution. Early Interv Psychiatry. 2019;13(S1):56–64. https://doi.org/10.1111/eip.12819
Dubé A, Lancu P, Doucet D, Tranchant CC, Joachin A, Malchow J, Robichaud S, Hach M, Godin I, Bourdon L, Bourque J, Iyer S, Malla A, Beaton AM. Transforming child and youth mental healthcare: ACCESS Open Minds New Brunswick in the rural Francophone region of the Acadian Peninsula. Early Interv Psychiatry. 2019;13(S1):29–34. https://doi.org/10.1111/eip.12815
El Emam K, Jonker E, Sampson M, Krleza-Jeric K, Neisa A. The use of electronic data capture tools in clinical trials: web-survey of 259 Canadian trials. J Med Internet Res. 2009;11(1):e8. https://doi.org/10.2196/jmir.1120.