Using flawed, uncertain, proximate and sparse (FUPS) data in the context of complexity: learning from the case of child mental health
Tóm tắt
The use of routinely collected data that are flawed and limited to inform service development in healthcare systems needs to be considered, both theoretically and practically, given the reality in many areas of healthcare that only poor-quality data are available for use in complex adaptive systems. Data may be compromised in a range of ways. They may be flawed, due to missing or erroneously recorded entries; uncertain, due to differences in how data items are rated or conceptualised; proximate, in that data items are a proxy for key issues of concern; and sparse, in that a low volume of cases within key subgroups may limit the possibility of statistical inference. The term ‘FUPS’ is proposed to describe these flawed, uncertain, proximate and sparse datasets. Many of the systems that seek to use FUPS data may be characterised as dynamic and complex, involving a wide range of agents whose actions impact on each other in reverberating ways, leading to feedback and adaptation. The literature on the use of routinely collected data in healthcare is often implicitly premised on the availability of high-quality data to be used in complicated but not necessarily complex systems. This paper presents an example of the use of a FUPS dataset in the complex system of child mental healthcare. The dataset comprised routinely collected data from services that were part of a national service transformation initiative in child mental health from 2011 to 2015. The paper explores the use of this FUPS dataset to support meaningful dialogue between key stakeholders, including service providers, funders and users, in relation to outcomes of services. There is a particular focus on the potential for service improvement and learning. The issues raised and principles for practice suggested have relevance for other health communities that similarly face the dilemma of how to address the gap between the ideal of comprehensive clear data used in complicated, but not complex, contexts, and the reality of FUPS data in the context of complexity.
Tài liệu tham khảo
Raghupathi W, Raghupathi V. Big data analytics in healthcare: promise and potential. Health Inform Sci Syst. 2014;2:3.
McIntosh AM, Stewart R, John A, Smith DJ, Davis K, Sudlow C, Hotopf M. Data science for mental health: a UK perspective on a global challenge. Lancet Psychiatry. 2016;3(10):993–8.
Lilford R, Mohammed MA, Spiegelhalter D, Use TR. misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004;363(9415):1147–54.
Black N. Assessing the quality of hospitals. BMJ. 2010;340:c2066.
Greenhalgh T, Stramer K, Bratan T, Byrne E, Mohammad Y, Russell J. Introduction of shared electronic records: multi-site case study using diffusion of innovation theory. BMJ (Clinical Research Ed). 2008;337:a1786.
Wolpert M, Jacob J, Napoleone E, Whale A, Calderon A, Edbrooke-Childs J. Child- and Parent-reported Outcomes and Experience from Child and Young People’s Mental Health Services 2011–2015. 2016. https://www.corc.uk.net/media/1172/201612child_and_parent-reported_outcomes_and_experience_from_child_and-young_peoples_mental_health_services_2011-2015.pdf. Accessed 5 Apr 2018.
Muir Gray J. Evidence-Based Health Care. Edinburgh: Churchill Livingstone; 2001.
Heitjan DF, Rubin DB. Ignorability and coarse data. Annals Statistics. 1991;19:2244–53.
Ford E, Nicholson A, Koeling R, Tate AR, Carroll J, Axelrod L, Smith HE, Rait G, Davies KA, Petersen I, et al. Optimising the use of electronic health records to estimate the incidence of rheumatoid arthritis in primary care: what information is hidden in free text? BMC Med Res Methodol. 2013;13(1):105.
Goldstein H, Spiegelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J Royal Stat Soc Series A (Statistics Soc). 1996;159:385–443.
Leckie G, Goldstein H. The limitations of using school league tables to inform school choice. J Royal Stat Soc Series A (Statistics Soc). 2009;172(4):835–51.
Plsek PE, Greenhalgh T. Complexity science: the challenge of complexity in health care. BMJ. 2001;323(7313):625.
Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood DT, Greaves F, Harper L, Hawe P, Moore L, et al. The need for a complex systems model of evidence for public health. Lancet. 2017;390(10112):2602–4.
Tversky A, Kahneman D. Judgment under uncertainty: heuristics and biases. Science. 1974;185(4157):1124–31.
Currie G, Lockett A, Finn R, Martin G, Waring J. Institutional work to maintain professional power: Recreating the model of medical professionalism. Organ Stud. 2012;33(7):937–62.
Schon D. The Reflective Practitioner: How Professionals Think in Action. New York, NY: Basic Books; 1984.
Department of Health, Department for Education, NHS England. Future in Mind: Promoting, Protecting and Improving our Children and young People’s Mental Health and Wellbeing. London: Department of Health; 2015.
Hindley P. Written Evidence for the House of Commons Select Committee Inquiry into Child and Adolescent Mental Health Services from the Faculty of Child and Adolescent Psychiatrists. London: Royal College of Psychiatrists; 2014.
Care Quality Commission. Review of Children and Young People’s Mental Health Services. 2017. https://www.cqc.org.uk/sites/default/files/20171103_cypmhphase1_report.pdf. Accessed 5 Apr 2018.
Department of Health, Department of Education. Transforming Children and Young People's Mental Health Provision: A Green Paper. London. 2017. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/664855/Transforming_children_and_young_people_s_mental_health_provision.pdf. Accessed 5 Apr 2018.
Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder - developmental follow-back of a prospective longitudinal cohort. Arch General Psychiatry. 2003;60:709–17.
Green H, McGinnity A, Meltzer H, Ford T, Goodman R. Mental Health of Children and Young People in Great Britain, 2004. London: Palgrave; 2005.
Copeland WE, Wolke D, Shanahan L, Costello EJ. Adult functional outcomes of common childhood psychiatric problems: a prospective, longitudinal study. JAMA Psychiatry. 2015;72(9):892–9.
Children and Teens: Treatment. https://adaa.org/living-with-anxiety/children/treatment. Accessed 5 Apr 2018.
Whiteford HA, Harris MG, McKeon G, Baxter A, Pennell C, Barendregt JJ, Wang J. Estimating remission from untreated major depression: a systematic review and meta-analysis. Psychol Med. 2013;43(08):1569–85.
Stockings EA, Degenhardt L, Dobbins T, Lee YY, Erskine HE, Whiteford HA, Patton G. Preventing depression and anxiety in young people: a review of the joint efficacy of universal, selective and indicated prevention. Psychol Med. 2016;46:11–26.
Tennant R, Goens C, Barlow J, Day C, Stewart-Brown SA. systematic review of reviews of interventions to promote mental health and prevent mental health problems in children and young people. J Public Mental Health. 2007;6(1):25–32.
Bayer J, Hiscock H, Scalzo K, Mathers M, McDonald M, Morris A, Birdseye J, Wake M. Systematic review of preventive interventions for children's mental health: what would work in Australian contexts? Aust N Z J Psychiatry. 2009;43(8):695–710.
Merry S, McDowell H, Hetrick S, Bir J, Muller N. Psychological and/or educational interventions for the prevention of depression in children and adolescents. Cochrane Database Syst Rev. 2004;1:CD003380.
Stallard P, Phillips R, Montgomery AA, Spears M, Anderson R, Taylor J, Araya R, Lewis G, Ukoumunne OC, Millings A, et al. A cluster randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of classroom-based cognitive-behavioural therapy (CBT) in reducing symptoms of depression in high-risk adolescents. Health Technol Assess. 2013;17(vii–xvii):1–109.
Rousmaniere T, Wolpert M. Talking Failure in Therapy and Beyond. 2017. https://thepsychologist.bps.org.uk/volume-30/december-2017/talking-failure-therapy-and-beyond. Accessed 5 Apr 2018.
Fink E, Patalay P, Sharpe H, Holley S, Deighton J, Wolpert M. Mental health difficulties in early adolescence: a comparison of two cross-sectional studies in England from 2009 to 2014. J Adolesc Health. 2015;56(5):502–7.
Deighton J, Humphrey N, Belsky J, Boehnke J, Vostanis P, Patalay P. Longitudinal pathways between mental health difficulties and academic performance during middle childhood and early adolescence. Br J Dev Psychol. 2018;36:110–26.
Stop Cutting CAMHS Services. http://www.youngminds.org.uk/about/our_campaigns/cuts_to_camhs_services. Accessed 5 Apr 2018.
House of Commons Education and Health Committees. Children and Young People’s Mental Health – the Role of Education. First Joint Report of the Education and Health Committees of Session 2016–2017. London. 2017. https://publications.parliament.uk/pa/cm201617/cmselect/cmhealth/849/849.pdf. Accessed 5 Apr 2018.
Edbrooke-Childs J, Deighton J, Wolpert M. Changes in severity of psychosocial difficulties in adolescents accessing specialist mental healthcare in England (2009–2014). J Adolesc. 2017;60:47–52.
Law D, Wolpert M, editors. Guide to Using Outcomes and Feedback Tools With Children, Young People and Families. 2nd ed. London: CAMHS Press; 2014.
Deighton J, Tymms P, Vostanis P, Belsky J, Fonagy P, Brown A, Martin A, Patalay P, Wolpert M. The development of a school-based measure of child mental health. J Psychoeducational Assess. 2013;31(3):247–57.
Deighton J, Croudace T, Fonagy P, Brown J, Patalay P, Wolpert M. Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures. Child Adolescent Psychiatry Mental Health. 2014;8(1):14.
Patalay P, Deighton J, Fonagy P, Vostanis P, Wolpert M. Clinical validity of the Me and My School questionnaire: a self-report mental health measure for children and adolescents. Child Adolesc Psychiatry Ment Health. 2014;8:17.
Yeh M, Weisz JR. Why are we here at the clinic? Parent-child (dis)agreement on referral problems at out-patient treatment entry. J Consulting Clin Psychol. 2001;69:1018–25.
Edbrooke-Childs J, Newman R, Fleming I, Deighton J, Wolpert M. The association between ethnicity and care pathway for children with emotional problems in routinely collected child and adolescent mental health services data. Eur Child Adolesc Psychiatry. 2016;25(5):539–46.
Pepys S. The Diary of Samuel Pepys. London: Penguin; 2003.
Fernandez vs Government of Singapore In.: 1WLR 987 at 994; 1971. http://www.refworld.org/cases,GBR_HL,3ae6b707c.html. Accessed 10 May 2018.
Fischer AJ, Threlfall A, Meah S, Cookson R, Rutter H, Kelly MP. The appraisal of public health interventions: an overview. J Public Health. 2013;35(4):488–94.
Threlfall AG, Meah S, Fischer AJ, Cookson R, Rutter H, Kelly MP. The appraisal of public health interventions: the use of theory. J Public Health. 2015;37(1):166–71.
Choosing Wisely. http://www.choosingwisely.org/. Accessed 5 Apr 2018.
Child Outcomes Research Consortium. http://www.corc.uk.net/. Accessed 5 Apr 2018.
The Long Term Conditions Clinic. http://www.implementingthrive.org/case-study-11/. Accessed 5 Apr 2018.
Carr E. What is History? Cambridge: Cambridge University Press; 1961.