Considerations of diversity, equity, and inclusion in mental health apps: A scoping review of evaluation frameworks

Adam, 2020, Use of a mobile app to augment psychotherapy in a community psychiatric clinic: Feasibility and fidelity trial, JMIR Formative Research, 4, 10.2196/17722 Alcaraz, 2017, The ConNECT framework: A model for advancing behavioral medicine science and practice to foster health equity, Journal of Behavioral Medicine, 40, 23, 10.1007/s10865-016-9780-4 Alhuwail, 2020, The state of mental digi-therapeutics: A systematic assessment of depression and anxiety apps available for Arabic speakers, International Journal of Medical Informatics, 135, 104056, 10.1016/j.ijmedinf.2019.104056 2020 Anderson, 2016, Mobile health apps to facilitate self-care: A qualitative study of user experiences, PLoS One, 11, 10.1371/journal.pone.0156164 Andrade, 2014, Barriers to mental health treatment: Results from the WHO world mental health (WMH) surveys, Psychological Medicine, 44, 1303, 10.1017/S0033291713001943 Bakker, 2018, Development and pilot evaluation of smartphone-delivered cognitive behavior therapy strategies for mood- and anxiety-related problems: MoodMission, Cognitive and Behavioral Practice, 25, 496, 10.1016/j.cbpra.2018.07.002 Bakker, 2019, Engagement with a cognitive behavioural therapy mobile phone app predicts changes in mental health and wellbeing: MoodMission, Australian Psychologist, 54, 245, 10.1111/ap.12383 Bauer, 2018, Applying the principles for digital development: Case study of a smartphone app to support collaborative care for rural patients with posttraumatic stress disorder or bipolar disorder, Journal of Medical Internet Research, 20, 10.2196/10048 Baumel, 2017, Enlight: A comprehensive quality and therapeutic potential evaluation tool for mobile and web-based eHealth interventions, Journal of Medical Internet Research, 19, e82, 10.2196/jmir.7270 Beaudoin, 2015 Berauk, 2018, Mobile health applications for caring of older people: Review and comparison, Therapeutic innovation & regulatory science, 52, 374, 10.1177/2168479017725556 Blondeel, 2016, Evidence and knowledge gaps on the disease burden in sexual and gender minorities: A review of systematic reviews, International Journal for Equity in Health, 15, 1, 10.1186/s12939-016-0304-1 Borghouts, 2021, Barriers to and facilitators of user engagement with digital mental health interventions: Systematic review, Journal of Medical Internet Research, 23, 10.2196/24387 Bradway, 2020, Methods and measures used to evaluate patient-operated mobile health interventions: Scoping literature review, JMIR mHealth and uHealth, 8, 10.2196/16814 Brewer, 2020, Back to the future: Achieving health equity through health informatics and digital health, JMIR mHealth and uHealth, 8, 10.2196/14512 2021 Brown, 2020, Mobile health applications for people with dementia: A systematic review and synthesis of qualitative studies, Informatics for Health and Social Care, 45, 343, 10.1080/17538157.2020.1728536 Buitenweg, 2019, Cocreative development of the QoL-ME: A visual and personalized quality of life assessment app for people with severe mental health problems, JMIR mental health, 6, 10.2196/12378 Chang, 2021, Impact of a mobile-based (mHealth) tool to support community health nurses in early identification of depression and suicide risk in Pacific Island Countries, Australasian Psychiatry, 29, 200, 10.1177/1039856220956458 Chan, 2015, Towards a framework for evaluating mobile mental health apps, Telemedicine and e-Health, 21, 1038, 10.1089/tmj.2015.0002 Chávez, 2019, Design and evaluation of a mobile application for monitoring patients with alzheimer's disease: A day center case study, International Journal of Medical Informatics, 131, 103972, 10.1016/j.ijmedinf.2019.103972 Choi, 2020, Review of the content and quality of mobile applications about Alzheimer's disease and related dementias, Journal of Applied Gerontology, 39, 601, 10.1177/0733464818790187 Chow, 2020, Use of mental health apps by patients with breast cancer in the United States: Pilot pre-post study, JMIR cancer, 6, 10.2196/16476 Cook, 2017, Trends in racial-ethnic disparities in access to mental health care, 2004–2012, Psychiatric Services, 68, 9, 10.1176/appi.ps.201500453 Cummings, 2017, Geographic access to specialty mental health care across high-and low-income US communities, JAMA Psychiatry, 74, 476, 10.1001/jamapsychiatry.2017.0303 Dahlhamer, 2016, Barriers to health care among adults identifying as sexual minorities: A US national study, American Journal of Public Health, 106, 1116, 10.2105/AJPH.2016.303049 Davidson, 2020, A mobile phone app to improve the mental health of taxi drivers: Single-arm feasibility trial, JMIR mHealth and uHealth, 8, e13133, 10.2196/13133 Eiring, 2017, The development and feasibility of a personal health-optimization system for people with bipolar disorder, BMC Medical Informatics and Decision Making, 17, 1, 10.1186/s12911-017-0481-x Emerson, 2020, Lessons learned in selection and review of depression apps for primary care settings, Journal of Technology in Behavioral Science, 6, 42, 10.1007/s41347-020-00156-5 Evans-Lacko, 2018, Socio-economic variations in the mental health treatment gap for people with anxiety, mood, and substance use disorders: Results from the WHO world mental health (WMH) surveys, Psychological Medicine, 48, 1560, 10.1017/S0033291717003336 2018 Ferguson, 2017, Selecting, appraising, recommending and using mobile applications (apps) in nursing, Journal of Clinical Nursing, 26, 3253, 10.1111/jocn.13834 Fortuna, 2017, Adapting a psychosocial intervention for smartphone delivery to middle-aged and older adults with serious mental illness, American Journal of Geriatric Psychiatry, 25, 819, 10.1016/j.jagp.2016.12.007 Friis-Healy, 2021, It is time to REACT: Opportunities for digital mental health apps to reduce mental health disparities in racially and ethnically minoritized groups, JMIR mental health, 8, 10.2196/25456 Ginossar, 2010, Reducing the health and digital divides: A model for using community-based participatory research approach to e-health interventions in low-income hispanic communities, Journal of Computer-Mediated Communication, 15, 530, 10.1111/j.1083-6101.2009.01513.x Helweg-Joergensen, 2019, Using a mobile diary app in the treatment of borderline personality disorder: Mixed methods feasibility study, JMIR formative research, 3, 10.2196/12852 Jeong, 2020, Development and feasibility of a safety plan mobile application for adolescent suicide attempt survivors, CIN: Computers, Informatics, Nursing, 38, 382 Jin, 2015, Development and evaluation of an evaluation tool for healthcare smartphone applications, Telemedicine and e-Health, 21, 831, 10.1089/tmj.2014.0151 Kazdin, 2015, Technology-based interventions and reducing the burdens of mental illness: Perspectives and comments on the special series, Cognitive and Behavioral Practice, 22, 359, 10.1016/j.cbpra.2015.04.004 Kazdin, 2019, Annual research review: Expanding mental health services through novel models of intervention delivery, Journal of Child Psychology and Psychiatry, 60, 455, 10.1111/jcpp.12937 Kizakevich, 2018, PHIT for duty, a mobile application for stress reduction, sleep improvement, and alcohol moderation, Military Medicine, 183, 353, 10.1093/milmed/usx157 Klingemann, 2020, Mobile applications for alcohol dependent persons as tools supporting the recovery process, Alcoholism & Drug Addiction, 33, 10.5114/ain.2020.95978 Krahn, 2015, Persons with disabilities as an unrecognized health disparity population, American Journal of Public Health, 105, S198, 10.2105/AJPH.2014.302182 Lagan, 2020, Actionable health app evaluation: Translating expert frameworks into objective metrics, NPJ digital medicine, 3, 1, 10.1038/s41746-020-00312-4 Lagan, 2021, 72 Lagan, 2021, Evaluating evaluation frameworks: A scoping review of frameworks for assessing health apps, BMJ open, 11, 10.1136/bmjopen-2020-047001 Lan, 2018, Review of cognitive behavioural therapy mobile apps using a reference architecture embedded in the patient-provider relationship, BioMedical Engineering Online, 17, 1, 10.1186/s12938-018-0611-4 Lecy, 2012 Leong, 2011, Cross-cultural barriers to mental health services in the United States, Cerebrum : The Dana Forum on Brain Science, 2011, 5 Liao, 2020, Racial mirroring effects on human-agent interaction in psychotherapeutic conversations, 430 Linardon, 2020, Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review, Journal of Consulting and Clinical Psychology, 88, 1, 10.1037/ccp0000459 Lourenco, 2020, No participant left behind: Conducting science during COVID-19, Trends in Cognitive Sciences, 24, 583, 10.1016/j.tics.2020.05.003 Lui, 2017, Evidence-based apps? A review of mental health mobile applications in a psychotherapy context, Professional Psychology: Research and Practice, 48, 199, 10.1037/pro0000122 Magee, 2018, Mobile app tools for identifying and managing mental health disorders in primary care, Current Treatment Options in Psychiatry, 5, 345, 10.1007/s40501-018-0154-0 Mojtabai, 2011, Barriers to mental health treatment: Results from the national comorbidity survey replication (NCS-R), Psychological Medicine, 41, 1751, 10.1017/S0033291710002291 Mordecai, 2021, How Kaiser Permanente created a mental health and wellness digital ecosystem, NEJM Catalyst Innovations in Care Delivery, 2 Moshi, 2018, Suitability of current evaluation frameworks for use in the health technology assessment of mobile medical applications: A systematic review, International Journal of Technology Assessment in Health Care, 34, 464, 10.1017/S026646231800051X Munn, 2018, Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach, BMC Medical Research Methodology, 18, 1, 10.1186/s12874-018-0611-x 2021 Neary, 2018, State of the field of mental health apps, Cognitive and Behavioral Practice, 25, 531, 10.1016/j.cbpra.2018.01.002 Nouri, 2018, Criteria for assessing the quality of mHealth apps: A systematic review, Journal of the American Medical Informatics Association, 25, 1089, 10.1093/jamia/ocy050 Ouzzani, 2016, Rayyan—a web and mobile app for systematic reviews, Systematic Reviews, 5, 1, 10.1186/s13643-016-0384-4 Patterson, 2015 2015 2019 2019 2021 Pham, 2014, A scoping review of scoping reviews: Advancing the approach and enhancing the consistency, Research Synthesis Methods, 5, 371, 10.1002/jrsm.1123 Plaza-García, 2017, Development and initial evaluation of a mobile application to help with mindfulness training and practice, International Journal of Medical Informatics, 105, 59, 10.1016/j.ijmedinf.2017.05.018 Ponting, 2020, 43 Pospos, 2018, Web-based tools and mobile applications to mitigate burnout, depression, and suicidality among healthcare students and professionals: A systematic review, Academic Psychiatry, 42, 109, 10.1007/s40596-017-0868-0 Powell, 2016, Interrater reliability of mHealth app rating measures: Analysis of top depression and smoking cessation apps, JMIR mHealth and uHealth, 4, e5176, 10.2196/mhealth.5176 Price, 2016, Usability evaluation of a mobile monitoring system to assess symptoms after a traumatic injury: A mixed-methods study, JMIR mental health, 3, e3, 10.2196/mental.5023 Psihogios, 2020, The needle in the haystack: Identifying credible mobile health apps for pediatric populations during a pandemic and beyond, Journal of Pediatric Psychology, 45, 1106, 10.1093/jpepsy/jsaa094 Ramos, 2021, Community providers' experiences with evidence-based practices: The role of therapist race/ethnicity, Cultural Diversity and Ethnic Minority Psychology, 27, 471, 10.1037/cdp0000357 Ramos, 2019 Rathbone, 2015, Better duplicate detection for systematic reviewers: Evaluation of systematic review assistant-deduplication module, Systematic Reviews, 4, 1, 10.1186/2046-4053-4-6 Rodriguez-Villa, 2020, Making mental health more accessible in light of COVID-19: Scalable digital health with digital navigators in low and middle-income countries, Asian journal of psychiatry, 54, 102433, 10.1016/j.ajp.2020.102433 Salehi, 2019, 303 Santiago, 2013, Poverty and mental health: How do low‐income adults and children fare in psychotherapy?, Journal of Clinical Psychology, 69, 115, 10.1002/jclp.21951 Scheer, 2003, Access barriers for persons with disabilities: The consumer's perspective, Journal of Disability Policy Studies, 13, 221, 10.1177/104420730301300404 Schueller, 2019, Use of digital mental health for marginalized and underserved populations, Current treatment options in psychiatry, 6, 243, 10.1007/s40501-019-00181-z Schueller, 2018, Discovery of and interest in health apps among those with mental health needs: Survey and focus group study, Journal of Medical Internet Research, 20, 10.2196/10141 Schultchen, 2020, Stay present with your phone: A systematic review and standardized rating of mindfulness apps in european app stores, International Journal of Behavioral Medicine, 1–9 Scott, 2020, Going digital: A narrative overview of the effects, quality and utility of mobile apps in chronic disease self-management, Australian Health Review, 44, 62, 10.1071/AH18064 Shakespeare-Finch, 2020, Experiences of serving and ex-serving members with the PTSD coach Australia app: Mixed methods study, Journal of Medical Internet Research, 22, 10.2196/18447 Shang, 2019, Mental health apps in China: Analysis and quality assessment, JMIR mHealth and uHealth, 7, e13236, 10.2196/13236 Statista, 2020 Stoyanov, 2015, Mobile app rating scale: A new tool for assessing the quality of health mobile apps, JMIR mHealth and uHealth, 3, e27, 10.2196/mhealth.3422 Strodl, 2020, Clinicians' perceptions of PTSD coach Australia, Internet interventions, 21, 100333, 10.1016/j.invent.2020.100333 Terhorst, 2018, «Hilfe aus dem App-Store?»: Eine systematische Übersichtsarbeit und Evaluation von Apps zur Anwendung bei Depressionen, Verhaltenstherapie, 28, 101, 10.1159/000481692 Thornton, 2017, Free smoking cessation mobile apps available in Australia: A quality review and content analysis, Australian & New Zealand Journal of Public Health, 41, 625, 10.1111/1753-6405.12688 Tofighi, 2019, Smartphone apps targeting alcohol and illicit substance use: Systematic search in in commercial app stores and critical content analysis, JMIR mHealth and uHealth, 7, 10.2196/11831 Torous, 2014, Patient smartphone ownership and interest in mobile apps to monitor symptoms of mental health conditions: A survey in four geographically distinct psychiatric clinics, JMIR mental health, 1, 10.2196/mental.4004 Tricco, 2018, PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation, Annals of Internal Medicine, 169, 467, 10.7326/M18-0850 Valdez, 2012, Designing consumer health IT to enhance usability among different racial and ethnic groups within the United States, Health Technology, 2, 225, 10.1007/s12553-012-0031-6 Van Singer, 2015, Quality of smartphone apps related to panic disorder, Frontiers in Psychiatry, 6, 96, 10.3389/fpsyt.2015.00096 Veinot, 2018, Good intentions are not enough: How informatics interventions can worsen inequality, Journal of the American Medical Informatics Association, 25, 1080, 10.1093/jamia/ocy052 Vilsaint, 2019, Racial/ethnic differences in 12-month prevalence and persistence of mood, anxiety, and substance use disorders: Variation by nativity and socioeconomic status, Comprehensive Psychiatry, 89, 52, 10.1016/j.comppsych.2018.12.008 Vu, 2018 Waller, 2009, Barriers to the uptake of computerized cognitive behavioural therapy: A systematic review of the quantitative and qualitative evidence, Psychological Medicine, 39, 705, 10.1017/S0033291708004224 Wasil, 2021 Whittaker, 2012, Text4baby: Development and implementation of a national text messaging health information service, American Journal of Public Health, 102, 2207, 10.2105/AJPH.2012.300736 Wilson, 2016, The quality and accuracy of mobile apps to prevent driving after drinking alcohol, JMIR mHealth and uHealth, 4, 10.2196/mhealth.5961 Wyatt, 2015, What makes a good clinical app? Introducing the RCP health informatics unit checklist, Clinical Medicine, 15, 519, 10.7861/clinmedicine.15-6-519 Yin, 2020, Mobile mental health apps in China: Systematic app store search, Journal of Medical Internet Research, 22, 10.2196/14915 Zelmer, 2018, An assessment framework for e-mental health apps in Canada: Results of a modified Delphi process, JMIR mHealth and uHealth, 6, 10.2196/10016 Zhang, 2017, Current status of postnatal depression smartphone applications available on application stores: An information quality analysis, BMJ open, 7, 10.1136/bmjopen-2016-015655