Implementation Degree Assessment Sheet for Health Program in Japan by Customizing CFIR: Development and Validation
Tóm tắt
More than 70% of public health nurses in Japan belong to government agencies, and there is a need for further evidence-based capacity development for program implementation. The purpose of this research was to develop an Implementation Degree Assessment Sheet (IDAS) by customizing the Consolidated Framework for Implementation Research (CFIR) to health programs in Japan. The draft IDAS (five domains, 31 constructs) created by customizing the CFIR was refined by the researchers and modified through pre-testing. The survey covered full-time public health nurses (PHNs) affiliated to all prefectures and the cities with health centers of Japan. The survey was conducted as an anonymous, self-administered questionnaire survey by mail. One hundred eighty-five of the 334 institutions (55.4%) agreed to participate in our survey. Of the 966 questionnaire forms distributed, 709 forms (73.4%) were collected, of which 702 responses (72.7%) were valid. No item required consideration of deletion based on the results of item analysis, and our confirmatory factor analysis on model fitness between the five IDAS domains and CFIR showed sufficient fit indices after modification. With regard to reliability, Cronbach’s coefficient alpha, a measure of internal consistency, stayed above 0.8 overall. Our verification of stability with the split-half (odd/even) method resulted in a Spearman–Brown reliability coefficient of 0.95. The correlation coefficient between the IDAS scores and the research utilization competency score, used as an external criterion, was 0.51 (p<0.001), supporting the coexistence validity of the criterion-related validity of the IDAS. The significant differences were observed between known-groups, supporting the known-group validity of the IDAS. This study developed the IDAS and confirmed constant reliability and validity. Hereafter, it is necessary to promote the required capacity development based on the actual degree of implementation in order to use the IDAS for the competency development of public health nurses and related professions to deliver health programs.
Tài liệu tham khảo
Gray JAM. Evidence-based Healthcare: How to make health policy decisions and management decisions. Edinburgh: Churchill Livingstone; 1997.
Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, et al. Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci. 2016. https://doi.org/10.1186/s13012-016-0396-4.
Estabrooks PA, Brownson RC, Pronk NP. Dissemination and Implementation Science for Public Health Professionals: An Overview and Call to Action. Prev Chronic Dis. 2018. https://doi.org/10.5888/pcd15.180525.
Ministry of Health, Labour and Welfare. Guidelines for health activities of public health nurses in the community (4/19/2013). (in Japanese) https://www.mhlw.go.jp/web/t_doc?dataId=00tb9310&dataType=1&pageNo=1 . Accessed 23 Jan 2021.
Ministry of Health, Labour and Welfare. Report on Public Health Administration and Services (Practicing health professionals) 2018. https://www.mhlw.go.jp/toukei/saikin/hw/eisei/18/dl/kekka1.pdf (in Japanese). https://www.mhlw.go.jp/english/database/db-hss/dl/rophas_2018_biennialyear.pdf (Digest of summary report only) Accessed 23 Jan 2021.
Ministry of Health, Labour and Welfare. Guidance guidelines for the operation of the Nurse training school (3/31/2019). (in Japanese). https://www.mhlw.go.jp/web/t_doc?dataId=00tc1593&dataType=1. Accessed 23 Jan 2021.
Ministry of Health, Labour and Welfare. Standard career ladder for municipality public health nurses (3/31/2016). (in Japanese) .https://www.mhlw.go.jp/file/05-Shingikai-10901000-Kenkoukyoku-Soumuka/0000131415.xlsx. https://www.mhlw.go.jp/file/04-Houdouhappyou-10901000-Kenkoukyoku-Soumuka/0000120158.pdf Accessed 23 Jan 2021.
Okamoto R, Seki H, Gouda K, Iwamoto S, Koide K, Fukukawa K, et al. Development of a Research Utilization Competency Scale for. Public Health Nurs. 2017. https://doi.org/10.20746/jachn.20.1_13 (in Japanese with English abstract).
Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB. Evidence-based Medicine: How to practice and teach EBM. 2nd ed. Edinburgh: Churchill Livingstone; 2000.
Mazzucca S, Tabak GR, Pilar M, Ramsey TA, Baumann AA, Kryzer E, et al. Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review. Front Public Health. https://doi.org/10.3389/fpubh.2018.00032.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009. https://doi.org/10.1186/1748-5908-4-50.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999. https://doi.org/10.2105/AJPH.89.9.1322.
Boateng GO, Neilands TB, Frongillo EA, Melgar-Quiñonez HR, Young SL. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front Public Health. 2018. https://doi.org/10.3389/fpubh.2018.00149.
CFIR Research Team-Center for Clinical Management Research. CFIR constructs 2019. https://cfirguide.org/constructs/. https://cfirguide.org/guide/app/#/. Accessed 23 Jan 2021.
Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci. 2016. https://doi.org/10.1186/s13012-016-0437-z.
Wild D, Grove A, Martin M, Eremenco S, Mc-Elroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8:94–104.
Cramer D, Howitt DL. “Ceiling effect”: The SAGE Dictionary of Statistics: A Practical Resource for Students in the Social Sciences. 3rd ed. London: SAGE; 2005. p. 21. ISBN 978-0-7619-4138-5
Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8:51. https://doi.org/10.1186/1748-5908-8-51.
Hudson KG, Lawton R, Hugh-Jones S. Factors affecting the implementation of a whole school mindfulness program: a qualitative study using the consolidated framework for implementation research. BMC Health Serv Res. 2020;20(1):133. https://doi.org/10.1186/s12913-020-4942-z.
VanDevanter N, Kumar P, Nguyen N, Nguyen L, Nguyen T, Stillman F, et al. Application of the Consolidated Framework for Implementation Research to assess factors that may influence implementation of tobacco use treatment guidelines in the Viet Nam public health care delivery system. Implement Sci. 2017;12(1):27. https://doi.org/10.1186/s13012-017-0558-z.
Burton W, Twiddy M, Sahota P, Brown J, Bryant M. Participant engagement with a UK community-based preschool childhood obesity prevention programme: a focused ethnography study. BMC Public Health. 2019;19(1):1074. https://doi.org/10.1186/s12889-019-7410-0.
Vidgen HA, Love PV, Wutzke SE, Daniels LA, Rissel CE, Inne-Hughes C, et al. A description of health care system factors in the implementation of universal weight management services for children with overweight or obesity: case studies from Queensland and New South Wales, Australia. Implement Sci. 2018;13(1):109. https://doi.org/10.1186/s13012-018-0801-2.
Means RA, Kemp GC, Gwayi-Chore M-C, Gimbe S, Soi C, Sherr K, et al. Evaluating and optimizing the consolidated framework for implementation research (CFIR) for use in low- and middle-income countries: a systematic review. Implement Sci. 2020. https://doi.org/10.1186/s13012-020-0977-0.