The effectiveness of supervision strategies to improve health care provider practices in low- and middle-income countries: secondary analysis of a systematic review
Tóm tắt
Although supervision is a ubiquitous approach to support health programs and improve health care provider (HCP) performance in low- and middle-income countries (LMICs), quantitative evidence of its effects is unclear. The objectives of this study are to describe the effect of supervision strategies on HCP practices in LMICs and to identify attributes associated with greater effectiveness of routine supervision. We performed a secondary analysis of data on HCP practice outcomes (e.g., percentage of patients correctly treated) from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series studies. We described distributions of effect sizes (defined as percentage-point [%-point] changes) for each supervision strategy. To identify attributes associated with supervision effectiveness, we performed random-effects linear regression modeling and examined studies that directly compared different approaches of routine supervision. We analyzed data from 81 studies from 36 countries. For professional HCPs, such as nurses and physicians, primarily working at health facilities, routine supervision (median improvement when compared to controls: 10.7%-points; IQR: 9.9, 27.9) had similar effects on HCP practices as audit with feedback (median improvement: 10.1%-points; IQR: 6.2, 23.7). Two attributes were associated with greater mean effectiveness of routine supervision (p < 0.10): supervisors received supervision (by 8.8–11.5%-points), and supervisors participated in problem-solving with HCPs (by 14.2–20.8%-points). Training for supervisors and use of a checklist during supervision visits were not associated with effectiveness. The effects of supervision frequency (i.e., number of visits per year) and dose (i.e., the number of supervision visits during a study) were unclear. For lay HCPs, the effect of routine supervision was difficult to characterize because few studies existed, and effectiveness in those studies varied considerably. Evidence quality for all findings was low primarily because many studies had a high risk of bias. Although evidence is limited, to promote more effective supervision, our study supports supervising supervisors and having supervisors engage in problem-solving with HCPs. Supervision’s integral role in health systems in LMICs justifies a more deliberate research agenda to identify how to deliver supervision to optimize its effect on HCP practices.
Tài liệu tham khảo
Rowe AK, Rowe SY, Peters DH, Holloway KA, Chalker J, Ross-Degnan D. Effectiveness of strategies to improve health-care provider practices in low-income and middle-income countries: a systematic review. Lancet Glob Health. 2018;6(11):e1163–75.
Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Glob Health. 2018;6(11):e1196–252.
Jha A, Larizgoitia I, Audera-Lopez C, Prosopa-Plaizier N, Waters H, Bates D. The global burden of unsafe medical care: analytic modelling of observational studies. BMJ Qual Saf. 2013;22:809–15.
National Academies of Sciences, Engineering, and Medicine. Crossing the global quality chasm: improving health care worldwide. Washington, DC: The National Academies Press; 2018. https://doi.org/10.17226/25152.
Flahault D, Piot M, Franklin A. The supervision of health personnel at district level. Geneva: WHO; 1988.
McMahon R, Barton E, Piot M. On being in charge. A guide to management in primary health care, 2nd edn. Geneva: WHO; 1992.
Tarimo E. Towards a Health District. Organizing and Managing District Health Systems Based on Primary Health Care. Geneva: WHO; 1991.
Walt G. Community Health Workers in National Programmes. Just Another Pair of Hands? Philadelphia: Open University Press, Milton Keynes; 1990.
WHO-UNICEF. Primary Health Care. Report of the International Conference on Primary Health Care. Alma-Ata (USSR). Geneva: WHO; 1978a.
WHO-UNICEF. Joint Report of the Director-General of the World Health Organization. Geneva: WHO; 1978b.
World Health Organization. Community Involvement in Health Development, Challenging Health Services. WHO Technical Report Series 809. Geneva: WHO; 1991.
Kilminster S, Cottrell D, Grant J, Jolly B. AMEE Guide No 2.7: effective educational and clinical supervision. Med Teach. 2007;29(1):2–19.
Bosch-Capblanch X, Liaqat S, Garner P. Managerial supervision to improve primary health care in low- and middle-income countries. Cochrane Database Syst Rev. 2011. https://doi.org/10.1002/14651858.CD006413.pub2.
Bosch-Capblanch X, Garner P. Primary health care supervision in developing countries. Trop Med Int Health. 2008;13(3):369–83. https://doi.org/10.1111/j.1365-3156.2008.02012.x.
Human Resources for Health 2030. Enhanced supervision approaches: phase 1 landscape analysis findings report. Technical report. 2019. https://hrh2030program.org/enhanced-supervision-landscape-analysis/. Accessed 1 Jun 2020.
Bailey C, Blake C, Schriver M, Cubaka VK, Thomas T, Martin HA. A systematic review of supportive supervision as a strategy to improve primary healthcare services in Sub-Saharan Africa. Int J Gynaecol Obstet. 2016;132(1):117–25. https://doi.org/10.1016/j.ijgo.2015.10.004.
Gangwani MK, Khan RS, Das JK. Systematic Reviews to inform guidelines on health policy and system support to optimise community health worker programmes: In the context of community health worker programmes, what strategies of supportive supervision should be adopted over what other strategies? Final report to the World Health Organisation Guideline Development Group. Centre for Evidence and Implementation; 2017.
Salem B, Beattie KJ. Facilitative supervision: A vital link in quality reproductive health service delivery. AVSC Working Paper No. 10. New York: AVSC International. http://www.netfemmes.com/sante/asvc/www.igc.apc.org/avsc/workpap/wp10/wp_10.html. Accessed 16 Dec 2020.
World Health Organization. Ninth Programme Report 1992–1993. Geneva: Programme for Control of Diarrhoeal Diseases, WHO; 1994.
President’s Malaria Initiative. Fiscal year 2017 Malaria Operational Plans. https://www.pmi.gov/resource-library/mops/fy-2017. Accessed 11 Feb 2019.
President’s Malaria Initiative. Fiscal year 2018 Malaria Operational Plans. https://www.pmi.gov/resource-library/mops/fy-2018. Accessed 13 Feb 2019.
President’s Malaria Initiative. Fiscal year 2019 Malaria Operational Plans. https://www.pmi.gov/resource-library/mops/fy-2019. Accessed 14 Feb 2019.
Dieleman M, Gerretsen B, van der Wilt GJ. Human resource management interventions to improve health workers’ performance in low and middle income countries: a realist review. Health Res Pol Syst. 2009;7:7.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012. https://doi.org/10.1002/14651858.CD000259.pub3.
Rowe AK, Rowe SY, Peters DH, Holloway KA, Ross-Degnan D. The effectiveness of training strategies to improve healthcare provider practices in low-income and middle-income countries. BMJ Glob Health. 2021;6: e003229. https://doi.org/10.1136/bmjgh-2020-003229.
Rowe SY, Peters DH, Holloway KA, Chalker J, Ross-Degnan D, Rowe AK. A systematic review of the effectiveness of strategies to improve health care provider performance in low- and middle-income countries: methods and descriptive results. PLoS ONE. 2019;14(5): e0217617. https://doi.org/10.1371/journal.pone.0217617.
Effective Practice and Organisation of Care. Suggested risk of bias criteria for EPOC reviews. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2015. http://epoc.cochrane.org/epoc-specific-resourcesreview-authors. Accessed 19 Jun 2015.
Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309.
Friedman J, Qamruddin J, Chansa C, Das AK. Impact evaluation of Zambia’s health results-based financing pilot project. Washington DC: World Bank Group; 2016.
Sterne JAC, Smith GD. Sifting the evidence—what’s wrong with significance tests? BMJ. 2001;322:226–31.
Afenyadu GY, Agyepong IA, Barnish G, Adjei S. Improving access to early treatment of malaria: a trial with primary school teachers as care providers. Trop Med Int Health. 2005;10(10):1065–72.
Holloway KA, Ivanovska V, Wagner AK, Vialle-Valentin C, Ross-Degnan D. Have we improved use of medicines in developing and transitional countries and do we know how to? Two decades of evidence. Trop Med Int Health. 2013;18:656–64.
Rowe AK, Onikpo F, Lama M, Deming MS. The rise and fall of supervision in a project designed to strengthen supervision of Integrated Management of Childhood Illness in Benin. Health Policy Plan. 2010;25(2):125–34. https://doi.org/10.1093/heapol/czp054.
Arsenault C, Rowe SY, Ross-Degnan D, Peters DH, Roder-DeWan S, Kruk ME, et al. How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review. BMJ Qual Saf. 2021. https://doi.org/10.1136/bmjqs-2020-011717.
Franco LM, Marquez L. Effectiveness of collaborative improvement: evidence from 27 applications in 12 less-developed and middle-income countries. BMJ Qual Saf. 2011;20(8):658–65.
Garcia-Elorrio E, Rowe SY, Teijeiro ME, Ciapponi A, Rowe AK. The effectiveness of the quality improvement collaborative strategy in low- and middle-income countries: a systematic review and meta-analysis. PLoS ONE. 2019;14(10):e0221919.
Loevinsohn BP, Guerrero ET, Gregorio SP. Improving primary health care through systematic supervision: a controlled field trial. Health Policy Plan. 1995;10(2):144–53.
Steinhardt LC, Onikpo F, Kouamé J, Piercefield E, Lama M, Deming MS, et al. Predictors of health worker performance after integrated management of childhood illness training in Benin: a cohort study. BMC Health Serv Res. 2015;15:276. https://doi.org/10.1186/s12913-015-0910-4.