Performance-based financing as a health system reform: mapping the key dimensions for monitoring and evaluation
Tóm tắt
Performance-based financing is increasingly being applied in a variety of contexts, with the expectation that it can improve the performance of health systems. However, while there is a growing literature on implementation issues and effects on outputs, there has been relatively little focus on interactions between PBF and health systems and how these should be studied. This paper aims to contribute to filling that gap by developing a framework for assessing the interactions between PBF and health systems, focusing on low and middle income countries. In doing so, it elaborates a general framework for monitoring and evaluating health system reforms in general. This paper is based on an exploratory literature review and on the work of a group of academics and PBF practitioners. The group developed ideas for the monitoring and evaluation framework through exchange of emails and working documents. Ideas were further refined through discussion at the Health Systems Research symposium in Beijing in October 2012, through comments from members of the online PBF Community of Practice and Beijing participants, and through discussion with PBF experts in Bergen in June 2013. The paper starts with a discussion of definitions, to clarify the core concept of PBF and how the different terms are used. It then develops a framework for monitoring its interactions with the health system, structured around five domains of context, the development process, design, implementation and effects. Some of the key questions for monitoring and evaluation are highlighted, and a systematic approach to monitoring effects proposed, structured according to the health system pillars, but also according to inputs, processes and outputs. The paper lays out a broad framework within which indicators can be prioritised for monitoring and evaluation of PBF or other health system reforms. It highlights the dynamic linkages between the domains and the different pillars. All of these are also framed within inter-sectoral and wider societal contexts. It highlights the importance of differentiating short term and long term effects, and also effects (intended and unintended) at different levels of the health system, and for different sectors and areas of the country. Outstanding work will include using and refining the framework and agreeing on the most important hypotheses to test using it, in relation to PBF but also other purchasing and provider payment reforms, as well as appropriate research methods to use for this task.
Tài liệu tham khảo
Eichler R, De S: Paying for Performance in Health: A Guide to Developing the Blueprint. 2008, Bethesda, MD: Health Systems, 20/20
AIDSTAR-Two-project: The PBF Handbook: Designing and Implementing Effective Performance-Based Financing Programs. 2011, Cambridge, MA: Management Sciences for Health
Soeters R: PBF in Action: Theory and Instruments. Course Guide - Performance Based Financing (PBF). 2013, The Hague: CORDAID-SINA
Basinga P, Gertler P, Binagwaho A, Soucat A, Sturdy J, Vermeersch C: Effect on maternal and child health services in Rwanda of payment to primary health-care providers for performance: an impact evaluation. Lancet. 2011, 377: 1421-1428. 10.1016/S0140-6736(11)60177-3.
Gertler P, Vermeersch C: Using Performance Incentives to Improve Health Outcomes. 2012, Washington, DC: World Bank, Report No.: Policy Research Working Paper 6100
Witter S, Fretheim A, Kessy F, Lindahl A: Paying for performance to improve the delivery of health interventions in low and middle-income countries. Cochrane Database Syst Rev. 2012, 2: CD007899-doi:10.1002/14651858.CD007899.pub2
Meessen B, Soucat A, Sekabaraga C: Performance-based financing: just a donor fad or a catalyst towards comprehensive health-care reform?. Bull World Health Organ. 2011, 89 (153): 156.
Vermeersch C, Rothenbuhler E, Sturdy J: Impact evaluation toolkit: measuring the impact of results-based financing on maternal and child health. 2012, Washington, D.C: World Bank
de Savigny D, Adam T: Systems thinking for health systems strengthening. 2009, Geneva: Alliance for Health Policy and Systems Research, WHO
Meessen B, Van Heteren G, Soeters R, Fritsche G, Van Damme W: Time for innovative dialogue on health systems research. WHO Bull. 2012, 90 (10): 713-792.
Kutzin J: Health financing reform: a framework for evaluation - revised working document. 1995, Geneva: World Health Organisation
World Health Organisation: Everybody's business: strengthening health systems to improve health outcomes: WHO's framework for action. 2007, Geneva: WHO
Loevinsohn B: Performance-based contracting for health services in developing countries: a toolkit. 2008, Washington, DC: World Bank
Fiszbein A, Schady N, Ferreira F, Grosh M, Kelleher N, Olinto P, et al: Conditional Cash Transfers, Reducing Present and Future Poverty. 2009, Washington, D.C: World Bank, Report No.: Policy Research Report
Musgrove P: Rewards for good performance or results: a short glossary. 2011, Washington, D.C.: World Bank
Eichler R, Levine R: Performance Incentives for Global Health, Potential and Pitfalls. 2009, Washington DC: Center for Global Development
Birdsall N, Savedoff W: Cash on Delivery, A New Approach to Foreign Aid with an Application to Primary Schooling. 2010, Washington D.C: Center for Global Development
Loevinsohn B, Harding A: Buying results? Contracting for health service delivery in developing countries. Lancet. 2005, 366 (9486): 676-81. 10.1016/S0140-6736(05)67140-1.
Meessen B, Kashala JP, Musango L: Output-based payment to boost staff productivity in public health centres: contracting in Kabutare district, Rwanda. WHO Bull. 2007, 85 (2): 108-15.
Morin E: Seven complex lessons in education for the future. 2001, Paris: UNESCO
Witter S: Performance-based financing for strengthening delivery of sexual and reproductive health services in low- and middle-income countries: an evidence synthesis paper. 2012, Washington, D.C.: World Bank
Bertone M, Meessen B: Studying the link between institutions and health system performance: a framework and an illustration with the analysis of two performance-based financing schemes in Burundi. Health Policy Plan. 2012, doi:10.1093/heapol/czs124
Macq J, Chiem J-C: Looking at the effects of performance-based financing through a complex adaptive systems lens. WHO Bull. 2011, 89 (9): 699-700.
Sheikh K, Gilson L, Agyepong I, Hanson K, Ssengooba F, et al: Building the field of health policy and systems research: framing the questions. PLoS Med. 2011, 8 (8): e1001073-10.1371/journal.pmed.1001073.
Toonen J, Canavan A, Vergeer P, Elovainio R: Performance Based Financing: a synthesis report. 2009, Amsterdam: KIT, in collaboration with Cordaid and WHO
Witter S: Health financing in fragile and post-conflict states: What do we know and what are the gaps. Soc Sci Med. 2012, 75 (12): 2370-2377. 10.1016/j.socscimed.2012.09.012.
Fox S, Witter S, Wylde E, Mafuta E, Lievens T: Paying health workers for performance in a fragmented, fragile state: reflections from Katanga Province. 2013, Democratic Republic of Congo: Health Policy and Planning
Basenya O, et al: Le financement basé sur la performance comme stratégie pour améliorer la mise en oeuvre de la gratuité des soins: premières leçons de l'expérience du Burundi. 2011, Report No.: CoP PBF Working Paper 5, http://www.healthfinancingafrica.org/uploads/8/0/8/8/8088846/wp5.pdf.
Nsengiyumva G, Musango L: Le système de santé de district et le financement basé sur la performance au Burundi: synergies et contradictions possibles. 2011, Report No.: PBF CoP Working Paper 4, http://www.hha-online.org/hso/system/files/PBFdistrictsanitaire_WP4_F.pdf.
Meessen B, et al: Reviewing institutions of rural health centers: the Performance Initiative in Butare, Rwanda. Trop Med Int Health. 2006, 11 (8): 1303-1317. 10.1111/j.1365-3156.2006.01680.x.
Peabody J, Shimkhada R, Quimbo S, Florentino J, Bacate M, McCulloch C, et al: Financial incentives and measurement improved physicians' quality of carei In the Phillipines. Health Aff. 2011, 30 (4): 773-781. 10.1377/hlthaff.2009.0782.
Falisse JB, Meessen B, Ndayishimiye J, Bossuyt M: Community participation and voice mechanisms under performance-based financing schemes in Burundi. Trop Med Int Health. 2012, 17 (5): 674-682. 10.1111/j.1365-3156.2012.02973.x.
Soeters R, Peerenboom P, Mushagulusa P, Kimanuka C: Performance-based financing experiment improved health care in the Democratic Republic of Congo. Health Aff. 2011, 30: 81518-81527.
Mayaka S, Lushimba M, Bertone M, de Borman N: Le financement basé sur la performance en République Démocratique du Congo: comparaison de deux expériences pilotes. 2011, Report No.: PBF CoP Working Paper 6, http://www.healthfinancingafrica.org/uploads/8/0/8/8/8088846/wp6.pdf.
Aryankhesal A, Sheldon T, Mannion R: Role of pay-for-performance in a hospital performance measurement system: a multiple case study in Iran. Health Policy Plan. 2013, 28 (2): 206-214. 10.1093/heapol/czs055. Published online 17 June
Ssengooba F, McPake B, Palmer N: Why performance-based contracting failed in Uganda: an "open-box" evaluation of a complex health system intervention. Soc Sci Med. 2012, 75 (2): 377-383. 10.1016/j.socscimed.2012.02.050.
Hoffman S, Rottingen J-A, Bennett S, Lavis J, Edge J, Frenk J: Background Paper on Conceptual Issues Related to Health Systems Research to Inform a WHO Global Strategy on Health Systems Research - a working paper in progress. 2012, Geneva: World Health Organisation
Roberts M, Hsiao W, Berman P, Reich M: Getting Health Reform Right. 2003, New York: Oxford University Press
Musagalusa P, Ntabuyantwa C, Vroeg P, Zihalirwa I: Le Financement basé sur la Performance dans le Secteur de l'Education: Expérience pilote de Shabunda Sud Kivu en RDC. 2013, Report No.: PBF CoP Working Paper 7, http://www.healthfinancingafrica.org/uploads/8/0/8/8/8088846/wp7.pdf.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/367/prepub