Health Research Policy and Systems

When deciding whether to implement an intervention, decision-makers typically have questions on feasibility and acceptability and on factors affecting implementation. Descriptions of programme implementation and of policies and systems are rich sources of information for these questions. However, this information is often not based on empirical data collected using explicit methods. To use the information in unconventional source materials in syntheses or other decision support products, we need methods of assessing their strengths and limitations. This paper describes the development and content of the Assessing unConventional Evidence (ACE) tool, a new tool to assess the strengths and limitations of these sources. We developed the ACE tool in four stages: first, we examined existing tools to identify potentially relevant assessment criteria. Second, we drew on these criteria and team discussions to create a first draft of the tool. Third, we obtained feedback on the draft from potential users and methodologists, and through piloting the tool in evidence syntheses. Finally, we used this feedback to iteratively refine the assessment criteria and to improve our guidance for undertaking the assessment. The tool is made up of 11 criteria including the purpose and context of the source; the completeness of the information presented; and the extent to which evidence is provided to support the findings made. Users are asked to indicate whether each of the criteria have been addressed. On the basis of their judgements for each criterion, users then make an overall assessment of the limitations of the source, ranging from no or very minor concerns to serious concerns. These assessments can then facilitate appropriate use of the evidence in decision support products. Through focussing on unconventional source materials, the ACE tool fills an important gap in the range of tools for assessing the strengths and limitations of policy-relevant evidence and supporting evidence-informed decision-making.

Assuring equitable universal access to essential health services without exposure to undue financial hardship requires adequate resource mobilization, efficient use of resources, and attention to quality and responsiveness of services. The way providers are paid is a critical part of this process because it can create incentives and patterns of behaviour related to supply. The objective of this work was to describe provider behaviour related to supply of health services to insured clients in Ghana and the influence of provider payment methods on incentives and behaviour. A mixed methods study involving grey and published literature reviews, as well as health management information system and primary data collection and analysis was used. Primary data collection involved in-depth interviews, observations of time spent obtaining service, prescription analysis, and exit interviews with clients. Qualitative data was analysed manually to draw out themes, commonalities, and contrasts. Quantitative data was analysed in Excel and Stata. Causal loop and cause tree diagrams were used to develop a qualitative explanatory model of provider supply incentives and behaviour related to payment method in context. There are multiple provider payment methods in the Ghanaian health system. National Health Insurance provider payment methods are the most recent additions. At the time of the study, the methods used nationwide were the Ghana Diagnostic Related Groupings payment for services and an itemized and standardized fee schedule for medicines. The influence of provider payment method on supply behaviour was sometimes intuitive and sometimes counter intuitive. It appeared to be related to context and the interaction of the methods with context and each other rather than linearly to any given method. As countries work towards Universal Health Coverage, there is a need to holistically design, implement, and manage provider payment methods reforms from systems rather than linear perspectives, since the latter fail to recognize the effects of context and the between-methods and context interactions in producing net effects.

Policy-makers, managers, scientists, patients and the general public are confronted daily with figures on health and healthcare through public reporting in newspapers, webpages and press releases. However, information on the key characteristics of these figures necessary for their correct interpretation is often not adequately communicated, which can lead to misinterpretation and misinformed decision-making. The objective of this research was to map the key characteristics relevant to the interpretation of figures on health and healthcare, and to develop a Figure Interpretation Assessment Tool-Health (FIAT-Health) through which figures on health and healthcare can be systematically assessed, allowing for a better interpretation of these figures. The abovementioned key characteristics of figures on health and healthcare were identified through systematic expert consultations in the Netherlands on four topic categories of figures, namely morbidity, healthcare expenditure, healthcare outcomes and lifestyle. The identified characteristics were used as a frame for the development of the FIAT-Health. Development of the tool and its content was supported and validated through regular review by a sounding board of potential users. Identified characteristics relevant for the interpretation of figures in the four categories relate to the figures’ origin, credibility, expression, subject matter, population and geographical focus, time period, and underlying data collection methods. The characteristics were translated into a set of 13 dichotomous and 4-point Likert scale questions constituting the FIAT-Health, and two final assessment statements. Users of the FIAT-Health were provided with a summary overview of their answers to support a final assessment of the correctness of a figure and the appropriateness of its reporting. FIAT-Health can support policy-makers, managers, scientists, patients and the general public to systematically assess the quality of publicly reported figures on health and healthcare. It also has the potential to support the producers of health and healthcare data in clearly communicating their data to different audiences. Future research should focus on the further validation of the tool in practice.

The institutionalization of evidence-informed health policy-making (EIHP) is complex and complicated. It is complex because it has many players and is complicated because its institutionalization will require many changes that will be challenging to make. Like many other issues, strengthening EIHP needs a road map, which should consider challenges and address them through effective, harmonized and contextualized strategies. This study aims to develop a road map for enhancing EIHP in Iran based on steps of planning. This study consisted of three phases: (1) identifying barriers to EIHP, (2) recognizing interventions and (3) measuring the use of evidence in Iran's health policy-making. A set of activities was established for conducting these, including foresight, systematic review and policy dialogue, to identify the current and potential barriers for the first phase. For the second phase, an evidence synthesis was performed through a scoping review, by searching the websites of benchmark institutions which had good examples of EIHP practices in order to extract and identify interventions, and through eight policy dialogues and two broad opinion polls to contextualize the list of interventions. Simultaneously, two qualitative-quantitative studies were conducted to design and use a tool for assessing EIHP in the third phase. We identified 97 barriers to EIHP and categorized them into three groups, including 35 barriers on the “generation of evidence” (push side), 41 on the “use of evidence” (pull side) and 21 on the “interaction between these two” (exchange side). The list of 41 interventions identified through evidence synthesis and eight policy dialogues was reduced to 32 interventions after two expert opinion polling rounds. These interventions were classified into four main strategies for strengthening (1) the education and training system (6 interventions), (2) the incentives programmes (7 interventions), (3) the structure of policy support organizations (4 interventions) and (4) the enabling processes to support EIHP (15 interventions). The policy options developed in the study provide a comprehensive framework to chart a path for strengthening the country’s EIHP considering both global practices and the context of Iran. It is recommended that operational plans be prepared for road map interventions, and the necessary resources provided for their implementation. The implementation of the road map will require attention to the principles of good governance, with a focus on transparency and accountability.

This is the third in a series of three papers describing the use of qualitative evidence syntheses (QES) to inform the development of clinical and health systems guidelines. WHO has recognised the need to improve its guideline methodology to ensure that decision-making processes are transparent and evidence based, and that the resulting recommendations are relevant and applicable to end users. In addition to the standard data on effectiveness, WHO guidelines increasingly use evidence derived from QES to provide information on acceptability and feasibility and to develop important implementation considerations. WHO convened a group drawn from the technical teams involved in formulating recent (2010–2018) guidelines employing QES. Using a pragmatic and iterative approach that included feedback from WHO staff and other stakeholders, the group reflected on, discussed and identified key methods and research implications from designing QES and using the resulting findings in guideline development. As members of WHO guideline technical teams, our aim in this paper is to explore how we have used findings from QES to develop implementation considerations for these guidelines. For each guideline, in addition to using systematic reviews of effectiveness, the technical teams used QES to gather evidence of the acceptability and feasibility of interventions and, in some cases, equity issues and the value people place on different outcomes. This evidence was synthesised using standardised processes. The teams then used the QES to identify implementation considerations combined with other sources of information and input from experts. QES were useful sources of information for implementation considerations. However, several issues for further development remain, including whether researchers should use existing health systems frameworks when developing implementation considerations; whether researchers should take confidence in the evidence into account when developing implementation considerations; whether qualitative evidence that reveals implementation challenges should lead guideline panels to make conditional recommendations or only point to implementation considerations; and whether guideline users find it helpful to have challenges pointed out to them or whether they also need solutions. Finally, we need to explore how QES findings can be incorporated into derivative products to aid implementation.

The use of participatory monitoring and evaluation (M&E) approaches is important for guiding local decision-making, promoting the implementation of effective interventions and addressing emerging issues in the course of implementation. In this article, we explore how participatory M&E approaches helped to identify key design and implementation issues and how they influenced stakeholders’ decision-making in eastern Uganda. The data for this paper is drawn from a retrospective reflection of various M&E approaches used in a maternal and newborn health project that was implemented in three districts in eastern Uganda. The methods included qualitative and quantitative M&E techniques such as  key informant interviews, formal surveys and supportive supervision, as well as participatory approaches, notably participatory impact pathway analysis. At the design stage, the M&E approaches were useful for identifying key local problems and feasible local solutions and informing the activities that were subsequently implemented. During the implementation phase, the M&E approaches provided evidence that informed decision-making and helped identify emerging issues, such as weak implementation by some village health teams, health facility constraints such as poor use of standard guidelines, lack of placenta disposal pits, inadequate fuel for the ambulance at some facilities, and poor care for low birth weight infants. Sharing this information with key stakeholders prompted them to take appropriate actions. For example, the sub-county leadership constructed placenta disposal pits, the district health officer provided fuel for ambulances, and health workers received refresher training and mentorship on how to care for newborns. Diverse sources of information and perspectives can help researchers and decision-makers understand and adapt evidence to contexts for more effective interventions. Supporting districts to have crosscutting, routine information generating and sharing platforms that bring together stakeholders from different sectors is therefore crucial for the successful implementation of complex development interventions.

If and when sustained human-to-human transmission of H5N1 becomes a reality, the world will no longer be dealing with sporadic avian flu borne along migratory flight paths of birds, but aviation flu – winged at subsonic speed along commercial air conduits to every corner of planet Earth. Given that air transportation is the one feature that most differentiates present day transmission scenarios from those in 1918, our present inability to prevent spread of influenza by international air travel, as reckoned by the World Health Organization, constitutes a major weakness in the current global preparedness plan against pandemic flu. Despite the lessons of SARS, it is surprising that aviation-related health policy options have not been more rigorously evaluated, or scientific research aimed at strengthening public health measures on the air transportation front, more energetically pursued.

Within the context of the growing burden of non-communicable diseases (NCDs) globally, there is limited evidence on how researchers have explored the response to chronic health needs in the context of health policy and systems in low- and middle-income countries. Continuity of care (CoC) is one concept that represents several elements of a long-term model of care. This scoping review aims to map and describe the state of knowledge regarding how researchers in resource-constrained settings have defined and used the concept of CoC for chronic conditions in primary healthcare. This scoping review adopted the modified framework for interpretive scoping literature reviews. A systematic literature search in PubMed was performed, followed by a study selection process and data extraction, analysis and synthesis. Extracted data regarding the context of using CoC and the definition of CoC were analysed inductively to identify similar patterns; based on this, articles were divided into groups. MaxQDA was then used to re-code each article with themes according to the CoC definition to perform a cross-case synthesis under each identified group. A total of 55 peer-reviewed articles, comprising reviews or commentaries and qualitative or quantitative studies, were included. The number of articles has increased over the years. Five groups were identified as those (1) reflecting a change across stages or systems of care, (2) mentioning continuity or lack of continuity without a detailed definition, (3) researching CoC in HIV/AIDS programmes and its scaling up to support management of NCDs, (4) researching CoC in NCD management, and (5) measuring CoC with validated questionnaires. Research or policy documents need to provide an explicit definition of CoC when this terminology is used. A framework for CoC is suggested, acknowledging three components for CoC (i.e. longitudinal care, the nature of the patient–provider relationship and coordinated care) while considering relevant contextual factors, particularly access and quality.