Implementation Science Communications

Screening for colorectal, breast, and cervical cancer has been shown to reduce mortality; however, not all men and women are screened in the USA. Further, there are disparities in screening uptake by people from racial and ethnic minority groups, people with low income, people who lack health insurance, and those who lack access to care. The Centers for Disease Control and Prevention funds two programs—the Colorectal Cancer Control Program and the National Breast and Cervical Cancer Early Detection Program—to help increase cancer screenings among groups that have been economically and socially marginalized. The goal of this manuscript is to describe how programs and their partners integrate evidence-based interventions (e.g., patient reminders) and supporting activities (e.g., practice facilitation to optimize electronic medical records) across colorectal, breast, and cervical cancer screenings, and we suggest research areas based on implementation science. We conducted an exploratory assessment using qualitative and quantitative data to describe implementation of integrated interventions and supporting activities for cancer screening. We conducted 10 site visits and follow-up telephone interviews with health systems and their partners to inform the integration processes. We developed a conceptual model to describe the integration processes and reviewed screening recommendations of the United States Preventive Services Task Force to illustrate challenges in integration. To identify factors important in program implementation, we asked program implementers to rank domains and constructs of the Consolidated Framework for Implementation Research. Health systems integrated interventions for all screenings across single and multiple levels. Although potentially efficient, there were challenges due to differing eligibility of screenings by age, gender, frequency, and location of services. Program implementers ranked complexity, cost, implementation climate, and engagement of appropriate staff in implementation among the most important factors to success. Integrating interventions and supporting activities to increase uptake of cancer screenings could be an effective and efficient approach, but we currently do not have the evidence to recommend widescale adoption. Detailed multilevel measures related to process, screening, and implementation outcomes, and cost are required to evaluate integrated programs. Systematic studies can help to ascertain the benefits of integrating interventions and supporting activities for multiple cancer screenings, and we suggest research areas that might address current gaps in the literature.

Pragmatic measures are essential to evaluate the implementation of evidence-based interventions. Cognitive interviewing, a qualitative method that collects partner feedback throughout measure development, is particularly useful for developing pragmatic implementation measures. Measure developers can use cognitive interviewing to increase a measure’s fit within a particular implementation context. However, cognitive interviewing is underused in implementation research, where most measures remain “homegrown” and used for single studies. We provide a rationale for using cognitive interviewing in implementation science studies and illustrate its use through a case example employing cognitive interviewing to inform development of a measurement-based care protocol for implementation in opioid treatment programs. Applications of cognitive interviewing, including developing a common language with partners and collecting multi-level feedback on assessment procedures, to improve measurement in implementation science are discussed.

Health inequity (HI) remains a major challenge in public health. Improving the health of children with low socioeconomic status (SES) can help to reduce overall HI in children. Childhood obesity is a global problem, entailing several adverse health effects. It is crucial to assess the influencing factors for adoption, implementation, and sustainment of interventions. This review aims to identify articles reporting about influencing factors for the implementation of school-based interventions promoting obesity prevention behaviors in children with low SES. It aims to critically appraise the articles’ quality, assess influencing factors, categorize and evaluate them, and to discuss possible implications. A systematic search was conducted in 7 databases with the following main inclusion criteria: (1) school-based interventions and (2) target group aged 5–14 years. The Consolidated Framework for Implementation Research, its five domains (intervention characteristics, inner setting, outer setting, characteristics of individuals, process) along with 39 categories within these domains were used as deductive category system for data analysis. We grouped the articles with regard to the characteristics of the interventions in simple and complex interventions. For each domain, and for the groups of simple and complex interventions, the most commonly reported influencing factors are identified. In total, 8111 articles were screened, and 17 met all eligibility criteria. Included articles applied mixed methods (n=11), qualitative (n=5), and quantitative design (n=1). Of these, six were considered to report simple interventions and eleven were considered to report complex interventions. In total, 301 influencing factors were assessed. Aspects of the inner setting were reported in every study, aspects of the outer setting were the least reported domain. In the inner setting, most reported influencing factors were time (n=8), scheduling (n=6), and communication (n=6). This review found a wide range of influencing factors for implementation and contributes to existing literature regarding health equity as well as implementation science. Including all stakeholders involved in the implementation process and assessing the most important influencing factors in the specific setting, could enhance implementation and intervention effectiveness. More empirical research and practical guidance are needed to promote obesity prevention behaviors among children with low SES. CRD42021281209 (PROSPERO)

Các hướng dẫn thực hành lâm sàng trước sinh khuyến nghị việc đánh giá định kỳ mức tiêu thụ rượu của phụ nữ trong thời gian mang thai. Việc tư vấn và giới thiệu khi cần thiết cũng được khuyến nghị. Tuy nhiên, bằng chứng cho thấy còn có những rào cản trong việc thực hiện các hướng dẫn chăm sóc tốt nhất. Các chiến lược thực hiện hiệu quả, tiết kiệm chi phí và phải chăng là cần thiết để đảm bảo những lợi ích dự kiến từ các hướng dẫn được thực hiện thông qua việc giải quyết các rào cản đã xác định. Bài báo này mô tả giao thức để đánh giá hiệu quả và tính hợp lý của một can thiệp thay đổi thực hành so với thực hành thông thường trong một thử nghiệm thực hiện. Hiệu quả của can thiệp sẽ được đánh giá trong một thử nghiệm đối chứng ngẫu nhiên theo phương pháp bước thang, được thực hiện trong bối cảnh Úc. Một đánh giá kinh tế sẽ được thực hiện song song với thử nghiệm để đánh giá hiệu quả của can thiệp. Một đánh giá tác động ngân sách sẽ được thực hiện để đánh giá tính hợp lý. Đánh giá kinh tế dựa trên thử nghiệm sẽ xác định, đo lường và định giá những tác động về tài nguyên và kết quả quan trọng phát sinh từ can thiệp thay đổi thực hành đa chiến lược so với thực hành thông thường. Đánh giá sẽ bao gồm (i) phân tích chi phí-kết quả, nơi sử dụng phương pháp điểm số để thể hiện chi phí và lợi ích given ảnh hưởng của các kết quả chính khác nhau được bao gồm trong thử nghiệm, và (ii) phân tích chi phí-hiệu quả, trong đó kết quả chính sẽ là chi phí gia tăng cho mỗi phần trăm tăng trong số người tham gia báo cáo nhận chăm sóc antenatal cho sự tiêu thụ rượu của mẹ phù hợp với các khuyến nghị trong hướng dẫn. Tính khả năng chi trả của can thiệp sẽ được đánh giá bằng cách sử dụng đánh giá tác động ngân sách và sẽ ước tính những tác động tài chính của việc áp dụng và phổ biến chiến lược thực hiện này từ quan điểm của các nhà tài trợ liên quan. Kết quả sẽ được suy diễn để ước tính chi phí và tính chi phí hiệu quả của việc triển khai mô hình chăm sóc. Việc áp dụng các hướng dẫn lâm sàng yêu cầu hỗ trợ thay đổi thực hành. Giả thuyết rằng chiến lược thực hiện, nếu được chứng minh là hiệu quả, cũng sẽ là có hiệu quả về chi phí, phải chăng và có thể mở rộng. Giao thức này mô tả đánh giá kinh tế sẽ giải quyết các giả thuyết này.

Research co-production is an umbrella term used to describe research users and researchers working together to generate knowledge. Research co-production is used to create knowledge that is relevant to current challenges and to increase uptake of that knowledge into practice, programs, products, and/or policy. Yet, rigorous theories and methods to assess the quality of co-production are limited. Here we describe a framework for assessing the quality of research co-production—Research Quality Plus for Co-Production (RQ+ 4 Co-Pro)—and outline our field test of this approach. Using a co-production approach, we aim to field test the relevance and utility of the RQ+ 4 Co-Pro framework. To do so, we will recruit participants who have led research co-production projects from the international Integrated Knowledge Translation Research Network. We aim to sample 16 to 20 co-production project leads, assign these participants to dyadic groups (8 to 10 dyads), train each participant in the RQ+ 4 Co-Pro framework using deliberative workshops and oversee a simulation assessment exercise using RQ+ 4 Co-Pro within dyadic groups. To study this experience, we use a qualitative design to collect participant demographic information and project demographic information and will use in-depth semi-structured interviews to collect data related to the experience each participant has using the RQ+ 4 Co-Pro framework. This study will yield knowledge about a new way to assess research co-production. Specifically, it will address the relevance and utility of using RQ+ 4 Co-Pro, a framework that includes context as an inseparable component of research, identifies dimensions of quality matched to the aims of co-production, and applies a systematic and transferable evaluative method for reaching conclusions. This is a needed area of innovation for research co-production to reach its full potential. The findings may benefit co-producers interested in understanding the quality of their work, but also other stewards of research co-production. Accordingly, we undertake this study as a co-production team representing multiple perspectives from across the research enterprise, such as funders, journal editors, university administrators, and government and health organization leaders.

Evidence-based innovations can improve health outcomes, but only if successfully implemented. Implementation can be complex, highly susceptible to failure, costly and resource intensive. Internationally, there is an urgent need to improve the implementation of effective innovations. Successful implementation is best guided by implementation science, but organizations lack implementation know-how and have difficulty applying it. Implementation support is typically shared in static, non-interactive, overly academic guides and is rarely evaluated. In-person implementation facilitation is often soft-funded, costly, and scarce. This study seeks to improve effective implementation by (1) developing a first-in-kind digital tool to guide pragmatic, empirically based and self-directed implementation planning in real-time; and (2) exploring the tool’s feasibility in six health organizations implementing different innovations. Ideation emerged from a paper-based resource, The Implementation Game©, and a revision called The Implementation Roadmap©; both integrate core implementation components from evidence, models and frameworks to guide structured, explicit, and pragmatic planning. Prior funding also generated user personas and high-level product requirements. This study will design, develop, and evaluate the feasibility of a digital tool called The Implementation Playbook©. In Phase 1, user-centred design and usability testing will inform tool content, visual interface, and functions to produce a minimum viable product. Phase 2 will explore the Playbook’s feasibility in six purposefully selected health organizations sampled for maximum variation. Organizations will use the Playbook for up to 24 months to implement an innovation of their choosing. Mixed methods will gather: (i) field notes from implementation team check-in meetings; (ii) interviews with implementation teams about their experience using the tool; (iii) user free-form content entered into the tool as teams work through implementation planning; (iv) Organizational Readiness for Implementing Change questionnaire; (v) System Usability Scale; and (vi) tool metrics on how users progressed through activities and the time required to do so. Effective implementation of evidence-based innovations is essential for optimal health. We seek to develop a prototype digital tool and demonstrate its feasibility and usefulness across organizations implementing different innovations. This technology could fill a significant need globally, be highly scalable, and potentially valid for diverse organizations implementing various innovations.

More than 70% of public health nurses in Japan belong to government agencies, and there is a need for further evidence-based capacity development for program implementation. The purpose of this research was to develop an Implementation Degree Assessment Sheet (IDAS) by customizing the Consolidated Framework for Implementation Research (CFIR) to health programs in Japan. The draft IDAS (five domains, 31 constructs) created by customizing the CFIR was refined by the researchers and modified through pre-testing. The survey covered full-time public health nurses (PHNs) affiliated to all prefectures and the cities with health centers of Japan. The survey was conducted as an anonymous, self-administered questionnaire survey by mail. One hundred eighty-five of the 334 institutions (55.4%) agreed to participate in our survey. Of the 966 questionnaire forms distributed, 709 forms (73.4%) were collected, of which 702 responses (72.7%) were valid. No item required consideration of deletion based on the results of item analysis, and our confirmatory factor analysis on model fitness between the five IDAS domains and CFIR showed sufficient fit indices after modification. With regard to reliability, Cronbach’s coefficient alpha, a measure of internal consistency, stayed above 0.8 overall. Our verification of stability with the split-half (odd/even) method resulted in a Spearman–Brown reliability coefficient of 0.95. The correlation coefficient between the IDAS scores and the research utilization competency score, used as an external criterion, was 0.51 (p<0.001), supporting the coexistence validity of the criterion-related validity of the IDAS. The significant differences were observed between known-groups, supporting the known-group validity of the IDAS. This study developed the IDAS and confirmed constant reliability and validity. Hereafter, it is necessary to promote the required capacity development based on the actual degree of implementation in order to use the IDAS for the competency development of public health nurses and related professions to deliver health programs.

An amendment to this paper has been published and can be accessed via the original article.

The fit between an intervention and its local context may affect its implementation and effectiveness. Researchers have stated that both fidelity (the degree to which an intervention is delivered, enacted, and received as intended) and adaptation to the local context are necessary for high-quality implementation. This study describes the implementation of an audit and feedback (AF)-based intervention to improve transition to type 1 diabetes adult care, at five sites, in terms of adaptation and fidelity. An audit and feedback (AF)-based intervention for healthcare teams to improve transition to adult care for patients with type 1 diabetes was studied at five pediatric sites. The Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) was used to document the adaptations made during the study. Fidelity was determined on three different levels: delivery, enactment, and receipt. Fidelity of delivery, receipt, and enactment were preserved during the implementation of the intervention. Of the five sites, three changed their chosen quality improvement initiative, however, within the parameters of the study protocol; therefore, fidelity was preserved while still enabling participants to adapt accordingly. We describe implementing a multi-center AF-based intervention across five sites in Ontario to improve the transition from pediatric to adult diabetes care for youth with type 1 diabetes. This intervention adopted a balanced approach considering both adaptation and fidelity to foster a community of practice to facilitate implementing quality improvement initiatives for improving transition to adult diabetes care. This approach may be adapted for improving transition care for youth with other chronic conditions and to other complex AF-based interventions. ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.