Person:

Hirschhorn, Lisa

Background: Mutuelles is a community-based health insurance program, established since 1999 by the Government of Rwanda as a key component of the national health strategy on providing universal health care. The objective of the study was to evaluate the impact of Mutuelles on achieving universal coverage of medical services and financial risk protection in its first eight years of implementation. Methods and Findings: We conducted a quantitative impact evaluation of Mutuelles between 2000 and 2008 using nationally-representative surveys. At the national and provincial levels, we traced the evolution of Mutuelles coverage and its impact on child and maternal care coverage from 2000 to 2008, as well as household catastrophic health payments from 2000 to 2006. At the individual level, we investigated the impact of Mutuelles' coverage on enrollees' medical care utilization using logistic regression. We focused on three target populations: the general population, under-five children, and women with delivery. At the household level, we used logistic regression to study the relationship between Mutuelles coverage and the probability of incurring catastrophic health spending. The main limitation was that due to insufficient data, we are not able to study the impact of Mutuelles on health outcomes, such as child and maternal mortalities, directly. The findings show that Mutuelles improved medical care utilization and protected households from catastrophic health spending. Among Mutuelles enrollees, those in the poorest expenditure quintile had a significantly lower rate of utilization and higher rate of catastrophic health spending. The findings are robust to various estimation methods and datasets. Conclusions: Rwanda's experience suggests that community-based health insurance schemes can be effective tools for achieving universal health coverage even in the poorest settings. We suggest a future study on how eliminating Mutuelles copayments for the poorest will improve their healthcare utilization, lower their catastrophic health spending, and affect the finances of health care providers.

Access to pediatric HIV treatment in resource-limited settings has risen significantly. However, little is known about the quality of care that pediatric or adolescent patients receive. The objective of this study is to explore quality of HIV care and treatment in Nigeria and to determine the association between quality of care, loss-to-follow-up and mortality. A retrospective cohort study was conducted including patients ≤18 years of age who initiated ART between November 2002 and December 2011 at 23 sites across 10 states. 1,516 patients were included. A quality score comprised of 6 process indicators was calculated for each patient. More than half of patients (55.5%) were found to have a high quality score, using the median score as the cut-off. Most patients were screened for tuberculosis at entry into care (81.3%), had adherence measurement and counseling at their last visit (88.7% and 89.7% respectively), and were prescribed co-trimoxazole at some point during enrollment in care (98.8%). Thirty-seven percent received a CD4 count in the six months prior to chart review. Mortality within 90 days of ART initiation was 1.9%. A total of 4.2% of patients died during the period of follow-up (mean: 27 months) with 19.0% lost to follow-up. In multivariate regression analyses, weight for age z-score (Adjusted Hazard Ratio (AHR): 0.90; 95% CI: 0.85, 0.95) and high quality indicator score (compared a low score, AHR: 0.43; 95% CI: 0.26, 0.73) had a protective effect on mortality. Patients with a high quality score were less likely to be lost to follow-up (Adjusted Odds Ratio (AOR): 0.42; 95% CI: 0.32, 0.56), compared to those with low score. These findings indicate that providing high quality care to children and adolescents living with HIV is important to improve outcomes, including lowering loss to follow-up and decreasing mortality in this age group.

Background: While health systems strengthening (HSS) interventions are recommended by global health policy experts to improve population health in resource-limited settings, few examples exist of evaluations of HSS interventions conducted at the district level. In 2009, a partnership between Partners In Health (PIH), a non-governmental organization, and the Rwandan Ministry of Health (RMOH) was provided funds to implement and evaluate a district-level HSS intervention in two rural districts of Rwanda. Design: The partnership provided limited funds to 14 health centers for targeted systems support in 2010; six others received support prior to the intervention (reference). RMOH health systems norms were mapped across the WHO HSS framework, scored from 0 to 10 and incorporated into a rapid survey assessing 11 domains of facility readiness. Stakeholder meetings allowed partnership leaders to review results, set priorities, and allocate resources. Investments included salary support, infrastructure improvements, medical equipment, and social support for patients. We compared facility domain scores from the start of the intervention to 12 months and tested for correlation between change in score and change in funding allocation to assess equity in our approach. Results: We found significant improvements among intervention facilities from baseline to 12 months across several domains [infrastructure (+4, p=0.0001), clinical services (+1.2, p=0.03), infection and sanitation control (+0.6, p=0.03), medical equipment (+1.0, p=0.02), information use (+2, p=0.002)]. Composite score across domains improved from 6.2 at baseline to 7.4 at 12 months (p=0.002). Across facilities, 50% had composite scores greater than the average score among reference facilities (7.4) at 12 months compared to none at baseline. Conclusions: Rapid facility surveys, stakeholder engagement, and information feedback can be used for gap analysis and resource allocation. This approach can achieve effective use of limited resources, improve facility readiness, and ensure consistency of facility capacity to provide quality care at the district level.

Background: In 30 years of experience in responding to the HIV epidemic, critical decisions and program characteristics for successful scale-up have been studied. Now leaders face a new challenge: sustaining large-scale HIV prevention programs. Implementers, funders, and the communities served need to assess what strategies and practices of scaling up are also relevant for sustaining delivery at scale. Methods: We reviewed white and gray literature to identify domains central to scaling-up programs and reviewed HIV case studies to identify how these domains might relate to sustaining delivery at scale. Results: We found 10 domains identified as important for successfully scaling up programs that have potential relevance for sustaining delivery at scale: fiscal support; political support; community involvement, integration, buy-in, and depth; partnerships; balancing flexibility/adaptability and standardization; supportive policy, regulatory, and legal environment; building and sustaining strong organizational capacity; transferring ownership; decentralization; and ongoing focus on sustainability. We identified one additional potential domain important for programs sustaining delivery at scale: emphasizing equity. Conclusions: Today, the public and private sector are examining their ability to generate value for populations. All stakeholders are aiming to stem the tide of the HIV epidemic. Implementers need a framework to guide the evolution of their strategies and management practices. Greater research is needed to refine the domains for policy and program implementers working to sustain HIV program delivery at scale.

Background: Pragmatic and adaptive trial designs are increasingly used in quality improvement (QI) interventions to provide the strongest evidence for effective implementation and impact prior to broader scale-up. We previously showed that an on-site coaching intervention focused on the World Health Organization Safe Childbirth Checklist (SCC) improved performance of essential birth practices (EBPs) in one facility in Karnataka, India. We report on the process and outcomes of adapting the intervention prior to larger-scale implementation in a randomized controlled trial in Uttar Pradesh (UP), India. Methods: Initially, we trained a local team of physicians and nurses to coach birth attendants in SCC use at two public facilities for 4–6 weeks. Trained observers evaluated adherence to EBPs before and after coaching. Using mixed methods and a systematic adaptation process, we modified and strengthened the intervention. The modified intervention was implemented in three additional facilities. Pre/post-change in EBP prevalence aggregated across facilities was analyzed. Results: In the first two facilities, limited improvement was seen in EBPs with the exception of post-partum oxytocin. Checklists were used <25 % of observations. We identified challenges in physicians coaching nurses, need to engage district and facility leadership to address system gaps, and inadequate strategy for motivating SCC uptake. Revisions included change to peer-to-peer coaching (nurse to nurse, physician to physician); strengthened coach training on behavior and system change; adapted strategy for effective leadership engagement; and an explicit motivation strategy to enhance professional pride and effectiveness. These modifications resulted in improvement in multiple EBPs from baseline including taking maternal blood pressure (0 to 16 %), post-partum oxytocin (36 to 97 %), early breastfeeding initiation (3 to 64 %), as well as checklist use (range 32 to 88 %), all p < 0.01. Further adaptations were implemented to increase the effectiveness prior to full trial launch. Conclusions: The adaptive study design of implementation, evaluation, and feedback drove iterative redesign and successfully developed a SCC-focused coaching intervention that improved EBPs in UP facilities. This work was critical to develop a replicable BetterBirth package tailored to the local context. The multi-center pragmatic trial is underway measuring impact of the BetterBirth program on EBP and maternal-neonatal morbidity and mortality. Trial registration Clinical trials identifier: NCT02148952.

Background: Health data can be useful for effective service delivery, decision making, and evaluating existing programs in order to maintain high quality of healthcare. Studies have shown variability in data quality from national health management information systems (HMISs) in sub-Saharan Africa which threatens utility of these data as a tool to improve health systems. The purpose of this study is to assess the quality of Rwanda's HMIS data over a 5-year period. Methods: The World Health Organization (WHO) data quality report card framework was used to assess the quality of HMIS data captured from 2008 to 2012 and is a census of all 495 publicly funded health facilities in Rwanda. Factors assessed included completeness and internal consistency of 10 indicators selected based on WHO recommendations and priority areas for the Rwanda national health sector. Completeness was measured as percentage of non-missing reports. Consistency was measured as the absence of extreme outliers, internal consistency between related indicators, and consistency of indicators over time. These assessments were done at the district and national level. Results: Nationally, the average monthly district reporting completeness rate was 98% across 10 key indicators from 2008 to 2012. Completeness of indicator data increased over time: 2008, 88%; 2009, 91%; 2010, 89%; 2011, 90%; and 2012, 95% (p<0.0001). Comparing 2011 and 2012 health events to the mean of the three preceding years, service output increased from 3% (2011) to 9% (2012). Eighty-three percent of districts reported ratios between related indicators (ANC/DTP1, DTP1/DTP3) consistent with HMIS national ratios. Conclusion and policy implications Our findings suggest that HMIS data quality in Rwanda has been improving over time. We recommend maintaining these assessments to identify remaining gaps in data quality and that results are shared publicly to support increased use of HMIS data.

Background: As resource-limited health systems evolve to address complex diseases, attention must be returned to basic primary care delivery. Limited data exists detailing the quality of general adult and adolescent primary care delivered at front-line facilities in these regions. Here we describe the baseline quality of care for adults and adolescents in rural Rwanda. Methods: Patients aged 13 and older presenting to eight rural health center outpatient departments in one district in southeastern Rwanda between February and March 2011 were included. Routine nurse-delivered care was observed by clinical mentors trained in the WHO Integrated Management of Adolescent & Adult Illness (IMAI) protocol using standardized checklists, and compared to decisions made by the clinical mentor as the gold standard. Results: Four hundred and seventy consultations were observed. Of these, only 1.5% were screened and triaged for emergency conditions. Fewer than 10% of patients were routinely screened for chronic conditions including HIV, tuberculosis, anemia or malnutrition. Nurses correctly diagnosed 50.1% of patient complaints (95% CI: 45.7%-54.5%) and determined the correct treatment 44.9% of the time (95% CI: 40.6%-49.3%). Correct diagnosis and treatment varied significantly across health centers (p = 0.03 and p = 0.04, respectively). Conclusion: Fundamental gaps exist in adult and adolescent primary care delivery in Rwanda, including triage, screening, diagnosis, and treatment, with significant variability across conditions and facilities. Research and innovation toward improving and standardizing primary care delivery in sub-Saharan Africa is required. IMAI, supported by routine mentorship, is one potentially important approach to establishing the standards necessary for high-quality care.

Objective: To describe healthcare worker (HCW)-identified system-based bottlenecks and the value of local engagement in designing strategies to improve referral processes related to emergency obstetric care in rural Ghana. Design: Qualitative study using semistructured interviews of participants to obtain provider narratives. Setting: Referral systems in obstetrics in Assin North Municipal Assembly, a rural district in Ghana. This included one district hospital, six health centres and four local health posts. This work was embedded in an ongoing quality improvement project in the district addressing barriers to existing referral protocols to lessen delays. Participants: 18 HCWs (8 midwives, 4 community health officers, 3 medical assistants, 2 emergency room nurses, 1 doctor) at different facility levels within the district. Results: We identified important gaps in referral processes in Assin North, with the most commonly noted including recognising danger signs, alerting receiving units, accompanying critically ill patients, documenting referral cases and giving and obtaining feedback on referred cases. Main root causes identified by providers were in four domains: (1) transportation, (2) communication, (3) clinical skills and management and (4) standards of care and monitoring, and suggested interventions that target these barriers. Mapping these challenges allowed for better understanding of next steps for developing comprehensive, evidence-based solutions to identified referral gaps within the district. Conclusions: Providers are an important source of information on local referral delays and in the development of approaches to improvement responsive to these gaps. Better engagement of HCWs can help to identify and evaluate high-impact holistic interventions to address faulty referral systems which result in poor maternal outcomes in resource-poor settings. These perspectives need to be integrated with patient and community perspectives.

Background: Despite evidence supporting Integrated Management of Childhood Illness (IMCI) as a strategy to improve pediatric care in countries with high child mortality, its implementation faces challenges related to lack of or poor post-didactic training supervision and gaps in necessary supporting systems. These constraints lead to health care workers’ inability to consistently translate IMCI knowledge and skills into practice. A program providing mentoring and enhanced supervision at health centers (MESH), focusing on clinical and systems improvement was implemented in rural Rwanda as a strategy to address these issues, with the ultimate goal of improving the quality of pediatric care at rural health centers. We explored perceptions of MESH from the perspective of IMCI clinical mentors, mentees, and district clinical leadership. Methods: We conducted focus group discussions with 40 health care workers from 21 MESH-supported health centers. Two FGDs in each district were carried out, including one for nurses and one for director of health centers. District medical directors and clinical mentors had individual in-depth interviews. We performed a hermeneutic analysis using Atlas.ti v5.2. Results: Study participants highlighted program components in five key areas that contributed to acceptability and impact, including: 1) Interactive, collaborative capacity-building, 2) active listening and relationships, 3) supporting not policing, 4) systems improvement, and 5) real-time feedback. Staff turn-over, stock-outs, and other facility/systems gaps were identified as barriers to MESH and IMCI implementation. Conclusion: Health care workers reported high acceptance and positive perceptions of the MESH model as an effective strategy to build their capacity, bridge the gap between knowledge and practice in pediatric care, and address facility and systems issues. This approach also improved relationships between the district supervisory team and health center-based care providers. Despite some challenges, many perceived a strong benefit on clinical performance and outcomes. This study can inform program implementers and policy makers of key components needed for developing similar health facility-based mentorship interventions and potential barriers and resistance which can be proactively addressed to ensure success.

Background: Nationally, health in Rwanda has been improving since 2000, with considerable improvement since 2005. Despite improvements, rural areas continue to lag behind urban sectors with regard to key health outcomes. Partners In Health (PIH) has been supporting the Rwanda Ministry of Health (MOH) in two rural districts in Rwanda since 2005. Since 2009, the MOH and PIH have spearheaded a health systems strengthening (HSS) intervention in these districts as part of the Rwanda Population Health Implementation and Training (PHIT) Partnership. The partnership is guided by the belief that HSS interventions should be comprehensive, integrated, responsive to local conditions, and address health care access, cost, and quality. The PHIT Partnership represents a collaboration between the MOH and PIH, with support from the National University of Rwanda School of Public Health, the National Institute of Statistics, Harvard Medical School, and Brigham and Women’s Hospital. Description of intervention The PHIT Partnership’s health systems support aligns with the World Health Organization’s six health systems building blocks. HSS activities focus across all levels of the health system — community, health center, hospital, and district leadership — to improve health care access, quality, delivery, and health outcomes. Interventions are concentrated on three main areas: targeted support for health facilities, quality improvement initiatives, and a strengthened network of community health workers. Evaluation design The impact of activities will be assessed using population-level outcomes data collected through oversampling of the demographic and health survey (DHS) in the intervention districts. The overall impact evaluation is complemented by an analysis of trends in facility health care utilization. A comprehensive costing project captures the total expenditures and financial inputs of the health care system to determine the cost of systems improvement. Targeted evaluations and operational research pieces focus on specific programmatic components, supported by partnership-supported work to build in-country research capacity. Discussion Building on early successes, the work of the Rwanda PHIT Partnership approach to HSS has already seen noticeable increases in facility capacity and quality of care. The rigorous planned evaluation of the Partnership’s HSS activities will contribute to global knowledge about intervention methodology, cost, and population health impact.