Person:

Hirschhorn, Lisa

Background: Mutuelles is a community-based health insurance program, established since 1999 by the Government of Rwanda as a key component of the national health strategy on providing universal health care. The objective of the study was to evaluate the impact of Mutuelles on achieving universal coverage of medical services and financial risk protection in its first eight years of implementation. Methods and Findings: We conducted a quantitative impact evaluation of Mutuelles between 2000 and 2008 using nationally-representative surveys. At the national and provincial levels, we traced the evolution of Mutuelles coverage and its impact on child and maternal care coverage from 2000 to 2008, as well as household catastrophic health payments from 2000 to 2006. At the individual level, we investigated the impact of Mutuelles' coverage on enrollees' medical care utilization using logistic regression. We focused on three target populations: the general population, under-five children, and women with delivery. At the household level, we used logistic regression to study the relationship between Mutuelles coverage and the probability of incurring catastrophic health spending. The main limitation was that due to insufficient data, we are not able to study the impact of Mutuelles on health outcomes, such as child and maternal mortalities, directly. The findings show that Mutuelles improved medical care utilization and protected households from catastrophic health spending. Among Mutuelles enrollees, those in the poorest expenditure quintile had a significantly lower rate of utilization and higher rate of catastrophic health spending. The findings are robust to various estimation methods and datasets. Conclusions: Rwanda's experience suggests that community-based health insurance schemes can be effective tools for achieving universal health coverage even in the poorest settings. We suggest a future study on how eliminating Mutuelles copayments for the poorest will improve their healthcare utilization, lower their catastrophic health spending, and affect the finances of health care providers.

Access to pediatric HIV treatment in resource-limited settings has risen significantly. However, little is known about the quality of care that pediatric or adolescent patients receive. The objective of this study is to explore quality of HIV care and treatment in Nigeria and to determine the association between quality of care, loss-to-follow-up and mortality. A retrospective cohort study was conducted including patients ≤18 years of age who initiated ART between November 2002 and December 2011 at 23 sites across 10 states. 1,516 patients were included. A quality score comprised of 6 process indicators was calculated for each patient. More than half of patients (55.5%) were found to have a high quality score, using the median score as the cut-off. Most patients were screened for tuberculosis at entry into care (81.3%), had adherence measurement and counseling at their last visit (88.7% and 89.7% respectively), and were prescribed co-trimoxazole at some point during enrollment in care (98.8%). Thirty-seven percent received a CD4 count in the six months prior to chart review. Mortality within 90 days of ART initiation was 1.9%. A total of 4.2% of patients died during the period of follow-up (mean: 27 months) with 19.0% lost to follow-up. In multivariate regression analyses, weight for age z-score (Adjusted Hazard Ratio (AHR): 0.90; 95% CI: 0.85, 0.95) and high quality indicator score (compared a low score, AHR: 0.43; 95% CI: 0.26, 0.73) had a protective effect on mortality. Patients with a high quality score were less likely to be lost to follow-up (Adjusted Odds Ratio (AOR): 0.42; 95% CI: 0.32, 0.56), compared to those with low score. These findings indicate that providing high quality care to children and adolescents living with HIV is important to improve outcomes, including lowering loss to follow-up and decreasing mortality in this age group.

Background: In 30 years of experience in responding to the HIV epidemic, critical decisions and program characteristics for successful scale-up have been studied. Now leaders face a new challenge: sustaining large-scale HIV prevention programs. Implementers, funders, and the communities served need to assess what strategies and practices of scaling up are also relevant for sustaining delivery at scale. Methods: We reviewed white and gray literature to identify domains central to scaling-up programs and reviewed HIV case studies to identify how these domains might relate to sustaining delivery at scale. Results: We found 10 domains identified as important for successfully scaling up programs that have potential relevance for sustaining delivery at scale: fiscal support; political support; community involvement, integration, buy-in, and depth; partnerships; balancing flexibility/adaptability and standardization; supportive policy, regulatory, and legal environment; building and sustaining strong organizational capacity; transferring ownership; decentralization; and ongoing focus on sustainability. We identified one additional potential domain important for programs sustaining delivery at scale: emphasizing equity. Conclusions: Today, the public and private sector are examining their ability to generate value for populations. All stakeholders are aiming to stem the tide of the HIV epidemic. Implementers need a framework to guide the evolution of their strategies and management practices. Greater research is needed to refine the domains for policy and program implementers working to sustain HIV program delivery at scale.

Background: Health data can be useful for effective service delivery, decision making, and evaluating existing programs in order to maintain high quality of healthcare. Studies have shown variability in data quality from national health management information systems (HMISs) in sub-Saharan Africa which threatens utility of these data as a tool to improve health systems. The purpose of this study is to assess the quality of Rwanda's HMIS data over a 5-year period. Methods: The World Health Organization (WHO) data quality report card framework was used to assess the quality of HMIS data captured from 2008 to 2012 and is a census of all 495 publicly funded health facilities in Rwanda. Factors assessed included completeness and internal consistency of 10 indicators selected based on WHO recommendations and priority areas for the Rwanda national health sector. Completeness was measured as percentage of non-missing reports. Consistency was measured as the absence of extreme outliers, internal consistency between related indicators, and consistency of indicators over time. These assessments were done at the district and national level. Results: Nationally, the average monthly district reporting completeness rate was 98% across 10 key indicators from 2008 to 2012. Completeness of indicator data increased over time: 2008, 88%; 2009, 91%; 2010, 89%; 2011, 90%; and 2012, 95% (p<0.0001). Comparing 2011 and 2012 health events to the mean of the three preceding years, service output increased from 3% (2011) to 9% (2012). Eighty-three percent of districts reported ratios between related indicators (ANC/DTP1, DTP1/DTP3) consistent with HMIS national ratios. Conclusion and policy implications Our findings suggest that HMIS data quality in Rwanda has been improving over time. We recommend maintaining these assessments to identify remaining gaps in data quality and that results are shared publicly to support increased use of HMIS data.

Background: As resource-limited health systems evolve to address complex diseases, attention must be returned to basic primary care delivery. Limited data exists detailing the quality of general adult and adolescent primary care delivered at front-line facilities in these regions. Here we describe the baseline quality of care for adults and adolescents in rural Rwanda. Methods: Patients aged 13 and older presenting to eight rural health center outpatient departments in one district in southeastern Rwanda between February and March 2011 were included. Routine nurse-delivered care was observed by clinical mentors trained in the WHO Integrated Management of Adolescent & Adult Illness (IMAI) protocol using standardized checklists, and compared to decisions made by the clinical mentor as the gold standard. Results: Four hundred and seventy consultations were observed. Of these, only 1.5% were screened and triaged for emergency conditions. Fewer than 10% of patients were routinely screened for chronic conditions including HIV, tuberculosis, anemia or malnutrition. Nurses correctly diagnosed 50.1% of patient complaints (95% CI: 45.7%-54.5%) and determined the correct treatment 44.9% of the time (95% CI: 40.6%-49.3%). Correct diagnosis and treatment varied significantly across health centers (p = 0.03 and p = 0.04, respectively). Conclusion: Fundamental gaps exist in adult and adolescent primary care delivery in Rwanda, including triage, screening, diagnosis, and treatment, with significant variability across conditions and facilities. Research and innovation toward improving and standardizing primary care delivery in sub-Saharan Africa is required. IMAI, supported by routine mentorship, is one potentially important approach to establishing the standards necessary for high-quality care.

Objective: To describe healthcare worker (HCW)-identified system-based bottlenecks and the value of local engagement in designing strategies to improve referral processes related to emergency obstetric care in rural Ghana. Design: Qualitative study using semistructured interviews of participants to obtain provider narratives. Setting: Referral systems in obstetrics in Assin North Municipal Assembly, a rural district in Ghana. This included one district hospital, six health centres and four local health posts. This work was embedded in an ongoing quality improvement project in the district addressing barriers to existing referral protocols to lessen delays. Participants: 18 HCWs (8 midwives, 4 community health officers, 3 medical assistants, 2 emergency room nurses, 1 doctor) at different facility levels within the district. Results: We identified important gaps in referral processes in Assin North, with the most commonly noted including recognising danger signs, alerting receiving units, accompanying critically ill patients, documenting referral cases and giving and obtaining feedback on referred cases. Main root causes identified by providers were in four domains: (1) transportation, (2) communication, (3) clinical skills and management and (4) standards of care and monitoring, and suggested interventions that target these barriers. Mapping these challenges allowed for better understanding of next steps for developing comprehensive, evidence-based solutions to identified referral gaps within the district. Conclusions: Providers are an important source of information on local referral delays and in the development of approaches to improvement responsive to these gaps. Better engagement of HCWs can help to identify and evaluate high-impact holistic interventions to address faulty referral systems which result in poor maternal outcomes in resource-poor settings. These perspectives need to be integrated with patient and community perspectives.

Background: Despite evidence supporting Integrated Management of Childhood Illness (IMCI) as a strategy to improve pediatric care in countries with high child mortality, its implementation faces challenges related to lack of or poor post-didactic training supervision and gaps in necessary supporting systems. These constraints lead to health care workers’ inability to consistently translate IMCI knowledge and skills into practice. A program providing mentoring and enhanced supervision at health centers (MESH), focusing on clinical and systems improvement was implemented in rural Rwanda as a strategy to address these issues, with the ultimate goal of improving the quality of pediatric care at rural health centers. We explored perceptions of MESH from the perspective of IMCI clinical mentors, mentees, and district clinical leadership. Methods: We conducted focus group discussions with 40 health care workers from 21 MESH-supported health centers. Two FGDs in each district were carried out, including one for nurses and one for director of health centers. District medical directors and clinical mentors had individual in-depth interviews. We performed a hermeneutic analysis using Atlas.ti v5.2. Results: Study participants highlighted program components in five key areas that contributed to acceptability and impact, including: 1) Interactive, collaborative capacity-building, 2) active listening and relationships, 3) supporting not policing, 4) systems improvement, and 5) real-time feedback. Staff turn-over, stock-outs, and other facility/systems gaps were identified as barriers to MESH and IMCI implementation. Conclusion: Health care workers reported high acceptance and positive perceptions of the MESH model as an effective strategy to build their capacity, bridge the gap between knowledge and practice in pediatric care, and address facility and systems issues. This approach also improved relationships between the district supervisory team and health center-based care providers. Despite some challenges, many perceived a strong benefit on clinical performance and outcomes. This study can inform program implementers and policy makers of key components needed for developing similar health facility-based mentorship interventions and potential barriers and resistance which can be proactively addressed to ensure success.

Background: Nationally, health in Rwanda has been improving since 2000, with considerable improvement since 2005. Despite improvements, rural areas continue to lag behind urban sectors with regard to key health outcomes. Partners In Health (PIH) has been supporting the Rwanda Ministry of Health (MOH) in two rural districts in Rwanda since 2005. Since 2009, the MOH and PIH have spearheaded a health systems strengthening (HSS) intervention in these districts as part of the Rwanda Population Health Implementation and Training (PHIT) Partnership. The partnership is guided by the belief that HSS interventions should be comprehensive, integrated, responsive to local conditions, and address health care access, cost, and quality. The PHIT Partnership represents a collaboration between the MOH and PIH, with support from the National University of Rwanda School of Public Health, the National Institute of Statistics, Harvard Medical School, and Brigham and Women’s Hospital. Description of intervention The PHIT Partnership’s health systems support aligns with the World Health Organization’s six health systems building blocks. HSS activities focus across all levels of the health system — community, health center, hospital, and district leadership — to improve health care access, quality, delivery, and health outcomes. Interventions are concentrated on three main areas: targeted support for health facilities, quality improvement initiatives, and a strengthened network of community health workers. Evaluation design The impact of activities will be assessed using population-level outcomes data collected through oversampling of the demographic and health survey (DHS) in the intervention districts. The overall impact evaluation is complemented by an analysis of trends in facility health care utilization. A comprehensive costing project captures the total expenditures and financial inputs of the health care system to determine the cost of systems improvement. Targeted evaluations and operational research pieces focus on specific programmatic components, supported by partnership-supported work to build in-country research capacity. Discussion Building on early successes, the work of the Rwanda PHIT Partnership approach to HSS has already seen noticeable increases in facility capacity and quality of care. The rigorous planned evaluation of the Partnership’s HSS activities will contribute to global knowledge about intervention methodology, cost, and population health impact.

Background: Integrated into the work in health systems strengthening (HSS) is a growing focus on the importance of ensuring quality of the services delivered and systems which support them. Understanding how to define and measure quality in the different key World Health Organization building blocks is critical to providing the information needed to address gaps and identify models for replication. Description of approaches We describe the approaches to defining and improving quality across the five country programs funded through the Doris Duke Charitable Foundation African Health Initiative. While each program has independently developed and implemented country-specific approaches to strengthening health systems, they all included quality of services and systems as a core principle. We describe the differences and similarities across the programs in defining and improving quality as an embedded process essential for HSS to achieve the goal of improved population health. The programs measured quality across most or all of the six WHO building blocks, with specific areas of overlap in improving quality falling into four main categories: 1) defining and measuring quality; 2) ensuring data quality, and building capacity for data use for decision making and response to quality measurements; 3) strengthened supportive supervision and/or mentoring; and 4) operational research to understand the factors associated with observed variation in quality. Conclusions: Learning the value and challenges of these approaches to measuring and improving quality across the key components of HSS as the projects continue their work will help inform similar efforts both now and in the future to ensure quality across the critical components of a health system and the impact on population health.

Background: Geographic Information Systems (GIS) have become an important tool in monitoring and improving health services, particularly at local levels. However, GIS data are often unavailable in rural settings and village-level mapping is resource-intensive. This study describes the use of community health workers’ (CHW) supervisors to map villages in a mountainous rural district of Northern Rwanda and subsequent use of these data to map village-level variability in safe water availability. Methods: We developed a low literacy and skills-focused training in the local language (Kinyarwanda) to train 86 CHW Supervisors and 25 nurses in charge of community health at the health center (HC) and health post (HP) levels to collect the geographic coordinates of the villages using Global Positioning Systems (GPS). Data were validated through meetings with key stakeholders at the sub-district and district levels and joined using ArcMap 10 Geo-processing tools. Costs were calculated using program budgets and activities’ records, and compared with the estimated costs of mapping using a separate, trained GIS team. To demonstrate the usefulness of this work, we mapped drinking water sources (DWS) from data collected by CHW supervisors from the chief of the village. DWSs were categorized as safe versus unsafe using World Health Organization definitions. Result Following training, each CHW Supervisor spent five days collecting data on the villages in their coverage area. Over 12 months, the CHW supervisors mapped the district’s 573 villages using 12 shared GPS devices. Sector maps were produced and distributed to local officials. The cost of mapping using CHW supervisors was $29,692, about two times less than the estimated cost of mapping using a trained and dedicated GIS team ($60,112). The availability of local mapping was able to rapidly identify village-level disparities in DWS, with lower access in populations living near to lakes and wetlands (p < .001). Conclusion: Existing national CHW system can be leveraged to inexpensively and rapidly map villages even in mountainous rural areas. These data are important to provide managers and decision makers with local-level GIS data to rapidly identify variability in health and other related services to better target and evaluate interventions.