World J Surg (2015) 39:10–20 DOI 10.1007/s00268-014-2516-0

Charitable Platforms in Global Surgery: A Systematic Review of their Effectiveness, Cost-Effectiveness, Sustainability, and Role Training
Mark G. Shrime • Ambereen Sleemi Thulasiraj D. Ravilla
•

Published online: 29 March 2014 Ó The Author(s) 2014. This article is published with open access at Springerlink.com

Abstract Objective This study was designed to propose a classification scheme for platforms of surgical delivery in lowand middle-income countries (LMICs) and to review the literature documenting their effectiveness, cost-effectiveness, sustainability, and role in training. Approximately 28 % of the global burden of disease is surgical. In LMICs, much of this burden is borne by a rapidly growing international charitable sector, in fragmented platforms ranging from short-term trips to specialized hospitals. Systematic

M. G. Shrime (&) Harvard Interfaculty Initiative in Health Policy, 14 Story Street, 4th Floor, Cambridge, MA 02138, USA e-mail: shrime@gmail.com M. G. Shrime Massachusetts Eye and Ear Infirmary, Boston, MA, USA M. G. Shrime Department of Otology and Laryngology, Harvard Medical School, Cambridge, MA, USA M. G. Shrime Program in Global Surgery and Social Change, Children’s Hospital, Boston, MA, USA A. Sleemi Maimonides Medical Center, New York, NY, USA A. Sleemi Mailman School of Public Health, Columbia University, New York, NY, USA T. D. Ravilla Lions Aravind Institute of Community Ophthalmology, Madurai, India

reviews of these platforms, across regions and across disease conditions, have not been performed. Methods A systematic review of MEDLINE and EMBASE databases was performed from 1960 to 2013. Inclusion and exclusion criteria were defined a priori. Bibliographies of retrieved studies were searched by hand. Of the 8,854 publications retrieved, 104 were included. Results Surgery by international charitable organizations is delivered under two, specialized hospitals and temporary platforms. Among the latter, short-term surgical missions were the most common and appeared beneficial when no other option was available. Compared to other platforms, however, worse results and a lack of cost-effectiveness curtailed their role. Self-contained temporary platforms that did not rely on local infrastructure showed promise, based on very few studies. Specialized hospitals provided effective treatment and appeared sustainable; cost-effectiveness evidence was limited. Conclusions Because the charitable sector delivers surgery in vastly divergent ways, systematic review of these platforms has been difficult. This paper provides a framework from which to study these platforms for surgery in LMICs. Given the available evidence, self-contained temporary platforms and specialized surgical centers appear to provide more effective and cost-effective care than shortterm surgical mission trips, except when no other delivery platform exists.

Introduction Approximately 28 % of the global burden of disease is amenable to surgical intervention, a proportion that is higher in the developing world (author calculations, using the 2010 Global Burden of Disease survey [1]. Because of

123

World J Surg (2015) 39:10–20

11

difficulties in access to care [2–5], at least part of this burden is borne by the international charitable sector. Historically, local hospitals in low- and middle-income countries (LMICs) have treated conditions associated with a low disability-adjusted life year (DALY) burden and have done so with a high loss to follow-up, especially as the complexity and upfront cost of surgeries increase [3]. Meanwhile, the charitable sector is large; in the United States, this sector, which includes many international surgical organizations, has grown at a pace exceeding GDP by 20 % [6]. This review will focus on the role of charitable organizations in surgical delivery in LMICs. Any attempt to examine nongovernmental organizations (NGOs) must necessarily define these platforms. This is a daunting task—an entire galaxy of NGOs provides surgical care, few of which easily fit into any single categorization. Additionally, although the literature currently focuses on the conditions each organization treats, this focus masks salient similarities and differences among platforms, and, in doing so, may actually promote fragmentation in delivery. This review, instead, will accomplish two goals: first, propose a classification scheme for charitable surgical delivery, focusing on the method of delivery, as opposed to the diseases treated. Using this new framework, this review will then compare NGO platforms along metrics of effectiveness, cost-effectiveness, sustainability, and their role in training. Focusing on the platform of care, rather than on disease-specific organizations, allows for benefits common to each platform to emerge, distinct from the diseases treated and the organizations that treat them. We have limited our study only to charitable (or partly charitable) organizations and have evaluated them along only four domains: effectiveness, cost-effectiveness, sustainability, and their role in training. This is not to suggest that these are the only metrics by which these organizations should be evaluated. Ethical considerations are not, for example, explicitly considered, although they are arguably as important as the included domains [7–10]. Finally, other methods of delivering surgery in LMICs are not discussed: telemedicine [11] and cancer screening [12] are not included. Many individual surgeons organize their own trips to LMICs; none have produced peerreviewed publications. Mobile surgical platforms sent from in-country hospitals [13], and surgical outreaches in humanitarian emergencies (as performed by organizations, ´ ` such as Medecins Sans Frontieres and the Red Cross) operate under different mandates, with currently limited (but positive) data, and are similarly excluded [14, 15]. Finally, teams that aim to establish residency or training programs have yet to publish enough of their outcomes to be evaluated. The few papers that have been published are, however, promising [16, 17].

Methodology A systematic review of the literature was performed to assess the cost, effectiveness, sustainability, and role in training of various surgical platforms. Guidelines and methods for systematic review have been standardized and reported elsewhere [18]. These guidelines, as they apply to observational studies, were followed in this paper. The MEDLINE search strategy is given in Box 1. Bibliographies of the retrieved studies were searched for other relevant publications. Inclusion and exclusion criteria were decided on a priori. Only published, peer-reviewed articles were included. The search was not limited to articles in English. Data were extracted using piloted forms and performed by all three authors. Because of a high risk of heterogeneity in studies across multiple disease conditions, countries, and platforms of delivery, no mathematical summary measure was calculated. Of 8,854 records retrieved, 6,741 were screened by title and abstract; one additional article was found on bibliographic review, and the full text of 322 was screened. From these, 104 articles were selected inclusion. The review process, as well as the previously determined exclusion criteria are listed in the PRISMA diagram found in Fig. 1. A note on terminology: although some NGOs providing surgery in LMICs are faith-based, not all are. The word mission in this review does not refer only to faith-based organizations; it is used more broadly of all temporary delivery platforms. Similarly, the word humanitarian is limited to missions that operate under the setting of acute emergencies, and the word charitable to organizations that are, at least in part, funded by private donations.

Results A taxonomy of specialized surgical platforms The literature suggests that charitable organizations delivery surgery in two basic ways: by establishing specialty surgical hospitals, or by focusing on more temporary platforms: Temporary surgical platforms By far the most common, this near-ubiquitous model of surgical delivery can be informatively broken down further: • Short-term surgical trips This platform sends surgeons, anesthesiologists, nurses, and/or supporting staff—along with, at times, surgical instrumentation and technology—into LMIC hospitals and clinics for short periods. Often, these NGOs perform a restricted set of surgeries, relying on local physicians for followup. Organizations such as Operation Smile

123

12 Fig. 1 PRISMA diagram, documenting the search strategy results, inclusion criteria, exclusion criteria, and final records included in this qualitative systematic review

World J Surg (2015) 39:10–20

•

[19–23], numerous orthopedic organizations [24], and many others fit this model. Self-contained surgical platforms Significantly rarer, these NGOs often spend longer in-country than the short-term trips (months to years) but, importantly, carry their infrastructure with them. Self-contained on ships, airplanes, and other modes of transportation, these organizations tend not to leave behind any physical structure. Organizations such as Mercy Ships [25, 26] and CinterAndes fit this model.

Specialty surgical hospitals Another common model for surgical delivery by NGOs, these platforms establish an entire physical plant, either de novo or within an existing structure, dedicated to the treatment of one or a few related surgical conditions. Organizations such as the Addis Ababa Fistula Hospital or the Aravind Eye Hospital fit this model. This classification scheme allows conclusions to be drawn about effectiveness, cost-effectiveness, sustainability, and the role in training of broad platforms of charitable

123

World J Surg (2015) 39:10–20

13

surgical delivery in LMICs, separate from the individual conditions treated. Temporary surgical platforms Short-term surgical trips Short-term, disease-specific surgical missions are myriad [27]: from ‘‘eye camps’’ in India [28–33] to ‘‘ear camps’’ in Namibia [34]; from organizations focused on facial clefting [19–23] to those focused on hernias [35], cardiac surgery [36], and endemic goiter [37]—services rendered, lengths of surgical trips, and resultant efficacies vary. Underpinning these platforms, however, is a uniting model: surgical teams are flown into regions with high burdens of specific diseases, where they operate for short stints, often on the order of 1 to 2 weeks [38], and often in partnership with incountry physicians, to whom is left all but the most immediate of follow-up care. These missions, also called safaris [39] or blitzes [40], frequently carry their own equipment with them [38, 41], often return to the same region in subsequent years [24, 42–44], and strive toward close partnership with local hospitals and ministries of health [45, 46]. Despite the plethora of organizations that adopt this shortterm model, evaluations of its effectiveness and cost-effectiveness are few. In part, this is due to a difficulty with followup. Of 4,100 operations for cleft lip and palate by 1 organization in 40 simultaneous sites, for example, only 703 patients (17 %) returned for a 6- to 9-month postoperative visit [19]. Similarly, in a Spanish-African cooperation program for the repair of hernias, follow-up was 21 % [16]. Effectiveness A survey of 99 international surgical organizations found that the majority provided fewer than 500 operations per year [27]. Strong evidence exists for an association between surgical volume and outcomes in North America [47], with a stronger impact by hospital volume than by surgeon volume, especially for higher-complexity procedures [48, 49]. This seems to be maintained in the short-term platform; these organizations tend to suffer from higher mortality and complication rates while producing mixed results. In an evaluation of more than 17,000 operations performed in subSaharan Africa more than 114 surgical missions in two decades, an overall mortality of 3.3 % was achieved [50]. The majority of these operations were for hernias, for which a mortality as high as 1 % was observed—20 times higher than in high-income countries [51]. Both the success of an operative mission and its complication rates, however, vary by surgical procedure. Simpler procedures, such as tonsillectomy, appear safe when performed by short-term surgical missions [52].

Others less so: Maine et al [53]. Reported a rate oronasal fistula after cleft palate repair, which is more than 20-fold higher in surgical missions than in high-income countries. In their study, cases performed by experienced Ecuadorean and North American surgeons on a mission to Ecuador were compared with cases performed by similar surgeons at an American tertiary hospital. All surgeons showed this 20-fold increase in complication rates; no difference was found between Ecuadorean and North American surgeons. Although there are obviously patient-level factors that confound this increased complication rate, this finding lends further credence to an assertion that mission volume has potentially more impact than surgeon experience [53]. De Buys Roessingh et al. [42] similarly report relatively poor functional results in the repair of cleft palates on short-term surgical missions; the inherent difficulty of establishing a multidisciplinary approach in short-term surgical missions may contribute to these outcomes [54]. Results from cataract surgeries performed in eye camps are equally variable: Some report good vision outcomes [31], others poor [55]. Variability also is seen in otologic surgery; in surgical camps in Greenland [56, 57] and in mobile surgical units in Thailand [58], low complication rates and good results were found for chronic ear disease. Other authors, however, report success tied very strongly to either pathologic diagnosis [59] or the age of the surgical mission, with better results occurring a few years after the mission’s establishment [60]. Acceptable results have been found in cardiac surgery [36, 61], although some results come from very small surveys. Similar good results are reported in goiter missions, especially as they are repeated [37]. However, for the repair of burn contractures, Kim et al. found complications rates higher on surgical missions than in high-income countries [62], and, in orthopedics, Cousins et al. report success rates ranging from 28 to 75 %. Among the largest group of patients—those with lower limb trauma—47 % experienced complications [24]. Young et al. [63, 64] similarly document a not insignificant, postoperative infection rate after intramedullary nailing. Overall, a pattern emerges in a review of the effectiveness of the short-term platform; for the condition most commonly treated by the charitable sector, the more complex the surgery, the more unsatisfactory the results. Both Marck et al [65]. and Huijing et al [66]. find this pattern, which combined with Maine’s findings above [53], leads them to recommend against short-term surgical missions for any but the simplest conditions [65, 66]. Cost-effectiveness With a caveat to be discussed below, the few cost-effectiveness analyses that have been performed on surgical

123

14

World J Surg (2015) 39:10–20

missions point to a beneficial cost-effectiveness ratio: cleft lip and palate repair costs anywhere from $52/DALY averted [67] to $1,827/DALY averted [23], or approximately $40 per patient [41], and benefit-cost analyses are similarly positive [68]. Orthopedic surgeries, at $340-$360/ DALY averted, are slightly more expensive buys [38, 69]. These findings, however, must be interpreted with extreme caution, especially because they do not square with the assertion short-term surgical missions tend toward unsatisfactory outcomes. The apparent cost-effectiveness of surgical missions is an artifact of the way in which the analyses were conducted; almost all of the cited studies assume uncomplicated repairs, and all assumed that, without the mission, no surgery occurred. These assumptions will systematically result in a small cost-effectiveness ratio, biasing the analysis toward the charitable organization. As a result, an interpretation of these findings must be very narrow: only when no other platform treats the condition do these results imply that a surgical mission may be costeffective. If the condition can be treated by other platforms— which, in many cases, it can—these cost-effectiveness results lose validity. This caveat should be combined with the fact that results of these cost-effectiveness studies depend on how the studies were conducted [70]. One cost-effectiveness analysis compared short-term platforms with other platforms for the treatment of one condition; Singh et al [55]. examined cataract surgeries performed at specialized eye camps, NGO hospitals, and the state medical college. Although not the worst value— that distinction fell to the state medical college—short-term eye camps were much less cost-effective than nongovernmental hospitals. Sustainability and training Many authors laud the salutary role that short-term surgical missions have in the education of surgical trainees in highincome countries [43, 71–85]. While this role is not to be dismissed, it cannot come at the cost of delivery of unsatisfactory care in LMICs [9, 86]. Besides one study, which documented an increase in laparoscopic surgeries after repeated training missions [17], no other evidence was found for the role of short-term missions in training. Short-term surgical missions, however, have been put forward as a method to alleviate disease burden in LMICs. Unfortunately, the sustainability of this platform unclear. It is not altogether unlikely, for example, that these surgical camps treat the same conditions that are otherwise treated in local hospitals, and fragmentation in delivery contributes to an inability to meet the large burden of unmet need [87, 88]. The structure of the short-term medical mission itself may be detrimental to sustainability; patients are identified before the surgical team’s arrival, and the large volume of

cases performed often disrupts local infrastructure, even after the team’s departure [40, 89]. Finally, although these platforms create awareness of surgery in the communities that they serve [90, 91], this awareness often can have counterintuitively detrimental effects on local infrastructure: when outcomes are consistently good, awareness influences positive health-seeking behavior in patients. Even the most sporadic bad outcomes, however, seem to discourage care-seeking outright [92]. Despite its ubiquity, the short-term surgical safari appears to have a relatively limited role in the delivery of surgical care. Given potentially unsatisfactory results, detrimental effects on health-seeking behavior, and stress on the local infrastructure, the short-term stand-alone surgical mission, when other options exist, is likely to be inefficient [93]. Self-contained surgical platforms The fact that complex procedures performed by short-term missions can yield unsatisfactory results [65, 66], combined with the fact that most local hospitals also are unable to provide this care consistently [3, 5, 94], leads to an obvious question. While LMICs improve their local infrastructure, how can the interim need be best met? Are specialized surgical hospitals (to be discussed next) the most effective and efficient method, or can a different temporary model, better structured than the short-term mission, provide effective surgical care? Few examples of an intermediate model for surgical delivery exist, but those that do are promising. Mercy Ships, for example, maintains hospital ships, carrying an entire infrastructure (including pathology and radiology [26]), allowing them to provide ophthalmologic, reconstructive, general, orthopedic, and obstetric fistula surgeries [25, 95]. The few studies on the effectiveness of surgical procedures performed by this platform indicate outcomes comparable with those seen in high-income centers [25]. Military organizations adopt a similar model: the U.S. Navy maintains two hospital ships, which report mortality and complication rates that are equivalent to, if not better than, those found in highincome, country hospitals [96–98]. In addition, complex craniofacial surgeries, for which the short-term platform appears ill-suited, appear to be successfully performed by this platform [99]. There have been no cost-effectiveness evaluations of self-contained delivery platforms to date. Specialty surgical hospitals Demand and supply constraints Specialized surgical hospitals are myriad (see Box 2); many evolved from temporary surgical platforms. Cataract

123

World J Surg (2015) 39:10–20

15

surgeries in India, for example, were initially performed in makeshift facilities before their care transferred to specialized hospitals. A population-based study, however, estimates that patients accessing short-term ‘‘eye camps’’ represent a mere 7 % of those in need [100], and current estimates put resource utilization of eye care facilities at 25 % [101]. Research by Browning and Patel, in the setting of obstetric fistula [93], similarly indicates that less than 1 % of surgical need for fistula repair is being met [93]. In Ethiopia alone, an estimated 9,000 women develop an obstetric fistula each year [102, 103]. Similar statements can be made about the unmet need for cardiac surgery, maternity services, and cancer care. Effectiveness Data for specialized surgical hospitals come primarily from ophthalmologic, fistula, and cancer centers [104, 105]. Although publications from specialized surgical hospitals treating other conditions exist, none include objective outcome measures [106, 107]. Evidence for the effectiveness and cost-effectiveness of specialty ophthalmologic hospitals has been presented above [55]; overall, they appear able to deliver high volumes of ophthalmologic surgery effectively [108]. A single publication from an eye hospital in Nigeria, however, reported poor postoperative vision outcomes [109]. Similarly, laparoscopic radical hysterectomy, other obstetric services, and repair of congenital anomalies can both be performed in LMIC specialized hospitals with outcomes similar to those found in the United States [105, 110–113]. Repair of obstetric fistulae is complex. Fistula surgeons are not considered expert until they have performed 300 cases, which may take years in short-term missions or local hospitals [114]. Even expert surgeons deliver closure and continence to only 85 % of patients. Both the Addis Ababa (a charitable organization) and Babbar Ruga (an initiative of the Nigerian government with some external funding) centers, however, report rates of successful fistula closure and return to continence of more than 90 % [115, 116]. Finally, complex surgical conditions, such as obstetric fistula and facial clefting, place specific design demands on the physical facility and require rehabilitative services [102]. While the local or district hospital may meet some of these needs, it must prioritize more life-threatening surgical conditions, making complex repair less likely [117]. In keeping with these findings, a recent expert elicitation study concluded that complicated obstetric fistulae are likely best repaired at high-volume, specialized surgical hospitals [118].

Cost-effectiveness The single published, cross-platform comparison demonstrates the superior cost-effectiveness of permanent NGO hospitals in cataract surgery [55]. One other cost-effectiveness study published on surgery performed in the larger context of a mission hospital showed a beneficial costbenefit ratio [119]. Sustainability and training The Babbar Ruga fistula hospital reports having trained more than 600 fistula surgeons nurses worldwide [116]. Consistent with the above estimates [93], the experience of one author (AS) demonstrates the level of sustainability required for fistula training: the training of two Eritrean fistula surgeons required at least 5 years before competency levels and adequate case numbers were met. This is only possible in specialized platforms.

Discussion Surgical conditions constitute up to 28 % of the global burden of disease, and the current surgical infrastructure in many low-income countries cannot meet all of it. Access to surgical care is low [93, 101, 120], and most hospitals in LMICs do not treat high-DALY conditions [3]. Simultaneously, a rapidly growing, often fragmented charitable sector has stepped in to meet surgical need—a sector that has not been systematically evaluated [87]. Unfortunately, what evaluations have been done may actually promote fragmentation—examining surgical missions in isolation prevents informative similarities and differences from becoming explicit. We propose, instead, structuring evaluations around platforms for the delivery, not around disease types or individual missions. Doing so highlights the relative impact of models that underpin charitable surgery. The overall findings from this systematic review are presented in Table 1. The literature suggests that NGOs deliver surgery by either establishing permanent surgical hospitals or in more temporary platforms—which themselves can be self-contained or can rely on local infrastructure. The available evidence suggests that, despite its ubiquity, the short-term temporary surgical mission’s role should be limited to areas and conditions for which no other surgical delivery platform is available. In these settings, it delivers care efficiently. In settings in which alternative delivery systems exist, however, it appears much less effective [88]: short-term missions may not reach patients with unmet need [93]; risk delivering

123

16 Table 1 Summary of results (see text for further details) Domain Platform Temporary, short-term Effectiveness Cost-effectiveness Poor results for complex procedures; effective for simple procedures Cost-effective if serving as the only platform for surgery; unlikely costeffective otherwise Unlikely sustainable; may have a detrimental impact on healthseeking behaviour Effective for training of developedworld surgeons. Little data on training of LMIC surgeons Temporary, self-contained Potentially equivalent to developed-world outcomes No data

World J Surg (2015) 39:10–20

Surgical specialty hospital Equivalent to developed-world outcomes Most cost-effective of the competing choices

Sustainability

No data

Platform suitable for sustainability

Training

Platform available for training

Definite role for training of LMIC surgeons

Sparse data on this platform limit the certainty of these conclusions

unsatisfactory results, especially around complex reconstructions [53, 65, 66]; often stress the local surgical infrastructure [40]; and may discourage health-seeking behavior [92], all of which undermine its sustainability. In most cost-effectiveness analyses, short-term missions are compared against not providing any surgery and are assumed to be without complication [23, 38, 41, 67]. This overestimates their marginal effectiveness, systematically biasing analyses toward the surgical mission. In analyses in which the short-term platform is compared with other platforms, it becomes less cost-effective [55]. Self-contained temporary platforms are rare, but fit in the negative space between the short-term mission and the specialty hospital. They offer services usually not found in the short-term mission and are able to deliver care
Box 1 MEDLINE search strategy (Surgical Procedures, Operative[MeSH Terms] OR surgery[tiab] OR surgeries[tiab] OR surgical[tiab] OR operative[tiab] OR operating room[tiab] OR operation[tiab] OR cleft lip[tiab] OR cleft palate[tiab] OR eye[tiab] OR congenital[tiab] OR heart[tiab] OR cardiac[tiab] OR vesicovaginal[tiab] OR obstetric fistula[tiab] OR genital fistula[tiab] OR trauma[tiab]) AND (Medical Missions, Official[MeSH Terms] OR Missions and Missionaries[MeSH Terms] OR Mobile Health Units[MeSH Terms] OR Relief Work[MeSH Terms] OR Voluntary Workers[MeSH Terms] OR humanitarian[tiab] OR surgical mission*[tiab] OR missionary[tiab] OR resource limited[tiab] OR low income countr*[tiab] OR middle income countr*[tiab] OR developing countr*[tiab] OR LMIC[tiab]) NOT ‘‘case reports’’[publication type] This search strategy (with appropriate language) also was used for EmBASE

comparable to that found specialty hospitals in both LMICs and high-income countries [25, 26]. Cost-effectiveness studies have yet to be performed on this platform of delivery. Finally, the literature suggests that specialized surgical centers might be effective in providing a high volume of care with good outcomes [115, 116]. Simultaneously, these permanent platforms are able to provide for some of the unique needs faced by patients with more complex conditions [102, 117, 121], and do so sustainably. One costeffectiveness analysis demonstrates their increased efficiency over short-term camps [55], but further cost-effectiveness analyses are necessary. This review is the first to attempt a broad, systematic evaluation of charitable surgical delivery in LMICs, distinct
Box 2 Examples of surgical specialty hospitals working in LMICs Example surgical specialty hospitals working in low-resource settings Cardiac Salam Center, Khartoum, Sudan Narayana Hrudayalaya Hospitals, Bangalore, India Innova Children’s Heart Hospital, Hyderabad, India Ophthalmic ORBIS Aravind Eye Hospitals, Tamilnadu, India LRBT Eye Hospitals, Pakistan Obstetric fistula Babbar Ruga Hospital, Katsina, Nigeria Hamlin Hospital, Addis Ababa, Ethiopia Danja Fistula Center, Danja, Niger Maternity services Life Spring Hospitals, India Cancer: Adayar Cancer Hospital, Chennai, India Tata Memorial Hospital, Mumbai, India

123

World J Surg (2015) 39:10–20

17 Acknowledgments The authors are indebted to Dr. Peggy Lai, Sweta Adhikari, and Dr. Vittoria Lutje for help in the literature search. Conflicts of interest and sources of funding TR is the director of operations of the Aravind Eye Care System. No other financial conflicts of interest are declared. Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.

from the conditions treated and the individual organizations that treat them. As such, it has certain limitations. It should be noted, for example, that any taxonomy is leaky. Some organizations that establish hospitals and send short-term missions trips to other countries, some of the self-contained organizations have themselves established hospitals. That no classification system can adequately characterize any NGO does not, however, mean that research into these organizations must remain fragmented. This taxonomy, leaky though it may be, proposes a structure for future research into a large sector of the health system. The peer-reviewed literature in this area is small, all outcomes studies are case series, and nearly all the costeffectiveness are predicated on relatively heroic assumptions. In addition, although some studies do show less-thanoptimal results, publication bias very likely exists. More importantly, a lack of evidence does not imply evidence of a lack. Many surgeons in LMICs, in addition to surgeons who work with these charitable organizations, have little time to devote to producing peer-reviewed publications. As such, a dearth of evidence exists as to the comparative effectiveness of NGO platforms and local hospitals within the same setting. This dearth highlights the need for further investigation into the effectiveness of surgery as delivered in these settings, as well as the potential role other research methods—such as realist synthesis—in the study of surgical delivery by charities in low- and middle-income countries. Finally, of the domains along which delivery platforms were evaluated (cost-effectiveness, effectiveness, sustainability, and training), the former is controversial, especially given the various platforms used. Some organizations, for example, work entirely with volunteer staff; others pay. As such, these studies must be interpreted with caution.

References
1. (2012) Institute for Health Metrics and Evaluation. Global Burden of Disease, 2010 2. Chao TE, Burdic M, Ganjawalla K et al (2012) Survey of surgery and anesthesia infrastructure in Ethiopia. World J Surg 36:2545–2553. doi:10.1007/s00268-012-1729-3 3. Ilbawi AM, Einterz EM, Nkusu D (2013) Obstacles to surgical services in a rural cameroonian district hospital. World J Surg 37:1208–1215. doi:10.1007/s00268-013-1977-x 4. Knowlton LM, Chackungal S, Dahn B, LeBrun D, Nickerson J, McQueen K (2013) Liberian surgical and anesthesia infrastructure: a survey of county hospitals. World J Surg 37:721– 729. doi:10.1007/s00268-013-1903-2 5. Linden AF, Sekidde FS, Galukande M, Knowlton LM, Chackungal S, McQueen KA (2012) Challenges of surgery in developing countries: a survey of surgical and anesthesia capacity in Uganda’s public hospitals. World J Surg 36:1056–1065. doi:10. 1007/s00268-012-1482-7 6. Casey KM (2007) The global impact of surgical volunteerism. Surg Clin N Am 87:949–960 7. Isaacson G, Drum ET, Cohen MS (2010) Surgical missions to developing countries: Ethical conflicts. Otolaryngol Head Neck Surg 143:476–479 8. Ott BB, Olson RM (2011) Ethical issues of medical missions: the clinicians’ view. HEC Forum 23:105–113 9. Wall LL (2011) Ethical concerns regarding operations by volunteer surgeons on vulnerable patient groups: the case of women with obstetric fistulas. HEC Forum 23:115–127 10. Schneider WJ, Migliori MR, Gosain AK, Gregory G, Flick R (2011) Volunteers in plastic surgery guidelines for providing surgical care for children in the less developed world: part II. Ethical considerations. Plastic Reconstr Surg 128:216e–222e 11. Bai VT, Murali V, Kim R, Srivatsa SK (2007) Teleophthalmology-based rural eye care in India. Telemed J E-Health 13: 313–321 12. Bailie R (1996) An economic appraisal of a mobile cervical cytology screening service. South Afr Med J 86:1179–1184 13. Rodas E, Vicuna A, Merrell RC (2005) Intermittent and mobile surgical services: logistics and outcomes. World J Surg 29:1335–1339. doi:10.1007/s00268-005-7632-4 14. Chu KM, Ford N, Trelles M (2010) Operative mortality in resource-limited settings: the experience of Medecins Sans Frontieres in 13 countries. Arch Surg (Chicago, Ill: 1960) 145: 721–725 15. Nickerson JW, Chackungal S, Knowlton L, McQueen K, Burkle FM (2012) Surgical care during humanitarian crises: a systematic review of published surgical caseload data from foreign medical teams. Prehosp Disaster Med 27:184–189 16. Gil J, Rodriguez JM, Hernandez Q et al (2012) Do hernia operations in international cooperation programmes provide

Conclusions Despite these limitations, the classification scheme in this review allows for the first systematic evaluation of disparate charitable organizations. The charitable sector is large and spends a significant amount of donor money [6]. Limitations in the literature highlight the obvious need for more, and larger, evaluations of the effectiveness and costeffectiveness of this sector’s role in the delivery of surgical care in LMICs. Determining the most effective platform for surgery stands to benefit patients, for whom this is often the only affordable avenue of care, while determining the most cost-effective platform stands also to align donor interests with those of the patients they seek to help. Finally, structuring future research around surgical delivery platforms will help in decreasing the fragmentation found in the nongovernmental world [3].

123

18 good quality? World J Surg 36:2795–2801. doi:10.1007/s00268012-1768-9 Vargas G, Price RR, Sergelen O, Lkhagvabayar B, Batcholuun P, Enkhamagan T (2012) A successful model for laparoscopic training in Mongolia. Int Surg 97:363–371 Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009) Preferred reporting items for systematic reviews and metaanalyses: the PRISMA statement. Ann Int Med 151:264–269 Bermudez L, Carter V, Magee W Jr, Sherman R, Ayala R (2010) Surgical outcomes auditing systems in humanitarian organizations. World J Surg 34:403–410. doi:10.1007/s00268-009-0253-6 Bermudez L, Trost K, Ayala R (2013) Investing in a surgical outcomes auditing system. Plast Surg Int 2013:671786 Magee WP Jr (2010) Evolution of a sustainable surgical delivery model. J Craniofac Surg 21:1321–1326 Magee WP, Raimondi HM, Beers M, Koech MC (2012) Effectiveness of international surgical program model to build local sustainability. Plast Surg Int 2012:185725 Magee WP Jr, Vander Burg R, Hatcher KW (2010) Cleft lip and palate as a cost-effective health care treatment in the developing world. World J Surg 34:420–427. doi:10.1007/s00268-009-0333-7 Cousins GR, Obolensky L, McAllen C, Acharya V, Beebeejaun A (2012) The Kenya orthopaedic project: surgical outcomes of a travelling multidisciplinary team. J Bone Joint Surg Br 94: 1591–1594 Cheng LH, McColl L, Parker G (2012) Thyroid surgery in the UK and on board the Mercy Ships. Br J Oral Maxillofac Surg 50:592–596 Harris RD (2013) Radiology on the Africa Mercy, the largest private floating hospital ship in the world. AJR Am J Roentgenol 200:W124–W129 McQueen KA, Hyder JA, Taira BR, Semer N, Burkle FM Jr, Casey KM (2010) The provision of surgical care by international organizations in developing countries: a preliminary report. World J Surg 34:397–402. doi:10.1007/s00268-009-0181-5 Balent LC, Narendrum K, Patel S, Kar S, Patterson DA (2001) High-volume sutureless intraocular lens surgery in a rural eye camp in India. Ophthalmic Surg Lasers 32:446–455 Civerchia L, Apoorvananda SW, Natchiar G, Balent A, Ramakrishnan R, Green D (1993) Intraocular lens implantation in rural India. Ophthalmic Surg 24:648–652 (discussion 652–643) Civerchia L, Ravindran RD, Apoorvananda SW et al (1996) High-volume intraocular lens surgery in a rural eye camp in India. Ophthalmic Surg Lasers 27:200–208 Kapoor H, Chatterjee A, Daniel R, Foster A (1999) Evaluation of visual outcome of cataract surgery in an Indian eye camp. Br J Ophthalmol 83:343–346 van der Hoek J (1997) Three months follow-up of IOL implantation in remote eye camps in Nepal. Int Ophthalmol 21:195–197 Venkataswamy G (1975) Massive eye relief project in India. Am J Ophthalmol 79:135–140 Lehnerdt G, van Delden A, Lautermann J (2005) Management of an ‘‘Ear Camp’’ for children in Namibia. Int J Pediatr Otorhinolaryngol 69:663–668 Sanders DL, Kingsnorth AN (2007) Operation hernia: humanitarian hernia repairs in Ghana. Hernia 11:389–391 Tefuarani N, Vince J, Hawker R et al (2007) Operation open heart in PNG, 1993-2006. Heart Lung Circ 16:373–377 Rumstadt B, Klein B, Kirr H, Kaltenbach N, Homenu W, Schilling D (2008) Thyroid surgery in Burkina Faso, West Africa: experience from a surgical help program. World J Surg 32:2627–2630. doi:10.1007/s00268-008-9775-6 Gosselin RA, Gialamas G, Atkin DM (2011) Comparing the costeffectiveness of short orthopedic missions in elective and relief situations in developing countries. World J Surg 35:951–955. doi:10.1007/s00268-010-0947-9

World J Surg (2015) 39:10–20 39. Frampton MC (1993) Otological relief work in Romania. J Laryngal Otol 107:1185–1189 40. Nthumba PM (2010) ‘‘Blitz surgery’’: redefining surgical needs, training, and practice in sub-Saharan Africa. World J Surg 34: 433–437. doi:10.1007/s00268-009-0256-3 41. Hodges AM, Hodges SC (2000) A rural cleft project in Uganda. Br J Plast Surg 53:7–11 42. de Buys Roessingh AS, Dolci M, Zbinden-Trichet C, Bossou R, Meyrat BJ, Hohlfeld J (2012) Success and failure for children born with facial clefts in Africa: a 15-year follow-up. World J Surg 36:1963–1969. doi:10.1007/s00268-012-1607-z 43. Haskell A, Rovinsky D, Brown HK, Coughlin RR (2002) The University of California at San Francisco international orthopaedic elective. Clin Orthop Relat Res 396:12–18 44. Ruiz-Razura A, Cronin ED, Navarro CE (2000) Creating longterm benefits in cleft lip and palate volunteer missions. Plast Reconstr Surg 105:195–201 45. Wright IG, Walker IA, Yacoub MH (2007) Specialist surgery in the developing world: luxury or necessity? Anaesthesia 62(Suppl 1): 84–89 46. Yeow VK, Lee ST, Lambrecht TJ et al (2002) International task force on volunteer cleft missions. J Craniofac Surg 13:18–25 47. Birkmeyer JD, Siewers AE, Finlayson EV et al (2002) Hospital volume and surgical mortality in the United States. N Engl J Med 346:1128–1137 48. Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE (2003) Surgeon volume and operative mortality in the United States. N Engl J Med 349:2117–2127 49. Eskander A (2013) Volume-outcome relationships in the surgical management of head and neck cancer in Ontario. Harvard School of Public Health, Toronto 50. Poilleux J, Lobry P (1991) Surgical humanitarian missions. An experience over 18 years. Chirurgie 117:602–606 51. Rodgers A, Walker N, Schug S et al (2000) Reduction of postoperative mortality and morbidity with epidural or spinal anaesthesia: results from overview of randomised trials. BMJ 321:1493 52. Sykes KJ, Le PT, Sale KA, Nicklaus PJ (2012) A 7-year review of the safety of tonsillectomy during short-term medical mission trips. Otolaryngol Head Neck Surg 146:752–756 53. Maine RG, Hoffman WY, Palacios-Martinez JH, Corlew DS, Gregory GA (2012) Comparison of fistula rates after palatoplasty for international and local surgeons on surgical missions in Ecuador with rates at a craniofacial center in the United States. Plast Reconstr Surg 129:319e–326e 54. Furr MC, Larkin E, Blakeley R, Albert TW, Tsugawa L, Weber SM (2011) Extending multidisciplinary management of cleft palate to the developing world. J Oral Maxillofac Surg 69:237–241 55. Singh AJ, Garner P, Floyd K (2000) Cost-effectiveness of public-funded options for cataract surgery in Mysore, India. Lancet 355:180–184 56. Homoe P, Nikoghosyan G, Siim C, Bretlau P (2008) Hearing outcomes after mobile ear surgery for chronic otitis media in Greenland. Int J Circumpolar Health 67:452–460 57. Homoe P, Siim C, Bretlau P (2008) Outcome of mobile ear surgery for chronic otitis media in remote areas. Otolaryngol Head Neck Surg 139:55–61 58. Snidvongs K, Vatanasapt P, Thanaviratananich S, Pothaporn M, Sannikorn P, Supiyaphun P (2010) Outcome of mobile ear surgery units in Thailand. J Laryngal Otol 124:382–386 59. Horlbeck D, Boston M, Balough B et al (2009) Humanitarian otologic missions: long-term surgical results. Otolaryngol Head Neck Surg 140:559–565 60. Barrs DM, Muller SP, Worrndell DB, Weidmann EW (2000) Results of a humanitarian otologic and audiologic project performed outside of the United States: lessons learned from the

17.

18.

19.

20. 21. 22.

23.

24.

25.

26.

27.

28.

29.

30.

31.

32. 33. 34.

35. 36. 37.

38.

123

World J Surg (2015) 39:10–20 ‘‘Oye, Amigos!’’ project. Otolaryngol Head Neck Surg 123: 722–727 Adams C, Kiefer P, Ryan K et al (2012) Humanitarian cardiac care in Arequipa, Peru: experiences of a multidisciplinary Canadian cardiovascular team. Can J Surg 55:171–176 Kim FS, Tran HH, Sinha I et al (2012) Experience with corrective surgery for postburn contractures in Mumbai, India. J Burn Care Res 33:e120–e126 Young S, Lie SA, Hallan G, Zirkle LG, Engesaeter LB, Havelin LI (2011) Low infection rates after 34,361 intramedullary nail operations in 55 low- and middle-income countries: Validation of the Surgical Implant Generation Network (SIGN) Online Surgical Database. Acta Orthop 82:737–743 Young S, Lie SA, Hallan G, Zirkle LG, Engesaeter LB, Havelin LI (2013) Risk factors for infection after 46,113 intramedullary nail operations in low- and middle-income countries. World J Surg 37:349–355. doi:10.1007/s00268-012-1817-4 Marck R, Huijing M, Vest D, Eshete M, Marck K, McGurk M (2010) Early outcome of facial reconstructive surgery abroad: a comparative study. Eur J Plast Surg 33:193–197 Huijing MA, Marck KW, Combes J et al (2011) Facial reconstruction in the developing world: a complicated matter. Br J Oral Maxillofac Surg 49:292–296 Moon W, Perry H, Baek RM (2012) Is international volunteer surgery for cleft lip and cleft palate a cost-effective and justifiable intervention? A case study from East Asia. World J Surg 36:2819–2830. doi:10.1007/s00268-012-1761-3 Hughes CD, Babigian A, McCormack S et al (2012) The clinical and economic impact of a sustained program in global plastic surgery: valuing cleft care in resource-poor settings. Plast Reconstr Surg 130:87e–94e Chen AT, Pedtke A, Kobs JK, Edwards GS Jr, Coughlin RR, Gosselin RA (2012) Volunteer orthopedic surgical trips in Nicaragua: a cost-effectiveness evaluation. World J Surg 36:2802–2808. doi:10.1007/s00268-012-1754-2 Lansingh VC, Carter MJ, Martens M (2007) Global cost-effectiveness of cataract surgery. Ophthalmology 114:1670–1678 Alterman DM, Goldman MH (2008) International volunteerism during general surgical residency: a resident’s experience. J Surg Educ 65:378–383 Aziz SR, Ziccardi VB, Chuang SK (2012) Survey of residents who have participated in humanitarian medical missions. J Oral Maxillofac Surg 70:e147–e157 Belyansky I, Williams KB, Gashti M, Heitmiller RF (2011) Surgical relief work in Haiti: a practical resident learning experience. J Surg Educ 68:213–217 Boyd NH, Cruz RM (2011) The importance of international medical rotations in selection of an otolaryngology residency. J Grad Med Educ 3:414–416 Cameron BH, Rambaran M, Sharma DP, Taylor RH (2010) International surgery: the development of postgraduate surgical training in Guyana. Can J Surg 53:11–16 Campbell A, Sherman R, Magee WP (2010) The role of humanitarian missions in modern surgical training. Plast Reconstr Surg 126:295–302 Campbell A, Sullivan M, Sherman R, Magee WP (2011) The medical mission and modern cultural competency training. J Am Coll Surg 212:124–129 Henry JA, Groen RS, Price RR et al (2013) The benefits of international rotations to resource-limited settings for U.S. surgery residents. Surgery 153:445–454 Hughes C, Wong A, McCormack S et al (2012) International efforts in plastic surgery: the Hartford Hospital, Connecticut Children’s Medical Center and University of Connecticut experience in Ecuador. Connecticut Med 76:19–22

19 80. Hughes C, Zani S, O’Connell B, Daoud I (2010) International surgery and the University of Connecticut experience: lessons from a short-term surgical mission. Connecticut Med 74:157–160 81. Jarman BT, Cogbill TH, Kitowski NJ (2009) Development of an international elective in a general surgery residency. J Surg Educ 66:222–224 82. Lee DK, Weinstein S (2009) International public health in third world country medical missions: when small legs walk, we all stand a little taller. J Am Podiatr Med Assoc 99:371–376 83. Matar WY, Trottier DC, Balaa F, Fairful-Smith R, Moroz P (2012) Surgical residency training and international volunteerism: a national survey of residents from 2 surgical specialties. Can J Surg 55:S191–S199 84. Ozgediz D, Roayaie K, Debas H, Schechter WS, Farmer D (2005) Surgery in developing countries: essential training in residency. Arch Surg (Chicago, Ill: 1960) 140:795–800 85. Ozgediz D, Wang J, Jayaraman S et al (2008) Surgical training and global health: initial results of a 5-year partnership with a surgical training program in a low-income country. Arch Surg (Chicago, Ill: 1960) 143:860–865 discussion 865 86. Riviello R, Lipnick M, Ozgediz D (2011) Medical missions, surgical education, and capacity building. J Am Coll Surg 213:572–574 87. Butler MW (2010) Fragmented international volunteerism: need for a global pediatric surgery network. J Pediatr Surg 45:303–309 88. Cam C, Karateke A, Ozdemir A et al (2010) Fistula campaigns– are they of any benefit? Taiwan J Obstet Gynecol 49:291–296 89. Mitchell KB, Balumuka D, Kotecha V, Said SA, Chandika A (2012) Short-term surgical missions: joining hands with local providers to ensure sustainability. South Afr J Surg 50:2 90. Donkor P, Bankas DO, Agbenorku P, Plange-Rhule G, Ansah SK (2007) Cleft lip and palate surgery in Kumasi, Ghana: 2001-2005. J Craniofac Surg 18:1376–1379 91. Uetani M, Jimba M, Niimi T et al (2006) Effects of a long-term volunteer surgical program in a developing country: the case in Vietnam from 1993 to 2003. Cleft Palate Craniofac J 43:616–619 92. Fletcher A, Donoghue M, Devavaram J et al (1999) Low uptake of eye services in rural India: a challenge for programs of blindness prevention. Arch Ophthalmol 117:1393–1399 93. Browning A, Patel TL (2004) FIGO initiative for the prevention and treatment of vaginal fistula. Int J Gynaecol Obstet 86: 317–322 94. Hsia RY, Mbembati NA, Macfarlane S, Kruk ME (2012) Access to emergency and surgical care in sub-Saharan Africa: the infrastructure gap. Health Policy Plan 27:234–244 95. Lewis G, de Bernis L (2006) Obstetric fistula: guiding principles for clinical management and programme development. Periodical [serial online]. World Health Organization. Accessed 7 July 2013 96. Troup L (2007) The USNS Mercy’s Southeast Asia humanitarian cruise: the perioperative experience. AORN J 86:781–790 97. Walk RM, Donahue TF, Sharpe RP, Safford SD (2011) Three phases of disaster relief in Haiti–pediatric surgical care on board the United States Naval Ship Comfort. J Pediatr Surg 46: 1978–1984 98. Walk RM, Glaser J, Marmon LM, Donahue TF, Bastien J, Safford SD (2012) Continuing promise 2009—assessment of a recent pediatric surgical humanitarian mission. J Pediatr Surg 47:652–657 99. Ray JM, Lindsay RW, Kumar AR (2010) Treatment of earthquake-related craniofacial injuries aboard the USNS Comfort during Operation Unified Response. Plast Reconstr Surg 126: 2102–2108 100. Fletcher A, Vijaykumar V, Selvaraj S, Thulasiraj RD, Ellwein LB (1998) The Madurai Intraocular Lens Study. III: Visual

61.

62.

63.

64.

65.

66.

67.

68.

69.

70. 71.

72.

73.

74.

75.

76.

77.

78.

79.

123

20 functioning and quality of life outcomes. Am J Ophthalmol 125:26–35 World Health Organization (2005) State of the world’s sight: VISION 2020: the right to sight 1999-2005. Periodical [serial online]. Accessed 7 July 2013 Hamlin EC, Muleta M, Kennedy RC (2002) Providing an obstetric fistula service. Br J Urol Int 89:50–53 Muleta M, Rasmussen S, Kiserud T (2010) Obstetric fistula in 14,928 Ethiopian women. Acta Obstet Gynecol Scand 89:945–951 Frajzyngier V, Ruminjo J, Barone MA (2012) Factors influencing urinary fistula repair outcomes in developing countries: a systematic review. Am J Obstet Gynecol 207:248–258 Pareja R, Nick AM, Schmeler KM et al (2012) Quality of laparoscopic radical hysterectomy in developing countries: a comparison of surgical and oncologic outcomes between a comprehensive cancer center in the United States and a cancer center in Colombia. Gynecol Oncol 125:326–329 Reddy SG, Reddy LV, Reddy RR (2009) Developing and standardizing a center to treat cleft and craniofacial anomalies in a developing country like India. J Craniofac Surg 20:1664–1667 Youssef A, Harrison WJ (2010) Establishing a children’s orthopedic hospital for Malawi: an assessment after 5 years. Malawi Med J 22:75–78 Venkatesh R, Muralikrishnan R, Balent LC, Prakash SK, Prajna NV (2005) Outcomes of high volume cataract surgeries in a developing country. Br J Ophthalmol 89:1079–1083 Ezegwui IR, Ajewole J (2009) Monitoring cataract surgical outcome in a Nigerian mission hospital. Int Ophthalmol 29:7–9 Del Rossi C, Attanasio A, Del Curto S, D’Agostino S, De Castro R (2003) Treatment of vaginal atresia at a missionary hospital in Bangladesh: results and followup of 20 cases. J Urol 170: 864–866 Del Rossi C, Attanasio A, Domenichelli V, De Castro R (1999) Treatment of the Mayer-Rokitansky-Kuster-Hauser syndrome in

World J Surg (2015) 39:10–20 Bangladesh: results of 10 total vaginal replacements with sigmoid colon at a missionary hospital. J Urol 162:1138–1139 discussion 1140 Del Rossi C, Fontechiari S, Casolari E, Fainardi V, Caravaggi F, Lombardi L (2008) Treatment of congenital anomalies in a missionary hospital in Bangladesh: results of 17 paediatric surgical missions. Acta Bio Med 79:260–263 Vogel JP, Betran AP, Widmer M et al (2012) Role of faith-based and nongovernment organizations in the provision of obstetric services in 3 African countries. Am J Obstet Gynecol 207:e491–e497 International Federation of Gynecology and Obstetrics (2011) Global competency-based fistula surgery training manual. Periodical [serial online]. Accessed 7 July 2013 Muleta M (1997) Obstetric fistulae: a retrospective study of 1210 cases at the Addis Ababa Fistula Hospital. J Obstet Gynaecol 17:68–70 Waaldijk K (2008) Obstetric fistula surgery: art and science: basics. Waaldijk Wall LL (2007) Where should obstetric vesico-vaginal fistulas be repaired: At the district general hospital or a specialized fistula center? Int J Gynaecol Obstet 99:S28–S31 Colson A, Adhikari S, Sleemi A, Laxminarayan R (2013) Quantifying uncertainty in intervention effectiveness: an application in obstetric fistula Gosselin R, Thind A, Bellardinelli A (2006) Cost/DALY averted in a small hospital in Sierra Leone: what is the relative contribution of different services? World J Surg 30:505–511. doi:10. 1007/s00268-005-0609-5 Brilliant LB, Pokrel RP, Grasset NC et al (1985) Epidemiology of blindness in Nepal. Bull World Health Organ 63:375–386 Wall LL, Arrowsmith SD, Lassey AT, Danso K (2006) Humanitarian ventures or ‘fistula tourism?’: the ethical perils of pelvic surgery in the developing world. Int Urogynecol J Pelvic Floor Dysfunct 17:559–562

101.

112.

102. 103.

113.

104.

114.

105.

115.

116. 117.

106.

107.

118.

108.

119.

109. 110.

120. 121.

111.

123