Evaluation of an Automated Safety Surveillance System Using Risk Adjusted Sequential Probability Ratio Testing

DSpace/Manakin Repository

Evaluation of an Automated Safety Surveillance System Using Risk Adjusted Sequential Probability Ratio Testing

Citable link to this page


Title: Evaluation of an Automated Safety Surveillance System Using Risk Adjusted Sequential Probability Ratio Testing
Author: Matheny, Michael E; Marinac-Dabic, Danica; Loyo-Berrios, Nilsa; Vidi, Venkatesan D; Donnelly, Sharon; Normand, Sharon-Lise Teresa; Gross, Thomas; Resnic, Frederic S.

Note: Order does not necessarily reflect citation order of authors.

Citation: Matheny, Michael E., Sharon-Lise T. Normand, Thomas P. Gross, Danica Marinac-Dabic, Nilsa Loyo-Berrios, Venkatesan D. Vidi, Sharon Donnelly, and Frederic S. Resnic. 2011. Evaluation of an automated safety surveillance system using risk adjusted sequential probability ratio testing. BMC Medical Informatics and Decision Making 11:75.
Full Text & Related Files:
Abstract: Background: Automated adverse outcome surveillance tools and methods have potential utility in quality improvement and medical product surveillance activities. Their use for assessing hospital performance on the basis of patient outcomes has received little attention. We compared risk-adjusted sequential probability ratio testing (RA-SPRT) implemented in an automated tool to Massachusetts public reports of 30-day mortality after isolated coronary artery bypass graft surgery. Methods A total of 23,020 isolated adult coronary artery bypass surgery admissions performed in Massachusetts hospitals between January 1, 2002 and September 30, 2007 were retrospectively re-evaluated. The RA-SPRT method was implemented within an automated surveillance tool to identify hospital outliers in yearly increments. We used an overall type I error rate of 0.05, an overall type II error rate of 0.10, and a threshold that signaled if the odds of dying 30-days after surgery was at least twice than expected. Annual hospital outlier status, based on the state-reported classification, was considered the gold standard. An event was defined as at least one occurrence of a higher-than-expected hospital mortality rate during a given year. Results: We examined a total of 83 hospital-year observations. The RA-SPRT method alerted 6 events among three hospitals for 30-day mortality compared with 5 events among two hospitals using the state public reports, yielding a sensitivity of 100% (5/5) and specificity of 98.8% (79/80). Conclusions: The automated RA-SPRT method performed well, detecting all of the true institutional outliers with a small false positive alerting rate. Such a system could provide confidential automated notification to local institutions in advance of public reporting providing opportunities for earlier quality improvement interventions.
Published Version: doi:10.1186/1472-6947-11-75
Other Sources: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3262755/pdf/
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:10288672
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search