Using Observational Data to Calibrate Simulation Models

DSpace/Manakin Repository

Using Observational Data to Calibrate Simulation Models

Citable link to this page


Title: Using Observational Data to Calibrate Simulation Models
Author: Murray, Eleanor Jane ORCID  0000-0003-0043-4901 ; Robins, James M.; Seage, George R.; Lodi, Sara; Hyle, Emily Parker; Reddy, Krishna Podditur; Freedberg, Kenneth Alan; Hernan, Miguel Angel

Note: Order does not necessarily reflect citation order of authors.

Citation: Murray, Eleanor J., James M. Robins, George R. Seage, Sara Lodi, Emily P. Hyle, Krishna P. Reddy, Kenneth A. Freedberg, and Miguel A. Hernán. 2017. “Using Observational Data to Calibrate Simulation Models.” Medical Decision Making (November 15): 0272989X1773875. doi:10.1177/0272989x17738753.
Full Text & Related Files:
Individual-level simulation models are valuable tools for comparing the impact of clinical or public health interventions on population health and cost outcomes over time. However, a key challenge is ensuring that outcome estimates correctly reflect real-world impacts. Calibration to targets obtained from randomized trials may be insufficient if trials do not exist for populations, time periods, or interventions of interest. Observational data can provide a wider range of calibration targets but requires methods to adjust for treatment-confounder feedback. We propose the use of the parametric g-formula to estimate calibration targets and present a case-study to demonstrate its application.

We used the parametric g-formula applied to data from the HIV-CAUSAL Collaboration to estimate calibration targets for 7-y risks of AIDS and/or death (AIDS/death), as defined by the Center for Disease Control and Prevention under 3 treatment initiation strategies. We compared these targets to projections from the Cost-Effectiveness of Preventing AIDS Complications (CEPAC) model for treatment-naïve individuals presenting to care in the following year ranges: 1996 to 1999, 2000 to 2002, or 2003 onwards.

The parametric g-formula estimated a decreased risk of AIDS/death over time and with earlier treatment. The uncalibrated CEPAC model successfully reproduced targets obtained via the g-formula for baseline 1996 to 1999, but over-estimated calibration targets in contemporary populations and failed to reproduce time trends in AIDS/death risk. Calibration to g-formula targets improved CEPAC model fit for contemporary populations.

Individual-level simulation models are developed based on best available information about disease processes in one or more populations of interest, but these processes can change over time or between populations. The parametric g-formula provides a method for using observational data to obtain valid calibration targets and enables updating of simulation model inputs when randomized trials are not available.
Published Version: 10.1177/0272989X17738753
Other Sources:
Terms of Use: This article is made available under the terms and conditions applicable to Open Access Policy Articles, as set forth at
Citable link to this page:
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search