Person:

Sorger, Peter

Background: Systems biology has embraced computational modeling in response to the quantitative nature and increasing scale of contemporary data sets. The onslaught of data is accelerating as molecular profiling technology evolves. The Dialogue for Reverse Engineering Assessments and Methods (DREAM) is a community effort to catalyze discussion about the design, application, and assessment of systems biology models through annual reverse-engineering challenges. Methodology and Principal Findings: We describe our assessments of the four challenges associated with the third DREAM conference which came to be known as the DREAM3 challenges: signaling cascade identification, signaling response prediction, gene expression prediction, and the DREAM3 in silico network challenge. The challenges, based on anonymized data sets, tested participants in network inference and prediction of measurements. Forty teams submitted 413 predicted networks and measurement test sets. Overall, a handful of best-performer teams were identified, while a majority of teams made predictions that were equivalent to random. Counterintuitively, combining the predictions of multiple teams (including the weaker teams) can in some cases improve predictive power beyond that of any single method. Conclusions: DREAM provides valuable feedback to practitioners of systems biology modeling. Lessons learned from the predictions of the community provide much-needed context for interpreting claims of efficacy of algorithms described in the scientific literature.

Stochastic fluctuations in gene expression give rise to cell-to-cell variability in protein levels which can potentially cause variability in cellular phenotype. For TRAIL (TNF-related apoptosis-inducing ligand) variability manifests itself as dramatic differences in the time between ligand exposure and the sudden activation of the effector caspases that kill cells. However, the contribution of individual proteins to phenotypic variability has not been explored in detail. In this paper we use feature-based sensitivity analysis as a means to estimate the impact of variation in key apoptosis regulators on variability in the dynamics of cell death. We use Monte Carlo sampling from measured protein concentration distributions in combination with a previously validated ordinary differential equation model of apoptosis to simulate the dynamics of receptor-mediated apoptosis. We find that variation in the concentrations of some proteins matters much more than variation in others and that precisely which proteins matter depends both on the concentrations of other proteins and on whether correlations in protein levels are taken into account. A prediction from simulation that we confirm experimentally is that variability in fate is sensitive to even small increases in the levels of Bcl-2. We also show that sensitivity to Bcl-2 levels is itself sensitive to the levels of interacting proteins. The contextual dependency is implicit in the mathematical formulation of sensitivity, but our data show that it is also important for biologically relevant parameter values. Our work provides a conceptual and practical means to study and understand the impact of cell-to-cell variability in protein expression levels on cell fate using deterministic models and sampling from parameter distributions.

Background: Kinetochores attach sister chromatids to microtubules of the mitotic spindle and orchestrate chromosome disjunction at anaphase. Although S. cerevisiae has the simplest known kinetochores, they nonetheless contain ∼70 subunits that assemble on centromeric DNA in a hierarchical manner. Developing an accurate picture of the DNA-binding, linker and microtubule-binding layers of kinetochores, including the functions of individual proteins in these layers, is a key challenge in the field of yeast chromosome segregation. Moreover, comparison of orthologous proteins in yeast and humans promises to extend insight obtained from the study of simple fungal kinetochores to complex animal cell kinetochores. Principal Findings: We show that S. cerevisiae Spc105p forms a heterotrimeric complex with Kre28p, the likely orthologue of the metazoan kinetochore protein Zwint-1. Through systematic analysis of interdependencies among kinetochore complexes, focused on Spc105p/Kre28p, we develop a comprehensive picture of the assembly hierarchy of budding yeast kinetochores. We find Spc105p/Kre28p to comprise the third linker complex that, along with the Ndc80 and MIND linker complexes, is responsible for bridging between centromeric heterochromatin and kinetochore MAPs and motors. Like the Ndc80 complex, Spc105p/Kre28p is also essential for kinetochore binding by components of the spindle assembly checkpoint. Moreover, these functions are conserved in human cells. Conclusions/Significance: Spc105p/Kre28p is the last of the core linker complexes to be analyzed in yeast and we show it to be required for kinetochore binding by a discrete subset of kMAPs (Bim1p, Bik1p, Slk19p) and motors (Cin8p, Kar3p), all of which are nonessential. Strikingly, dissociation of these proteins from kinetochores prevents bipolar attachment, even though the Ndc80 and DASH complexes, the two best-studied kMAPs, are still present. The failure of Spc105 deficient kinetochores to bind correctly to spindle microtubules and to recruit checkpoint proteins in yeast and human cells explains the observed severity of missegregation phenotypes.

Mathematical equations are fundamental to modeling biological networks, but as networks get large and revisions frequent, it becomes difficult to manage equations directly or to combine previously developed models. Multiple simultaneous efforts to create graphical standards, rule-based languages, and integrated software workbenches aim to simplify biological modeling but none fully meets the need for transparent, extensible, and reusable models. In this paper we describe PySB, an approach in which models are not only created using programs, they are programs. PySB draws on programmatic modeling concepts from little b and ProMot, the rule-based languages BioNetGen and Kappa and the growing library of Python numerical tools. Central to PySB is a library of macros encoding familiar biochemical actions such as binding, catalysis, and polymerization, making it possible to use a high-level, action-oriented vocabulary to construct detailed models. As Python programs, PySB models leverage tools and practices from the open-source software community, substantially advancing our ability to distribute and manage the work of testing biochemical hypotheses. We illustrate these ideas using new and previously published models of apoptosis.

Using models to simulate and analyze biological networks requires principled approaches to parameter estimation and model discrimination. We use Bayesian and Monte Carlo methods to recover the full probability distributions of free parameters (initial protein concentrations and rate constants) for mass-action models of receptor-mediated cell death. The width of the individual parameter distributions is largely determined by non-identifiability but covariation among parameters, even those that are poorly determined, encodes essential information. Knowledge of joint parameter distributions makes it possible to compute the uncertainty of model-based predictions whereas ignoring it (e.g., by treating parameters as a simple list of values and variances) yields nonsensical predictions. Computing the Bayes factor from joint distributions yields the odds ratio (∼20-fold) for competing ‘direct' and ‘indirect' apoptosis models having different numbers of parameters. Our results illustrate how Bayesian approaches to model calibration and discrimination combined with single-cell data represent a generally useful and rigorous approach to discriminate between competing hypotheses in the face of parametric and topological uncertainty.

Predictive understanding of cell signaling network operation based on general prior knowledge but consistent with empirical data in a specific environmental context is a current challenge in computational biology. Recent work has demonstrated that Boolean logic can be used to create context-specific network models by training proteomic pathway maps to dedicated biochemical data; however, the Boolean formalism is restricted to characterizing protein species as either fully active or inactive. To advance beyond this limitation, we propose a novel form of fuzzy logic sufficiently flexible to model quantitative data but also sufficiently simple to efficiently construct models by training pathway maps on dedicated experimental measurements. Our new approach, termed constrained fuzzy logic (cFL), converts a prior knowledge network (obtained from literature or interactome databases) into a computable model that describes graded values of protein activation across multiple pathways. We train a cFL-converted network to experimental data describing hepatocytic protein activation by inflammatory cytokines and demonstrate the application of the resultant trained models for three important purposes: (a) generating experimentally testable biological hypotheses concerning pathway crosstalk, (b) establishing capability for quantitative prediction of protein activity, and (c) prediction and understanding of the cytokine release phenotypic response. Our methodology systematically and quantitatively trains a protein pathway map summarizing curated literature to context-specific biochemical data. This process generates a computable model yielding successful prediction of new test data and offering biological insight into complex datasets that are difficult to fully analyze by intuition alone.

When modeling cell signaling networks, a balance must be struck between mechanistic detail and ease of interpretation. In this paper we apply a fuzzy logic framework to the analysis of a large, systematic dataset describing the dynamics of cell signaling downstream of TNF, EGF, and insulin receptors in human colon carcinoma cells. Simulations based on fuzzy logic recapitulate most features of the data and generate several predictions involving pathway crosstalk and regulation. We uncover a relationship between MK2 and ERK pathways that might account for the previously identified pro-survival influence of MK2. We also find unexpected inhibition of IKK following EGF treatment, possibly due to down-regulation of autocrine signaling. More generally, fuzzy logic models are flexible, able to incorporate qualitative and noisy data, and powerful enough to produce quantitative predictions and new biological insights about the operation of signaling networks.

Receptor-mediated apoptosis proceeds via two pathways: one requiring only a cascade of initiator and effector caspases (type I behavior) and the second requiring an initiator–effector caspase cascade and mitochondrial outer membrane permeabilization (type II behavior). Here, we investigate factors controlling type I versus II phenotypes by performing Lyapunov exponent analysis of an ODE-based model of cell death. The resulting phase diagrams predict that the ratio of XIAP to pro-caspase-3 concentrations plays a key regulatory role: type I behavior predominates when the ratio is low and type II behavior when the ratio is high. Cell-to-cell variability in phenotype is observed when the ratio is close to the type I versus II boundary. By positioning multiple tumor cell lines on the phase diagram we confirm these predictions. We also extend phase space analysis to mutations affecting the rate of caspase-3 ubiquitylation by XIAP, predicting and showing that such mutations abolish all-or-none control over activation of effector caspases. Thus, phase diagrams derived from Lyapunov exponent analysis represent a means to study multi-factorial control over a complex biochemical pathway.

Background: Understanding the information-processing capabilities of signal transduction networks, how those networks are disrupted in disease, and rationally designing therapies to manipulate diseased states require systematic and accurate reconstruction of network topology. Data on networks central to human physiology, such as the inflammatory signalling networks analyzed here, are found in a multiplicity of on-line resources of pathway and interactome databases (Cancer CellMap, GeneGo, KEGG, NCI-Pathway Interactome Database (NCI-PID), PANTHER, Reactome, I2D, and STRING). We sought to determine whether these databases contain overlapping information and whether they can be used to construct high reliability prior knowledge networks for subsequent modeling of experimental data. Results: We have assembled an ensemble network from multiple on-line sources representing a significant portion of all machine-readable and reconcilable human knowledge on proteins and protein interactions involved in inflammation. This ensemble network has many features expected of complex signalling networks assembled from high-throughput data: a power law distribution of both node degree and edge annotations, and topological features of a “bow tie” architecture in which diverse pathways converge on a highly conserved set of enzymatic cascades focused around PI3K/AKT, MAPK/ERK, JAK/STAT, NFκB, and apoptotic signaling. Individual pathways exhibit “fuzzy” modularity that is statistically significant but still involving a majority of “cross-talk” interactions. However, we find that the most widely used pathway databases are highly inconsistent with respect to the actual constituents and interactions in this network. Using a set of growth factor signalling networks as examples (epidermal growth factor, transforming growth factor-beta, tumor necrosis factor, and wingless), we find a multiplicity of network topologies in which receptors couple to downstream components through myriad alternate paths. Many of these paths are inconsistent with well-established mechanistic features of signalling networks, such as a requirement for a transmembrane receptor in sensing extracellular ligands. Conclusions: Wide inconsistencies among interaction databases, pathway annotations, and the numbers and identities of nodes associated with a given pathway pose a major challenge for deriving causal and mechanistic insight from network graphs. We speculate that these inconsistencies are at least partially attributable to cell, and context-specificity of cellular signal transduction, which is largely unaccounted for in available databases, but the absence of standardized vocabularies is an additional confounding factor. As a result of discrepant annotations, it is very difficult to identify biologically meaningful pathways from interactome networks a priori. However, by incorporating prior knowledge, it is possible to successively build out network complexity with high confidence from a simple linear signal transduction scaffold. Such reduced complexity networks appear suitable for use in mechanistic models while being richer and better justified than the simple linear pathways usually depicted in diagrams of signal transduction.

Chromosome instability (CIN) is deleterious to normal cells because of the burden of aneuploidy. However, most human solid tumors have an abnormal karyotype implying that gain and loss of chromosomes by cancer cells confers a selective advantage. CIN can be induced in the mouse by inactivating the spindle assembly checkpoint. This is lethal in the germline but we show here that adult T cells and hepatocytes can survive conditional inactivation of the Mad2l1 SAC gene and resulting CIN. This causes rapid onset of acute lymphoblastic leukemia (T-ALL) and progressive development of hepatocellular carcinoma (HCC), both lethal diseases. The resulting DNA copy number variation and patterns of chromosome loss and gain are tumor-type specific, suggesting differential selective pressures on the two tumor cell types. DOI: http://dx.doi.org/10.7554/eLife.20873.001