Dynamic models of immune responses: what is the ideal level of detail?
© Thakar et al; licensee BioMed Central Ltd. 2010
Received: 28 June 2010
Accepted: 20 August 2010
Published: 20 August 2010
One of the goals of computational immunology is to facilitate the study of infectious diseases. Dynamic modeling is a powerful tool to integrate empirical data from independent sources, make novel predictions, and to foresee the gaps in the current knowledge. Dynamic models constructed to study the interactions between pathogens and hosts' immune responses have revealed key regulatory processes in the infection.
Optimum complexity and dynamic modeling
We discuss the usability of various deterministic dynamic modeling approaches to study the progression of infectious diseases. The complexity of these models is dependent on the number of components and the temporal resolution in the model. We comment on the specific use of simple and complex models in the study of the progression of infectious diseases.
Models of sub-systems or simplified immune response can be used to hypothesize phenomena of host-pathogen interactions and to estimate rates and parameters. Nevertheless, to study the pathogenesis of an infection we need to develop models describing the dynamics of the immune components involved in the progression of the disease. Incorporation of the large number and variety of immune processes involved in pathogenesis requires tradeoffs in modeling.
Immune responses encompass a large range of temporal- (millisecond to days) and spatial (molecular to whole body) scales. It is increasingly recognized that intuitive arguments are not sufficient to make sense of this complexity. As an alternative, dynamic models are more and more frequently used to synthesize and complement empirical studies. Many dynamic models lead to valuable insights and predictions. For example, early dynamic models of infections provide a significant insight into the progression of AIDS [1, 2].
Overview of dynamic modeling methods
Dynamic modeling method
Examples in immunology
Pros and cons
Discrete dynamic models
Discrete time and discrete (abstract) state
Modeling of Bordetella infection pathogenesis, T cell receptor signaling
Can deal with many components but the simple state description cannot replicate continuous variation of immune components.
Continuous-discrete hybrid models (e.g. piecewise linear differential equations)
Combination of discrete and continuous state, continuous time
Modeling of infection pathogenesis and pathogen time-courses
The number of components that can be modeled is smaller than in discrete models because of the increase in the number of parameters. The state of the variables may not be directly comparable with experimental measurements. Although there are few parameters per component, parameter estimation becomes an issue for large systems.
Continuous time and state
SIR (Susceptible Infectious and Recovered) models of target cells and pathogens, T cell differentiation
The variables of the model can reproduce the experimentally observed concentrations. Insufficient data to inform the functional forms and parameter values can limit the use of this method. Less scalable than discrete approaches.
Finite state automata (e.g. agent-based models)
Discrete states (abstraction of cell state), discrete space and continuous time
Cell to cell communications
Simplified way to simulate spatial aspects. Can handle a few immune components in detail. Computationally expensive.
Partial differential equations
Continuous time, state and space
Transport of cells across vascular membranes
Appropriate to model a few immune components in detail. Computationally expensive and the determination of parameters is rather difficult.
Given our need to study the dynamics of immune responses to infection across different biological scales, and the limitations posed by the current state of empirical data, here we discuss the applications of simple versus complex models, and explore the use of discrete dynamic models. Excellent reviews of mathematical modeling in immunology  and of modeling multi-scale interactions [9, 10] have already been published.
Models of sub-systems or simplified immune response
Models can be kept relatively simple by detailing a few chosen processes and abstracting others. The number of components that need to be included in the model is reduced by focusing on a sub-system such as T cell expansion or the innate immune response, or by abstracting the immune response.
Dynamic models focusing on sub-systems of the immune response can be used to estimate specific parameters when appropriate empirical data is available. For example, mathematical models of T cell dynamics can be used to estimate T cell decay, production rates , killing rates , and the fate of recently produced T cells . Such parameter estimates assist in the estimation of the in vivo basic reproduction number (R0) of viral infections. They are also useful for studying the efficacy of treatment for viral infections such as HIV [14, 15]. Models revealing the differences in T cell dynamics of mice and humans  are critical in extending the empirical observations from mice to humans. Models tracking the dynamics of virus infection of host cells and cellular innate response, for example type I Interferon, predict the rates of target cell depletion in equine influenza virus infections .
Several dynamic models that simplify the immune response characterize the pathogen behavior in detail. Thus they can be used to determine the optimal conditions for within-host survival of a pathogen. For instance, the limited availability of red blood cells (resource limitation) can explain the early dynamics of malaria . Similar models also reveal the pathogen-induced constraints leading to acute or persistent infections . Although these models are based on assumptions such as correlation between virulence and growth rate of the pathogen [18, 19], they give important insight into pathogenesis.
Models of infection pathogenesis
The complexity of the models increases when they aim to capture multiple components of the immune response, which can include interactions between pathogen and host factors and the subsequent generation of specific antibody and T cell responses. The choice of mathematical description is critical in such instances due to the intricacies it can add or simplify. One example is a quantitative model constructed to simulate the immune response to infections by Mycobacterium tuberculosis (Mtb) [20, 21] that tracks the dynamics of resident macrophages, immature dendritic cells, infected macrophages and mature dendritic cells. The dynamic causality in this model is approximated by mass-action and Michaelis-Menten kinetics. Since there are quantitative estimates available for Mtb (see table 4 in [20, 21]), the model can parameterize the continuous change of immune components as a function of time. The model reveals specific parameters defining the dynamics of the host's immune processes that are important in persistent and acute infections. The simulated dynamics are validated by nonhuman primate data consisting of necropsies of Mtb infected animals .
In the absence of quantitative and mechanistic information, but having assembled a causal interaction network of the intra-cellular and cellular players elucidated by immunologists, a simpler qualitative/semi-qualitative formulation without or with only a few parameters can be followed. This discrete dynamic approach is supported by the observations that regulatory networks maintain their function even when faced with fluctuations in components and reaction rates [23–31]. Various discrete dynamic frameworks including Boolean networks , finite dynamical systems , difference equations , and Petri nets  have been used in modeling biological systems. Particularly, Boolean network models assume that each component has two qualitative states (e.g. active and inactive) and reproduce a sequence of switching events instead of modeling exact time courses. The active qualitative state can be interpreted as the concentration of an immune component that can induce downstream signaling. Such network models, tracking the dynamics of more than 30 immune components including various cytokines and cells, have been constructed for two Bordetella pathogens [6, 7], for which few quantitative parameters have been determined. These models reproduce the qualitative features, such as the number of peaks, of the experimental time-courses of various immune components such as neutrophils and dominant cytokines.
Continuous-discrete hybrid models [7, 36, 37] are also developed with the aim to improve the representation of time while retaining the simplicity of switching functions. These hybrid models have a relatively small number of parameters, such as activation thresholds and decay rates, which are at a higher, more coarse-grained level than the kinetics of elementary reactions. A hybrid Bordetella model  reveals that many parameter combinations are compatible with the existing experimental knowledge on the pathogenesis. The distribution of the parameter values for each immune component in the model tells us about its role in the pathogenesis. Recent experimental measurements validate the IL4 time-course predicted by the model [Pathak, A. K., Creppage, K. E., Werner, J. R., Cattadori, I. M., "Immune regulation of a chronic bacterial infection and consequences for pathogen transmission", submitted].
Since the immune responses involve interactions at the site of infection, the maturation of T and B cells in the lymph nodes and the transport of cells through blood, capturing spatial dynamics may be critical for the success of a model. Approximations at various levels of detail are available that allow for the inclusion of some spatial information in the form of spatial compartments, coarse grids or reaction-diffusion processes. For example, the follow-up models of Mtb and Bordetellae [7, 20] define two compartments, the site of infection (the lung) and the site of T cell differentiation (lymph node). A more detailed approach used by Gammack et. al. [38, 39] describes granuloma formation in Mtb infections with a reaction-diffusion model using partial differential equations and the movement of innate immune cells toward a focal point of Mtb infection with a coarse-grid spatial formulation.
Pros and cons of qualitative and quantitative approaches
The decision to use qualitative or quantitative models is based on the density of observations over time, the number of molecular or cellular players participating in a particular process and the connectivity of the regulatory network formed by these players. We note that both approaches necessitate knowledge of the causal or interaction network among components. Missing data and within-lab variations caused by the use of different experimental systems can introduce uncertainty in the determination of causal relationships; this issue is dealt with by the techniques of reverse engineering . Observations taken at many time-points minimize the uncertainty about the behavior between the observations. The availability of frequent measurements for all or almost all the immune components one wants to model facilitates the use of quantitative modeling. The unavailability of such data guides us to use qualitative models which will inform us about the sequence of events and ultimate outcomes rather than trying to interpolate between the existing sparse observations. The assumption of switch-like regulatory relationships underlying qualitative models is a good approximation if the functional form of the regulatory relationship is sigmoidal.
Qualitative and quantitative approaches detail the immune interactions at different levels. Generally speaking, quantitative models give a detailed description of a relatively small number of interactions whereas qualitative models incorporate more interactions but have fewer kinetic details. Quantitative models offer predictions of kinetic parameters and of how the system will behave at a given instance. Qualitative models predict the response to knock-out or over-expression of components. An effective strategy to bridge these two approaches can be to iteratively refine qualitative models as more quantitative information becomes available through incorporation of more states, using a continuous-discrete hybrid formalism, or a fully quantitative description of an important sub-system.
Quantitative models require substantial prior knowledge and the interactions that require parameterization in these models have not yet been quantitatively characterized for most of the infections. The assumptions and estimations necessary to give values for the parameters may introduce unwanted artifacts in the model, reducing its usefulness. Since many molecular and cellular players of the immune cascades [41, 42] are available for a range of infectious diseases, along with the outcomes of pathogen manipulation experiments, qualitative models can be constructed for less studied infectious diseases giving us insight about the dynamic interplay arising from the complex multi-scale interactions. Qualitative models also lose their simplicity and usefulness if the number of components and interactions included in the network is too large since that dramatically increases the system's dynamic repertoire. Various network simplification methods are available which reduce the number of components, for instance based on shortening long linear paths or collapsing alternative paths between a pair of nodes .
The simple models developed to study parts of the immune system decipher parameters that reveal the regulation of immune responses and allow us to extrapolate the observations from experimental hosts to the natural hosts. The models developed to test the evolutionary fitness of pathogens reveal fundamental characteristics of the host-pathogen interactions and give useful insight into the pathogenesis of the infections. Among the models which aim to describe most of the immune components important in the pathogenesis, we show that both qualitative and quantitative models can be used effectively to study the progression of the infections.
This opinion is an outcome of the discussions at the workshop organized in June 2008 at the Center for Infectious Disease Dynamics. We want to thank all the speakers for their contributions; the list of the speakers can be found at http://www.cidd.psu.edu/calendar/workshops/multi-scale-modeling-of-immune-responses. JT is thankful to the Cancer Research Institute for a postdoctoral fellowship. We are also thankful to the three anonymous reviewers whose comments made this manuscript better in many ways.
- Nowak MA, Anderson RM, McLean AR, Wolfs TF, Goudsmit J, May RM: Antigenic diversity thresholds and the development of AIDS. Science. 1991, 254: 963-969. 10.1126/science.1683006.View ArticlePubMedGoogle Scholar
- Perelson AS, Kirschner DE, De Boer R: Dynamics of HIV infection of CD4+ T cells. Math Biosci. 1993, 114: 81-125. 10.1016/0025-5564(93)90043-A.View ArticlePubMedGoogle Scholar
- Banga JR, Balsa-Canto E: Parameter estimation and optimal experimental design. Essays Biochem. 2008, 45: 195-209. 10.1042/BSE0450195.View ArticlePubMedGoogle Scholar
- Antia R, Yates A, de Roode JC: The dynamics of acute malaria infections. I. Effect of the parasite's red blood cell preference. Proc Biol Sci. 2008, 275: 1449-1458. 10.1098/rspb.2008.0198.PubMed CentralView ArticlePubMedGoogle Scholar
- Ganusov VV, Bergstrom CT, Antia R: Within-host population dynamics and the evolution of microparasites in a heterogeneous host population. Evolution. 2002, 56: 213-223.View ArticlePubMedGoogle Scholar
- Thakar J, Pilione M, Kirimanjeswara G, Harvill ET, Albert R: Modeling Systems-Level Regulation of Host Immune Responses. PLoS Comput Biol. 2007, 3: e109-10.1371/journal.pcbi.0030109.PubMed CentralView ArticlePubMedGoogle Scholar
- Thakar J, Saadatpour A, Harvill ET, Albert R: Constraint Based Network Model of Pathogen-Immune System Interactions. J R Soc Interface. 2009Google Scholar
- Louzoun Y: The evolution of mathematical immunology. Immunol Rev. 2007, 216: 9-20.View ArticlePubMedGoogle Scholar
- Kirschner DE, Linderman JJ: Mathematical and computational approaches can complement experimental studies of host-pathogen interactions. Cell Microbiol. 2009, 11: 531-539. 10.1111/j.1462-5822.2009.01281.x.PubMed CentralView ArticlePubMedGoogle Scholar
- Meier-Schellersheim M, Fraser ID, Klauschen F: Multi-scale modeling in cell biology. Wiley Interdiscip Rev Syst Biol Med. 2009, 1: 4-14. 10.1002/wsbm.33.PubMed CentralView ArticlePubMedGoogle Scholar
- De Boer RJ, Ganusov VV, Milutinovic D, Hodgkin PD, Perelson AS: Estimating lymphocyte division and death rates from CFSE data. Bull Math Biol. 2006, 68: 1011-1031. 10.1007/s11538-006-9094-8.View ArticlePubMedGoogle Scholar
- Ganusov VV, De Boer RJ: Estimating in vivo death rates of targets due to CD8 T-cell-mediated killing. J Virol. 2008, 82: 11749-11757. 10.1128/JVI.01128-08.PubMed CentralView ArticlePubMedGoogle Scholar
- De Boer RJ, Noest AJ: T cell renewal rates, telomerase, and telomere length shortening. J Immunol. 1998, 160: 5832-5837.PubMedGoogle Scholar
- Ribeiro RM, Mohri H, Ho DD, Perelson AS: In vivo dynamics of T cell activation, proliferation, and death in HIV-1 infection: why are CD4+ but not CD8+ T cells depleted?. Proc Natl Acad Sci USA. 2002, 99: 15572-15577. 10.1073/pnas.242358099.PubMed CentralView ArticlePubMedGoogle Scholar
- De Boer RJ: Time scales of CD4+ T cell depletion in HIV infection. PLoS Med. 2007, 4: e193-10.1371/journal.pmed.0040193.PubMed CentralView ArticlePubMedGoogle Scholar
- Vrisekoop N, den Braber I, de Boer AB, Ruiter AF, Ackermans MT, van der Crabben SN, Schrijver EH, Spierenburg G, Sauerwein HP, Hazenberg MD: Sparse production but preferential incorporation of recently produced naive T cells in the human peripheral pool. Proc Natl Acad Sci USA. 2008, 105: 6115-6120. 10.1073/pnas.0709713105.PubMed CentralView ArticlePubMedGoogle Scholar
- Saenz RA, Quinlivan M, Elton D, Macrae S, Blunden AS, Mumford JA, Daly JM, Digard P, Cullinane A, Grenfell BT: Dynamics of influenza virus infection and pathology. J Virol. 84: 3974-3983. 10.1128/JVI.02078-09.Google Scholar
- Antia R, Koella JC, Perrot V: Models of the within-host dynamics of persistent mycobacterial infections. Proc Biol Sci. 1996, 263: 257-263. 10.1098/rspb.1996.0040.View ArticlePubMedGoogle Scholar
- Bonhoeffer S, Barbour AD, De Boer RJ: Procedures for reliable estimation of viral fitness from time-series data. Proc Biol Sci. 2002, 269: 1887-1893. 10.1098/rspb.2002.2097.PubMed CentralView ArticlePubMedGoogle Scholar
- Marino S, Kirschner DE: The human immune response to Mycobacterium tuberculosis in lung and lymph node. J Theor Biol. 2004, 227: 463-486. 10.1016/j.jtbi.2003.11.023.View ArticlePubMedGoogle Scholar
- Wigginton JE, Kirschner D: A model to predict cell-mediated immune regulatory mechanisms during human infection with Mycobacterium tuberculosis. J Immunol. 2001, 166: 1951-1967.View ArticlePubMedGoogle Scholar
- Marino S, Pawar S, Fuller CL, Reinhart TA, Flynn JL, Kirschner DE: Dendritic cell trafficking and antigen presentation in the human immune response to Mycobacterium tuberculosis. J Immunol. 2004, 173: 494-506.View ArticlePubMedGoogle Scholar
- Alon U, Surette MG, Barkai N, Leibler S: Robustness in bacterial chemotaxis. Nature. 1999, 397: 168-171. 10.1038/16483.View ArticlePubMedGoogle Scholar
- Conant GC, Wagner A: Duplicate genes and robustness to transient gene knock-downs in Caenorhabditis elegans. Proc Biol Sci. 2004, 271: 89-96. 10.1098/rspb.2003.2560.PubMed CentralView ArticlePubMedGoogle Scholar
- Csete M, Doyle J: Bow ties, metabolism and disease. Trends Biotechnol. 2004, 22: 446-450. 10.1016/j.tibtech.2004.07.007.View ArticlePubMedGoogle Scholar
- Eldar A, Dorfman R, Weiss D, Ashe H, Shilo BZ, Barkai N: Robustness of the BMP morphogen gradient in Drosophila embryonic patterning. Nature. 2002, 419: 304-308. 10.1038/nature01061.View ArticlePubMedGoogle Scholar
- von Dassow G, Meir E, Munro EM, Odell GM: The segment polarity network is a robust developmental module. Nature. 2000, 406: 188-192. 10.1038/35018085.View ArticlePubMedGoogle Scholar
- Conant GC, Wagner A: Duplicate genes and robustness to transient gene knock-downs in Caenorhabditis elegans. Proc R Soc Lond B Biol Sci. 2004, 271: 89-96. 10.1098/rspb.2003.2560.View ArticleGoogle Scholar
- Csete M, Doyle J: Bow ties, metabolism and disease. Trends in Biotechnology. 2004, 22: 446-450. 10.1016/j.tibtech.2004.07.007.View ArticlePubMedGoogle Scholar
- Fomekong-Nanfack Y, Postma M, Kaandorp JA: Inferring Drosophila gap gene regulatory network: a parameter sensitivity and perturbation analysis. BMC Syst Biol. 2009, 3: 94-10.1186/1752-0509-3-94.PubMed CentralView ArticlePubMedGoogle Scholar
- Alvarez-Buylla ER, Chaos A, Aldana M, Benitez M, Cortes-Poza Y, Espinosa-Soto C, Hartasanchez DA, Lotto RB, Malkin D, Escalera Santos GJ, Padilla-Longoria P: Floral morphogenesis: stochastic explorations of a gene network epigenetic landscape. PLoS One. 2008, 3: e3626-10.1371/journal.pone.0003626.PubMed CentralView ArticlePubMedGoogle Scholar
- Kauffman SA: Metabolic stability and epigenesis in randomly constructed genetic nets. J Theor Biol. 1969, 22: 437-467. 10.1016/0022-5193(69)90015-0.View ArticlePubMedGoogle Scholar
- Jarrah AS, Laubenbacher R: Finite Dynamical Systems: A Mathematical Framework for Computer Simulation. Mathematical Modeling, Simulation, Visualization and e-Learning. Edited by: Konaté D. 2007, Springer Berlin HeidelbergGoogle Scholar
- May RM: Simple mathematical models with very complicated dynamics. Nature. 1976, 261: 459-467. 10.1038/261459a0.View ArticlePubMedGoogle Scholar
- Chaouiya C: Petri net modelling of biological networks. Brief Bioinform. 2007, 8: 210-219. 10.1093/bib/bbm029.View ArticlePubMedGoogle Scholar
- Mendoza L, Xenarios I: A method for the generation of standardized qualitative dynamical systems of regulatory networks. Theor Biol Med Model. 2006, 3: 13-10.1186/1742-4682-3-13.PubMed CentralView ArticlePubMedGoogle Scholar
- Wittmann DM, Krumsiek J, Saez-Rodriguez J, Lauffenburger DA, Klamt S, Theis FJ: Transforming Boolean models to continuous models: methodology and application to T-cell receptor signaling. BMC Syst Biol. 2009, 3: 98-10.1186/1752-0509-3-98.PubMed CentralView ArticlePubMedGoogle Scholar
- Gammack D, Doering CR, Kirschner DE: Macrophage response to Mycobacterium tuberculosis infection. J Math Biol. 2004, 48: 218-242. 10.1007/s00285-003-0232-8.View ArticlePubMedGoogle Scholar
- Gammack D, Ganguli S, Marino S, Segovia-Juarez J, Kirschner DE: Understanding the immune response in tuberculosis using different mathematical models and biological scales. SIAM journal of multiscale modeling and simulation. 2005, 3: 312-345. 10.1137/040603127.View ArticleGoogle Scholar
- Fomekong-Nanfack Y, Postma M, Kaandorp JA: Inferring Drosophila gap gene regulatory network: pattern analysis of simulated gene expression profiles and stability analysis. BMC Res Notes. 2009, 2: 256-10.1186/1756-0500-2-256.PubMed CentralView ArticlePubMedGoogle Scholar
- Harvill ET, Miller JF: Manipulating the host to study bacterial virulence. Curr Opin Microbiol. 2000, 3: 93-96. 10.1016/S1369-5274(99)00057-0.View ArticlePubMedGoogle Scholar
- Randall RE, Goodbourn S: Interferons and viruses: an interplay between induction, signalling, antiviral responses and virus countermeasures. J Gen Virol. 2008, 89: 1-47. 10.1099/vir.0.83391-0.View ArticlePubMedGoogle Scholar
- Kachalo S, Zhang R, Sontag E, Albert R, DasGupta B: NET-SYNTHESIS: a software for synthesis, inference and simplification of signal transduction networks. Bioinformatics. 2008, 24: 293-295. 10.1093/bioinformatics/btm571.View ArticlePubMedGoogle Scholar
- Raman K, Bhat AG, Chandra N: A systems perspective of host-pathogen interactions: predicting disease outcome in tuberculosis. Mol Biosyst. 6: 516-530. 10.1039/b912129c.Google Scholar
- Aldridge BB, Saez-Rodriguez J, Muhlich JL, Sorger PK, Lauffenburger DA: Fuzzy logic analysis of kinase pathway crosstalk in TNF/EGF/insulin-induced signaling. PLoS Comput Biol. 2009, 5: e1000340-10.1371/journal.pcbi.1000340.PubMed CentralView ArticlePubMedGoogle Scholar
- Chaves M, Sontag ED, Albert R: Methods of robustness analysis for Boolean models of gene control networks. Syst Biol (Stevenage). 2006, 153: 154-167.View ArticleGoogle Scholar
- Thieffry D, Thomas R: Dynamical behaviour of biological regulatory networks--II. Immunity control in bacteriophage lambda. Bull Math Biol. 1995, 57: 277-297.PubMedGoogle Scholar
- Celada F, Seiden PE: A computer model of cellular interactions in the immune system. Immunol Today. 1992, 13: 56-62. 10.1016/0167-5699(92)90135-T.View ArticlePubMedGoogle Scholar
- Cohn M, Mata J: Quantitative modeling of immune responses. Immunol Rev. 2007, 216: 5-8.View ArticlePubMedGoogle Scholar
- Efroni S, Harel D, Cohen IR: Emergent dynamics of thymocyte development and lineage determination. PLoS Comput Biol. 2007, 3: e13-10.1371/journal.pcbi.0030013.PubMed CentralView ArticlePubMedGoogle Scholar
- Meier-Schellersheim M, Xu X, Angermann B, Kunkel EJ, Jin T, Germain RN: Key role of local regulation in chemosensing revealed by a new molecular interaction-based modeling method. PLoS Comput Biol. 2006, 2: e82-10.1371/journal.pcbi.0020082.PubMed CentralView ArticlePubMedGoogle Scholar
- Slepchenko BM, Schaff JC, Macara I, Loew LM: Quantitative cell biology with the Virtual Cell. Trends Cell Biol. 2003, 13: 570-576. 10.1016/j.tcb.2003.09.002.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.