Shlomo Ta'asan

None of the aforementioned approaches were designed to model the biological aspect of the immune response. Computer based approaches like cellular automata or complex system are the only approaches existing so far, which have the potential to describe adequately such processes. In the context of the immune system, there have been at least two lines of research following that approach. P. Seiden and F. Celada have used cellular automata to capture such processes, (86,87,88,89). The goal was to capture as much as possible of the dynamics of the immune system and to be able to make experiments ex machina. A study of the thymus along similar lines has been developed (77,78). This interesting approach has provided important insights on the regulation of the positive and negative selection, and on the dynamics of production of the TCR repertoire in the thymus.

Partial differential equations as well as ordinary differential equation can be viewed as limits of discrete models. The continuum equations of fluid dynamics or of elasticity can be explained as limiting behavior of atomistic/molecular models as the number of molecules/atoms is large enough. These limiting processes are valid under certain smoothness assumption for the spatial distributions and the presence of enough 'particles'.

Many biological systems involve high levels of heterogeneity and variability, features that raise questions regarding the appropriateness of continuum models. Consider a classical reaction equation between a site S and a ligand L It is a classical result that the concentration, say S, obey an ordinary differential equation. This equation describing the dynamics of concentration is valid under the assumption that the mixture is homogeneous in space, that enough sites S and ligands L exist, and that there is no variability in each type. Considering biochemical reactions happening as part of the immune response, these assumptions are definitely incorrect. The concentration of antigen, for example, is not uniform, and similarly for almost any other population relevant to the immune response. This suggests the use of partial differential equations (PDE) instead of ordinary differential equation (ODE), and in some case it is justified. However, when spatial distributions are not smooth enough or at low levels of concentration even a PDE model breaks down. These observations are relevant when dealing with the immune system. The B-cell population relevant to a given antigen, their variability in terms of affinity to the antigen certainly do not satisfy the requirements for a continuum description, at least at the initial response. Moreover, during the immune response a subpopulation of B cells goes through a significant mutation phase and a single spatial variable cannot capture the right dynamics.

In terms of the immune system such functions may not be not known but they presumably exist. This may be relevant, for example, to distribution functions for the level of expression of cell receptor population. These distribution functions have a single attractor in simple systems. In immune system, due to its complex response patterns, it is likely that a few attractors exist. The evolution of these distribution functions plays a major role in the global dynamics. A possible scenario is that the wandering of the distribution functions among the limit points can be an explanation of the change in character (Th1/Th2), bifurcation or chaos. Therefore, part of the more theoretical study in this work will be geared toward understanding these attracting limits and their role in construction of a macroscopic model.

The tight control over the recognition of foreign pathogens and development of appropriate effector functions is poorly understood at the present time. This is partly due to the fact that, in order to understand how and why a particular response develops, it is becoming necessary to devise experiments that can look at the whole immune system rather than its individual parts. In the past, experimental techniques that isolate the questions of interest have been used. For example, the actions of a particular cytokine can be determined using in vitro experiments with individual cell types and purified cytokines. In addition, the in vivo relevance of the same cytokine can be determined by generating a mouse lacking this cytokine through the targeted disruption of the cytokine gene. These approaches have been extremely successful in determining the functions of individual cytokines or cell surface molecules. These experiments do not, however, allow a true assessment of the relative importance of each molecule in the naturally occurring immune response, in which all of the cells and cytokines are functioning simultaneously. A good example of this is the case of interleukin (IL)-2 which, from in vitro experiments, was thought to be the most important factor driving T cell proliferation (1, 2). It was a surprise, therefore, that IL-2 knockout mice showed little to no impairment of T cell proliferation, but rather appeared to have defects in T cell death, which led to the development of inflammatory bowel disease (3-5). Do these results mean that IL-2 is not an important factor for T cell proliferation in vivo? Probably not: it is likely that, in the normal mouse, IL-2 does play an important role in T cell proliferation, but that the expansion of pathogen-specific T cells is such an important function of the immune system that other mechanisms can be utilized in the event of IL-2 dysfunction.

These, and other similar experiments, point to the flaws in using reductionism experimental techniques to address complex issues of immune regulation and development. There is now an increasing need to understand how the immune system functions as a whole in order to be able to predict outcomes of a particular challenge better, and to potentially devise strategies that could influence particular immune responses. An important concept is that the immune response evolves rapidly in time and its interactions are all highly regulated.

A major difficulty in gaining an insight into different processes in the immune system has to do with the limitation on possible measurements that can be conducted. Measurements affect the system and may hurt its integrity. The most accessible measurements are those involved with blood samples. Although these are easily done, the number of blood samples from a given mouse is limited as it has only 2 ml of blood. Thus, measurements of dynamic processes are very limited. In addition, there are many factors that cannot be measured without killing the animal involved; detailed examination of lymph node which is essential to understand the adaptive response. These and other limitations on the availability of experimental data regarding the system pose challenges to the immunologist that can be overcome only by the use of modeling together with system identification techniques. This is one of the places where the scientific questions of immunology origin are tightly connected to mathematical questions. Given a set of measurements of a certain type, what can we say about the internal structure of the system? How stable is the identifiability process? What is the relation between errors in measurements and errors in parameter estimation? Such questions have been studied in the context of other problems in various sciences. There are mathematical frameworks to deal with them as well as numerical algorithms for fast calculations. We regard this part of the work as a very fundamental to the development. It is only by a tight connection between experimental data, modeling and system identification that one can get hold of the non-measurable aspects of the system, and enables a deeper understanding of the immune system.

There has been relatively little interest in this area, on the part of experimental immunologists, probably due to the complexity of the mathematics necessary for this work and the dearth of mathematicians sufficiently cognizant of the immune system to make such models useful.

Among the unique features of this work is the inclusion of both innate and adaptive systems. This by itself is not enough to tackle the complexity of the system. Mathematical tools which enable us to make connection between models of different types (discrete vs. continuous) will be used; stochastic model, ODE's and PDE's which have been used successfully for different purposes are related to each other through certain limiting processes. Understanding their relation is probably more crucial in biological problems than in other fields due to the natural heterogeneity in such systems.

Our model is stochastic and include the other modeling approaches, as well as specific models using ODE/PDE as limiting cases where certain parameter (population size, for example) is sufficiently large, and certain uniformity exists. Moreover, our model tackles the problem of multitude of scale present in the problem and suggests an effective way to handle it, thus, it is not a mere extension of previous work. While previous work focused on important issues such as affinity maturation, clonal expansion etc, the relation to real experimental data was not emphasized enough. Different models can give qualitative pictures that resemble the experimental data, however, without a quantitative comparison one cannot rule out the possibility of missing crucial factors in the model. Our effort will therefore try to bridge this gap using appropriate techniques described later.

A general way to accelerate computationally intensive simulation
is to identify different scales in the problem (spatial and temporal),
leading to multilevel approaches. This has been applied to many problems
of different types, including solutions of PDE's, optimization techniques,
integral equations, particle simulations and more. Multiscale techniques
answer both the problem of efficient representation as well as the fast
algorithm issues. This was a guideline for us in choosing the proposed
approach. The main model is that of a mesoscale level but its precise definition
comes from interactions with subsystem models. This is needed in order
to have an accurate representation of the complex interaction that take
place in the immune system. It allows the tuning of certain parts of the
mesoscale model as well as to have the right dependencies between different
parts whose behavior depends on some smaller scale 'entities'. A typical
connectivity of such models is given in figure 1 where three levels of
modeling are shown. We believe that at least two will be needed for accurate
model, although a single level on the mesoscale will already give new information.