# A stochastic model for circadian rhythms from coupled ultradian oscillators

- Roderick Edwards
^{1}Email author, - Richard Gibson
^{1}, - Reinhard Illner
^{1}and - Verner Paetkau
^{2}

**4**:1

https://doi.org/10.1186/1742-4682-4-1

© Edwards et al; licensee BioMed Central Ltd. 2007

**Received: **15 September 2006

**Accepted: **09 January 2007

**Published: **09 January 2007

## Abstract

### Background

Circadian rhythms with varying components exist in organisms ranging from humans to cyanobacteria. A simple evolutionarily plausible mechanism for the origin of such a variety of circadian oscillators, proposed in earlier work, involves the non-disruptive coupling of pre-existing ultradian transcriptional-translational oscillators (TTOs), producing "beats," in individual cells. However, like other TTO models of circadian rhythms, it is important to establish that the inherent stochasticity of the protein binding and unbinding does not invalidate the finding of clear oscillations with circadian period.

### Results

The TTOs of our model are described in two versions: 1) a version in which the activation or inhibition of genes is regulated stochastically, where the 'unoccupied" (or "free") time of the site under consideration depends on the concentration of a protein complex produced by another site, and 2) a deterministic, "time-averaged" version in which the switching between the "free" and "occupied" states of the sites occurs so rapidly that the stochastic effects average out. The second case is proved to emerge from the first in a mathematically rigorous way. Numerical results for both scenarios are presented and compared.

### Conclusion

Our model proves to be robust to the stochasticity of protein binding/unbinding at experimentally determined rates and even at rates several orders of magnitude slower. We have not only confirmed this by numerical simulation, but have shown in a mathematically rigorous way that the time-averaged deterministic system is indeed the fast-binding-rate limit of the full stochastic model.

## Keywords

## Background

We are concerned with mechanisms that can account for circadian rhythms at the cellular level. Although circadian oscillators exist in complex multicellular organisms as well as in single-cell organisms, it is thought that most occur in single cells [1–3]. We have previously [4] described a model for circadian oscillations in which ultradian oscillators, which have been widely observed to occur in living systems, are coupled to produce circadian periods. The model was based, as is much of the related literature, on so-called transcriptional-translational oscillators (TTOs), in which genes are activated or inhibited for transcription by protein products of the oscillating system itself (transcriptional activators or suppressors, respectively). Several models for interactions between more than one oscillator to generate a circadian one have been described [5–7], but ours differs in positing coupling between the protein products of *independent* ultradian oscillators. We argued that our model provides a plausible evolutionary origin for circadian oscillators across a range of organisms, since it allows existing ultradian oscillations to be co-opted as components of circadian oscillators without disturbing their primary functions.

A challenging feature of TTOs is the fact that in cells, a given transcribed gene is present in one, or at most a small number, of copies, and its interaction with a transcriptional regulator is not correctly modeled by deterministic differential equations as used in [4]. Rather, because the number of copies of an expressed gene, and at some times the numbers of transcription factor molecules in a cell is small, such interactions are more accurately described by stochastic equations, and this has been done for a number of existing models [6, 8–10], using a classical algorithm due to Gillespie [11]. In some cases this results in shorter autocorrelation times [8] or random fluctuations [6]. Typically, as for example in reference [9], the effect of the stochasticity is to degrate the circadian oscillations, but for fast enough binding rates, the circadian oscillations are maintained. Our objective here is to apply the stochastic approach to a model similar to the one described in [4]. To do this, we have estimated the rates of association and dissociation of transcription factors from their DNA binding sites. We have then incorporated these rates, together with parameters previously used [4], into the new version of the model, in which the DNA binding steps have been treated as stochastic processes. The subsequent steps of translation and turnover of protein and mRNA have been left as deterministic ones, since the numbers of molecules in these processes are large.

We suggest that if the model is well-behaved with the critical DNA-binding step as a stochastic process, then the remaining steps can be left as deterministic without compromising the reliability of the model. Three quite different time scales arise in the model. The binding and dissociation of the transcription factors to DNA sites occur on a fast time scale, as discussed below. We introduce an (artificial) parameter *ε* with dimensions of *time* to adjust the time scales for these events and to explore the limit *ε* → 0. In our Numerical Tests section we vary *ε*; for several numerical simulations we use a value that corresponds to a relatively high rate of binding and dissociation, as explained in the Model section below. Under these conditions the results are essentially indistinguishable from the simulations for a time-averaged deterministic model which is obtained in the limit *ε* → 0. We subsequently show that the model is well-behaved even for binding rates that are at least 1000-fold slower.

The second significant time scale is given by the periods of the individual ultradian oscillators, which are of the order of a few hours. The critical parameters for these oscillations are those describing the half-lives of mRNA, proteins, and protein complexes. Following our numerical tests, we conduct a brief exploratory analysis of the range of periods of our "primary" oscillators.

The third time scale is, of course, the circadian rhythm time scale, which in our model arises from an interaction of two of the simpler ultradian oscillators of slightly different frequencies. Natural selection could explain why pairs of frequencies leading to the right "beats" have emerged in the course of evolution. In fact, the common occurrence of ultradian oscillators would make it easy for evolution to produce circadian rhythms out of different components in different organisms, as is actually observed [4]. This mechanism has the added advantages of robustness and easy adaptability (the period of the beat will change with minor adjustments of the frequency ratio between the two primary oscillators, but this ratio could stay quite stable even if the parameters involved varied with external conditions such as temperature). A power spectrum analysis presented below demonstrates the robustness of the model with respect to the parameter *ε*. We mention that power spectra could be used to analyze observational data for a potential validation of the model. First steps in this direction were taken in [12].

## The model

Our model involves TTOs contained in a single cell. As described in [4], the model comprises two ultradian "primary" oscillators whose protein products are coupled to drive a circadian rhythm. For simplicity, the two coupled primary oscillators are essentially identical, with only their frequencies different, since the critical feature is the ability to couple TTOs through known molecular processes (formation of transcriptional-regulatory protein heterodimers). Therefore, the key question regarding the ability of a stochastic process to describe stable circadian oscillators can be addressed in terms of one primary oscillator. In this system, two genes (DNA sites) are transcribed into mRNA, and this process is the origin of the following chemical dynamics.

Transcription by gene 1 occurs when site 1 (its regulatory region) is unoccupied. Its state is given by a random variable *X*_{1}, so that

*X*_{1} = 0 if site 1 is empty; *X*_{1} = 1 if site 1 is occupied by *D*_{2} (see below)

When gene 1 is active it produces mRNA (measured in molecules per cell, *R*_{1}) at a constant rate *k*_{13}. These molecules undergo first-order decay with a rate constant *k*_{14}.

The mRNA molecules are translated into protein *P*_{1}, which: (a) decays at rate constant *k*_{16}, (b) forms homodimers *D*_{1} at rate *k*_{17}, and (c) forms heterodimers *D*_{13} with proteins *P*_{3} from a third gene (see below) with a rate constant *k*_{61}.

The homodimer *D*_{1} binds to site 2, and thereby activates the transciption of gene 2. The state of gene 2 is given by the value of a random variable *Y*_{1} so that

*Y*_{1} = 0 if site 2 is empty, and *Y*_{1} = 1 if site 2 is occupied by *D*_{1}.

Transcription of gene 2 and translation of its mRNA into protein *P*_{2}, which forms homodimer *D*_{2}, which in turn feeds back to inhibit gene 1 (above). In addition, the *P*_{2} molecules decay with a certain (biological) half-life.

These linked reactions generate a TTO for an appropriate choice of parameters. The parameters used in our subsequent calculations are listed in Table 1. Our model entails gene 1 being inhibited by homodimer *D*_{2} and gene 2 being activated by homodimer *D*_{1}. This is the mechanism leading to *primary* oscillations.

Parameters. The dimensions are [*k*_{13}] = *hr*^{-1}, [*k*_{14}] = (*nr*. × *hr*)^{-1}, [*k*_{17}] = (*nr*.^{2} × *hr*)^{-1}, [*r*] = 1 etc. We assign [*ε*] = *hr*, so that *r, s*,... become dimensionless

Parameter | Value |
---|---|

| 1800 |

| 3.2 |

| 700 |

| 4 |

| 3.6 × 10 |

| 15 |

| 1400 |

| 10 |

| 5 |

| 500 |

| 0.8 |

| 6.8 × 10 |

| 3 |

| 5 × 10 |

| 0.3 |

| 25 |

| 5000 |

| 5500 |

| 1.125 |

We denote by *R*_{
i
}, *P*_{
i
}, *D*_{
i
}, *i* = 1, 2 the concentrations of the mRNA, the translated protein and the homodimer produced by site *i*. The above scenario is then summarized in the following system of stochastic differential equations (only two of the equations contain the random variables *X*_{1} and *Y*_{1} explicitly, but all dependent variable are then random variables of necessity). The parameters *k*_{13} etc. have the same meaning as in Ref. [4], and we have kept the notation used there; this explains the unconventional numbering (some of the equations from the reference, and hence some of the parameters, are no longer needed).

${{R}^{\prime}}_{1}={k}_{13}(1-{X}_{1})-{k}_{14}{R}_{1}\left(1\right)$

${{P}^{\prime}}_{1}={k}_{15}{R}_{1}-{k}_{16}{P}_{1}-2{k}_{17}{P}_{1}^{2}+2{k}_{18}{D}_{1}-{k}_{61}{P}_{1}{P}_{3}+{k}_{62}{D}_{13}\left(2\right)$

${{D}^{\prime}}_{1}={k}_{17}{P}_{1}^{2}-{k}_{18}{D}_{1}\left(3\right)$

${{R}^{\prime}}_{2}={k}_{13}{Y}_{1}-{k}_{14}{R}_{2}\left(4\right)$

${{P}^{\prime}}_{2}={k}_{25}{R}_{2}-{k}_{16}{P}_{2}-2{k}_{27}{P}_{2}^{2}+2{k}_{28}{D}_{2}\left(5\right)$

${{D}^{\prime}}_{2}={k}_{27}{P}_{2}^{2}-{k}_{28}{D}_{2}\left(6\right)$

The last two terms in the second equation reflect the combination of proteins *P*_{1} and *P*_{3} (which is produced by the second primary oscillator) to form the heterodimer *D*_{13}. This heterodimer in turn breaks down into pairs *P*_{1} and *P*_{3} at rate constant *k*_{62}.

The second primary oscillator is given by a nearly identical set of equations, except that the periods of the oscillations are slightly different. This can, of course, be achieved by changing the parameters in many ways, but the simplest method is to have the two TTOs identical in nature but with different time scales. To do this we simply multiply each right hand side by a fixed constant *δ* > 0, where *δ* is close (but not identical) to one. For example, the first equation of the second oscillator will read

*δ*(

*k*

_{13}(1 -

*X*

_{2}) -

*k*

_{14}

*R*

_{3}).

The parameters chosen reflect, where available, reasonable choices of known molecular processes. The critical ones for establishing the periods of the primary oscillators are the decay times of the mRNAs and proteins. For the former, a half-life of 13–17 minutes and for the latter, 4–17 minutes generate ultradian oscillations in the model. The values used in the simulation are given in Table 1.

The coupling between the two sites communicating in each oscillator is, of course, provided by the random variables *X*_{
i
}, *Y*_{
i
}. The times for which these random variables stay constant are assumed to be exponentially distributed. For example,

*Prob*{*X*_{1} = 0 in (*t, t + h*)|*X*_{1}(*t*) = 0} = exp (-*D*_{2}(*t*)*h*/*ε*) + *o*(*h*),

*Prob*{*X*_{1} = 1 in (*t, t + h*)|*X*_{1}(*t*) = 1} = exp (-*rh*/*ε*) + *o*(*h*)

while

*Prob*{*Y*_{1} = 0 in (*t, t + h*)|*Y*_{1}(*t*) = 0} = exp (-*D*_{1}(*t*)*h*/*ε*) + *o*(*h*),

*Prob*{*Y*_{1} = 1 in (*t, t + h*)|*Y*_{1}(*t*) = 1} = exp (-*st*/*ε*) + *o*(*h*).

Here *ε* is a time scaling parameter, introduced for convenience to exploit the fact that the binding and unbinding of the homodimers occurs on a faster time scale than the remaining processes. The constants *r* and *s* measure, relative to the scale *ε*, the average times for which the sites will remain occupied. As this is an internal parameter of the site it should not depend on the states of the rest of the system (like, for example, the dimer concentrations).

*ε*to gauge the rate constant for binding of the transcriptional-regulatory proteins (D1, D2) to the binding sites on the relevant genes. Experimental work has shown that the second-order rate constant for the binding of transcription-regulating proteins to DNA can be 100 to 1000 times greater than the maximum rate predicted for three-dimensional diffusion [13, 14]. With transcription-regulating protein concentrations measured in molecules/nucleus, using the experimental rate constant for binding of the lac repressor to its cognate DNA [10

^{-10}(Msec)

^{-1}], and assuming that a small eukaryotic nucleus has an effective volume of 40% of its total volume, this suggests a value for

*ε*of 0.10 seconds (2.8 × 10

^{-5}hours). This can be interpreted as the time required for a binding event when Dl or D2 is present at 1 molecule/nucleus. At higher concentrations (of D1 or D2), this time will shorten proportionately. The average "free" time of the binding site for

*D*

_{2}is thus

*ε*/

*D*

_{2}, and the average "occupied" time is

*ε*/

*r*. Their quotient is independent of

*ε*, but will change with the homodimer concentration

*D*

_{2}. Similar interpretations apply for

*X*

_{2}and

*Y*

_{2}and the random variables associated with the second primary oscillator. We have used the value

*ε*= 0.1 sec for producing most of the numerical simulations in our Numerical Tests Section below (Figures 1, 2, 3, 4). However, as shown in Figures 5 and 6, an

*ε*of 1000 times greater value (corresponding to a 1000-fold slower rate of binding) yields effectively the same power spectrum for the circadian model. This is comparable to the observation by Forger and Peskin that in their model for mammalian circadian rhythms the on/off times need to be in the order of seconds.

The average times for which a dimer stays bound (*ε*/*r*, *ε*/*s*, etc.) are independent of the state of the system. In contrast, the "free" times are inversely proportional to the concentration of the attaching homodimer. In one of our simulations we use *r* = 25 and *ε* = 10^{-1}sec (which corresponds to $\frac{\epsilon}{r}=\frac{1}{250}$ sec, or an average of 900,000 binding events per hour). We shall see that the corresponding stochastic simulation compares well with a limiting scenario for which *ε* = 0. Before we describe this limiting scenario in detail we present the remaining equations making up the complete oscillatory system.

As stated earlier, the protein products *P*_{1} and *P*_{3} of the first and second primary oscillators combine to produce the heterodimer *D*_{13}. As formulated in the model, this heterodimer binds to the regulatory site of a fifth gene and activates it for transcription (other constructs, involving other heterodimeric products of the two primary oscillators, and either stimulation or inhibition of transcription of the fifth gene, could also be used). Transcription, translation, and dimerization of the protein product of gene 5 yields the product *D*_{5}, which is the primary circadian output of the model (although all variables show circadian behaviour to a greater or less extent, as seen in the graphical results).

The corresponding system is

${{D}^{\prime}}_{13}={k}_{61}{P}_{1}{P}_{3}-{k}_{62}{D}_{13}\left(7\right)$

${{R}^{\prime}}_{5}={k}_{53}{X}_{3}-{k}_{54}{R}_{5}\left(8\right)$

${{P}^{\prime}}_{5}={k}_{15}{R}_{5}-{k}_{16}{P}_{5}-2{k}_{57}{P}_{5}^{2}+2{k}_{58}{D}_{5}\left(9\right)$

${{D}^{\prime}}_{5}={k}_{57}{P}_{5}^{2}-{k}_{58}{D}_{5},\left(10\right)$

and

$\begin{array}{c}Prob\{{X}_{3}=0\text{in}(t,t+h)|{X}_{3}(t)=0\}=\mathrm{exp}\left(\frac{-{D}_{13}(t)}{\epsilon}h\right)+o(h),\\ Prob\{{X}_{3}=1\text{in}(t,t+h)|{X}_{3}(t)=1\}=\mathrm{exp}\left(\frac{-q}{\epsilon}h\right)+o(h).\end{array}$

## The time-averaged deterministic model

We employ renewal reward theory (see [15]) to derive a system of ordinary differential equations which replaces (1–6) by a "time-averaged" system in the limit *ε* → 0. To this end, note first that if *D*_{2} were independent of time, the time average of *X*_{1}(*t*) over "macroscopic" time intervals (i.e., intervals of scale much larger than *ε*) is $\frac{{D}_{2}}{r+{D}_{2}}$. The corresponding average of 1 - *X*_{1}(*t*) is then $\frac{r}{r+{D}_{2}}$. Renewal reward theory implies that this intuition is mathematically accurate.

Specifically, define a cycle to consist of a period of unoccupied time followed by a period of occupied time. The cycle ends with detachment. The period of unoccupied time is exponentially distributed with mean *ε*/*D*_{2}. Suppose, in the language of renewal reward theory, that no reward is received during this time. The following occupied part of the cycle is exponentially distributed with mean *ε*/*r*, and we assume that the reward associated with this period is exactly equal to the amount of occupied time. Then, by renewal reward theory, the long-term average reward (i.e., the proportion of occupied time) is with probability 1 equal to *E*(*R*)/*E*(*L*) where *E*(*R*) is the expected reward during a cycle and *E*(*L*) is the expected length of a cycle. In the case under consideration

*E*(*R*) = *ε*/*r*, *E*(*L*) = *ε*/*r* + *ε*/*D*_{2},

so the long-term time average of *X*_{1}(*t*) is *D*_{2}/(*r* + *D*_{2}), i.e., lim_{ε→0}*X*_{1ε}(*t*) = $\frac{{D}_{2}}{r+{D}_{2}}$ (here, we denote the random variables *X*_{
i
}as *X*_{
iε
}to emphasize the dependence on *ε*). This time average will hold over any time interval over which *D*_{2} is constant or changes sufficiently slowly. In this time-averaged system Eqns. (1,4) then become

${{R}^{\prime}}_{1}={k}_{13}\frac{r}{r+{D}_{2}}-{k}_{14}{R}_{1}\left(11\right)$

${{R}^{\prime}}_{2}={k}_{13}\frac{{D}_{1}}{s+{D}_{1}}-{k}_{14}{R}_{2}\left(12\right)$

and the remaining equations stay the same. Similarly, Equation (8) becomes

${{R}^{\prime}}_{5}={k}_{53}\frac{{D}_{13}}{(q+{D}_{13})}-{k}_{54}{R}_{5}.$

This intuitive argument is not rigorous. As is transparent from the equations for the primary oscillators, all the dependent variables are random variables with time fluctuations at time scale *ε*. In particular, *D*_{1} and *D*_{2} (and likewise *D*_{3} and *D*_{4}) experience stochastic fluctuations in their third derivatives (${{R}^{\prime}}_{1}$ experiences random jumps, as does ${{P}^{\u2033}}_{1}$, and as does ${{D}^{\u2034}}_{1}$). The integration process involved in the computation of *D*_{
i
}, (*i* = 1, 2) will average out these fluctuations, so that *D*_{
i
}will indeed vary more slowly than, say, *R*_{
i
}. An argument based on the Arzelà-Ascoli Theorem can be used to translate these observations into a mathematical proof.

To this end we denote by *R*_{1ε}, *P*_{1ε}, *D*_{1ε}etc. the solution of (1–6) for some *ε* > 0 and given initial values *R*_{1}(0), *P*_{1}(0),..., and denote by *R*_{1}, *P*_{1}, *D*_{1} etc. the solution of Eqns. (11, 12) ff. for the same initial values.

We prove

**Proposition 1** *Almost surely for all t* > 0,

$\begin{array}{l}\underset{\epsilon \to 0}{\mathrm{lim}}{R}_{1\epsilon}(t)={R}_{1}(t)\\ \underset{\epsilon \to 0}{\mathrm{lim}}{P}_{1\epsilon}(t)={P}_{1}(t)\\ \underset{\epsilon \to 0}{\mathrm{lim}}{D}_{1\epsilon}(t)={D}_{1}(t)\\ \underset{\epsilon \to 0}{\mathrm{lim}}{R}_{2\epsilon}(t)={R}_{2}(t)\end{array}$

*etc*.

*Proof*.

**Step 1**. Consider an arbitrary but fixed time interval [0, *T*] and let (*ε*_{
n
}) be a sequence such that *ε*_{
n
}→ 0 as *n* → ∞. For each *n* we consider a realization, again denoted by *R*_{1ε}etc., of the initial value problem (1–6) ff. with the given fixed initial data.

The resulting functions ${R}_{1{\epsilon}_{n}}$, ${P}_{1{\epsilon}_{n}}$, ${D}_{1{\epsilon}_{n}}$,... all remain bounded and have (uniformly in *ε*) bounded first derivatives on [0, *T*]. By the Arzelà-Ascoli Theorem, there is a convergent subsequence of *ε*_{
n
}, denoted again by *ε*_{
n
}. We denote the limits by ${\tilde{R}}_{1}$, ${\tilde{P}}_{1}$,.... What we show next is that these limits are solutions of the deterministic limit equations (11,12) ff.

**Step 2**. We write *ε* rather than *ε*_{
n
}to simplify the notation. Observe that

${R}_{1\epsilon}(t)={R}_{1}(0){e}^{-{k}_{14}t}+{k}_{13}{\displaystyle {\int}_{0}^{t}(1-{X}_{1\epsilon})(\tau ){e}^{{k}_{14}(\tau -t)}d\tau}$

and

${R}_{1}(t)={R}_{1}(0){e}^{-{k}_{14}t}+{k}_{13}{\displaystyle {\int}_{0}^{t}\frac{r}{r+{D}_{2}(\tau )}}{e}^{{k}_{14}(\tau -t)}d\tau .$

The central step of our proof is showing that ${\tilde{R}}_{1}$ and ${\tilde{D}}_{2}$ are also related by (11). This will follow if we can show that for any differentiable function *f* = *f*(*τ*) and any fixed time interval [*s, t*]

$\underset{\epsilon \to 0}{\mathrm{lim}}{\displaystyle {\int}_{s}^{t}(1-{X}_{1\epsilon})(\tau )f(\tau )}d\tau ={\displaystyle {\int}_{s}^{t}\frac{r}{r+{\tilde{D}}_{2}(\tau )}}f(\tau )d\tau .$

To this end consider a partition {*s, s* +Δ,*s* + 2Δ,..., *s* + *n* Δ = *t*} of [*s, t*], where Δ = $\frac{t-s}{n}$. Then

${\int}_{s}^{t}(1-{X}_{1\epsilon})(\tau )f(\tau )}d\tau ={\displaystyle \sum _{k=0}^{n-1}{\displaystyle {\int}_{s+k\Delta}^{s+(k+1)\Delta}(1-{X}_{1\epsilon})(\tau )f(\tau )}}d\tau .$

On [*s* + *k* Δ, *s* + (*k* + 1)Δ] we have

*f*(*τ*) = *f*(*s* + *k* Δ) + *O*(Δ)

so

${\int}_{s+k\Delta}^{s+(k+1)\Delta}(1-{X}_{1\epsilon})(\tau )f(\tau )}d\tau =[f(s+k\Delta )+O(\Delta )]{\displaystyle {\int}_{s+k\Delta}^{s+(k+1)\Delta}(1-{X}_{1\epsilon})(\tau )}d\tau $

Because of the equicontinuity we have uniformly in *ε*

*D*_{2,ε}(*τ*) = ${\tilde{D}}_{2}$(*s* + *k* Δ) + *O*(Δ) + *μ*(*ε*),

Where *μ*(*ε*) → 0 as *ε* → 0 Hence, by the renewal reward result quoted earlier [15] we have almost surely

$\underset{\epsilon \to 0}{\mathrm{lim}}{\displaystyle {\int}_{s+k\Delta}^{s+(k+1)\Delta}(1-{X}_{1\epsilon})(\tau )f(\tau )}d\tau =\frac{r\Delta}{r+{\tilde{D}}_{2}(s+k\Delta )+O(\Delta )}f(s+k\Delta )+O({\Delta}^{2})$

so

$\underset{\epsilon \to 0}{\mathrm{lim}}{\displaystyle {\int}_{s}^{t}(1-{X}_{1\epsilon})(\tau )f(\tau )}d\tau ={\displaystyle \sum _{k=0}^{n-1}\frac{r}{r+{\tilde{D}}_{2}(s+k\Delta )}}\Delta f(s+k\Delta )+O(\Delta ),$

and in the limit Δ → 0 the right hand side converges to

${\int}_{s}^{t}\frac{r}{r+{\tilde{D}}_{2}(\tau )}f(\tau )}d\tau .$

**Step 3**. The argument in step 2 and similar (but simpler) reasonings for the other dependent variables show that the *R*_{
i
}, *P*_{
i
}and *D*_{
i
}, *i* = 1, 2 and the ${\tilde{R}}_{i}$, ${\tilde{P}}_{i}$ and ${\tilde{D}}_{i}$ are both solutions of the same initial value problem. By unique solvability it follows that these solutions are identical, so for example ${\tilde{R}}_{1}$(*t*) = *R*_{1}(*t*) for all *t*. This uniqueness also implies (by a standard argument) that the passage to a subsequence of the *ε*_{
n
}made earlier is not necessary, but that in fact lim_{ε→0}*R*_{
iε
}(*t*) = *R*_{
i
}(*t*) and likewise for all other dependent variables.

This completes the proof.

**Remark**. This result is only a first step in a possible more complete analysis of the whole process. Specifically, we intend to study the partial differential equations governing the probabilities that the stochastic variables *R*_{
i
}, *P*_{
i
}, *D*_{
i
}assume values in certain ranges, derive the deterministic model given earlier as a set of equations for the first moments of these variables, and proceed to study fluctuations. The nonlinear coupling in our equations makes this a challenging program.

## Numerical tests

Here we present some results of simulations performed with the XPPAUT package (see [16, 17]). The chosen parameters are those from Table 1. Figure 1 shows the time course of the proteins *P*_{1} and *P*_{3} for the deterministic model, which oscillate with a period of about 3 hours but differ slightly in their periods. A slight circadian variation is seen; it is much more promiment in Figure 2, where the responses of the protein products of the fifth DNA site are shown; note the time lag of *D*_{5} with respect to *D*_{13}.

In Figures 3 and 4 the same calculation was done for the stochastic model. This calculation used Gillespie's method [11], where the *ε* was chosen as 2.8 × 10^{-5}*hrs*. The results are essentially identical to the ones for the time-averaged model.

As a control measure we performed some calculations with larger *ε*, for example *ε* = 2.8 × 10^{-3} hrs and *ε* = 0.028 hrs. For the former case, especially, the results were close to the time-averaged simulations. For the latter case, deviations from the time-averaged simulations became noticable: the amplitude of the circadian oscillations in *D*_{5} fluctuated stochastically and their period decreased slightly.

Despite these more significant stochastic effects with larger *ε*, the integrity of the circadian period is remarkably robust in our model with respect to the choice of *ε*. We demonstrate this by computing Fourier power spectra of *D*_{5} time series generated by simulations with *ε* = 2.8 × 10^{-5} and *ε* = 2.8 × 10^{-2} (see Figures 5 and 6). The former was calculated from a time series of 7447 data points at intervals of 1 minute, representing 124.1 hours of real time. The latter was calculated from a time series of 9920 data points at intervals of 10 minutes, representing 1653.2 hours of real time. We chose to integrate for a longer time in the latter case because the circadian oscillations were less regular. The power spectrum is shown in decibels (decibels = 10 log_{10}(power), where power = |*X*_{
i
}|^{2} for *X*_{
i
}, the *i*^{
th
}frequency component of the Fourier transform of the time series {*x*_{
k
}}). The frequencies of the primary oscillators show up clearly in the power spectra at close to 8 and 9 cycles per day respectively, and the circadian oscillations are clearly overwhelmingly dominant at close to (but not exactly) 1 cycle per day in both cases. Even after 65 "days" with *ε* = 0.028, the stochastic oscillator remained in phase with the circadian period; the wave form appeared to persist indefinitely.

## Remarks on the frequencies of the primary oscillators

The fundamental idea of our model is that circadian oscillations can easily be achieved via coupling of faster oscillators. We now address the question of whether the primary oscillators could attain circadian periods without need for coupling within reasonable ranges of parameter values based on known biochemistry. To this end we investigated which (if any) intrinsic limitations there are on the periods of the primary oscillators introduced earlier. We first explored (randomly) variations of the growth parameters *k*_{13}, *k*_{15}, *k*_{17}, etc., and the unbinding rates *r* and *s* to see how they would affect the periods of the time-averaged single primary oscillator

$\begin{array}{c}\frac{d{R}_{1}}{dt}={k}_{13}\frac{r}{r+{D}_{2}}-{k}_{14}{R}_{1}\\ \frac{d{P}_{1}}{dt}={k}_{15}{R}_{1}-{k}_{16}{P}_{1}-2{k}_{17}{P}_{1}^{2}+2{k}_{18}{D}_{1}\\ \frac{d{D}_{1}}{dt}={k}_{17}{P}_{1}^{2}-{k}_{18}{D}_{1}\\ \frac{d{R}_{2}}{dt}={k}_{13}\frac{{D}_{1}}{s+{D}_{1}}-{k}_{14}{R}_{2}\\ \frac{d{P}_{2}}{dt}={k}_{25}{R}_{2}-{k}_{16}{P}_{2}-2{k}_{27}{P}_{2}^{2}+2{k}_{28}{D}_{2}\\ \frac{d{D}_{2}}{dt}={k}_{27}{P}_{2}^{2}-{k}_{28}{D}_{2}\end{array}$

Initially we kept the decay parameters *k*_{14}, *k*_{16}, *k*_{18} fixed and just varied *k*_{13}. This had a modest effect on the period; the longest which was observed was 3.5 hrs. Random experiments of this nature did not produce periods of circadian length.

For a systematic investigation of the dependence of the periods on the parameters, we then set *k*_{25} = *k*_{15}, *k*_{27} = *k*_{17}, *k*_{28} = *k*_{18} and linearized the system about its unique positive equilibrium (*R*_{1E}, *P*_{1E}, *D*_{1E}, *R*_{2E}, *P*_{2E}, *D*_{2E}). The linearization yields the 6-by-6 matrix

$A=\left(\begin{array}{cccccc}-{k}_{14}& 0& 0& 0& 0& \frac{-{k}_{13}r}{{(r+{D}_{2E})}^{2}}\\ {k}_{15}& -{k}_{16}-2{k}_{17}{P}_{1E}& 2{k}_{18}& 0& 0& 0\\ 0& 2{k}_{17}{P}_{1E}& -{k}_{18}& 0& 0& 0\\ 0& 0& \frac{{k}_{13}s}{{(s+{D}_{1E})}^{2}}& -{k}_{14}& 0& 0\\ 0& 0& 0& {k}_{15}& -{k}_{16}-2{k}_{17}{P}_{2E}& 2{k}_{18}\\ 0& 0& 0& 0& 2{k}_{17}{P}_{2E}& -{k}_{18}\end{array}\right)$

Its eigenvalues satisfy det (*A* - *λI*) = 0. This yields the characteristic equation

(*k*_{14} + *λ*)^{2} (*k*_{18} + *λ*)^{2} (*k*_{16} + 2*k*_{17}*P*_{1E}+*λ*) (*k*_{16} + 2*k*_{17}*P*_{2E}+*λ*) + ${c}_{0}^{2}$ = 0. (14)

Here,

${c}_{0}^{2}=\frac{4{k}_{15}^{2}{k}_{17}^{2}{k}_{13}^{2}rs}{{(s+{D}_{1E})}^{2}{(r+{D}_{2E})}^{2}}.$

To identify solutions with longer periods we look for a pair of eigenvalues with positive real part and small imaginary parts. Observe that ${c}_{0}^{2}$ = 0 in (14) produces 6 real and negative eigenvalues (eigenvalues are counted with their multiplicity). If we now increase ${c}_{0}^{2}$, one pair of eigenvalues approaches and eventually crosses the imaginary axis (Hopf bifurcation), producing the oscillations. However, the only way to force the crossing of the imaginary axis at small imaginary value is to move a pair of eigenvalues closer to the imaginary axis to begin with (i.e., when ${c}_{0}^{2}$ = 0).

To achieve this, we first modified the parameter *k*_{17} governing the rate of homodimer formation. However, decreasing *k*_{17} turns out to increase *P*_{1E}, counter-acting attempts to move the crossing pair closer to the real axis.

Finally, the actual rate constant of homodimer decay, *k*_{18}, is not known, although it is unlikely to be smaller than 1 per hour. Choosing it to be exactly 1 per hour (earlier it was set to 15 per hour) we increased the periods up to 9 hours. Setting *k*_{18} this low is probably not reasonable, but given no *a priori* firm bounds as to how small *k*_{18} can actually be (a comment that applies to *k*_{14} and *k*_{16} as well), no simple predictions on the size of the periods of the primary oscillators can be made.

The following set of parameters produces a wavelength of about 22 hours:

*k*_{13} = 1000, *k*_{14} = *k*_{16} = 1, *k*_{15} = 400, *k*_{17} = 10^{-5}, *k*_{18} = 0.25, *r* = 1, *s* = 9000. Thus almost circadian periods can be obtained, but only by stretching parameters beyond biochemically reasonable values.

## Conclusion

We have shown that TTOs in both their stochastic and time-averaged versions produce stable ultradian oscillations for reasonable parameter choices. Although the effect of the stochasticity is to degrade the circadian rhythms as in other models like that of Forger and Peskin [9], these oscillations are nevertheless robust in our model with respect to the scaling parameter governing the dimer-driven stochastic activation or inhibition of the relevant gene sites. Couplings of such TTOs with slight variations in their periods offer a simple mechanism to explain the emergence of circadian rhythms as "beats". This explanation has the added desirable feature of making circadian rhythms readily adaptable to evolutionary pressures.

## Declarations

### Acknowledgements

This work was supported by the University of Victoria and by discovery grants of the Natural Sciences and Engineering Research Council of Canada.

## Authors’ Affiliations

## References

- Dunlap JC: Molecular bases for circadian clocks. Cell. 1999, 96: 271-290. 10.1016/S0092-8674(00)80566-8.View ArticlePubMedGoogle Scholar
- Mihalcescu I, Hsing W, Leibler S: Resilient circadian oscillator revealed in individual cyanobacteria. Nature. 2004, 430: 81-85. 10.1038/nature02533.View ArticlePubMedGoogle Scholar
- Schibler U, Naef F: Cellular oscillators: rhythmic gene expression and metabolism. Curr Opin Cell Biol. 2005, 53: 401-417.Google Scholar
- Edwards R, Illner R, Paetkau V: A model for generating circadian rhythm by coupling ultradian oscillators. Theoretical Biology and Medical Modelling. 2006, 3: 12-10.1186/1742-4682-3-12.PubMed CentralView ArticlePubMedGoogle Scholar
- Barkai N, Leibler S: Circadian clocks limited by noise. Nature. 2000, 403: 267-268.PubMedGoogle Scholar
- Vilar JM, Kueh HY, Barkai N, Leibler S: Mechanisms of noise-resistance in genetic oscillators. Proc Natl Acad Sci USA. 2002, 99: 5988-5992. 10.1073/pnas.092133899.PubMed CentralView ArticlePubMedGoogle Scholar
- Leloup JC, Goldbeter A: Toward a detailed computational model for the mammalian circadian clock. Proc Natl Acad Sci USA. 2003, 100: 7051-7056. 10.1073/pnas.1132112100.PubMed CentralView ArticlePubMedGoogle Scholar
- Elowitz MB, Leibler S: A synthetic oscillatory network of transciptional regulators. Nature. 2000, 403: 335-338. 10.1038/35002125.View ArticlePubMedGoogle Scholar
- Forger DB, Peskin CS: Stochastic simulation of the mammalian circadian clock. Proc Nat Acad Sci. 2005, 102: 321-324. 10.1073/pnas.0408465102.PubMed CentralView ArticlePubMedGoogle Scholar
- Gonze D, Halloy J, Leloup JC, Goldbeter A: Stochastic models for circadian rhythms: effect of molecular noise on periodic and chapotic behaviour. C R Biol. 2003, 326: 189-203.View ArticlePubMedGoogle Scholar
- Gillespie DT: Exact stochastic simulation of coupled chemical-reactions. J Phys Chem. 1977, 81: 2340-2361. 10.1021/j100540a008.View ArticleGoogle Scholar
- Dowse HB, Ringo JM: Further evidence that the circadian clock in Drosophila is a population of coupled ultradian oscillators. Journal of Biological Rhythms. 1987, 2: 65-76.View ArticlePubMedGoogle Scholar
- Riggs AD, Bourgeois S, Cohn M: The lac represser-operator interaction. 3. Kinetic studies. J Mol Biol. 1970, 53: 401-417. 10.1016/0022-2836(70)90074-4.View ArticlePubMedGoogle Scholar
- Berg OG, Winter RB, von Hippel PH: Diffusion-driven mechanisms of protein translocation on nucelic acids. 1. Models and theory. Biochemistry. 1981, 20: 6929-6948. 10.1021/bi00527a028.View ArticlePubMedGoogle Scholar
- Ross SM: Introduction to Probability Models. 1989, New York: Academic Press, 4Google Scholar
- Ermentrout B: Simulating, analyzing, and animating dynamical systems: A guide to XPPAUT for researchers and students. 2002, Philadelphia: SIAMView ArticleGoogle Scholar
- XPP-Aut. 2002,http://www.math.pitt.edu/~bard/xpp/xpp.html

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.