Start the Lorenz equations at two states that differ by one part in a billion. The two computed solutions agree closely for a while and then end up in completely different places, although the equations contain no randomness at all. Is that already chaos, and what exactly has been shown? This lesson separates three kinds of statement about such a system. Some facts, such as its equilibria and the rate at which it shrinks volume, can be checked exactly, numerical solutions supply evidence about sensitive dependence, and a claim of chaos needs a definition and a proof of its own.
Key terms
Sensitive dependence on initial conditions
Definition Consider an autonomous system , where is time, the dot means , the state lies in and is continuously differentiable. Each initial state then has exactly one solution, and denotes the state at time of the solution with . Let be a set of states whose solutions exist and stay in for all . The system has sensitive dependence on initial conditions on if there is a distance with the following property. For every in and every there are a state in with and a time with
This does not conflict with determinism, because each exact state still has exactly one future. It limits prediction instead. If small errors grow roughly like with , an initial error reaches a size after a time of about
so each tenfold improvement in the initial data extends this prediction horizon by only .
In plain words No matter how closely you look around a starting state, some start nearby eventually leads to a state at least a fixed distance from where the original solution is at that moment. The equation still decides the future exactly, but a measured start is never exact, so detailed prediction runs out after a finite time.
Example Instability alone already gives sensitive dependence. For on the flow is , so two starts a distance apart are apart at time , and every works. Yet every solution is a plain exponential, and nothing about this equation is chaotic. A stable cycle behaves the other way. In polar coordinates the system , carries every point of the unit circle around at the same angular speed, so two points on the circle keep their distance forever and there is no sensitive dependence on the circle. For the classical Lorenz system below, numerical estimates give a growth rate , so each extra correct digit in the start adds only about time units to the horizon.
Lorenz system
Definition With as time and a dot for , the Lorenz system for the state is
with constant parameters . The classical values are , and . The right side is a polynomial, so each initial state has exactly one solution, and the only nonlinear terms are and . Replacing by carries solutions to solutions. The origin is an equilibrium for every choice of parameters. For it is the only one, and for there are exactly two more,
The system also contracts volume. In general, for with continuously differentiable, carry a bounded region of initial states along the solutions, let be the region they fill at time , and let be its volume. While these solutions exist,
where is the volume element. So a region loses volume while the divergence is negative throughout it, and the flow contracts volume when the divergence is negative everywhere. For the Lorenz field the divergence is the constant , and therefore
In plain words The system couples three rates through just two product terms, and it has a built-in squeeze. Any blob of starting states loses volume at the same exponential rate wherever it is, even while it is being stretched in some direction.
Example Take the classical values. At an equilibrium the first equation gives , and the second then reads . Both cases must be kept, so do not divide by . If , then and the third equation gives , the origin. If , then and the third equation becomes , so . Substituting gives , then , then , and changing the signs of and together leaves all three checks intact. At the origin the Jacobian matrix is
Its upper left block has characteristic polynomial , so the eigenvalues are
about , and . One direction stretches, so the origin is unstable. The divergence is , which is also the sum of these three eigenvalues, and volumes shrink like , by a factor of about in one time unit. The stretching in one direction is outweighed by stronger squeezing in the others.
Attractor
Definition Let the solutions of , with continuously differentiable, exist for all , and write for the flow. A closed bounded set of states is an attractor if three conditions hold. First, the set is invariant, meaning for every . Second, it attracts an open set containing it, so every solution that starts in has distance from tending to as . Third, it is minimal, so no smaller closed subset of satisfies the first two conditions. The set of all initial states whose solutions approach is its basin of attraction. Definitions in the literature differ in the third condition, for example by asking for a solution that comes arbitrarily close to every point of , so the one in use should be named. An attractor on which the motion is chaotic is called a chaotic attractor, and often a strange attractor. If everywhere for a constant , every closed bounded invariant set has zero volume, because its volume satisfies for every .
In plain words An attractor is where the long-term motion lives. It is a bounded set that solutions never leave once inside and that pulls in every start from a whole neighborhood. It can be a single point, a closed orbit or something far more intricate.
Example The damped oscillator , written as , , has divergence , so areas shrink like . Its eigenvalues have negative real part, every solution tends to the origin, and the origin alone is an attractor whose basin is the whole plane. Here contraction ends in rest, not in chaos. For the Lorenz system, the function changes along solutions at the rate
which is negative outside the bounded ellipsoid . From this one shows that every solution exists for all and eventually enters a fixed bounded region and stays there. Since the classical divergence is the constant , every attractor of the classical system has zero volume. The butterfly-shaped set that computed solutions trace out has no volume at all, however solid it looks in a picture.
Largest Lyapunov exponent
Definition Let be a bounded solution of for , with continuously differentiable and Jacobian matrix . To first order, a perturbation of the state evolves by the variational equation . Let be its fundamental matrix with . The largest Lyapunov exponent of the solution is
Every perturbation has the exponential growth rate , which is at most , and every perturbation outside a proper subspace has exactly the rate . The number belongs to the solution being followed, and it describes infinitesimal perturbations over infinite time. A computation follows only a finite time with finite accuracy, so it returns a finite-time estimate
usually obtained by rescaling the perturbation at regular intervals, adding the logarithms of the growth factors, and discarding an initial transient.
In plain words A positive exponent means that a typical tiny error grows roughly like along that solution. It measures how fast detailed predictions fail, but a value computed from a finite run is evidence, not a theorem.
Example At the origin of the classical Lorenz system the solution is constant, , and the exponent is the largest real part of an eigenvalue of , namely . Every perturbation with a nonzero component along the unstable eigenvector grows at this rate. The exponent is positive, yet it only records that the origin is an unstable equilibrium, which is not chaos. Along solutions that wind around the Lorenz attractor, long computations give estimates near . Runs of time units with classical Runge-Kutta steps of and , and from a second start, gave , and , so even the second decimal is uncertain after that much work. Two runs from the same start with those two step sizes are in completely different places on the attractor by , because every step error acts like a tiny change of the state. Late coordinates of such runs are not reliable, while averaged quantities such as the exponent still agree to within about .
Chaos
Definition Chaos has several precise definitions in use, so a claim of chaos should name the one it relies on. A common working definition calls a deterministic system chaotic when three things hold. It has bounded solutions that never settle onto an equilibrium, a periodic orbit or a quasiperiodic motion. These solutions start from a set of initial states that is not negligible, such as an open set. Finally, nearby solutions separate in the sense of sensitive dependence on initial conditions, which in practice is detected by a positive largest Lyapunov exponent. A stricter definition concerns the motion on a closed bounded invariant set and asks for sensitive dependence on , a solution in that passes arbitrarily close to every point of , and periodic orbits passing arbitrarily close to every point of . Smooth planar autonomous systems leave no room for chaos. By the Poincaré-Bendixson theorem, if in has continuously differentiable and only finitely many equilibria, the omega-limit set of a solution that stays bounded for is an equilibrium, a periodic orbit, or equilibria joined by solutions that tend to equilibria as , and none of these carries chaotic motion. Chaos in a smooth autonomous system therefore needs at least three state variables. Three variables make chaos possible but never guarantee it.
In plain words Chaotic motion is fully determined by its equations, stays in a bounded region, never settles into a repeating pattern, and amplifies small differences until they matter. Unstable equilibria, shrinking volumes and a tangled picture are all consistent with chaos, but none of them proves it.
Example For the classical Lorenz system three facts are exact. All three equilibria are unstable, since the origin has the eigenvalue and each of has the complex pair . Every solution enters a bounded region. Volumes shrink like . Numerical evidence adds nearby solutions that separate and a largest Lyapunov exponent estimated near . Neither level is a proof of chaos. With and the other parameters unchanged, all three equilibria are still unstable and the divergence is still , yet a numerical solution from settles onto a periodic orbit. For the classical values, the existence of a chaotic attractor was proved in 2002 by a computer-assisted argument with rigorous error bounds, which is a different kind of statement from both the exact checks and the estimates.
Forced Duffing equation
Definition With as time and a dot for , the forced Duffing equation for a displacement is
with damping , linear stiffness , cubic stiffness , forcing amplitude and forcing angular frequency . With the velocity and , the pair obeys a planar system whose right side depends on , so the planar theorems for autonomous systems do not apply to it. Taking the forcing phase as a third state, read modulo , gives the autonomous system
A solution of the forced equation corresponds to the solution of this system, the one with . The divergence of the new field is , so for the three-dimensional flow shrinks volume like .
In plain words Position and velocity are not enough to predict a forced oscillator, because the future also depends on where the forcing is in its cycle. Recording that phase as a third coordinate makes the system autonomous and three-dimensional, which is exactly the case the planar restriction on chaos does not cover.
Example Take and , the linear equation . The function solves it, since . In the three-dimensional form this solution is . Indeed equals , and . Every other solution differs from this one by a term
so all solutions approach the same periodic motion and nothing here is chaotic. Forcing alone does not create chaos. With the double-well values , , and , a computation with from settles onto a response that repeats with the forcing period. With the states sampled once per forcing period keep wandering, and long runs estimate a largest Lyapunov exponent near . That is evidence of chaos at , not a proof.
Check yourself
- Find every equilibrium of the Lorenz system with , and , and check one of them. What changes when ?
Show the answer
At an equilibrium the first equation gives , and the second becomes . If , then and the third equation gives . If , then and the third equation gives , so . The equilibria are the origin and with matching signs. For the three components are , then , then .
With the second equation becomes . The case would need and then , which is impossible. Only the origin remains, as the condition for the two outer equilibria predicts.
- A classmate argues that the divergence of the classical Lorenz field is , so nearby solutions must move toward each other and sensitive dependence is impossible. Explain the mistake using the system , .
Show the answer
This system has divergence , so areas shrink like . Its solutions are and . A small square of side becomes a rectangle with sides and , whose area does shrink. Yet the two starts and are apart at time , however small is.
A negative divergence controls the product of the stretching factors, not each factor separately. It does not imply boundedness either, since every start with runs off to infinity. The Lorenz origin shows the same split, with the rate in one direction and the total .
- With as time, explain why the unforced equation cannot behave chaotically. Then write the forced equation as an autonomous system, and say what the change of dimension allows and what it does not prove.
Show the answer
With the unforced equation is the planar autonomous system , . Its right side is a polynomial, and its equilibria are and . The energy
satisfies , and it grows without bound as , so every solution stays in a bounded set for . By the Poincaré-Bendixson theorem each omega-limit set is an equilibrium, a periodic orbit, or equilibria joined by connecting solutions, and none of these is chaotic. In fact the energy strictly decreases along every nonconstant solution, which rules out periodic orbits, and every solution tends to one of the three equilibria.
The forced equation becomes
with read modulo . This system is three-dimensional, so the planar theorem no longer applies and chaos becomes possible. The extra dimension proves nothing by itself. With in place of , a numerical solution from settles onto a periodic response, and at a positive exponent estimate near is evidence of chaos rather than a proof.