Video 4, chapter 17

Period Doubling and the Route to Chaos

How the logistic map follows the period-doubling route to chaos through a cascade of period-doubling bifurcations, how to read its bifurcation diagram, and why periodic windows interrupt the deterministic chaos.

  • Video 4, chapter 17
  • From shapes to changing systems

Raise the parameter rr of the logistic map xn+1=r xn(1−xn)x_{n+1} = r\,x_n(1 - x_n) a little at a time and record where its orbits end up. A single settled value splits into two at r=3r = 3, the two split into four near r=3.449r = 3.449, and then come eight, sixteen and more, ever faster, until beyond about r=3.5699r = 3.5699 the orbits for many values of rr never settle into a cycle at all. Why do stable rhythms keep splitting in two, and does disorder then take over for good? This page builds the bifurcation diagram that shows the cascade, explains each split with the slope test for cycles, and shows that the chaotic range is interrupted by periodic windows such as a stable three-cycle near r=3.83r = 3.83.

Key terms

Period-doubling bifurcation

Definition A bifurcation is a parameter value at which the long-term behavior of a family of rules changes its kind. Take a family of rules frf_r on an interval whose slopes fr′f_r' change continuously. A cycle of length kk is a list of kk different states x1,…,xkx_1, \ldots, x_k that the rule visits in turn, sending each one to the next and xkx_k back to x1x_1. Its multiplier is the product fr′(x1)⋯fr′(xk)f_r'(x_1) \cdots f_r'(x_k) of the slopes along the cycle. The cycle is stable if the multiplier lies strictly between −1-1 and 11, and unstable if it is larger than 11 in size. A period-doubling bifurcation happens at r0r_0 when, as rr increases through r0r_0, the multiplier of a stable cycle of length kk decreases through −1-1, so that the cycle becomes unstable, while a new cycle of length 2k2k branches off from it. In the logistic map fr(x)=r x(1−x)f_r(x) = r\,x(1 - x) the new cycle is stable just after r0r_0, and its points lie in pairs on either side of the points of the old cycle. The logistic map goes through a whole cascade of these bifurcations, called the period-doubling route to chaos. At r=3r = 3 the fixed point 1−1/r1 - 1/r, whose multiplier is 2−r2 - r, gives way to a two-cycle. At r=1+6≈3.4495r = 1 + \sqrt{6} \approx 3.4495 the two-cycle, whose multiplier is 4+2r−r24 + 2r - r^2, gives way to a four-cycle. Doublings to 88, 1616 and 3232 follow at about 3.54413.5441, 3.56443.5644 and 3.56883.5688, and the doubling points accumulate at r∞≈3.569946r_\infty \approx 3.569946. The ratios of successive gaps between doubling points tend to Feigenbaum’s constant δ≈4.6692\delta \approx 4.6692. Mitchell Feigenbaum found in the 1970s that the same limit appears for a broad class of smooth one-hump maps whose top is shaped like a parabola, such as rsin⁡(πx)r \sin(\pi x), whenever they go through such a cascade, which is why the constant is called universal.

In plain words Each time rr passes a doubling point, the current rhythm stops attracting nearby orbits, and a rhythm twice as long, which alternates around the old one, takes over. The doubling points crowd closer and closer together, so infinitely many of them fit below about 3.573.57.

Example At r=3.5r = 3.5 the two-cycle still exists. Its formula (r+1±D)/(2r)(r + 1 \pm \sqrt{D})/(2r) with D=(r−3)(r+1)=2.25D = (r - 3)(r + 1) = 2.25 gives exactly 3/7≈0.42863/7 \approx 0.4286 and 6/7≈0.85716/7 \approx 0.8571. Its multiplier is 4+7−12.25=−1.254 + 7 - 12.25 = -1.25, so it is unstable. The orbit of 0.20.2, after its transient, runs through a stable four-cycle, with multiplier about −0.03-0.03, in the order

0.8269→0.5009→0.8750→0.3828→0.8269,\begin{aligned} &0.8269 \to 0.5009 \\[0.4em] &\quad \to 0.8750 \to 0.3828 \\[0.4em] &\quad \to 0.8269, \end{aligned}

rounded to four decimal places. The values 0.38280.3828 and 0.50090.5009 lie on either side of 3/73/7, and 0.82690.8269 and 0.87500.8750 lie on either side of 6/76/7. The orbit still alternates between a high value and a low value, as on the old two-cycle, but it now takes four steps to return to the same value. Every value still determines the next one through the same formula, so the four values come in a fixed order and no random choice is made between them.

Bifurcation diagram

Definition A bifurcation diagram of a family of rules frf_r plots long-term behavior against the parameter. For each value of rr on a fine grid, start an orbit at a chosen x0x_0, discard a fixed number of early steps as the transient, and plot the next values of the orbit as dots above rr, with rr on the horizontal axis and the state on the vertical axis. Each vertical slice is a separate experiment with its own fixed rr, so the diagram is not the path of one orbit moving from left to right. A slice with one sharp dot suggests a stable fixed point, a slice with kk sharp dots suggests a cycle of length kk, and a slice with a cloud shows an orbit that did not settle during the plotted steps. The picture depends on the start, on the numbers of discarded and plotted steps and on the precision of the arithmetic, so it is evidence about long-term behavior and not a proof. For the logistic map the choice of start rarely matters, because it is known that whenever the map has a stable cycle, almost every start approaches it, meaning all starts except a set of total length zero.

In plain words Each column of dots answers one question. For this value of rr, which values does the orbit keep visiting once its transient is over?

Example Start every orbit at 0.20.2, discard the first 20002000 steps and plot the next 256256. Some slices of the logistic map then look like this, with values rounded to four decimal places.

rrValues in the sliceWhat it suggests
220.50.5stable fixed point
2.82.80.64290.6429stable fixed point 9/149/14
3.23.20.51300.5130 and 0.79950.7995two-cycle
3.53.50.38280.3828, 0.50090.5009, 0.82690.8269, 0.87500.8750four-cycle
3.553.55eight values from 0.35480.3548 to 0.88740.8874eight-cycle
3.833.830.15610.1561, 0.50470.5047, 0.95740.9574three-cycle
44a cloud spread over all of [0,1][0, 1]no cycle

Between r=2.5r = 2.5 and r=4r = 4 the slices join into the familiar picture. One branch splits at r=3r = 3, each branch splits again near 3.4493.449, and further splits come faster and faster until a cloud appears. Magnifying a small piece of the diagram shows more splitting, and the branches look roughly like smaller copies of the whole, although they are not exact scaled copies of each other. Each cycle in the table can be confirmed by computing it with 5050 significant digits and checking that its multiplier is smaller than 11 in size.

Deterministic chaos

Definition A system is deterministic when its current state fixes every later state exactly, with no random step. Deterministic chaos is behavior of such a system that never settles into a regular pattern and depends extremely sensitively on the starting state. Several precise definitions are in use. A widely used one, due to Robert Devaney, calls a rule ff that sends an interval SS into itself chaotic on SS when three conditions hold. The first is sensitive dependence on initial conditions. There is a distance d>0d > 0 such that, as close as we like to every starting value in SS, there is another starting value in SS whose orbit is more than dd away from the first orbit at some later step. The second is transitivity. For any two intervals inside SS, however short, some orbit that starts in the first later visits the second. The third is that cycles are dense, meaning that every interval inside SS, however short, contains a start whose orbit is a cycle. The logistic map with r=4r = 4 is chaotic on [0,1][0, 1] in this sense. A plotted cloud, or two computed orbits that drift apart, illustrates chaos but does not prove it, because a computer uses finitely many digits and finitely many steps.

In plain words The rule is exact, so nothing is random. Yet a tiny difference in the start can grow until two orbits have nothing in common, and some orbits wander through every part of the interval without ever repeating.

Example Take r=4r = 4 and the starts 0.20.2 and 0.2000000010.200000001, which differ by 10−910^{-9}. Both orbits were computed with 8080 significant digits, so the table shows the true values, rounded.

StepOrbit of 0.20.2Orbit of 0.2000000010.200000001Gap
000.20.20.2000000010.2000000011×10−91 \times 10^{-9}
10100.14783660.14783660.14783750.14783759.1×10−79.1 \times 10^{-7}
20200.82000.82000.81900.81900.00100.0010
27270.20340.20340.08740.08740.11600.1160
33330.98990.98990.12330.12330.86660.8666

After about thirty steps the two orbits have nothing in common. The reason is a trigonometric identity. Every value in [0,1][0, 1] can be written as x=sin⁡2θx = \sin^2\theta for an angle θ\theta, and

4sin⁡2θ (1−sin⁡2θ)=(2sin⁡θcos⁡θ)2=sin⁡2(2θ),\begin{aligned} &4 \sin^2\theta\,(1 - \sin^2\theta) \\[0.4em] &\quad = (2 \sin\theta \cos\theta)^2 \\[0.4em] &\quad = \sin^2(2\theta), \end{aligned}

so each step of the rule doubles the angle. A small error in the angle therefore doubles at every step, and thirty doublings multiply it by 230≈1.07×1092^{30} \approx 1.07 \times 10^{9}. Ordinary computer arithmetic, with about 1616 significant digits, runs into the same growth. Evaluating the formula as written in that arithmetic gives an orbit of 0.20.2 that is off by about 4×10−54 \times 10^{-5} at step 4040 and by more than 0.070.07 at step 5050.

Periodic window

Definition A periodic window of the logistic map is an interval of parameter values beyond r∞r_\infty in which a stable cycle appears and attracts the orbits, so that the bifurcation diagram shows a few sharp branches in place of the cloud. A window begins where a stable cycle is born, together with an unstable cycle of the same length, and the stable cycle then goes through its own period-doubling cascade before chaos returns. The most visible one is the period-three window, which begins at r=1+8≈3.8284r = 1 + \sqrt{8} \approx 3.8284. Its three-cycle doubles to a six-cycle near r=3.8415r = 3.8415, then to twelve and so on, with the doublings accumulating near 3.84943.8494. After that the orbits are chaotic again, first within three separate bands, which merge into a single cloud near r=3.857r = 3.857. Windows are found throughout the chaotic range. It has been proved that every interval of parameters between r∞r_\infty and 44, however short, contains parameters with a stable cycle, and yet the parameters at which typical orbits never settle into a cycle take up a positive total length. Increasing rr beyond r∞r_\infty therefore does not mean steadily increasing disorder.

In plain words Even deep in the chaotic range there are stretches of rr where order comes back and orbits settle into a short repeating cycle. Most of these stretches are far too narrow to see in a plot.

Example At r=3.83r = 3.83 the orbit of 0.20.2, after its transient, runs through the three-cycle

0.1561→0.5047→0.9574→0.1561,\begin{aligned} &0.1561 \to 0.5047 \\[0.4em] &\quad \to 0.9574 \to 0.1561, \end{aligned}

rounded to four decimal places, with multiplier about 0.330.33, so the cycle is stable. A theorem of Sharkovskii from 1964 says that a continuous rule on an interval with a cycle of length three also has cycles of every other length. They exist at r=3.83r = 3.83 too, but all of them except the stable three-cycle are unstable, so the diagram shows only three dots.

Check yourself

  1. Take r=4r = 4 and follow the orbits of 1/21/2, 1/41/4 and 3/43/4 for a few steps. Do these orbits contradict the claim that the logistic map with r=4r = 4 is chaotic on [0,1][0, 1]?
Show the answer

The start 1/21/2 goes to 4⋅12⋅12=14 \cdot \tfrac12 \cdot \tfrac12 = 1, then to 00, and stays at 00. The start 3/43/4 is a fixed point, since 4⋅34⋅14=344 \cdot \tfrac34 \cdot \tfrac14 = \tfrac34, and the start 1/41/4 reaches it in one step, since 4⋅14⋅34=344 \cdot \tfrac14 \cdot \tfrac34 = \tfrac34. None of these orbits wanders, but there is no contradiction. Sensitive dependence does not say that every orbit looks irregular. It says that next to every start there are other starts whose orbits eventually separate from it. The fixed point 3/43/4 has slope 4(1−2⋅34)=−24(1 - 2 \cdot \tfrac34) = -2, so the start 3/4+0.0000013/4 + 0.000001 has gaps of about 0.0000010.000001, −0.000002-0.000002, 0.0000040.000004 and −0.000008-0.000008 from 3/43/4, doubling in size and switching sides at each step until the orbit is far away. Starts on cycles are even required by the definition, since dense cycles are one of its three conditions, and 3/43/4 is a cycle of length one.

  1. Use the rounded doubling points 33, 3.44953.4495, 3.54413.5441 and 3.56443.5644. Compute the gaps between them and the ratios of successive gaps. Then use δ≈4.669\delta \approx 4.669 to predict the next doubling point and the accumulation point r∞r_\infty.
Show the answer

The gaps are 0.44950.4495, 0.09460.0946 and 0.02030.0203. The ratios are 0.4495/0.0946≈4.750.4495/0.0946 \approx 4.75 and 0.0946/0.0203≈4.660.0946/0.0203 \approx 4.66, already close to δ\delta. The next gap should be about 0.0203/4.669≈0.00430.0203/4.669 \approx 0.0043, which predicts the next doubling point near 3.5644+0.0043=3.56873.5644 + 0.0043 = 3.5687. The computed value is 3.56883.5688. If every later gap is the one before divided by δ\delta, the remaining gaps form a geometric series with sum

0.02034.669−1≈0.0055,\frac{0.0203}{4.669 - 1} \approx 0.0055,

so r∞≈3.5644+0.0055=3.5699r_\infty \approx 3.5644 + 0.0055 = 3.5699, in agreement with the computed 3.5699463.569946 to four decimal places. The prediction works because the ratios settle down quickly, although the first ratios are not yet equal to δ\delta.

  1. The two-cycle of the logistic map has multiplier 4+2r−r24 + 2r - r^2. At which rr does it lose its stability, and what does the multiplier say at r=3.5r = 3.5?
Show the answer

At r=3r = 3, where the two-cycle is born, the multiplier is 4+6−9=14 + 6 - 9 = 1, and it decreases as rr grows. The cycle stays stable until the multiplier reaches −1-1, so solve

4+2r−r2=−1,r2−2r−5=0.\begin{aligned} 4 + 2r - r^2 &= -1, \\[0.4em] r^2 - 2r - 5 &= 0. \end{aligned}

The roots are r=1±6r = 1 \pm \sqrt{6}, and the positive one is 1+6≈3.44951 + \sqrt{6} \approx 3.4495, the second doubling point. At r=3.5r = 3.5 the multiplier is 4+7−12.25=−1.254 + 7 - 12.25 = -1.25, which is larger than 11 in size, so the two-cycle is unstable there. That matches the stable four-cycle found at r=3.5r = 3.5.

How this lesson connects