The main definitions, formulas, theorems and conditions of the differential equations course on one page, unit by unit, with links to the lessons that explain each topic in full.
This sheet follows the thirteen units of the course in order. Each unit starts with the big idea in a few sentences, then gives the definitions, formulas, theorems and methods you will look up most often, with the conditions they need. When you want the full explanation, a derivation or more examples, follow the lesson links under each topic.
Unless a topic says otherwise, the independent variable is t and a prime is a derivative with respect to it, so y′=dy/dt. Topics about space or power series use x and say so. A scalar unknown is y, a state vector is a plain capital letter such as X=(x1,…,xn)T, and matrices are plain capitals such as A, I and Φ. Partial derivatives are written ut=∂u/∂t and uxx=∂2u/∂x2, and the only dot is in V˙, the rate of change of a function V along solutions. The order of an equation is its highest derivative, which is a different thing from the degree of a polynomial. Logarithms are natural logarithms, and the conventions for the Laplace transform, Fourier series and the Fourier transform are stated where they are used. A formula holds wherever both sides are defined unless a condition says otherwise.
Language, Solutions and Modeling
A differential equation relates an unknown function to its derivatives. A solution is a function that satisfies it at every point of an interval, and initial or boundary data pick one solution out of a family. Before using any method, identify the kind of equation, the data and the interval, and check whether a solution is guaranteed to exist and to be unique.
Classifying an equation
An ordinary differential equation (ODE) has one independent variable, and a partial differential equation (PDE) has several and involves partial derivatives. The order is the highest derivative that appears, whatever power it is raised to. An equation of order n is linear when it can be written as
an(t)y(n)+⋯+a1(t)y′+a0(t)y=g(t),
with coefficients ak and forcing g that depend on t only. It is homogeneous when g=0 and nonhomogeneous otherwise. Powers such as y2 or (y′)2, products such as yy′ and functions such as siny make an equation nonlinear. A first-order equation y′=F(y/x) is also called homogeneous, in a second sense that is about scaling, not about forcing.
A solution of an equation of order n on an open interval I is a function with n derivatives on I that satisfies the equation at every point of I. It is explicit when it is given as a formula for y and implicit when a relation G(t,y)=0 defines y as a differentiable function on I. A general solution is a family with arbitrary constants, usually n of them, and a particular solution is one member of the family.
Initial value problem. The values y(t0),y′(t0),…,y(n−1)(t0) are given at one point.
Boundary value problem. Conditions are given at two or more points. A linear one has exactly one solution, none or infinitely many.
In the variable x, the equation y′′+y=0 has the general solution C1cosx+C2sinx. The initial values y(0)=2 and y′(0)=−1 select 2cosx−sinx. The boundary conditions y(0)=y(π)=0 allow every Csinx, while y(0)=0 and y(π)=1 allow none. The relation x2+y2=25 gives the explicit solution y=25−x2 of y′=−x/y only on −5<x<5, since y=0 at the endpoints. To verify a solution, substitute it into the equation and the data and state the interval.
The product rule (uv)′=u′v+uv′ and the chain rule dtdf(y(t))=f′(y(t))y′(t) are used to check every solution. If f is continuous on an interval containing t0, the solutions of y′=f(t) there are
y(t)=y(t0)+∫t0tf(s)ds,
and an indefinite integral carries one arbitrary constant on each interval. In particular ∫tdt=ln∣t∣+C on each interval that does not contain 0.
A complex number z=a+ib with i2=−1 has real part a, imaginary part b, conjugate z=a−ib and modulus ∣z∣=a2+b2. The nonreal roots of a polynomial with real coefficients come in conjugate pairs. For real θ, a and b, Euler’s formula and the complex exponential are
For every complex constant r, dtdert=rert. If a complex function solves a linear equation with real coefficients, its real and imaginary parts are real solutions. For example (−1+2i)2+2(−1+2i)+5=0, so the real part e−tcos2t of e(−1+2i)t solves y′′+2y′+5y=0.
For y′=f(x,y) in the variable x, the direction field draws at each point (x,y) a short segment of slope f(x,y). A solution curve is tangent to the field at every one of its points. An isocline f(x,y)=m is a curve along which all segments have the same slope m, and in general it is not a solution curve. For y′=x−y the isoclines are the lines y=x−m and the solutions are y=x−1+Ce−x. The isocline m=1, the line y=x−1, happens to be the solution with C=0, and every other solution approaches it as x→∞.
Existence. If f is continuous on an open rectangle containing (t0,y0), at least one solution exists on some open interval containing t0. The interval may be shorter than the rectangle.
Uniqueness. If moreover f is locally Lipschitz in y, meaning that near each point some constant L gives ∣f(t,y1)−f(t,y2)∣≤L∣y1−y2∣, the solution is unique. A continuous ∂f/∂y is enough for this but not necessary, since f=∣y∣ is Lipschitz.
Maximal interval. Under both hypotheses on an open set D, the solution extends to a largest open interval of existence (α,ω). If ω<∞, the point (t,y(t)) leaves every closed and bounded subset of D as t→ω−, for example by blowing up, and the same holds at α.
The theorems are local. The function f(t,y)=y2 is smooth everywhere, yet y′=y2 with y(0)=1 has the solution y=1−t1 only on (−∞,1), which is finite-time blowup. The equation y′=2∣y∣ with y(0)=0 has a continuous right side that is not Lipschitz at y=0, and it has infinitely many solutions, the zero solution and, for each a≥0,
A balance law says that the rate of change of an amount equals what flows in minus what flows out, plus what is produced minus what is used up. Every term has the same units, those of the amount per unit time, and every exponent or argument of a function such as e−kt is dimensionless. The state is the quantity the equation evolves, and the parameters are fixed numbers that specify the model. To nondimensionalize, divide the state and the time by characteristic scales, u=y/Y and τ=t/T, chosen so that fewer parameters remain.
For a tank holding V=10 liters, with inflow and outflow of 2 liters per minute, inflow concentration 3 grams per liter and M(0)=10 grams of salt, the amount M in grams after t minutes satisfies
dtdM=6−5M,M(t)=30−20e−t/5.
The scales u=M/30 and τ=t/5 give dτdu=1−u with u(0)=31, an equation with no parameters left.
Many first-order equations can be solved exactly once their form is recognized. Each method below changes the equation into one that can be integrated, and each can lose solutions or hide the interval where a solution is valid, so those are checked after solving.
Separable equations
An equation y′=a(t)b(y) is separable. Take a continuous and b continuously differentiable, so that solutions are unique.
Find the constant solutions y=c with b(c)=0 first, because dividing by b(y) loses them.
Where b(y)=0, integrate both sides of b(y)dy=a(t)dt.
Solve for y if possible, apply the initial value and state the interval where the solution is defined.
By uniqueness a nonconstant solution never reaches a zero of b, so the constant solutions and the separated ones do not mix. For y′=2ty the constant solution is y=0, and elsewhere ln∣y∣=t2+C0. Together they give y=Cet2 for every real C, and y(0)=3 selects y=3et2. An implicit answer is often the natural one. In the variable x, the equation yy′=−x gives x2+y2=C, and with y(0)=2 the solution is y=4−x2 on −2<x<2.
Divide a(t)y′+b(t)y=g(t) by a(t) on an interval where a(t)=0 to get the standard form y′+p(t)y=q(t). The integrating factor μ=e∫pdt satisfies μ′=pμ, which turns the left side into a product derivative, (μy)′=μq.
If p and q are continuous on an open interval I containing t0, the problem with y(t0)=y0 has exactly one solution, it exists on all of I, and
For y′+2y=4t with y(0)=3, the factor e2t gives (e2ty)′=4te2t and y=2t−1+4e−2t. Points where the leading coefficient vanishes split the line. In the variable x, the equation xy′+y=1 has the solutions y=1+C/x, each defined on x>0 or on x<0 but never across x=0.
The equation M(x,y)dx+N(x,y)dy=0, with M and N continuously differentiable on an open set D, is exact on D when it has a potential function F there, with Fx=M and Fy=N. Its solutions lie on the level curves F(x,y)=C, and where N=0 they solve y′=−M/N.
Exactness on D implies My=Nx on D.
If D is simply connected, such as a disk or a rectangle, then My=Nx on D implies exactness. So the test always works locally.
On a region with a hole it can fail. The form x2+y2−ydx+xdy satisfies My=Nx on the plane without the origin, but its integral around the unit circle is 2π, so it has no potential there.
To find a potential, integrate M in x to get F=∫Mdx+h(y), then choose h so that Fy=N. For (2xy+3x2)dx+(x2+4y)dy=0 the test gives My=Nx=2x, and the potential is F=x2y+x3+2y2.
A nonexact equation can become exact after multiplication by an integrating factor μ. Two tests look for one that depends on a single variable.
Factor
Works when this quotient
Formula
μ(x)
r=NMy−Nx depends on x only
μ=e∫r(x)dx
μ(y)
r=MNx−My depends on y only
μ=e∫r(y)dy
The new equation has the same solutions only where μ is defined and nonzero, so state that region. For ydx+2xdy=0 on x>0, the first quotient is −2x1, so μ=x−1/2, the potential is F=2yx and the solutions are yx=C.
Riccati, y′=a(t)y2+b(t)y+c(t) with a known solution yp
y=yp+u1
linear, u′+(2ayp+b)u=−a
Each substitution misses some solutions, which have to be added back.
Homogeneous. Every root v0 of F(v)=v gives a line solution y=v0x that is lost when dividing by F(v)−v, and x=0 is excluded. With x>0, the problem y′=1+y/x, y(1)=0 gives xv′=1 and y=xlnx.
Bernoulli. For n>0 the zero function is a solution that the new variable misses, and for fractional n the solution must stay where yn is defined. For y′+y=y2 with y(0)=21, the variable z=1/y satisfies z′−z=−1, so z=1+et and y=1+et1.
Riccati. The known solution yp itself corresponds to no finite u, and y has a pole wherever u=0. For y′=y2−1 with yp=1 and y(0)=0, the correction satisfies u′+2u=−1 with u(0)=−1, so u=−21(1+e−2t) and y=1+u1=−tanht.
An autonomous equation can be understood from the sign of its right side, without a formula for the solution. The models in this unit, growth and decay, cooling, logistic growth with harvesting, mixing and falling with drag, are first-order equations whose parameters carry units and whose solutions make sense only on a physical domain.
Equilibria and the phase line
For an autonomous equation y′=f(y) with f continuously differentiable, an equilibrium is a number y∗ with f(y∗)=0, and y=y∗ is then a constant solution. Between two equilibria f keeps one sign, so a solution there increases where f>0, decreases where f<0 and never reaches an equilibrium in finite time. The phase line marks the equilibria on the y axis and draws arrows in these directions.
Stable. For every ε>0 there is δ>0 such that ∣y(0)−y∗∣<δ gives ∣y(t)−y∗∣<ε for all t≥0.
Asymptotically stable. Stable, and every solution that starts close enough tends to y∗.
Semistable. Solutions approach y∗ from one side and move away on the other, so the equilibrium is unstable.
Condition at y∗
Conclusion
f′(y∗)<0
asymptotically stable
f′(y∗)>0
unstable
f′(y∗)=0
no conclusion, as y′=−y3, y′=y3 and y′=y2 show at 0
For y′=y(2−y) the equilibrium 0 is unstable and 2 is asymptotically stable, and y(0)=1 gives y=1+e−2t2, which rises toward 2. The equation y′=(y−1)2 is semistable at 1. From y(0)=0 the solution 1−1+t1 approaches 1, while from y(0)=2 the solution 1+1−t1 blows up at t=1.
After one time constant a decaying amount is Q0/e, about 37 percent of its starting value. A half-life of 4 hours gives λ=4ln2 per hour, so 80 grams decays to 40 grams after 4 hours and to 20 grams after 8 hours. A cup at 90 degrees in a room at A=20 degrees with k=51 per minute follows T=20+70e−t/5. If the surrounding temperature changes with time, the difference D=T−A obeys D′=−kD−A′(t), which is no longer pure decay.
With growth rate r>0 and carrying capacity K>0, the logistic model and its solution for P(0)=P0>0 are
P′=rP(1−KP),P(t)=1+Ae−rtK,A=P0K−1.
The equilibrium 0 is unstable and K is asymptotically stable. The growth rate is largest at P=K/2, where it equals rK/4. With a constant harvesting rate H≥0 the model becomes P′=rP(1−P/K)−H.
Harvest rate
Equilibria
Behavior
H<4rK
P±=2K±4K2−rHK
P− is an unstable threshold and P+ is stable
H=4rK
2K only
semistable, populations below it decline
H>4rK
none
P decreases from every starting value
A population that starts below the threshold, or below K/2 when H=rK/4, or at any level when H>rK/4, reaches 0 in finite time, where the model stops applying. With r=51 and K=100 the critical rate is 5, and H=516 gives the threshold 20 and the stable level 80.
For a perfectly mixed tank holding an amount M(t) of a substance in volume V(t), with inflow rate qin at concentration cin and outflow rate qout, all constant,
M′=qincin−qoutVM,V(t)=V0+(qin−qout)t,
valid while the tank neither empties nor overflows. Solve for the amount, which is linear in M, then compute the concentration c=M/V. For V=100+2t liters with M(0)=100 grams, an inflow of 3 liters per minute at 2 grams per liter and an outflow of 1 liter per minute, the equation M′=6−M/V has the integrating factor V and
M=2V−1000V−1/2,c=2−1000V−3/2.
For several compartments, write one balance per compartment, and each exchange appears with opposite signs in the two compartments it connects. The system M1′=−(M1−M2)/10, M2′=(M1−M2)/10 keeps M1+M2 constant, while the difference decays at rate 51. With M1(0)=20 and M2(0)=10 this gives M1=15+5e−t/5 and M2=15−5e−t/5.
Take velocity v positive downward. A mass m falling under gravity g obeys mv′=mg+Fdrag, where the drag force always opposes the motion.
Drag
Force
Terminal velocity
Velocity
Linear
−bv, b>0
vT=bmg
vT+(v0−vT)e−bt/m from v(0)=v0
Quadratic
−c∣v∣v, c>0
vT=cmg
vTtanhvTgt from rest
The terminal velocity is the equilibrium of the velocity equation, where gravity and drag balance. For quadratic drag the simpler form −cv2 is valid only while v≥0, because an object moving upward has drag pointing down. With m=2, g=10 and b=4 in SI units, vT=5 meters per second and, from rest, v=5(1−e−2t). Quadratic drag with c=54 has the same terminal velocity but approaches it as v=5tanh2t.
Linear equations have a clear solution structure. The solutions of a homogeneous equation of order n form a family with exactly n free constants, and every solution of a forced equation is one particular solution plus a homogeneous one. With constant coefficients the homogeneous solutions come from the roots of a polynomial.
Linear structure and the Wronskian
Write a linear equation of order n in standard form, with leading coefficient 1,
L[y]=y(n)+pn−1(t)y(n−1)+⋯+p0(t)y=g(t).
A regular interval is an open interval I on which every pk and g is continuous. For every t0 in I and any n values y(t0),…,y(n−1)(t0) there is exactly one solution, and it exists on all of I.
Superposition. Because L is linear, sums and constant multiples of solutions of L[y]=0 are again solutions. This fails for nonlinear equations and for L[y]=g with g=0.
General solution. If y1,…,yn is a fundamental set of solutions of L[y]=0 on I and yp is one solution of L[y]=g, every solution is c1y1+⋯+cnyn+yp.
Wronskian. For two functions W=y1y2′−y1′y2, and for n functions it is the determinant of the matrix whose rows are the functions and their derivatives up to order n−1.
For solutions of y′′+p(t)y′+q(t)y=0 on I, Abel’s identity
W(t)=W(t0)e−∫t0tp(s)ds
shows that W is zero everywhere on I or nowhere, and order n works the same way with pn−1 in place of p. So n solutions form a fundamental set exactly when W=0 at one point of I. The test is about solutions. For arbitrary functions W=0 everywhere does not imply dependence, as t2 and t∣t∣ show on the whole line. For y′′−3y′+2y=0 the solutions et and e2t have W=e3t, and y(0)=4, y′(0)=5 select y=3et+e2t.
For y′′+ay′+by=0 with real constants a and b, the function ert is a solution exactly when r2+ar+b=0.
Roots of r2+ar+b=0
General solution
real r1=r2, when a2>4b
C1er1t+C2er2t
double root r=−2a, when a2=4b
(C1+C2t)ert
α±iβ with β>0, when a2<4b
eαt(C1cosβt+C2sinβt)
For order n, with characteristic polynomial anrn+⋯+a1r+a0 and an=0, each real root r of multiplicity m contributes ert,tert,…,tm−1ert, and each pair α±iβ of multiplicity m contributes tkeαtcosβt and tkeαtsinβt for k=0,…,m−1. The multiplicities add up to n, so this gives a fundamental set of n functions, and the n initial values fix the constants.
The problem y′′+2y′+5y=0, y(0)=3, y′(0)=1 has roots −1±2i and the solution e−t(3cos2t+2sin2t).
The polynomial (r2+1)2 belongs to y(4)+2y′′+y=0, with the solutions cost, sint, tcost and tsint.
The polynomial (r−1)3 with y(0)=1 and y′(0)=y′′(0)=0 gives y=et(1−t+21t2).
The solution of L[y]=g is y=yc+yp, a complementary solution yc of L[y]=0 plus one particular solution yp. When L has constant coefficients and g is a sum of terms Pm(t)eαtcosβt or Pm(t)eαtsinβt, with Pm a polynomial of degree m and possibly β=0, try for each term
yp=tseαt(A(t)cosβt+B(t)sinβt).
Here A and B are polynomials of degree m with unknown coefficients, both needed even when g has only a cosine or only a sine, and s is the multiplicity of α+iβ as a root of the characteristic polynomial, with s=0 when it is not a root.
Forcing
Trial when s=0
t2
At2+Bt+C
e3t
Ae3t
sinωt
Acosωt+Bsinωt
te−tcos2t
e−t((A1t+A0)cos2t+(B1t+B0)sin2t)
The factor ts handles overlap with the complementary solutions. For y′′−2y′+y=et the root 1 is double, so s=2, the trial is At2et and A=21. The annihilator method explains the rule. If a constant-coefficient operator Q(D), with D=d/dt, satisfies Q(D)g=0, then every solution of L[y]=g solves Q(D)L[y]=0, and the trial is a combination of the basis solutions of that larger equation that do not solve L[y]=0. Here (D−1)et=0, so (D−1)3y=0 and the new term is t2et. For other forcings or variable coefficients, use variation of parameters.
Take y′′+p(t)y′+q(t)y=g(t) in standard form, with p, q and g continuous on I and a fundamental set y1, y2 with Wronskian W. Then
yp=u1y1+u2y2,u1′=−Wy2g,u2′=Wy1g.
Taking u1 and u2 as integrals from t0 to t gives the particular solution with yp(t0)=yp′(t0)=0. The leading coefficient must be 1, so for Py′′+Qy′+Ry=G use g=G/P on an interval where P=0. For y′′+y=sect on −2π<t<2π, with y1=cost, y2=sint and W=1, the derivatives are u1′=−tant and u2′=1, and
Reduction of order. If y1 solves y′′+py′+qy=0 and y1=0 on an interval, then y=vy1 gives a first-order linear equation for v′, and a second solution is
y2=y1∫y12e−∫pdtdt,
with W(y1,y2)=e−∫pdt=0. In the variable x, the equation y′′−x2y′+x22y=0 on x>0 with y1=x gives y2=x2.
Cauchy-Euler equations. In the variable x, the equation x2y′′+axy′+by=0 is studied on x>0. The trial y=xm gives the indicial equation m(m−1)+am+b=0. Equivalently, x=eτ turns it into Y′′+(a−1)Y′+bY=0 with constant coefficients, where Y(τ)=y(eτ) and primes on Y mean d/dτ.
Roots
Solutions on x>0
real m1=m2
xm1 and xm2
double root m
xm and xmlnx
α±iβ with β>0
xαcos(βlnx) and xαsin(βlnx)
On x<0 replace x by ∣x∣ in the solutions. The origin is a singular point where initial data do not select one solution, since y=0 and y=x2 both solve x2y′′−2y=0 with y(0)=y′(0)=0. For x2y′′−3xy′+4y=0 the indicial equation is (m−2)2=0, and y(1)=1, y′(1)=0 give y=x2(1−2lnx).
In the variable x, two kinds of second-order equation reduce to first order.
Missing variable
Form
Substitution
Result
dependent variable y
y′′=F(x,y′)
v=y′
v′=F(x,v)
independent variable x
y′′=G(y,y′)
v=y′ as a function of y
vdydv=G(y,v)
The second substitution uses y as the coordinate, so it is valid only on an interval where y′=0. After finding v, solve y′=v for y. For y′′=(y′)2 with y(0)=2 and y′(0)=1, the first substitution gives v=1−x1 and y=2−ln(1−x) on x<1. For y′′=2y3 with y(0)=y′(0)=1, the second gives the first integral (y′)2−y4=0, the data choose y′=y2, and y=1−x1 on x<1.
A mass on a spring and a series electric circuit obey the same second-order linear equation. Damping decides how free motion dies out, the forcing frequency decides how large the response is, and complex arithmetic gives the amplitude and phase of a steady response in one step.
Free and damped oscillations
A mass m>0 on a spring of stiffness k>0 with viscous damping c≥0, whose displacement from equilibrium is x(t), satisfies mx′′+cx′+kx=0. The natural angular frequency is ω0=k/m, and the characteristic roots are
r=2m−c±c2−4mk.
Case
Condition
Solution
Undamped
c=0
C1cosω0t+C2sinω0t
Underdamped
0<c2<4mk
e−ct/(2m)(C1cosωdt+C2sinωdt)
Critically damped
c2=4mk
(C1+C2t)e−ct/(2m)
Overdamped
c2>4mk
C1er1t+C2er2t with r2<r1<0
Here ωd=ω02−c2/(4m2) is the damped angular frequency. With c>0 every solution tends to 0, and critically damped or overdamped motion crosses equilibrium at most once. The mechanical energy
E=21m(x′)2+21kx2
satisfies E′=−c(x′)2≤0, so damping removes energy. With m=1, c=2 and k=5 in SI units, the release x(0)=2, x′(0)=0 gives x=e−t(2cos2t+sin2t), with ωd=2 and starting energy 10 joules.
For mx′′+cx′+kx=F0cosωt with F0=0, three cases matter.
No damping, ω=ω0. A particular solution is m(ω02−ω2)F0cosωt. Starting from rest, the motion is that amplitude times cosωt−cosω0t, and for ω near ω0 it shows beats, a fast oscillation inside a slow envelope that repeats with the beat period 2π/∣ω0−ω∣.
No damping, ω=ω0. This is resonance. A particular solution is 2mω0F0tsinω0t, which grows linearly without bound.
Damping, c>0. Every solution approaches a steady periodic response of amplitude
A(ω)=(k−mω2)2+c2ω2F0.
The amplitude has a peak at a positive frequency only when c2<2mk, a stronger condition than underdamping. The peak is at
ωpeak=mk−2m2c2,
with peak amplitude cωdF0, and when c2≥2mk the amplitude decreases for all ω>0. As examples, x′′+9x=5cos2t from rest gives x=cos2t−cos3t=2sin2tsin25t, and x′′+9x=6cos3t has the resonant solution x=tsin3t.
For c>0 and the input F0cosωt, solve the complex equation with input F0eiωt instead and take the real part. The complex gain, or frequency response, is
H(iω)=k−mω2+icω1,
and the steady response is
xss=Acos(ωt−φ),A=F0∣H(iω)∣.
The amplitude ratio is ∣H(iω)∣, and the phase lag φ=−argH(iω) is the angle of the point (k−mω2,cω), which lies between 0 and π for ω>0. Compute it with the two-argument arctangent, because arctank−mω2cω gives the wrong quadrant when mω2>k. The full solution is xss plus a transient, a homogeneous solution fitted to the initial values, and the transient decays because c>0.
For x′′+2x′+5x=13cos2t the gain is H(2i)=1+4i1, so the amplitude is 1713≈3.15, the phase lag is arctan4≈1.33 radians, and xss=1713cos2t+1752sin2t. From rest the transient is −e−t(1713cos2t+34117sin2t).
In a series circuit with inductance L, resistance R, capacitance C and applied voltage V(t), let q be the charge on the capacitor and i=q′ the current. Kirchhoff’s voltage law adds the voltage drops Li′, Ri and q/C, which gives
Lq′′+Rq′+Cq=V(t).
Mechanical
Electrical
mass m
inductance L
damping c
resistance R
stiffness k
1/C
force F(t)
voltage V(t)
displacement x
charge q
velocity x′
current i
So ω0=1/LC, and a free circuit is underdamped when 0<R2<4L/C. The stored energy E=21Li2+2Cq2 satisfies E′=Vi−Ri2. With L=1, R=2, C=51 in SI units, V=0, q(0)=1 and i(0)=0, the charge is q=e−t(cos2t+21sin2t), the current is i=−25e−tsin2t and the starting energy is 25 joules.
The Laplace transform turns a linear initial value problem with constant coefficients into algebra in a new variable s, with the initial values built in. It handles switched inputs, impulses and convolutions directly, and partial fractions invert the rational functions it produces. Time starts at t=0, and functions are considered for t≥0 only.
Definition and existence
For f defined for t≥0, the one-sided Laplace transform is
F(s)=L{f}(s)=∫0∞e−stf(t)dt
for the s where the improper integral converges. A function is of exponential order a when ∣f(t)∣≤Meat for all t≥T0, for some constants M and T0.
Existence. If f is piecewise continuous on every interval [0,T] and of exponential order a, the integral converges absolutely for Res>a, or s>a for real s, and F(s)→0 as real s→∞. The actual region of convergence can be larger, and some functions such as et2 have no Laplace transform at all.
Linearity. The Laplace transform of αf+βg is αF+βG on the region where both Laplace transforms exist.
Uniqueness. Two piecewise continuous functions of exponential order with the same Laplace transform agree at every t>0 where both are continuous. The inverse Laplace transform is therefore unique up to the values at isolated points such as jumps.
For example f=2+t+e3t has F(s)=s2+s21+s−31 for Res>3.
Here a, b and c are real constants and u(t−c) is the unit step at c.
f(t)
F(s)
Region
1
s1
Res>0
tn, n=0,1,2,…
sn+1n!
Res>0
eat
s−a1
Res>a
tneat
(s−a)n+1n!
Res>a
sinbt
s2+b2b
Res>0
cosbt
s2+b2s
Res>0
eatsinbt
(s−a)2+b2b
Res>a
eatcosbt
(s−a)2+b2s−a
Res>a
sinhbt
s2−b2b
Res>∣b∣
coshbt
s2−b2s
Res>∣b∣
tsinbt
(s2+b2)22bs
Res>0
u(t−c), c≥0
se−cs
Res>0
δ(t−c), c>0
e−cs
all s
Rule
f(t)
F(s)
First shift
eatf(t)
F(s−a)
Second shift, c≥0
u(t−c)f(t−c)
e−csF(s)
Derivative
f′(t)
sF(s)−f(0)
Second derivative
f′′(t)
s2F(s)−sf(0)−f′(0)
Multiplication by t
tf(t)
−F′(s)
Integral
∫0tf(τ)dτ
sF(s)
Convolution
(f∗g)(t)
F(s)G(s)
Period T>0
f(t+T)=f(t)
1−e−sT1∫0Te−stf(t)dt
Each rule holds where the Laplace transforms involved exist. The derivative rule needs f continuous on [0,∞) and of exponential order a with f′ piecewise continuous, and then it holds for Res>a. The second derivative rule needs the same of f and f′, with f′′ piecewise continuous. The periodic formula holds for Res>0 when f is piecewise continuous, and the convolution is defined in the last topic of this unit.
To find f from a rational F=P/Q with degP<degQ, factor Q over the real numbers and split F into partial fractions.
Factor of Q
Terms
Inverse Laplace transform
s−a
s−aA
Aeat
(s−a)k, a repeated pole
s−aA1+⋯+(s−a)kAk
j=1∑k(j−1)!Ajtj−1eat
(s+α)2+β2 with β>0
(s+α)2+β2C(s+α)+Dβ
e−αt(Ccosβt+Dsinβt)
An irreducible quadratic is put in this form by completing the square, as in s2+4s+13=(s+2)2+9. For example
s2+2s+52s+5=(s+1)2+42(s+1)+23⋅2,
so its inverse is e−t(2cos2t+23sin2t). Similarly s2(s+1)1=−s1+s21+s+11 has the inverse t−1+e−t. When f′ is also piecewise continuous and of exponential order, the initial value theorem f(0+)=lims→∞sF(s) gives a quick check, here f(0)=2 for the first example.
Take the Laplace transform of the equation, use the derivative rules so that the initial values appear, solve the resulting algebraic equation for Y(s) and invert. For ay′′+by′+cy=g(t) with y(0)=y0 and y′(0)=y1,
(as2+bs+c)Y(s)=G(s)+a(sy0+y1)+by0.
For y′′+3y′+2y=4 with y(0)=1 and y′(0)=0,
Y(s)=s(s+1)(s+2)s2+3s+4=s2−s+12+s+21,
so y=2−2e−t+e−2t. The zeros of as2+bs+c are the characteristic roots, and apart from the poles of G they are the only possible poles of Y.
The unit step u(t−c) is 0 for t<c and 1 for t>c, and its value at c does not affect any Laplace transform. An input equal to g1(t) for 0≤t<c and to g2(t) for t≥c is g1(t)+u(t−c)(g2(t)−g1(t)). The second shift theorem needs the switched part written in the elapsed time t−c, which gives
L{u(t−c)g(t)}=e−csL{g(t+c)},
where the last Laplace transform is taken of the function t↦g(t+c). So u(t−2)(t−2) has the Laplace transform s2e−2s, while u(t−2)t, which jumps to height 2, has e−2s(s21+s2). For y′+y=u(t−2)(t−2) with y(0)=0, the Laplace transform Y=s2(s+1)e−2s gives y=u(t−2)(t−3+e−(t−2)), that is,
y={0,t−3+e2−t,t<2,t≥2.
The pulse of period 2 that equals 1 on [0,1) and 0 on [1,2) has, by the periodic formula, the Laplace transform s(1+e−s)1 for Res>0.
and f∗g=g∗f. For piecewise continuous f and g of exponential order, L{f∗g}=F(s)G(s), while the Laplace transform of the product fg is not FG in general.
For any(n)+⋯+a0y=g with all initial values 0, the Laplace transform gives Y(s)=H(s)G(s) with the transfer function
H(s)=ansn+⋯+a01.
The impulse response h, the inverse Laplace transform of H, gives the zero-state response y=h∗g. With nonzero initial values, add the zero-input response, the solution of the homogeneous equation with those values.
The Dirac delta δ(t−t0) is a distribution, not a function. It acts on a continuous function φ by ∫δ(t−t0)φ(t)dt=φ(t0) and is the limit of pulses of area 1 that shrink to the point t0. In ay′′+by′+cy=Jδ(t−t0) with t0>0, the solution y stays continuous at t0 and y′ jumps by J/a.
The poles of H are the zeros of its denominator after cancelling common factors. A rational H whose numerator degree does not exceed its denominator degree is bounded-input bounded-output stable exactly when every pole has negative real part. A pole on the imaginary axis is enough to lose this, as in undamped resonance. The poles describe the input to output behavior with zero initial state, and a cancelled factor can hide an internal mode that grows from nonzero initial values.
For y′′+3y′+2y=3δ(t−2) from rest, H=(s+1)(s+2)1 and h=e−t−e−2t for t≥0, so y=3u(t−2)(e−(t−2)−e−2(t−2)). The poles −1 and −2 give a stable system, with ∫0∞∣h∣dt=21.
For y′+2y=3 with y(0)=0, the convolution gives y=∫0t3e−2(t−τ)dτ=23(1−e−2t), which also solves the Volterra integral equation y(t)=3t−2∫0ty(τ)dτ.
When the coefficients vary, a solution can be built as a power series whose coefficients follow a recurrence. Where the normalized coefficients are analytic this always works, and at a regular singular point a leading power xr, sometimes with a logarithm, is needed. The Bessel and Legendre functions arise this way. In this unit the independent variable is x and primes mean d/dx.
Power series at an ordinary point
Divide by the leading coefficient to get y′′+p(x)y′+q(x)y=0. A point x0 is ordinary when p and q are analytic there, meaning they equal convergent power series in x−x0, and singular otherwise.
Substitute y=∑an(x−x0)n and the series for y′ and y′′.
Shift indices so that every sum shows the same power (x−x0)n.
Set each coefficient to 0 to get a recurrence. The first two coefficients a0=y(x0) and a1=y′(x0) are free and determine the rest.
For y′′+2xy′=0 at 0, matching powers gives (n+2)(n+1)an+2+2nan=0, so for n≥0
an+2=−(n+2)(n+1)2nan.
The even and odd coefficients form separate chains. The choice a0=1, a1=0 gives y=1, and a0=0, a1=1 gives
If p and q are analytic in the disk ∣x−x0∣<ρ of the complex plane, the power series about x0 of every solution converges at least for ∣x−x0∣<ρ. For polynomial coefficients P2(x)y′′+P1(x)y′+P0(x)y=0 with P2(x0)=0, this guaranteed radius is at least the distance from x0 to the nearest complex zero of P2. Complex zeros count, so for (1+x2)y′′+y=0 at 0 the zeros ±i give a radius of at least 1, although the coefficients are smooth on the whole real line.
This is a lower bound, not the exact radius. The equation (1−x)y′′−2y′=0 has the singular point 1 and the solutions C0+1−xC1. The solution 1 has an infinite radius, while 1−x1=∑xn has radius exactly 1. A series also diverges outside its radius where the function is still defined, since ∑xn diverges at x=−1, where 1−x1=21.
A singular point x0=0 is regular when xp(x) and x2q(x) are analytic at 0. Then the equation can be written as x2y′′+xP(x)y′+Q(x)y=0 with P=xp and Q=x2q analytic, and on 0<x<ρ one looks for Frobenius series
y=xrn=0∑∞anxn,a0=0.
The lowest power gives the indicial equation r(r−1)+P(0)r+Q(0)=0. For real roots r1≥r2,
Roots
Two independent solutions
r1−r2 not an integer
a Frobenius series for each root
r1=r2
y1 for r1, and y2=y1lnx+xr1∑n≥1bnxn
r1−r2 a positive integer
y1 for r1, and y2=Cy1lnx+xr2∑n≥0bnxn with b0=0, where C may be 0
The series converge at least on 0<x<ρ, where ρ is the smaller radius of convergence of P and Q. Complex roots α±iβ give complex solutions whose real and imaginary parts are real solutions, such as xαcos(βlnx) in the simplest case. The equation x2y′′+xy′−94y=0 has the roots ±32 and the solutions x2/3 and x−2/3. With 41 in place of 94 the roots ±21 differ by an integer, yet x1/2 and x−1/2 need no logarithm. The equation x2y′′+xy′=0 has the double root 0 and the solutions 1 and lnx.
with indicial roots ±ν. The Bessel function of the first kind is
Jν(x)=m=0∑∞cm(2x)2m+ν,cm=m!Γ(m+ν+1)(−1)m.
So J0(x)=1−4x2+64x4−2304x6+⋯, with J0(0)=1. The general solution on x>0 is C1Jν+C2Yν, where the Bessel function of the second kind Yν is unbounded as x→0+, for example Y0(x)≈π2lnx there. When ν is not an integer, J−ν can be used in place of Yν. The half-order functions are elementary,
J1/2(x)=πx2sinx,J−1/2(x)=πx2cosx.
In radial problems the equation R′′+r1R′+(κ2−r2m2)R=0, with primes meaning d/dr, becomes Bessel’s equation of order m in x=κr. The solutions that stay bounded at r=0 are the multiples of Jm(κr).
Legendre’s equation on −1<x<1, for a constant n≥0, is
(1−x2)y′′−2xy′+n(n+1)y=0.
The point 0 is ordinary and the series coefficients satisfy
ak+2=(k+2)(k+1)(k−n)(k+n+1)ak.
When n is a nonnegative integer, the chain with the parity of n stops at k=n, which gives a polynomial. The Legendre polynomial Pn is that polynomial scaled so that Pn(1)=1, and Rodrigues’ formula gives it directly as Pn(x)=2nn!1dxndn(x2−1)n.
n
0
1
2
3
Pn(x)
1
x
23x2−1
25x3−3x
The polynomials are orthogonal on [−1,1],
∫−11PmPndx=⎩⎨⎧0,2n+12,m=n,m=n.
In the form ((1−x2)y′)′+n(n+1)y=0, the polynomials Pn are the eigenfunctions of a singular Sturm-Liouville problem with eigenvalues n(n+1), where boundedness at x=±1 takes the place of boundary conditions. For integer n every solution that is not a multiple of Pn is unbounded near x=1 or x=−1.
Several interacting quantities form a first-order system for a state vector. For a constant matrix, eigenvalues and eigenvectors give the solutions, the matrix exponential packages them into one map, and in the plane the eigenvalues sort the phase portraits. Undamped coupled oscillators separate into independent normal modes.
Systems and conversion
A first-order system for the state X(t)=(x1,…,xn)T is X′=F(t,X), autonomous when F does not depend on t. It is linear when X′=A(t)X+b(t), and if A(t) and b(t) are continuous on an open interval I, each initial value X(t0)=X0 with t0 in I gives exactly one solution, defined on all of I.
An equation y(n)=G(t,y,y′,…,y(n−1)) becomes a system with X=(y,y′,…,y(n−1))T, so that x1′=x2, up to xn−1′=xn, and xn′=G. The initial data become the vector X(t0)=(y(t0),…,y(n−1)(t0))T. For y′′′+2y′′−y′−2y=0,
X′=00210101−2X,
and the data y(0)=2, y′(0)=1, y′′(0)=−1 become X(0)=(2,1,−1)T, with the solution y=et+2e−t−e−2t.
For a constant matrix A, if Av=λv with v=0, then X=eλtv solves X′=AX. The eigenvalues are the roots of det(A−λI)=0.
Real eigenbasis. If A has n independent eigenvectors v1,…,vn, which is always the case for n distinct eigenvalues, then X=c1eλ1tv1+⋯+cneλntvn, and the constants solve Vc=X(0) for the matrix V with columns v1,…,vn.
Complex pair. For a real A with eigenvalue λ=α+iβ, β=0, and eigenvector v=p+iq with p and q real, the real and imaginary parts of eλtv are two independent real solutions,
X1X2=eαt(pcosβt−qsinβt),=eαt(psinβt+qcosβt).
The matrix with rows (−2,1) and (0,−1) has eigenvalues −2 and −1 with eigenvectors v1=(1,0)T and v2=(1,1)T, and X(0)=(3,1)T gives X=2e−2tv1+e−tv2. The matrix with rows (−1,−2) and (2,−1) has eigenvalues −1±2i with v=(1,−i)T, and X(0)=(1,0)T gives X=e−t(cos2t,sin2t)T, which spirals into the origin counterclockwise.
For X′=AX with a real 2×2 matrix A, trace τ=trA and determinant Δ=detA, the eigenvalues solve λ2−τλ+Δ=0.
Condition
Eigenvalues
The origin is
Δ<0
real, opposite signs
a saddle, unstable
Δ>0, τ2>4Δ
real, distinct, one sign
a node, stable if τ<0 and unstable if τ>0
Δ>0, τ2=4Δ
one repeated real eigenvalue
a star node if A=λI and a degenerate node otherwise, stable if τ<0 and unstable if τ>0
Δ>0, 0<τ2<4Δ
α±iβ with α=0
a spiral, stable if τ<0 and unstable if τ>0
Δ>0, τ=0
±iβ with β=0
a center, stable but not asymptotically stable
Δ=0
0 is an eigenvalue
not isolated, with a whole line of equilibria or, for A=0, the whole plane
For spirals and centers the motion is counterclockwise when the lower left entry of A is positive and clockwise when it is negative. The orbits of a center are ellipses in general, and circles only in special coordinates. A saddle has one attracting and one repelling eigenvector line, and almost every orbit eventually follows the repelling one.
The algebraic multiplicity of an eigenvalue λ is its multiplicity as a root of det(A−λI), and its geometric multiplicity is dimker(A−λI), which is never larger. The matrix is diagonalizable exactly when the two agree for every eigenvalue, and defective otherwise. For a defective 2×2 matrix with eigenvalue λ and eigenvector v, choose a generalized eigenvector w with (A−λI)w=v, which makes v, w a Jordan chain. Then
eλtvandeλt(tv+w)
form a fundamental set. Longer chains, with (A−λI)wk+1=wk, bring in the factors 2!t2, 3!t3 and so on. For the matrix with rows (2,1) and (0,2), the vectors v=(1,0)T and w=(0,1)T form a chain, and X(0)=(0,1)T gives X=e2t(t,1)T. Writing A=2I+N with N2=0 gives etA=e2t(I+tN). The solution teλt still decays when Reλ<0, while for Reλ=0 the factor t makes it unbounded.
converges for every t, satisfies dtdetA=AetA and e0A=I, and gives the solution X(t)=e(t−t0)AX0 of X′=AX with X(t0)=X0. The rule eA+B=eAeB holds when AB=BA and can fail otherwise. With A1 having rows (0,1) and (0,0) and A2 having rows (0,0) and (1,0), the product eA2eA1 has rows (1,1) and (1,2), while eA1+A2 has cosh1 on the diagonal and sinh1 off it. For the oscillator matrix with rows (0,1) and (−4,0),
etA=(cos2t−2sin2t21sin2tcos2t).
A fundamental matrix Φ(t) of X′=A(t)X has n independent solutions as its columns, so Φ′=A(t)Φ and detΦ(t)=0. Every solution is X(t)=Φ(t)Φ(t0)−1X0, and for a constant matrix etA=Φ(t)Φ(0)−1. For A(t) continuous, Liouville’s formula is
detΦ(t)=detΦ(t0)×exp(∫t0ttrA(τ)dτ).
For a time-dependent matrix, X=exp(∫t0tA(τ)dτ)X0 is a solution when A(t)A(s)=A(s)A(t) for all t and s, and not in general.
Undamped masses and springs give Mq′′+Kq=0 for the displacement vector q, with a symmetric positive definite mass matrix M and a symmetric stiffness matrix K. The trial q=vcos(ωt−ϕ) leads to the generalized eigenvalue problem
Kv=ω2Mv.
When K is positive definite there are n positive values ω12,…,ωn2, and the mode shapes vi can be chosen M-orthogonal, viTMvj=0 for i=j. The modal coordinates η defined by q=Vη, with the vi as the columns of V, separate the system into ηi′′+ωi2ηi=0, so every motion is
q(t)=i=1∑nvi(Aicosωit+Bisinωit).
A zero eigenvalue, possible when K is only positive semidefinite, gives a rigid motion ηi=Ai+Bit instead. With M=I and K having rows (3,−1) and (−1,3), the in-phase mode (1,1)T has ω2=2 and the opposite mode (1,−1)T has ω2=4. Releasing q(0)=(2,0)T from rest gives q1=cos2t+cos2t and q2=cos2t−cos2t, and the energy 21(q′)TMq′+21qTKq=6 stays constant.
Most nonlinear systems have no solution formula, so their behavior is read from the geometry of their solutions. Linearization decides stability near most equilibria and Lyapunov functions handle many of the rest. As a parameter changes, equilibria and periodic orbits can appear, disappear or change stability, and in three or more dimensions bounded solutions can be chaotic.
Phase planes and nullclines
For an autonomous planar system x′=f(x,y), y′=g(x,y) with f and g continuously differentiable on an open set, the vector field F=(f,g)T gives the direction of motion at each point.
The x-nullcline is the set where f=0, and the flow crosses it vertically. The y-nullcline is where g=0, and the flow crosses it horizontally.
Equilibria are the points where an x-nullcline meets a y-nullcline.
By uniqueness, trajectories never cross each other and never reach an equilibrium in finite time. A nullcline is usually not a trajectory.
A conserved quantity H, with ∇H⋅F=0, is constant along trajectories, so trajectories lie on its level curves.
The predator and prey model x′=x(2−y), y′=y(x−1) on x,y≥0 has the x-nullclines x=0 and y=2, the y-nullclines y=0 and x=1, and the equilibria (0,0) and (1,2). For x,y>0 the quantity H=x−lnx+y−2lny is conserved and has its minimum at (1,2), so the orbits around (1,2) are closed curves.
Near an equilibrium X∗ of X′=F(X), with F continuously differentiable, the displacement h=X−X∗ approximately satisfies h′=Jh, where J is the Jacobian matrix of F at X∗, with entries ∂Fi/∂xj. The equilibrium is hyperbolic when no eigenvalue of J has zero real part.
If every eigenvalue has negative real part, X∗ is locally asymptotically stable.
If some eigenvalue has positive real part, X∗ is unstable.
At a hyperbolic equilibrium, the Hartman-Grobman theorem says that near X∗ a continuous change of coordinates carries the orbits of the nonlinear system onto those of the linearization, keeping the direction of time.
At a nonhyperbolic equilibrium linearization decides nothing. Both x′=−x3 and x′=x3 have J=0 at the origin, yet the first attracts and the second repels.
These results are local, and the theorem does not say how large the neighborhood is. For x′=x(1−x), y′=−2y, the Jacobian is diag(1−2x,−2), so (1,0) with J=diag(−1,−2) is a sink and (0,0) with J=diag(1,−2) is a saddle. Starting from x(0)=−1, though, x=1−2e−t1 blows up at t=ln2.
Let the origin be an equilibrium of X′=F(X) and let V be continuously differentiable on a neighborhood U of the origin and positive definite, meaning V(0)=0 and V(X)>0 for X=0 in U. Its derivative along solutions is the orbital derivative V˙=∇V⋅F.
On U without the origin
Conclusion
V˙≤0
stable
V˙<0
asymptotically stable
V˙<0, with U the whole space and V→∞ as ∥X∥→∞
globally asymptotically stable
LaSalle’s invariance principle. If K is a compact positively invariant set, one that no solution starting in it leaves in forward time, and V˙≤0 on K, then every solution starting in K approaches the largest invariant set contained in {X∈K:V˙(X)=0}. Here V need not be positive definite.
For x′=y, y′=−x−x3−y take V=21y2+21x2+41x4. Then V˙=−y2≤0, which vanishes on the whole line y=0. A solution staying on that line needs y′=−x−x3=0, so x=0, and the only invariant set there is the origin. The sublevel sets of V are compact and are never left, so the origin is globally asymptotically stable. Without damping, x′=y and y′=−x keep V constant, and the origin is stable but not asymptotically stable. A candidate V that fails these tests proves nothing either way.
For x′=f(x;μ) with f smooth, an equilibrium x∗ is stable when fx(x∗;μ)<0 and unstable when fx(x∗;μ)>0. The number of equilibria near x∗ can change only at a parameter value where f=0 and fx=0 hold together. A bifurcation diagram plots the equilibria against μ and marks which are stable.
Type
Normal form
Equilibria
Stability
Saddle-node
x′=μ−x2
±μ for μ>0, none for μ<0
μ stable, −μ unstable
Transcritical
x′=μx−x2
0 and μ
they exchange stability at μ=0, and the larger one is stable
Supercritical pitchfork
x′=μx−x3
0, and ±μ for μ>0
0 stable for μ<0 and unstable for μ>0, ±μ stable
Subcritical pitchfork
x′=μx+x3
0, and ±−μ for μ<0
0 stable for μ<0 and unstable for μ>0, ±−μ unstable
A pitchfork is typical only for equations with the reflection symmetry f(−x;μ)=−f(x;μ), and without it a small change usually breaks it into other bifurcations. For μ=1 the supercritical form x′=x−x3 with x(0)=21 has the solution x=(1+3e−2t)−1/2, which tends to the stable branch 1.
A periodic orbit is the closed path of a nonconstant periodic solution, and a limit cycle is a periodic orbit with no other periodic orbit in some neighborhood of it. The omega-limit set of a trajectory is the set of points it approaches along some sequence of times tending to ∞.
Poincaré-Bendixson theorem. For a planar system with F continuously differentiable on an open set D, if a forward trajectory stays in a compact set K⊆D and its omega-limit set contains no equilibrium, that omega-limit set is a periodic orbit. In particular, a compact region with no equilibria that no forward trajectory leaves, a trapping region, contains a periodic orbit.
Bendixson-Dulac criterion. If D is a simply connected open set in the plane and some continuously differentiable function B makes ∇⋅(BF)=(Bf)x+(Bg)y positive everywhere on D or negative everywhere on D, then no periodic orbit lies entirely in D. With B=1 this is Bendixson’s criterion.
Both results are about the plane and do not carry over to three dimensions. The system x′=x(1−x2−y2)−y, y′=y(1−x2−y2)+x becomes r′=r(1−r2), θ′=1 in polar coordinates. The unit circle, traced by (cost,sint), is an attracting limit cycle, and the annulus 21≤r≤23 is a trapping region without equilibria. The damped oscillator x′=y, y′=−x−y has divergence −1 everywhere, so it has no periodic orbit.
the origin has eigenvalues μ±i, and polar coordinates give r′=μr−r3 and θ′=1. For μ≤0 the origin is asymptotically stable, at μ=0 only slowly, with r=r0/1+2r02t. For μ>0 the origin is unstable and the circle r=μ is an attracting limit cycle of period 2π. This is a supercritical Hopf bifurcation. Reversing the signs of the cubic terms gives r′=μr+r3, the subcritical case, where an unstable cycle r=−μ surrounds the stable origin for μ<0.
Hopf bifurcation theorem. Take a sufficiently smooth planar family X′=F(X;μ) with an equilibrium X∗(μ) whose Jacobian has eigenvalues α(μ)±iβ(μ), and suppose
the eigenvalues reach the imaginary axis, α(μ0)=0 with β(μ0)=0,
the transversality condition α′(μ0)=0 holds,
the nondegeneracy condition holds, the first Lyapunov coefficient ℓ1 being nonzero.
Then near X∗(μ0) and μ0 a unique family of periodic orbits branches off on one side of μ0, with amplitude proportional to ∣μ−μ0∣ and period near 2π/β(μ0). If ℓ1<0 the orbits are stable and exist where the equilibrium is unstable, the supercritical case. If ℓ1>0 they are unstable and exist where the equilibrium is stable, the subcritical case. The theorem says nothing about large oscillations away from X∗.
A common working definition of chaos is bounded, aperiodic long-term behavior of a deterministic system with sensitive dependence on initial conditions. An autonomous system needs at least three dimensions for it, because the Poincaré-Bendixson theorem restricts bounded planar trajectories. The Lorenz system
x′y′z′=10(y−x),=x(28−z)−y,=xy−38z
has the equilibria (0,0,0) and (±62,±62,27), with matching signs. The origin is a saddle with eigenvalues 2−11±1201 and −38. The divergence of the field is −341 everywhere, so phase-space volumes shrink like e−41t/3 and bounded solutions approach an attractor of zero volume. Nearby solutions on it separate roughly like eλ1t with largest Lyapunov exponent λ1≈0.9, a numerical estimate.
A periodically forced planar equation such as the Duffing equation q′′+δq′+αq+βq3=γcosωt is autonomous in the three variables q, q′ and θ=ωt, and it can be chaotic. A computed trajectory is evidence, not proof, because rounding and truncation errors grow at the same exponential rate as the true separation.
A numerical method follows the solution of y′=f(t,y), y(t0)=y0 in steps of size h, with tn=t0+nh and yn≈y(tn). The order of accuracy says how fast the error falls as h shrinks, and stability says whether errors are damped or amplified. Neither alone guarantees a trustworthy answer, so a computed solution is always checked.
Euler’s method and error
Euler’s method follows the tangent line for one step,
yn+1=yn+hf(tn,yn).
The local truncation error, made in one step that starts from the exact value, is of order h2 when y′′ is bounded. Some books divide it by h and call it of order h.
The global error yn−y(tn) on a fixed interval is of order h. If f is Lipschitz in y with constant L>0 and ∣y′′∣≤K, then
∣yn−y(tn)∣≤2LKh×(eL(tn−t0)−1).
Halving h roughly halves the error once h is small. For y′=−2y with y(0)=1, the step h=41 gives y2=41 at t=21 against e−1≈0.368, and h=81 gives (43)4=25681≈0.316. Each step multiplies by 1−2h, so the computed values decay only for 0<h<1 and stay positive only for h<21.
On smooth problems, halving h divides the global error of a method of order p by about 2p, so by 2 for Euler, 4 for Heun and midpoint and 16 for RK4. One step of h=0.1 for y′=y, y(0)=1 gives
Method
y1
Error against e0.1=1.1051709
Euler
1.1
5.2×10−3
Heun or midpoint
1.105
1.7×10−4
RK4
1.1051708
8.5×10−8
Heun and midpoint agree on this equation but not in general. For y′=t2 from y(0)=0, one step gives 2h3 and 4h3 against the exact 3h3.
Adaptive steps. For RK4, comparing one step of size h with two steps of size h/2 gives the error estimate 15yh/2−yh for the more accurate value yh/2. Embedded pairs get two approximations of different orders from shared stages and use their difference as the local error estimate. A step is accepted when that estimate is at most atol+rtol∣y∣, the absolute tolerance plus the relative tolerance times the size of the solution, and the next step is scaled by about (tol/err)1/(p+1) with a safety factor, where p is the lower order. Tolerances control the estimated local error, not the global error.
Stability is studied on the test equation y′=λy with Reλ<0, whose solutions decay. One step multiplies yn by an amplification factor R(z) with z=hλ, and the region of absolute stability is where ∣R(z)∣<1.
Method
R(z)
Decay for real λ<0 when
Explicit Euler
1+z
h<∣λ∣2
Classical RK4
1+z+2z2+6z3+24z4
h<∣λ∣2.785, approximately
Implicit Euler
1−z1
every h>0
Implicit Euler uses the slope at the new point, yn+1=yn+hf(tn+1,yn+1), so each step solves an equation for yn+1, by Newton’s method when f is nonlinear. A method is A-stable when its stability region contains the whole left half-plane Rez<0. Implicit Euler is A-stable, and no explicit Runge-Kutta method is.
An equation is stiff when fast decaying modes force an explicit method to take steps far smaller than accuracy for the slow behavior would need. For y′=−1000(y−cost)−sint with y(0)=1, the solution is cost, and nearby solutions approach it like e−1000t. With h=0.01 a deviation is multiplied by −9 in an explicit Euler step and by 111 in an implicit Euler step, against the exact factor e−10≈4.5×10−5. Stability is not accuracy, and implicit Euler is still only of order h.
For y′′=f(x,y,y′) on [a,b] with y(a)=α and y(b)=β, in the variable x, two methods are standard.
Shooting. Solve the initial value problem with y(a)=α and y′(a)=σ, and adjust σ until the residual R(σ)=y(b;σ)−β is zero, by bisection, the secant method or Newton’s method.
Finite differences. On the grid xi=a+ih replace y′′(xi) by
h2Yi+1−2Yi+Yi−1,
which has error of order h2, and solve the resulting system, which is tridiagonal for a linear equation.
For y′′=−2 with y(0)=y(1)=0 and h=41, the system 2Yi−Yi−1−Yi+1=81 gives (Y1,Y2,Y3)=(163,41,163), exactly the values of y=x−x2, because the difference quotient is exact for quadratics. When the homogeneous problem has a nonzero solution, as Asinπx does for y′′+π2y=0 with y(0)=y(1)=0, the boundary problem has no solution or infinitely many. Numerically this shows up as a nearly singular system or a shooting residual that does not depend on σ.
Residual. Substitute the computed solution into the equation and check that the difference between the two sides is small.
Data. Check the initial and boundary values separately.
Refinement. Halve the step or tighten the tolerances and check that the answer settles. With an error Eh against a trusted value, the observed order is p≈log2(Eh/Eh/2).
Units and invariants. Every term must have the same units, and conserved quantities such as energy or total mass should stay constant to the expected accuracy.
Events and singularities. An event is a time at which a stated condition first holds, located during the integration. A singularity is where the solution stops existing, and no solver can integrate through it.
For y′=y2 with y(0)=1, the solution 1−t1 reaches the event y=4 at t=43 and blows up at t=1. Euler with h=41 gives Y1=45 and Y2=64105≈1.64 against y(21)=2. Near t=1 refinement stops settling, which signals the singularity.
Conditions at both ends of an interval behave differently from initial conditions. A linear boundary problem has exactly one solution, none or infinitely many, depending on whether the homogeneous problem has a nonzero solution. The parameter values that produce such solutions are eigenvalues, and their eigenfunctions are the building blocks of Fourier series and separation of variables. In this unit the independent variable is x.
Solvability
Take a linear second-order equation L[y]=f on [a,b] with continuous coefficients, a nonzero leading coefficient and two homogeneous linear boundary conditions.
If the homogeneous problem, with f=0, has only the zero solution, there is exactly one solution for every continuous f.
If it has a nonzero solution φ, the problem is resonant and has no solution or infinitely many. For self-adjoint problems such as y′′+y=f with zero end values, a solution exists exactly when the compatibility condition ∫abfφdx=0 holds, and then the solutions are yp+Cφ.
For y′′+y=f on [0,π] with y(0)=y(π)=0, the homogeneous solution is sinx and the condition is ∫0πf(x)sinxdx=0. The forcing sinx fails it, since the particular solution −21xcosx has the value 2π at π and no multiple of sinx can correct that. The forcing cosx passes, with the solutions 21xsinx+Csinx. On [0,2π] with zero end values the homogeneous problem has only the zero solution, and f=1 gives the single solution 1−sinx−cosx.
An eigenvalue problem asks for the numbers λ for which −y′′=λy with homogeneous boundary conditions has a nonzero solution, an eigenfunction. Every nonzero multiple of an eigenfunction is again one, and the cases λ<0, λ=0 and λ>0 are checked separately. On [0,ℓ],
Boundary conditions
Eigenvalues
Eigenfunctions
Dirichlet, y(0)=y(ℓ)=0
(ℓnπ)2, n=1,2,…
sinℓnπx
Neumann, y′(0)=y′(ℓ)=0
(ℓnπ)2, n=0,1,2,…
cosℓnπx, the constant for n=0
Mixed, y(0)=0 and y′(ℓ)=0
(2ℓ(2n−1)π)2, n=1,2,…
sin2ℓ(2n−1)πx
Periodic, y(0)=y(ℓ) and y′(0)=y′(ℓ)
(ℓ2nπ)2, n=0,1,2,…
the constant, and both cosℓ2nπx and sinℓ2nπx for n≥1
The Neumann and periodic problems have the zero eigenvalue with a constant eigenfunction, the zero mode, and each periodic eigenvalue with n≥1 has two independent eigenfunctions. The Robin conditions y′(0)=h0y(0) and y′(ℓ)=−hℓy(ℓ), with the signs set by the outward direction at each end, lead to the identity
λ∫0ℓy2dx=∫0ℓ(y′)2dx+h0y(0)2+hℓy(ℓ)2.
So for h0,hℓ≥0, not both zero, every eigenvalue is positive. They are λ=k2 with k>0 solving (h0+hℓ)kcoskℓ=(k2−h0hℓ)sinkℓ, with eigenfunctions kcoskx+h0sinkx. A normalized eigenfunction has ∫0ℓφ2dx=1, as 2/ℓsinℓnπx does in the Dirichlet case.
A regular Sturm-Liouville problem on a finite interval [a,b] is
−(py′)′+qy=λwy,
where p is continuously differentiable with p>0 on [a,b], q and w are continuous with w>0 on [a,b], and the boundary conditions are separated,
α0y(a)+β0p(a)y′(a)=0,α1y(b)+β1p(b)y′(b)=0,
with real coefficients and neither pair (αi,βi) equal to (0,0). Under these hypotheses
the eigenvalues are real and simple and form an increasing sequence λ1<λ2<⋯ that tends to ∞, though the first ones may be negative,
eigenfunctions with different eigenvalues are orthogonal with the weight w, so ⟨u,v⟩w=∫abwuvdx=0,
the eigenfunctions are complete, so every square-integrable f has an expansion f=∑cnφn in the weighted mean-square sense, with cn=⟨f,φn⟩w/⟨φn,φn⟩w.
The problem −y′′−2y=λy with Dirichlet conditions on [0,π] has λ1=−1 with y=sinx, which shows that positive p and w do not make every eigenvalue positive. With p=w=ex, q=0 and y(0)=y(π)=0, the eigenvalues are n2+41 with eigenfunctions e−x/2sinnx, orthogonal with the weight ex. Legendre’s equation, where p=1−x2 vanishes at ±1, is singular, and periodic conditions are not separated and allow double eigenvalues, so the regular theorem does not apply to either as stated.
When the homogeneous problem has only the zero solution, the solution of L[y]=f with homogeneous boundary conditions is an integral against a Green’s function, y(x)=∫abG(x,s)f(s)ds. For −y′′=f on [0,1] with y(0)=y(1)=0,
G(x,s)={x(1−s),s(1−x),x≤s,x≥s.
As a function of x, the kernel is continuous, solves the homogeneous equation for x=s, satisfies both boundary conditions and has a derivative jump Gx(s+,s)−Gx(s−,s)=−1. For f=2 it gives y=x(1−x). For −(py′)′+qy=f with separated conditions, let u1 solve the homogeneous equation with the left condition and u2 with the right one. Then pW is constant for W=u1u2′−u1′u2, and
G(x,s)=−pWu1(x<)u2(x>),
with x<=min(x,s) and x>=max(x,s). The derivative jump at x=s is then −1/p(s).
Fredholm alternative. For −(py′)′+qy−λwy=f with separated conditions on a regular interval, exactly one of two cases holds. Either λ is not an eigenvalue and there is exactly one solution for each continuous f, or λ is an eigenvalue with eigenfunction φ, and then a solution exists exactly when ∫abfφdx=0, and adding multiples of φ gives all solutions. If the forcing is written as f=wg, the condition reads ∫abwgφdx=0. For −y′′−π2y=f on [0,1] with zero end values, φ=sinπx. The forcing sinπx has no solution, and cosπx has the solutions −2πxsinπx+Csinπx.
An Euler-Bernoulli beam with constant bending stiffness EI and mass per unit length ρA has transverse displacement u(x,t) with
ρAutt+EIuxxxx=0.
Vibrations u=X(x)cosωt need X′′′′=β4X with β4=ρAω2/EI, where primes mean d/dx, so X is a combination of cosβx, sinβx, coshβx and sinhβx.
End
Conditions
Meaning
Clamped
X=X′=0
no displacement and no rotation
Pinned
X=X′′=0
no displacement and no bending moment
Free
X′′=X′′′=0
no bending moment and no shear force
For a beam of length ℓ, the frequencies are ω=β2EI/(ρA), with β from
Supports
Frequency equation
Smallest positive βℓ
pinned at both ends
sinβℓ=0
π
clamped at both ends
cosβℓcoshβℓ=1
4.7300
clamped and free
cosβℓcoshβℓ=−1
1.8751
A pinned beam has the modes sinℓnπx with ωn=(ℓnπ)2EI/(ρA), and a free beam also has the zero-frequency rigid modes X=1 and X=x. With any combination of these end conditions, integration by parts gives EI∫0ℓ(X′′)2dx=ρAω2∫0ℓX2dx, so ω2≥0.
Fourier Methods and Partial Differential Equations
A Fourier series writes a function as a sum of sines and cosines, the eigenfunctions of the boundary problems above. With separation of variables these series solve the heat, wave and Laplace equations on bounded regions, characteristics solve first-order transport equations, and the Fourier transform does the same work on the whole line. In this unit ut, ux and uxx are partial derivatives.
Fourier series
For a function f of period 2L, integrable on [−L,L], the Fourier series is
f(x)∼2a0+n=1∑∞ancosLnπx+n=1∑∞bnsinLnπx,
with the coefficients, for n≥0 and n≥1 respectively,
With the inner product ⟨f,g⟩=∫−LLfgdx, the functions 1, cosLnπx and sinLnπx are mutually orthogonal, with ⟨1,1⟩=2L and squared norm L for the others, and each coefficient is an orthogonal projection. So the partial sum SN through n=N is the trigonometric polynomial of that degree closest to f in mean square. An even f has every bn=0 and an odd f has every an=0. For square-integrable f, Parseval’s identity is
L1∫−LLf(x)2dx=2a02+n=1∑∞(an2+bn2).
The sawtooth of period 2π equal to x on (−π,π) is odd, with bn=n2(−1)n+1, so
Convergence, Gibbs phenomenon and half-range series
Pointwise convergence. Let f be periodic and piecewise smooth, meaning that in each period f and f′ are continuous except at finitely many points, where they have finite one-sided limits. Then the Fourier series converges at every x to 21(f(x−)+f(x+)), which is f(x) wherever f is continuous.
Gibbs phenomenon. Near a jump of size J the partial sums overshoot on each side by about 0.0895J however many terms are taken. The overshoot gets narrower but not lower. The exact fraction is π1∫0πusinudu−21≈0.08949.
Decay. Coefficients of a function whose periodic extension has a jump decrease like 1/n, and those of a function with a continuous periodic extension and a piecewise smooth derivative decrease at least like 1/n2.
Termwise operations. Termwise integration is valid for piecewise continuous f. Termwise differentiation is valid when the periodic extension of f is continuous and f′ is piecewise smooth. Differentiating the sawtooth series term by term gives 2∑(−1)n+1cosnx, whose terms do not even tend to 0.
A function given only on (0,L) has a half-range sine series from its odd extension and a half-range cosine series from its even extension,
Sine series suit Dirichlet conditions and cosine series suit Neumann conditions. The constant 1 on (0,π) has the sine series π4(sinx+3sin3x+5sin5x+⋯), which is 0 at x=0 and x=π, the jump averages of the odd extension, while its cosine series is just 1.
with A, B and C not all zero at a point, is classified there by the sign of B2−AC, which comes from the principal part, the second-order terms.
B2−AC
Type
Example
negative
elliptic
Laplace’s equation uxx+uyy=0
zero
parabolic
the heat equation ut=κuxx
positive
hyperbolic
the wave equation utt=c2uxx
The type can change with position. The equation uxx+yuyy=0 is elliptic for y>0 and hyperbolic for y<0. A problem is well posed when a solution exists, it is unique and it depends continuously on the data, each measured in a stated norm. Data must also be compatible, so for a classical heat solution that is continuous up to the corners, the initial temperature at an end must equal the boundary temperature there at t=0. The backward heat equation ut=−uxx on [0,π] with zero end values is not well posed. Its solutions e−n+n2tsinnx start with size e−n→0 but have size en2−n→∞ at t=1.
The transport equation ut+cux=0 with constant speed c keeps u constant along the characteristic lines x=ξ+ct, so the data u(x,0)=f(x) give u(x,t)=f(x−ct), a shape moving at speed c. With a variable speed, ut+a(x,t)ux=0 keeps u constant along the characteristic curves dtdx=a(x,t), and with a source term g the value changes along them by dtdu=g. For ut+xux=0 the characteristics are x=ξet and u=f(xe−t).
On x≥0 with c>0, information enters at x=0, the inflow boundary, so boundary data u(0,t)=g(t) are given there and nothing is prescribed at an outflow boundary. The solution is f(x−ct) for x≥ct and g(t−x/c) for 0≤x<ct, and it is continuous when g(0)=f(0).
For the inviscid Burgers’ equation ut+uux=0 with u(x,0)=f(x), each characteristic x=ξ+f(ξ)t carries the value f(ξ). If f′ is bounded below and negative somewhere, characteristics first cross at the time t∗=−1/inff′, where the smooth solution breaks down. The data f=−x give u=−1−tx for t<1. After a breakdown one uses weak solutions, which can jump, together with an admissibility condition that selects the physical one. For Burgers’ equation a jump from uL down to uR<uL moves at the shock speed 2uL+uR.
The heat equation ut=κuxx on 0<x<L, with thermal diffusivity κ>0 and initial temperature u(x,0)=f(x), is solved by separation of variables. Products u=X(x)T(t) need X′′+λX=0 with the boundary conditions and T′=−κλT.
Ends
Solution
held at 0, u(0,t)=u(L,t)=0
n=1∑∞bne−κ(nπ/L)2tsinLnπx
insulated, ux(0,t)=ux(L,t)=0
2a0+n=1∑∞ane−κ(nπ/L)2tcosLnπx
Here bn and an are the half-range sine and cosine coefficients of f. Each mode decays at the rate κ(nπ/L)2, so high frequencies die fastest and the solution is smooth for t>0 even when f is not. Insulated ends keep the mean temperature L1∫0Ludx=2a0 constant, and u tends to it. For fixed end temperatures u(0,t)=A and u(L,t)=B, subtract the steady state A+(B−A)x/L, which leaves a problem with zero end values. With zero end values the quantity 21∫0Lu2dx decreases at the rate κ∫0Lux2dx. On [0,π] with κ=2, the data f=sinx+2sin2x and zero end values give u=e−2tsinx+2e−8tsin2x.
The wave equation utt=c2uxx needs an initial displacement u(x,0)=f(x) and an initial velocity ut(x,0)=g(x). With fixed ends u(0,t)=u(L,t)=0 the normal modes sinLnπx vibrate at the frequencies ωn=Lnπc, and
where fn and gn are the sine coefficients of f and g. Free ends, ux=0, give cosine modes and a zero mode A+Bt that moves the whole string. On the whole line, d’Alembert’s formula is
So u(x,t) depends only on the data in the domain of dependence [x−ct,x+ct], and disturbances travel no faster than c. Every twice differentiable solution on the whole line has the form F(x−ct)+G(x+ct), two traveling waves. With fixed or free ends the energy 21∫0L(ut2+c2ux2)dx is constant. On [0,π] with c=2, the data f=sinx and g=sin2x give u=sinxcos2t+41sin2xsin4t, with energy 45π.
Write Δu=uxx+uyy, which in polar coordinates is urr+r1ur+r21uθθ. A harmonic function solves Laplace’s equation Δu=0, and Poisson’s equation is Δu=f.
Rectangle. On 0<x<a, 0<y<b with u=0 on three sides and u(x,b)=g(x), separation of variables gives u=∑cnsinanπxsinhanπy, where cnsinhanπb is the nth half-range sine coefficient of g.
Disk. On r<R with u(R,θ)=g(θ), the bounded solution is u=2a0+∑n≥1(Rr)n(ancosnθ+bnsinnθ), with the Fourier coefficients of g. The separated solutions r−n and lnr are excluded because they are unbounded at the center.
Maximum principle. A function harmonic in a bounded region and continuous up to its boundary takes its maximum and its minimum on the boundary. So the Dirichlet problem, with u given on the boundary, has at most one solution.
Neumann problem. For Δu=f in a region Ω with normal derivative ∂u/∂n=h on its boundary, a solution can exist only if ∫ΩfdA=∮∂Ωhds, and it is then unique up to an added constant.
The function x2−y2=r2cos2θ is harmonic. The function u=x2+y2−1 solves Δu=4 in the unit disk with u=0 on the circle. Its normal derivative on the circle is 2, and the compatibility condition checks, since 4π=2⋅2π.
For f integrable on the real line R, the Fourier transform and its inverse are
f^(k)f(x)=∫Rf(x)e−ikxdx,=2π1∫Rf^(k)eikxdk,
where the inverse formula holds at every point where f is continuous when f^ is integrable too.
Function
Fourier transform
Conditions
f′(x)
ikf^(k)
f and f′ integrable
f′′(x)
−k2f^(k)
f, f′ and f′′ integrable
f(x−c)
e−ikcf^(k)
c real
∫Rf(x−y)g(y)dy
f^(k)g^(k)
f and g integrable
e−ax2
aπe−k2/(4a)
a>0
For the heat equation ut=κuxx on the whole line with u(x,0)=f(x), taking the Fourier transform in x gives u^t=−κk2u^, so u^(k,t)=e−κk2tf^(k). For bounded continuous f and t>0,
The heat kernel K is positive with integral 1, so for integrable f the total heat ∫udx stays constant. With κ=1 the data e−x2 give u=1+4t1e−x2/(1+4t), whose integral stays π. Backward in time each frequency would grow like eκk2t, which is why the backward problem is not well posed.
The course closes with a constructive proof of existence and three introductions to further study. Picard iteration builds the solution of an initial value problem as a limit, perturbation methods approximate solutions when a parameter is small, and delay and differential-algebraic equations show what changes when the state includes the past or must satisfy constraints.
Picard iteration
For y′=f(t,y), y(t0)=y0 with f continuous, a continuous function y solves the problem on an interval exactly when it solves the integral equation
y(t)=y0+∫t0tf(s,y(s))ds.
Picard iteration starts from the constant φ0(t)=y0 and repeats
φn+1(t)=y0+∫t0tf(s,φn(s))ds.
Picard-Lindelöf theorem. Let f be continuous on the rectangle R={∣t−t0∣≤a,∣y−y0∣≤b} with ∣f∣≤M and ∣f(t,y1)−f(t,y2)∣≤L∣y1−y2∣ on R. Then on ∣t−t0∣≤h with h=min(a,b/M), the iterates converge uniformly to the unique solution. On an interval ∣t−t0∣≤T with MT≤b and q=LT<1, the iteration is a contraction in the sup norm, and
∥φn−y∥∞≤1−qqn∥φ1−φ0∥∞.
The condition MT≤b keeps the iterates inside R, and LT<1 makes them contract. Existence is local, as y′=y2 with y(0)=1 shows, since its solution 1−t1 exists only for t<1. For y′=1+y with y(0)=0, the iterates are φ1=t, φ2=t+2t2 and φ3=t+2t2+6t3, partial sums of the solution et−1. On 0≤t≤21 with b=1 the constants are M=2 and L=1, so q=21 and the bound gives ∥φ3−y∥∞≤81, while the actual error is about 0.003.
These methods approximate a problem with a small parameter 0<ε≪1, and each approximation comes with an interval of validity that should be stated.
Regular perturbation. Substitute y=y0+εy1+ε2y2+⋯ and collect equal powers of ε. Each yk solves a linear problem.
Secular terms. For y′′+(1+ε)2y=0 with y(0)=1 and y′(0)=0, the exact solution cos((1+ε)t) has the expansion cost−εtsint+⋯, whose term εtsint grows with t. The expansion is accurate only while εt is small.
Multiple scales. A slow time T=εt lets the amplitudes vary, and removing the secular terms gives y≈cos(t+T), which here is exact.
Singular perturbation. When ε multiplies the highest derivative, setting ε=0 lowers the order and the reduced problem cannot meet every boundary condition, so a thin boundary layer forms.
For εy′′+y′=0 in the variable x with y(0)=0 and y(1)=1, the outer solution is y=1, the inner variable ξ=x/ε gives the layer 1−e−ξ, and the composite approximation 1−e−x/ε differs from the exact solution 1−e−1/ε1−e−x/ε by at most e−1/ε.
A delay equation such as y′(t)=F(t,y(t),y(t−τ)) with τ>0 needs as initial data a history function φ on [t0−τ,t0], not just the value y(t0). Its state at time t is the whole piece of y on [t−τ,t], so the state space is infinite-dimensional. In the method of steps, the delayed values on [t0,t0+τ] come from φ, so the equation there is an ordinary one, and its solution supplies the delayed values for the next interval of length τ. A jump in a derivative at t0 reappears one delay later in a higher derivative.
For y′(t)=−y(t−1) with history 1 on [−1,0], the method gives y=1−t on [0,1] and y=2t2−2t+23 on [1,2]. The history 1+s has the same value y(0)=1 but gives y=1−2t2 on [0,1], a different future.
For y′(t)=−ay(t−τ) with a>0 and τ>0, the function eλt is a solution when
λ=−ae−λτ,
an equation with infinitely many complex roots. Every root has negative real part, and the zero solution is asymptotically stable, exactly when aτ<2π. At aτ=2π the roots ±ia cross the imaginary axis, so a long enough delay destabilizes feedback that is stable without delay.
A semi-explicit differential-algebraic equation x′=f(t,x,z), 0=g(t,x,z) has differential variables x and algebraic variables z, which are fixed at each instant by the constraint rather than by their own rate equations. Initial values must be consistent, satisfying the constraint and every hidden constraint found by differentiating it. The differentiation index is the number of times the constraints must be differentiated to obtain an ordinary differential equation for all the variables. If ∂g/∂z is invertible, the constraint determines z locally and one differentiation gives z′, so the index is 1.
For x′=−x+z and 0=x+z−1, the value x(0)=0 forces z(0)=1, and z=1−x gives x′=1−2x, so x=21(1−e−2t) and z=21(1+e−2t). A pendulum with unit mass, length and gravity, with y measured upward, written as x′=v, y′=w, v′=−λx, w′=−1−λy with the constraint x2+y2=1, needs three differentiations. The first gives xv+yw=0, so the velocity is tangent to the circle, the second gives the multiplier λ=v2+w2−y, and the third gives λ′, so this formulation has index 3. A differentiated constraint alone loses information, since x′+z′=0 only says that x+z is constant, and consistent initial values select the constant 1.
May we count page visits to understand which courses and learning features are useful? Cloudflare collects visit and performance statistics, without your account details or answers. Your choice does not affect access. Details