ODE on Chen Kai Blog

Ordinary Differential Equations (18): Frontiers and Series Finale

Mon, 15 Apr 2024 09:00:00 +0000

The journey ends here. Eighteen chapters ago we picked up a falling apple. Today we’re going to finish in the same vein in which we began – by treating ODEs as the universal language of change – but standing on a much taller mountain.

This chapter does three things. First, it surveys four active research frontiers that are reshaping how we model dynamical systems: Neural ODEs, delay equations, stochastic differential equations, and fractional calculus. Second, it reviews the entire series with a problem-solving flowchart and a chapter-by-chapter map. Third, it draws explicit connections from the classical theory you have just mastered to modern machine learning – the place where ODEs are most alive in 2025.

Ordinary Differential Equations (17): Physics and Engineering Applications

Fri, 29 Mar 2024 09:00:00 +0000

Differential equations are not a pure mathematical game – they are the language for understanding the physical world. From celestial motion to circuit response, from a swinging pendulum to vortex shedding behind a bridge cable, every dynamical system “speaks” ODE.

This chapter is a deliberate tour through five canonical applications. Each one will pay back the entire ODE toolkit we built in chapters 1-16: phase planes, eigenvalues, Laplace transforms, modal analysis, conservation laws, numerical integration, control. None of the examples is a “toy” – they are all genuine working physics, written tightly so that the structure remains visible.

Ordinary Differential Equations (16): Fundamentals of Control Theory

Tue, 12 Mar 2024 09:00:00 +0000

When you steer a car you constantly correct based on lane position. A thermostat compares room temperature with the setpoint and adjusts a heater. A rocket gimbal nudges its thrust vector to keep the booster vertical. Strip away the hardware and the same idea remains: measure, compare, act. Control theory is the mathematics of that loop – and its native language is the ordinary differential equation.

This chapter shows how the entire ODE toolkit – Laplace transforms (Ch 4), linear systems (Ch 6), eigenvalue stability (Ch 7), nonlinear stability (Ch 8) – collapses into a single unified discipline whose job is no longer to describe dynamics, but to design them.

Ordinary Differential Equations (15): Population Dynamics

Sat, 24 Feb 2024 09:00:00 +0000

Why do lynx and snowshoe hare populations cycle with eerie regularity over a 10-year period? Why does introducing a single new species sometimes collapse an entire ecosystem? Why do similar competitors sometimes coexist and sometimes drive each other extinct? The answers are not in the species; they are in the equations relating the species. This chapter walks through the canonical models of mathematical ecology: from the single-population logistic and Allee models to multi-species competition, predator-prey oscillations, age structure, and spatial spread.

Ordinary Differential Equations (14): Epidemic Models and Epidemiology

Wed, 07 Feb 2024 09:00:00 +0000

In early 2020 the entire world watched a small system of ordinary differential equations decide policy. “Flatten the curve” was not a slogan; it was the intuition of a specific equation. Herd immunity was not a guess; it was the threshold $1 - 1/R_0$ derived in a single line. The SIR model – four lines of math, written down in 1927 by Kermack and McKendrick – turned out to be precise enough to drive trillion-dollar decisions.

Ordinary Differential Equations (13): Introduction to Partial Differential Equations

Sun, 21 Jan 2024 09:00:00 +0000

Once a quantity depends on more than one variable, the ODE world splinters into a vastly richer one: partial differential equations. Heat in a metal rod is a function of position and time; a vibrating string moves in space and time; a steady electrostatic potential lives in three spatial dimensions. ODE techniques become tools, not solutions – separation of variables turns one PDE into a family of ODEs, the eigenvalues of those ODEs become the spectrum of the operator, and superposition stitches everything back together.

Ordinary Differential Equations (12): Boundary Value Problems

Thu, 04 Jan 2024 09:00:00 +0000

An initial value problem hands you a starting state and asks you to march forward. A boundary value problem (BVP) hands you partial information at two different points and asks you to find a path that fits both. The change is small in wording, large in consequence: BVPs can have a unique solution, no solution at all, or infinitely many. They demand a fundamentally different toolkit – one that is iterative, global, and intimately connected to linear algebra.

Ordinary Differential Equations (11): Numerical Methods

Mon, 18 Dec 2023 09:00:00 +0000

Almost every interesting differential equation in science and engineering refuses to yield a closed-form solution. Nonlinear vector fields, variable coefficients, ten thousand coupled state variables – pen and paper give up long before the problem does. Numerical integration is the way through. This chapter builds, evaluates, and compares the small set of algorithms that solve essentially every ODE you will meet, and gives you the diagnostics to know when an integrator is lying to you.

Ordinary Differential Equations (10): Bifurcation Theory

Fri, 01 Dec 2023 09:00:00 +0000

A lake stays clear for decades, then turns murky in a single season. A power grid hums along stably, then trips into a cascading blackout in seconds. A column under slowly increasing load is straight, straight, straight – and then suddenly buckles.

These are not failures of prediction. They are the universe doing exactly what dynamical systems theory says it must do: cross a bifurcation. When a parameter drifts past a critical value, the topology of phase space rearranges itself, and what was once impossible becomes inevitable. This chapter is about classifying those rearrangements. There turn out to be only a handful of them, and once you see the catalogue you start spotting them everywhere.

ODE Chapter 9: Chaos Theory and the Lorenz System

Tue, 14 Nov 2023 09:00:00 +0000

In 1961, Edward Lorenz restarted a weather simulation from a rounded-off number – 0.506 instead of 0.506127. Within simulated weeks the forecast was unrecognisable. That single accident gave us the butterfly effect and turned chaos from a metaphor into a science. The lesson is profound and sober: equations that are exactly deterministic can still be practically unpredictable.

What You Will Learn

The four conditions that together define chaos
The Lorenz system: paradigm of deterministic chaos
Butterfly effect, visualised on the attractor itself
Lyapunov exponents: numerical fingerprint of chaos
Bifurcation cascades and the period-doubling route to chaos
Other chaotic systems: Rossler and the double pendulum
Strange attractors, fractal dimension, stretching-and-folding
Applications: weather, encryption, controlling chaos, ensemble forecasting

Prerequisites

Chapter 8: nonlinear systems, phase portraits, limit cycles
Chapter 7: stability and bifurcation basics
Comfort with 3D visualization

What Is Chaos?

A chaotic system satisfies all four of:

ODE Chapter 8: Nonlinear Systems and Phase Portraits

Sat, 28 Oct 2023 09:00:00 +0000

The real world is nonlinear. Predator-prey cycles, heartbeat rhythms, neuron firing – none of these can be captured by linear equations. When superposition fails, the world acquires new behaviors: limit cycles, multiple equilibria, bistability, hysteresis. This chapter gives you the geometric and analytic tools to read those behaviors directly off a 2D phase portrait.

What You Will Learn

Why nonlinear systems are fundamentally different from linear ones
Lyapunov stability visualized: level sets, bowls, and basins
Linearization vs. the full nonlinear picture (Hartman-Grobman in action)
Lotka-Volterra predator-prey: closed orbits and conserved quantities
Competition models: four canonical outcomes
Van der Pol oscillator and the geometry of limit cycles
Gradient and Hamiltonian systems
Poincare-Bendixson: why 2D systems cannot be chaotic

Prerequisites

Chapter 6: linear systems, phase portrait classification
Chapter 7: stability, linearization, Lyapunov functions

From Linear to Nonlinear

Linear systems obey superposition: if $\mathbf{x}_1$ and $\mathbf{x}_2$ are solutions, so is $c_1\mathbf{x}_1 + c_2\mathbf{x}_2$. This is the engine that powers the entire toolkit of Chapters 1-6 – exponential ansatz, eigenvectors, fundamental matrices.

ODE Chapter 7: Stability Theory

Wed, 11 Oct 2023 09:00:00 +0000

A small push hits a system. Does it return to rest, drift away, or break entirely? That single question decides whether bridges survive storms, ecosystems recover from droughts, and economies bounce back from crises. Stability theory answers it – and it does so without ever solving the differential equation. We will learn to read the destiny of a system off the geometry of its phase plane.

What You Will Learn

Three precise notions: Lyapunov stable, asymptotically stable, unstable
Linearization via the Jacobian and the Hartman-Grobman theorem
Lyapunov’s direct method – proving stability with energy-like functions
LaSalle’s invariance principle for borderline cases
Trace-determinant classification of all 2D linear systems
Four canonical bifurcations: saddle-node, transcritical, pitchfork, Hopf
Worked applications: pendulum, predator-prey, inverted pendulum control

Prerequisites

Chapter 6: linear systems, eigenvalues, phase portraits
Multivariable calculus: partial derivatives, Jacobian matrix

A Visual Tour Before the Theory

Stability is, at heart, a geometric statement about how trajectories move in phase space. Six pictures tell the entire story of 2D linear systems.

ODE Chapter 6: Linear Systems and the Matrix Exponential

Sun, 24 Sep 2023 09:00:00 +0000

One equation describes one quantity. The world is rarely that obliging. Predator and prey populations push each other up and down. Currents and voltages in an RLC network oscillate together. Chemical species in a reaction network feed into one another. The moment two unknowns share an equation, you have a system, and a single $y'=ay$ is no longer enough.

The miracle of the linear case is this: the scalar formula $y(t)=e^{at}y_0$ generalizes verbatim once you learn what $e^{At}$ means for a matrix $A$. Linear algebra and ODEs fuse into one object — the matrix exponential — and its eigenstructure tells you everything about the long-term behavior, the geometry of the flow, and the physics of normal modes and beats.

ODE Chapter 5: Power Series and Special Functions

Thu, 07 Sep 2023 09:00:00 +0000

Some ODEs have no solutions in terms of familiar functions. The Bessel equation, the Legendre equation, the Airy equation – all arise naturally in physics (heat conduction in cylinders, gravitational fields of planets, quantum tunneling). Their solutions define entirely new functions. This chapter shows you how to find them using power series, why the Frobenius extension is forced upon us at singular points, and why the same handful of “special functions” keeps appearing across physics and engineering.

ODE Chapter 4: The Laplace Transform

Mon, 21 Aug 2023 09:00:00 +0000

The Laplace transform turns calculus into algebra. Instead of grinding through integration, guessing trial solutions, and bolting on initial conditions at the end, you transform the entire ODE — equation, forcing, and initial data — into a single polynomial equation in a complex variable $s$. You solve it like a high-school problem, then transform back. Along the way, the shape of the solution becomes geometry: poles in the left half of the complex plane decay, poles on the right blow up, poles on the imaginary axis ring forever. This chapter develops that picture from first principles and connects it to the engineering tools — transfer functions, Bode plots, PID control — that turned the Laplace transform into the lingua franca of dynamics.

ODE Chapter 3: Higher-Order Linear Theory

Fri, 04 Aug 2023 09:00:00 +0000

A first-order ODE has memory of one number; a second-order ODE has memory of two. That tiny extra degree of freedom is what lets the same equation describe a plucked guitar string, the suspension of your car, the L-C tank circuit inside an FM radio, and the swaying of a tall building in the wind. In every case the same three regimes appear – oscillate, return-with-a-touch-of-overshoot, or crawl back – and the same algebraic gadget, the characteristic equation, predicts which one happens.

ODE Chapter 2: First-Order Methods

Tue, 18 Jul 2023 09:00:00 +0000

A bank account, a drug clearing the bloodstream, a tank of brine, a charging capacitor — they all obey the same kind of equation: a first-order ODE. The trick is recognising which of four shapes you are looking at, because each shape has a closed-form move that solves it cleanly. By the end of this chapter you will pattern-match an unfamiliar first-order equation in seconds and know exactly which lever to pull.

ODE Chapter 1: Origins and Intuition

Sat, 01 Jul 2023 09:00:00 +0000

Everything around you is changing. Coffee cools, populations grow, pendulums swing, viruses spread, stocks oscillate, planets orbit. None of these systems are described by what something equals — they are described by how fast something changes. That second mode of description is what differential equations are for, and learning to read them is, quite literally, learning to read the language physics and biology are written in.

This chapter rebuilds your intuition from scratch. We start with a single cup of coffee, derive the same equation that governs radioactive decay and capacitor discharge, then climb upward to direction fields, classification, and the existence-and-uniqueness theorem that tells you when an ODE has a sensible answer at all.