Ordinary Differential Equations: Types, Solutions & Applications

TAKEAWAYS:

• First-order ODEs (separable, linear, exact) and second-order ODEs (homogeneous/nonhomogeneous) are solved using distinct methods, with uniqueness guaranteed by Picard’s theorem under Lipschitz conditions.
• Power series solutions (Frobenius method) handle ODEs with variable coefficients, yielding recurrence relations for coefficients (e.g., Bessel’s equation for cylindrical systems).
• Legendre polynomials (Rodrigues’ formula) model physical phenomena like electrostatic potentials and quantum mechanics.
• Real-world applications include loan interest calculations (first-order linear ODEs), traffic flow modeling (PDEs derived from ODEs), and signal processing (Bessel functions in Fourier analysis).
• Exam focus: Derive solutions step-by-step, classify ODE types, and connect theory to engineering problems (e.g., RC circuits, spring-mass systems).

---

---

1. Introduction to Ordinary Differential Equations (ODEs)

ODEs describe how a quantity changes with respect to a single independent variable (usually time or space). They are fundamental in modeling dynamic systems in engineering, physics, and economics.

1.1 Classification of ODEs

ODEs are classified by:

• Order: Highest derivative present (e.g., $y^{\prime \prime }+y=0$ is second-order).
• Linearity: Linear ODEs have dependent variables and their derivatives to the first power (e.g., $y^{\prime }+p(x)y=q(x)$). Nonlinear ODEs include terms like $(y^{\prime }{)}^2$ or $\sin (y)$.
• Homogeneity: Homogeneous ODEs have $q(x)=0$; nonhomogeneous have a non-zero forcing term.

```mermaid
classDiagram
    class ODE {
        <<abstract>>
        +order: int
        +linearity: boolean
        +homogeneity: boolean
    }
    class FirstOrder {
        +dy/dx = f(x,y)
    }
    class SecondOrder {
        +d²y/dx² = f(x,y,y')
    }
    class Linear {
        +dy/dx + p(x)y = q(x)
    }
    class Nonlinear {
        +dy/dx = y² + x
    }
    ODE <|-- FirstOrder
    ODE <|-- SecondOrder
    FirstOrder <|-- Linear
    FirstOrder <|-- Nonlinear
    SecondOrder <|-- Linear
    SecondOrder <|-- Nonlinear

1.2 Real-World Example: Loan Interest Calculation (First-Order Linear ODE)

Banks use ODEs to model loan repayment. The differential equation for a loan balance ( P(t) ) with interest rate ( r ) and fixed payment ( A ) is: [ \frac{dP}{dt} = -A + rP ] Solution: Separate variables and integrate: [ \frac{dP}{A - rP} = dt \implies -\frac{1}{r}\ln|A - rP| = t + C ] Solve for ( P(t) ): [ P(t) = \frac{A}{r} + Ce^{-rt} ] Initial condition: ( P(0) = P_0 ) (loan amount) gives ( C = P_0 - \frac{A}{r} ).

```figure
{"type":"graph","fns":[{"expr":"20000*exp(-0.05*x) + 20000","label":"P(t) = 20000e^(-0.05t) + 20000"}],"x":[0,50],"points":[{"x":0,"y":40000,"label":"P₀ = 40,000"},{"x":20,"y":30000,"label":"P(20) ≈ 30,000"}],"caption":"Loan balance P(t) over time (t in years)"}

---

2. First-Order ODEs: Methods and Examples

2.1 Separable Equations

Form: $\frac{dy}{dx}=g(x)h(y)$. Method: Integrate both sides: $$\int \frac{1}{h(y)}dy=\int g(x)dx$$ Example 1: Solve $\frac{dy}{dx}=xy$. Solution: $$\int \frac{1}{y}dy=\int xdx⟹\ln |y|=\frac{x^2}{2}+C⟹y=C{e}^{x^2/2}$$

2.2 Linear First-Order ODEs

Form: $\frac{dy}{dx}+P(x)y=Q(x)$. Method: Integrating factor $\mu (x)=e^{\int P(x)dx}$. Example 2: Solve $\frac{dy}{dx}+2y=e^{-x}$. Solution:

1. Integrating factor: $\mu (x)=e^{\int 2dx}=e^{2x}$.
2. Multiply through: $e^{2x}\frac{dy}{dx}+2e^{2x}y=e^x$.
3. Left side is $\frac{d}{dx}(e^{2x}y)$, so integrate: $$e^{2x}y=\int e^{x}dx=e^x+C⟹y=e^{-x}+C{e}^{-2x}$$

2.3 Exact Equations

Form: $M(x,y)dx+N(x,y)dy=0$, where $\frac{\partial M}{\partial y}=\frac{\partial N}{\partial x}$. Method: Find potential function $\psi (x,y)$ such that $\frac{\partial \psi }{\partial x}=M$ and $\frac{\partial \psi }{\partial y}=N$. Example 3: Solve $(2xy+3)dx+(x^2+4y)dy=0$. Solution:

1. Check exactness: $\frac{\partial M}{\partial y}=2x=\frac{\partial N}{\partial x}$.
2. Integrate $M$ w.r.t. $x$: $\psi (x,y)=x^{2}y+3x+h(y)$.
3. Differentiate w.r.t. $y$: $x^2+h^{\prime }(y)=x^2+4y⟹h(y)=2y^2+C$.
4. General solution: $x^{2}y+3x+2y^2=C$.

---

3. Second-Order ODEs: Homogeneous and Nonhomogeneous Cases

3.1 Homogeneous Linear ODEs with Constant Coefficients

Form: $a{y}^{\prime \prime }+b{y}^{\prime }+cy=0$. Method: Characteristic equation $a{r}^2+br+c=0$. Cases:

1. Distinct real roots $r_1,r_2$: Solution $y=C_1{e}^{r_{1}x}+C_2{e}^{r_{2}x}$.
2. Repeated root $r$: Solution $y=(C_1+C_{2}x)e^{rx}$.
3. Complex roots $\alpha \pm i\beta$: Solution $y=e^{\alpha x}(C_1\cos (\beta x)+C_2\sin (\beta x))$.

Example 4: Solve $y^{\prime \prime }-5y^{\prime }+6y=0$. Solution:

1. Characteristic equation: $r^2-5r+6=0⟹r=2,3$.
2. General solution: $y=C_1{e}^{2x}+C_2{e}^{3x}$.

3.2 Nonhomogeneous ODEs: Method of Undetermined Coefficients

Form: $a{y}^{\prime \prime }+b{y}^{\prime }+cy=g(x)$. Method: Guess $y_p$ based on $g(x)$, then solve for coefficients. Example 5: Solve $y^{\prime \prime }+y=\sin (x)$. Solution:

1. Homogeneous solution: $y_h=C_1\cos (x)+C_2\sin (x)$.
2. Guess $y_p=A\cos (x)+B\sin (x)$ (but $\sin (x)$ is already in $y_h$, so multiply by $x$): $y_p=x(A\cos (x)+B\sin (x))$.
3. Compute derivatives, substitute into ODE, and solve for $A$ and $B$: $A=0$, $B=-\frac{1}{2}$.
4. General solution: $y=C_1\cos (x)+C_2\sin (x)-\frac{x}{2}\sin (x)$.

3.3 Real-World Example: Spring-Mass System (Second-Order ODE)

A mass $m$ on a spring with damping $c$ and forcing $F(t)$ obeys: $$m\frac{d^{2}x}{d{t}^2}+c\frac{dx}{dt}+kx=F(t)$$ Example 6: Undamped free vibration ($c=0$, $F(t)=0$): $$m\frac{d^{2}x}{d{t}^2}+kx=0⟹\frac{d^{2}x}{d{t}^2}+\frac{k}{m}x=0$$ Solution: $x(t)=C_1\cos (\omega t)+C_2\sin (\omega t)$, where $\omega =\sqrt{\frac{k}{m}}$.

---

4. Power Series Solutions: Frobenius Method

For ODEs with variable coefficients (e.g., Bessel’s equation), assume a solution of the form: $$y(x)=\sum _{n=0}^{\infty }{a}_n{x}^{n+r}$$ Steps:

1. Substitute $y$ and its derivatives into the ODE.
2. Collect powers of $x$ and set coefficients to zero.
3. Solve the resulting recurrence relation for $a_n$.

4.1 Example: Bessel’s Equation of Order 0

$$x^2{y}^{\prime \prime }+x{y}^{\prime }+x^{2}y=0$$ Solution:

1. Assume $y={\sum }_{n=0}^{\infty }{a}_n{x}^{n+r}$.
2. Substitute and collect terms to find the indicial equation: $$r^2=0⟹r=0\text{ (double root)}$$
3. Recurrence relation: $$a_{n+2}=-\frac{a_n}{(n+2{)}^2}$$
4. Solutions: $$y_1(x)=J_0(x)=1-\frac{x^2}{2^2}+\frac{x^4}{2^2\cdot 4^2}-\cdots$$ $$y_2(x)=Y_0(x)=J_0(x)\ln (x)+\sum _{n=1}^{\infty }\frac{(-1{)}^{n+1}{H}_n}{n!}{\left(\frac{x}{2}\right)}^n$$ where $H_n$ are harmonic numbers.

4.2 Real-World Example: Heat Distribution in a Cylinder (Bessel Functions)

Bessel’s equation models temperature $T(r,t)$ in a cylindrical rod: $$\frac{\partial T}{\partial t}=\alpha \left(\frac{{\partial }^{2}T}{\partial r^2}+\frac{1}{r}\frac{\partial T}{\partial r}\right)$$ Separation of variables leads to Bessel’s equation for the radial part.

---

5. Legendre Polynomials and Rodrigues’ Formula

Legendre polynomials $P_n(x)$ satisfy: $$\frac{d}{dx}\left[(1-x^2)\frac{d{P}_n}{dx}\right]+n(n+1)P_n=0$$ Rodrigues’ Formula: $$P_n(x)=\frac{1}{2^{n}n!}\frac{d^n}{d{x}^n}\left[(x^2-1{)}^n\right]$$ Example 7: Compute $P_2(x)$. Solution: $$P_2(x)=\frac{1}{8}\frac{d^2}{d{x}^2}(x^2-1{)}^2=\frac{1}{8}\frac{d}{dx}[4x(x^2-1)]=\frac{1}{2}(3x^2-1)$$

5.1 Real-World Example: Quantum Mechanics (Legendre Polynomials)

Legendre polynomials appear in the solution to the Schrödinger equation for a particle in a spherical potential well.

---

6. Existence and Uniqueness Theorems

Picard’s Existence Theorem: For $\frac{dy}{dx}=f(x,y)$, if $f$ and $\frac{\partial f}{\partial y}$ are continuous in a region containing $(x_0,y_0)$, then there exists a unique solution $y(x)$ passing through $(x_0,y_0)$.

Example 8: Check uniqueness for $\frac{dy}{dx}=y^{1/3}$, $y(0)=0$. Solution:

• $f(x,y)=y^{1/3}$ is not Lipschitz continuous at $y=0$.
• Multiple solutions exist (e.g., $y=0$ and $y=\frac{x^3}{27}$).

---

7. Applications in Engineering

---

## In the Real World

1. eSewa/Khalti (Digital Payments):

   • Idea Used: First-order linear ODEs model transaction processing delays.
   • How: The rate of transactions $T(t)$ in a queue follows $\frac{dT}{dt}=\lambda -\mu T$, where $\lambda$ is arrival rate and $\mu$ is service rate. Solving this gives the steady-state number of pending transactions.

2. Pathao (Ride-Hailing):

   • Idea Used: Second-order ODEs optimize driver acceleration/deceleration.
   • How: The position $x(t)$ of a Pathao driver’s vehicle satisfies $m\frac{d^{2}x}{d{t}^2}=F(t)-c\frac{dx}{dt}$, where $F(t)$ is engine force and $c$ is damping. Solving this ensures smooth rides and fuel efficiency.

3. NTC (Telecom Network Traffic):

   • Idea Used: Bessel functions model signal propagation in fiber optics.
   • How: The wave equation for light in optical fibers reduces to Bessel’s equation in cylindrical coordinates. Engineers use $J_0$ to design low-loss transmission lines.

4. Nepal Rastra Bank (Loan Modeling):

   • Idea Used: First-order linear ODEs for loan amortization.
   • How: As shown in Example 1, banks use $\frac{dP}{dt}=-A+rP$ to compute monthly payments $A$ that clear the loan in $n$ years. This directly impacts interest rates advertised by banks like NMB or Global IME.

5. YouTube (Video Buffering):

   • Idea Used: Power series solutions for adaptive bitrate streaming.
   • How: The buffer level $B(t)$ in a user’s device follows a piecewise ODE. During playback, $\frac{dB}{dt}=-r(t)$, where $r(t)$ is the playback rate. YouTube’s algorithm solves this dynamically to minimize buffering interruptions.

---

## Exam Tip

1. Classify ODEs Correctly:

   • Always state whether an ODE is linear/nonlinear, homogeneous/nonhomogeneous, and its order. Partial credit is lost if classification is skipped.

2. Show All Steps for Power Series:

   • For Bessel’s equation or Legendre polynomials, write the recurrence relation explicitly. Examiners check if you:
     • Assume $y=\sum a_n{x}^{n+r}$.
     • Substitute into the ODE correctly.
     • Solve the indicial equation for $r$.
     • Derive the recurrence for $a_n$.

3. Real-World Connections:

   • Link solutions to engineering contexts. For example:
     • A second-order ODE solution $y=e^{-t}\cos (2t)$ could model a damped oscillator (e.g., a car suspension).
     • A first-order solution $y=C{e}^{-kt}$ could represent drug concentration decay in the body.

4. Graphs Are Mandatory:

   • For every solution (e.g., $y=e^{2x}$, $y=\sin (x)$), sketch its graph. Label axes, equilibrium points, and asymptotes.

5. Common Pitfalls:

   • Forcing Function Mistakes: In undetermined coefficients, never assume a particular solution that is already part of the homogeneous solution (e.g., guess $A\cos (x)$ if $\cos (x)$ is in $y_h$).
   • Initial Conditions: Always apply initial conditions to find constants $C_1,C_2$. Leaving them as $C$ earns zero marks.

6. Legendre/Bessel Shortcuts:

   • Memorize the first few Legendre polynomials ($P_0=1$, $P_1=x$, $P_2=\frac{1}{2}(3x^2-1)$) and Bessel’s recurrence relation. Examiners may ask to verify these.

---

| Method                  | Applicable ODE Type          | Key Step                                  | Example Solution Form               |
|-------------------------|------------------------------|-------------------------------------------|--------------------------------------|
| Separation of Variables  | \( \frac{dy}{dx} = g(x)h(y) \) | Integrate \( \int \frac{1}{h(y)} dy = \int g(x) dx \) | \( y = f(x) + C \)                   |
| Integrating Factor       | Linear first-order           | Multiply by \( \mu(x) = e^{\int P(x) dx} \) | \( y = \frac{1}{\mu(x)} \left( \int \mu(x)Q(x) dx + C \right) \) |
| Exact Equations          | \( M dx + N dy = 0 \) exact   | Find \( \psi(x,y) \) s.t. \( \frac{\partial \psi}{\partial x} = M \) | \( \psi(x,y) = C \)                  |
| Characteristic Equation  | Linear with constant coeffs   | Solve \( ar^2 + br + c = 0 \)             | \( y = C_1e^{r_1x} + C_2e^{r_2x} \)  |
| Undetermined Coefficients| Nonhomogeneous linear        | Guess \( y_p \) based on \( g(x) \)        | \( y = y_h + y_p \)                  |
| Frobenius Method         | Variable-coefficient ODEs    | Assume \( y = \sum a_n x^{n+r} \)         | Recurrence relation for \( a_n \)    |
| Legendre Polynomials     | \( (1-x^2)y'' - 2xy' + n(n+1)y = 0 \) | Rodrigues’ formula                     | \( P_n(x) = \frac{1}{2^n n!} \frac{d^n}{dx^n} (x^2 - 1)^n \) |