Proofs

The chain rule

If yy is a function of uu, and uu is a function of xx, then

dydx=dydu×dudx.\frac{dy}{dx} = \frac{dy}{du} \times \frac{du}{dx}.

The rule says that the two rates multiply. This page shows why, and it is honest about the one place where the usual short argument hides a case.

Before you start

You need three facts.

Predict first

Suppose a car travels 12 km12\text{ km} for every litre of fuel, and uses 33 litres for every hour of driving.

Before reading on, predict: how far does the car travel in one hour? Work it out from the two rates you are given. Then predict what the arithmetic looks like when the two rates are written as fractions.

The proof

The numbers first

In one hour the car uses 33 litres. Each litre carries the car 1212 kilometres. So in one hour it travels

3×12=36 km.3 \times 12 = 36\text{ km}.

The rate of distance with respect to fuel is 1212, the rate of fuel with respect to time is 33, and the rate of distance with respect to time is

12×3=36.12 \times 3 = 36.

The rates multiply. Everything below is that sentence written with letters.

The algebra

Now let yy be a function of uu, and uu a function of xx. Let xx change by a small amount δx\delta x. Then uu changes by some δu\delta u, and because yy depends on uu, yy changes by some δy\delta y.

The three small changes are tied together by ordinary arithmetic. If δu\delta u is not zero, then

δyδx=δyδu×δuδx.\frac{\delta y}{\delta x} = \frac{\delta y}{\delta u} \times \frac{\delta u}{\delta x}.

The δu\delta u on the bottom of the first fraction and the δu\delta u on the top of the second are the same nonzero number, so they cancel. This identity is exact for the small changes. It is not an approximation.

Be careful with the word cancel. Here the δ\delta's are genuine numbers, so the cancelling is genuine arithmetic. What is not allowed is carrying the same move over to the derivatives, as if dydu\dfrac{dy}{du} were a fraction of two tiny numbers called dydy and dudu. The symbol dydx\dfrac{dy}{dx} is not a fraction; it is the limit of one. The next step is what turns the exact identity for small changes into the rule for derivatives.

Take the limit

Let δx→0\delta x \to 0. Because uu is continuous, δu\delta u tends to 00 as well. Each fraction tends to a derivative:

δyδu→dydu,δuδx→dudx,δyδx→dydx.\frac{\delta y}{\delta u} \to \frac{dy}{du}, \qquad \frac{\delta u}{\delta x} \to \frac{du}{dx}, \qquad \frac{\delta y}{\delta x} \to \frac{dy}{dx}.

The identity holds for every δx\delta x that gives δu≠0\delta u \neq 0, so its two sides have the same limit:

dydx=dydu×dudx.\frac{dy}{dx} = \frac{dy}{du} \times \frac{du}{dx}.

That is the chain rule, for the case where δu≠0\delta u \neq 0.

The case where δu is zero

There is one gap in the argument above, and it is worth naming rather than hiding.

The identity was written down because δu≠0\delta u \neq 0. For a function such as u=x2u = x^2 near x=0x = 0, or u=sin⁡xu = \sin x at multiples of π\pi, there are arbitrarily small changes δx\delta x for which δu=0\delta u = 0. At those values the fraction δyδu\dfrac{\delta y}{\delta u} is 00\dfrac{0}{0}, which has no meaning, so the identity does not apply there. The limit step above quietly assumed the case away, and it needs its own argument.

That argument is short, and it is worth seeing once. Do not use the quotient δyδu\dfrac{\delta y}{\delta u} at all — it is the object that fails when δu=0\delta u = 0. Instead give the quotient a companion quantity AA, defined by

A=δyδuwhen δu≠0,A=dyduwhen δu=0.A = \frac{\delta y}{\delta u} \quad\text{when } \delta u \neq 0, \qquad A = \frac{dy}{du} \quad\text{when } \delta u = 0.

The value used when δu=0\delta u = 0 is the limit of δyδu\dfrac{\delta y}{\delta u} as δu→0\delta u \to 0, which is dydu\dfrac{dy}{du}. It is not the meaningless 00\dfrac{0}{0}. Now multiply by δu\delta u:

δy=A×δu.\delta y = A \times \delta u.

Check the two cases. When δu≠0\delta u \neq 0 this is the definition of AA, so it is exact. When δu=0\delta u = 0, the value uu has not moved, and because yy depends on uu, neither has yy; both sides are then 00. So the equation holds for every small δx\delta x, and no division by δu\delta u appears anywhere.

Divide by δx\delta x:

δyδx=A×δuδx.\frac{\delta y}{\delta x} = A \times \frac{\delta u}{\delta x}.

Now let δx→0\delta x \to 0. Because uu is continuous, δu→0\delta u \to 0, so A→dyduA \to \dfrac{dy}{du}. Meanwhile δuδx→dudx\dfrac{\delta u}{\delta x} \to \dfrac{du}{dx}. Therefore

dydx=dydu×dudx,\frac{dy}{dx} = \frac{dy}{du} \times \frac{du}{dx},

with no case left out. The case δu=0\delta u = 0 was not a small exception to be patched later. It was a signal that the quotient was the wrong object to add up, and AA is the right one.

One condition the argument needs

Both versions of the argument use one more fact: uu is continuous at xx. A small change in xx has to make a small change in uu, or δu\delta u would not tend to 00 and the quantity AA would not settle on the value dydu\dfrac{dy}{du}. Every function differentiated in this course is continuous, so a reader never has to check this in practice. A proof does have to state it.

Check your understanding

  1. yy changes by 55 units for every unit of uu, and uu changes by 0.40.4 units for every unit of xx. How fast does yy change with respect to xx?
  2. Differentiate y=(3x+1)5y = (3x + 1)^5 by taking u=3x+1u = 3x + 1. Which factor is dydu\dfrac{dy}{du}, and which is dudx\dfrac{du}{dx}?
  3. Why can the identity δyδx=δyδu×δuδx\dfrac{\delta y}{\delta x} = \dfrac{\delta y}{\delta u} \times \dfrac{\delta u}{\delta x} not be used at every value of xx without a check?
Answers
  1. The rates multiply: 5×0.4=25 \times 0.4 = 2. So dydx=2\dfrac{dy}{dx} = 2.
  2. With u=3x+1u = 3x + 1 we have y=u5y = u^5, so dydu=5u4\dfrac{dy}{du} = 5u^4 and dudx=3\dfrac{du}{dx} = 3. The rule gives 5u4×3=15(3x+1)45u^4 \times 3 = 15(3x + 1)^4.
  3. The identity needs δu≠0\delta u \neq 0. For some values of xx, such as x=0x = 0 when u=x2u = x^2, there are small changes δx\delta x with δu=0\delta u = 0, and then δyδu\dfrac{\delta y}{\delta u} is 00\dfrac{0}{0}. The rule is still true there, but this identity is not the reason.

A common error

Written as dydx=dydu×dudx\dfrac{dy}{dx} = \dfrac{dy}{du} \times \dfrac{du}{dx}, the rule looks as though the dudu's cancel. They do not. The cancelling in the proof happened one line earlier, between the small changes δu\delta u, which are ordinary numbers; the derivatives are limits, and a limit is not a fraction of limits. The shorthand gives the right answer for a single chain, which is why the mistake survives. It is the small changes that cancel, not the derivatives.

Settings

Colour scheme

Applies to every book you read here.

Reading theme

Applies to every book you read here.