Study guide: Differential Calculus and Extrema

Course Outline

  1. First-Order Local Study
  2. Differential and Measurement Uncertainty
  3. Higher-Order Derivatives and Taylor Formula
  4. Extrema and Critical Point Classification
  5. Torus Altitude and Critical Points
  6. Cabin Volume Optimization
  7. Glacier Temperature and Heat Equation
  8. Machine Yield Optimization
  9. Scalar and Vector Fields
  10. Gradient Curl and Divergence
  11. Potentials and Exactness

1. First-Order Local Study

Key Concepts & Definitions

  • Gradient: The gradient of f at (x,y), when its first-order partial derivatives exist, is the vector grad⁑f(x,y)=(βˆ‚fβˆ‚x(x,y),βˆ‚fβˆ‚y(x,y))\operatorname{grad} f(x,y)=\left(\frac{\partial f}{\partial x}(x,y),\frac{\partial f}{\partial y}(x,y)\right).
  • Differentiability: The function f is differentiable at a = (x,y) if it has first-order partial derivatives there and lim⁑(h,k)β†’(0,0)f(x+h,y+k)βˆ’f(x,y)βˆ’βˆ‚fβˆ‚x(x,y)hβˆ’βˆ‚fβˆ‚y(x,y)kβˆ₯(h,k)βˆ₯=0\lim_{(h,k)\to(0{,}0)}\frac{f(x+h,y+k)-f(x,y)-\frac{\partial f}{\partial x}(x,y)h-\frac{\partial f}{\partial y}(x,y)k}{\|(h,k)\|}=0.
  • Differential: The differential of f at (x,y) is the linear function df(x,y)=βˆ‚fβˆ‚x(x,y) dx+βˆ‚fβˆ‚y(x,y) dydf_{(x,y)}=\frac{\partial f}{\partial x}(x,y)\,dx+\frac{\partial f}{\partial y}(x,y)\,dy, where dx(h,k)=h and dy(h,k)=k.

β˜… Must-know

πŸ“ Formula - At a point where the limits exist, the first-order partial derivatives are βˆ‚fβˆ‚x(x,y)=lim⁑hβ†’0f(x+h,y)βˆ’f(x,y)h\frac{\partial f}{\partial x}(x,y)=\lim_{h\to 0}\frac{f(x+h,y)-f(x,y)}{h} and βˆ‚fβˆ‚y(x,y)=lim⁑hβ†’0f(x,y+h)βˆ’f(x,y)h\frac{\partial f}{\partial y}(x,y)=\lim_{h\to 0}\frac{f(x,y+h)-f(x,y)}{h}.

  • The gradient points in the direction of maximal increase of f and is normal to the contour lines of f.

πŸ“Œ If a function f is of class C1 at a point a, then f is differentiable at a.

πŸ“ Formula - If f is differentiable at (x_0,y_0), the tangent plane to its graph at (x_0,y_0,f(x_0,y_0)) has equation z=f(x0,y0)+βˆ‚fβˆ‚x(x0,y0)(xβˆ’x0)+βˆ‚fβˆ‚y(x0,y0)(yβˆ’y0).z=f(x_0,y_0)+\frac{\partial f}{\partial x}(x_0,y_0)(x-x_0)+\frac{\partial f}{\partial y}(x_0,y_0)(y-y_0).

Further detail

πŸ“ Formula - The directional derivative of f at a = (xₐ,yₐ) along v = (xα΅₯,yα΅₯), when the limit exists, is dfa(v)=lim⁑tβ†’0f(xa+txv,ya+tyv)βˆ’f(xa,ya)tdf_a(v)=\lim_{t\to 0}\frac{f(x_a+t x_v,y_a+t y_v)-f(x_a,y_a)}{t}.

  • A function f is of class CΒΉ on U if its first-order partial derivatives are continuous on U.

  • Linear combinations, products, and quotients with a denominator that never vanishes of CΒΉ functions on U are CΒΉ on U, and if f: U β†’ ℝ and g: ℝ β†’ ℝ are CΒΉ, then g ∘ f is CΒΉ.

πŸ“ Formula - At a differentiable point (x,y), the first-order Taylor–Young expansion is f(x+h,y+k)=f(x,y)+βˆ‚fβˆ‚x(x,y)h+βˆ‚fβˆ‚y(x,y)k+βˆ₯(h,k)βˆ₯ φ(h,k)f(x+h,y+k)=f(x,y)+\frac{\partial f}{\partial x}(x,y)h+\frac{\partial f}{\partial y}(x,y)k+\|(h,k)\|\,\varphi(h,k), where Ο†(h,k)β†’0\varphi(h,k)\to 0 as (h,k)β†’(0,0)(h,k)\to(0{,}0).

  • For small increments h and k, the differential evaluated at (h,k) approximates the change in f: df(x,y)(h,k)β‰ˆf(x+h,y+k)βˆ’f(x,y)df_{(x,y)}(h,k)\approx f(x+h,y+k)-f(x,y).

πŸ“Œ If f is of class CΒΉ at a, then f is differentiable at a.

2. Differential and Measurement Uncertainty

β˜… Must-know

πŸ“ Formula - For small variations, the differential estimates the function variation by Ξ”fβ‰ˆβˆ‚fβˆ‚xΞ”x+βˆ‚fβˆ‚yΞ”y\Delta f \approx \frac{\partial f}{\partial x}\Delta x + \frac{\partial f}{\partial y}\Delta y.

  • If the relative uncertainty in temperature is 0.3% and that in volume is 0.2%, the differential estimate gives a relative pressure uncertainty bounded by 0.5%.

Further detail

πŸ“ Formula - For one mole of ideal gas, pressure satisfies P=f(T,V)=RTVP = f(T,V) = \frac{RT}{V}, where RR is the ideal gas constant.

3. Higher-Order Derivatives and Taylor Formula

Key Concepts & Definitions

  • Hessian matrix: The Hessian matrix of a function of two variables is Hf(x,y)=(fxx(x,y)fyx(x,y)fxy(x,y)fyy(x,y))H_f(x,y)=\begin{pmatrix} f_{xx}(x,y)&f_{yx}(x,y)\\ f_{xy}(x,y)&f_{yy}(x,y)\end{pmatrix}, wherever these derivatives exist.
  • Second-order partial derivatives: Second-order partial derivatives are obtained by differentiating a first-order partial derivative again; for a function of two variables they are βˆ‚2fβˆ‚x2\frac{\partial^2 f}{\partial x^2}, βˆ‚2fβˆ‚xβˆ‚y\frac{\partial^2 f}{\partial x\partial y}, βˆ‚2fβˆ‚yβˆ‚x\frac{\partial^2 f}{\partial y\partial x}, and βˆ‚2fβˆ‚y2\frac{\partial^2 f}{\partial y^2}.
  • Second-order remainder: The remainder o(βˆ₯(h,k)βˆ₯2)o(\|(h,k)\|^2) is a quantity of the form βˆ₯(h,k)βˆ₯2Ο†(h,k)\|(h,k)\|^2\varphi(h,k), where Ο†(h,k)\varphi(h,k) tends to zero as (h,k)(h,k) tends to (0,0)(0{,}0).

β˜… Must-know

  • A function is of class CkC^k when all its partial derivatives up to order kk are continuous; it is of class C∞C^\infty when partial derivatives of every order are continuous.

πŸ“Œ If a function is of class C2C^2 on an open set, its mixed second-order partial derivatives are equal, so its Hessian matrix is symmetric.

πŸ“ Formula - For a function of class C2C^2 and a point (x,y)(x,y) in its domain, the second-order Taylor–Young formula is f(x+h,y+k)=f(x,y)+fx(x,y)h+fy(x,y)k+12(fxx(x,y)h2+2fxy(x,y)hk+fyy(x,y)k2)+o(βˆ₯(h,k)βˆ₯2)f(x+h,y+k)=f(x,y)+f_x(x,y)h+f_y(x,y)k+\frac12\left(f_{xx}(x,y)h^2+2f_{xy}(x,y)hk+f_{yy}(x,y)k^2\right)+o\left(\|(h,k)\|^2\right).

Further detail

  • Linear combinations, products, quotients with a nowhere-zero denominator, and compositions of functions of class CkC^k remain of class CkC^k on their respective domains.

4. Extrema and Critical Point Classification

Key Concepts & Definitions

  • Critical point: A point is a critical point of a function when its differential is zero, equivalently when its gradient is zero and both first-order partial derivatives vanish there.
  • Local minimum: A function reaches a local minimum at a point when there is a neighborhood of that point on which its value is no greater than the function's value at any other point in that neighborhood.
  • Local maximum: A function reaches a local maximum at a point when there is a neighborhood of that point on which its value is no less than the function's value at any other point in that neighborhood.
  • Global minimum: A function reaches a global minimum at a point when its value there is no greater than its value at any point in its domain.
  • Global maximum: A function reaches a global maximum at a point when its value there is no less than its value at any point in its domain.

β˜… Must-know

  • If a function is differentiable at a point and reaches a local extremum there, then that point is critical.

  • At a critical point of a function of class C2C^2, if rtβˆ’s2>0rt-s^2>0 and r>0r>0, the function has a local minimum there.

  • At a critical point of a function of class C2C^2, if rtβˆ’s2>0rt-s^2>0 and r<0r<0, the function has a local maximum there.

  • At a critical point of a function of class C2C^2, if rtβˆ’s2<0rt-s^2<0, the function has neither a local minimum nor a local maximum and is at a saddle point.

Further detail

  • At a critical point of a function of class C2C^2, let r=fxxr=f_{xx}, s=fxys=f_{xy}, and t=fyyt=f_{yy} be the second-order partial derivatives evaluated at that point.

πŸ“Œ The Monge criterion gives no conclusion at a critical point when rtβˆ’s2=0rt-s^2=0.

  • A saddle point can have a minimum along one direction and a maximum at the same point along an orthogonal direction.

πŸ“Œ At a critical point of a function of class C2C^2, positive Hessian determinant and positive trace imply a local minimum, while positive determinant and negative trace imply a local maximum; negative determinant implies a saddle point, and zero determinant gives no conclusion.

Memory Hook

A local extremum is a peak or valley; a saddle is a minimum in one direction and a maximum in an orthogonal direction.

5. Torus Altitude and Critical Points

β˜… Must-know

πŸ“ Formula - The altitude of a point on the torus is modeled by z(Ο†,Ο‚)=Rsin⁑φ+rsin⁑φsin⁑ςz(\varphi,\varsigma)=R\sin\varphi+r\sin\varphi\sin\varsigma, where the torus has major radius RR and minor radius rr with R>rR>r.

  • The critical points of the altitude function occur, modulo 2Ο€2\pi, when Ο†βˆˆ{Ο€/2,3Ο€/2}\varphi\in\{\pi/2{,}3\pi/2\} and Ο‚βˆˆ{Ο€/2,3Ο€/2}\varsigma\in\{\pi/2{,}3\pi/2\}.

πŸ“Œ The point with Ο†=Ο€/2,Ο‚=Ο€/2\varphi=\pi/2,\varsigma=\pi/2 is a local maximum, the point with Ο†=3Ο€/2,Ο‚=Ο€/2\varphi=3\pi/2,\varsigma=\pi/2 is a local minimum, and the points with Ο‚=3Ο€/2\varsigma=3\pi/2 are saddles.

Further detail

  • At each critical point, the second-order Taylor polynomial is obtained from the value and Hessian of zz at that point.

6. Cabin Volume Optimization

β˜… Must-know

  • The available wood surface area is 90 m290\,\mathrm{m}^2, includes the ground-floor rectangle, and excludes the rectangle between the cuboid and the roof.

πŸ“ Formula - After eliminating hh using the surface-area constraint, the volume is V(x,y)=90xyβˆ’158x2y22x+2yV(x,y)=\frac{90xy-\frac{15}{8}x^2y^2}{2x+2y}.

Further detail

  • The cabin consists of a cuboid with dimensions x,y,hx,y,h and a triangular-prism roof whose isosceles-triangle base angles are Ξ±=arctan⁑(3/4)\alpha=\arctan(3/4).

πŸ“Œ Assuming V(x,y)V(x,y) has a unique global maximum for x,y>0x,y>0, the cabin dimensions and maximum volume are determined by locating that maximum and recovering hh from the area constraint.

7. Glacier Temperature and Heat Equation

β˜… Must-know

πŸ“ Formula - The glacier temperature is modeled by T(x,t)=T0+T1eβˆ’Ο‰xsin⁑(Ξ»tβˆ’ΞΌx)T(x,t)=T_0+T_1e^{-\omega x}\sin(\lambda t-\mu x), where tt is measured in days and xx in feet.

πŸ“Œ The temperature model is to be shown to satisfy the heat equation βˆ‚tT=kβ€‰βˆ‚xxT\partial_tT=k\,\partial_{xx}T for some constant kk.

Further detail

  • The model uses Ξ»=2Ο€365\lambda=\frac{2\pi}{365} and positive constants for the other parameters.

Memory Hook

Exponential depth decay and periodic time variation produce a temperature model to test against the heat equation.

8. Machine Yield Optimization

β˜… Must-know

πŸ“ Formula - The machine yield is given by R(U,Ο‰)=1+Ο‰1+U2βˆ’UΟ‰+Ο‰2R(U,\omega)=\frac{1+\omega}{1+U^2}-U\omega+\omega^2, where UU is tension and Ο‰\omega is frequency.

Further detail

πŸ“Œ The optimal machine yield is found by maximizing R(U,Ο‰)R(U,\omega) over the admissible values of tension and frequency.

9. Scalar and Vector Fields

Key Concepts & Definitions

  • Scalar field: A function on an open subset of R3\mathbb{R}^3 that assigns a real number to each point.
  • Vector field: A function on an open subset of R3\mathbb{R}^3 that assigns a vector in R3\mathbb{R}^3 to each point.

Essential Points

  • Examples of scalar fields include temperature, pressure, and fluid density; examples of vector fields include velocity, electric fields, and magnetic fields.

10. Gradient Curl and Divergence

Key Concepts & Definitions

  • Gradient: For a scalar field ff, the gradient is the vector field grad⁑f=(βˆ‚f/βˆ‚x,βˆ‚f/βˆ‚y,βˆ‚f/βˆ‚z).\operatorname{grad} f = (\partial f/\partial x,\partial f/\partial y,\partial f/\partial z).
  • Curl: For a vector field F=(Fx,Fy,Fz)\mathbf{F}=(F_x,F_y,F_z), the curl is rot⁑F=(βˆ‚Fz/βˆ‚yβˆ’βˆ‚Fy/βˆ‚z,βˆ‚Fx/βˆ‚zβˆ’βˆ‚Fz/βˆ‚x,βˆ‚Fy/βˆ‚xβˆ’βˆ‚Fx/βˆ‚y).\operatorname{rot}\mathbf{F}=(\partial F_z/\partial y-\partial F_y/\partial z,\partial F_x/\partial z-\partial F_z/\partial x,\partial F_y/\partial x-\partial F_x/\partial y).
  • Divergence: For a vector field F=(Fx,Fy,Fz)\mathbf{F}=(F_x,F_y,F_z), the divergence is the scalar field div⁑F=βˆ‚Fx/βˆ‚x+βˆ‚Fy/βˆ‚y+βˆ‚Fz/βˆ‚z.\operatorname{div}\mathbf{F}=\partial F_x/\partial x+\partial F_y/\partial y+\partial F_z/\partial z.

Essential Points

  • The nabla operator is βˆ‡=(βˆ‚/βˆ‚x,βˆ‚/βˆ‚y,βˆ‚/βˆ‚z)\nabla=(\partial/\partial x,\partial/\partial y,\partial/\partial z), so grad⁑f=βˆ‡f\operatorname{grad}f=\nabla f, rot⁑F=βˆ‡Γ—F\operatorname{rot}\mathbf{F}=\nabla\times\mathbf{F}, and div⁑F=βˆ‡β‹…F.\operatorname{div}\mathbf{F}=\nabla\cdot\mathbf{F}.

11. Potentials and Exactness

Key Concepts & Definitions

  • Scalar potential: A vector field derives from a scalar potential if there is a scalar field ff such that F=grad⁑f.\mathbf{F}=\operatorname{grad}f.

β˜… Must-know

  • In the operator sequence scalar fields β†’grad⁑\xrightarrow{\operatorname{grad}} vector fields β†’rot⁑\xrightarrow{\operatorname{rot}} vector fields β†’div⁑\xrightarrow{\operatorname{div}} scalar fields, the composition of either pair of successive operators is zero: rot⁑(grad⁑f)=0\operatorname{rot}(\operatorname{grad}f)=\mathbf{0} and div⁑(rot⁑F)=0.\operatorname{div}(\operatorname{rot}\mathbf{F})=0.

  • The sequence of gradient, curl, and divergence operators is exact on open sets without holes, such as R3\mathbb{R}^3, a ball, or the interior of a cube; exactness can fail on domains with holes, such as a torus interior or a ball with its center removed.

Further detail

  • The electric field derives from the electric potential VV up to sign, as expressed in the course by E=grad⁑V.\mathbf{E}=\operatorname{grad}V.

  • Maxwell's equations were published in 1862 by James Clerk Maxwell and describe the electromagnetic field through four equations: div⁑E=ρ/Ξ΅0\operatorname{div}\mathbf{E}=\rho/\varepsilon_0, rot⁑E=βˆ’βˆ‚B/βˆ‚t\operatorname{rot}\mathbf{E}=-\partial\mathbf{B}/\partial t, c2rot⁑B=βˆ‚E/βˆ‚t+j/Ξ΅0c^2\operatorname{rot}\mathbf{B}=\partial\mathbf{E}/\partial t+\mathbf{j}/\varepsilon_0, and div⁑B=0\operatorname{div}\mathbf{B}=0.

  • On R3βˆ–Ox\mathbb{R}^3\setminus Ox, the field F(x,y,z)=(0,βˆ’z/(y2+z2),y/(y2+z2))\mathbf{F}(x,y,z)=(0,-z/(y^2+z^2),y/(y^2+z^2)) has zero curl but does not derive from a scalar potential.

  • The study of when the gradient–curl–divergence sequence is exact, and its generalizations, contributed to the development of cohomology in topology in the 20th century.

Memory Hook

A curl-free field need not derive from a potential when the domain has a hole.

Test yourself

Take a 31-question practice quiz on Differential Calculus and Extrema, with every answer explained.

1. At a glacier depth of 2 feet and time 30 days, which expression gives the modeled temperature?

2. For one mole of an ideal gas with temperature TT and volume VV, which expression gives pressure as a function of those variables?

Take the quiz β†’

Study with flashcards

Memorize the key concepts of Differential Calculus and Extrema with 62 flashcards.

What limit defines the partial derivative of f with respect to x at (x,y)?

lim⁑hβ†’0f(x+h,y)βˆ’f(x,y)h\lim_{h\to 0}\frac{f(x+h,y)-f(x,y)}{h}

What vector is the gradient of f at (x,y)?

(βˆ‚fβˆ‚x(x,y),βˆ‚fβˆ‚y(x,y))\left(\frac{\partial f}{\partial x}(x,y),\frac{\partial f}{\partial y}(x,y)\right)

In which direction does the gradient of f point?

The direction of maximal increase of f.

See the flashcards β†’

Related classes

Make your own study guides

Upload your class notes and Revizly writes a study guide, a quiz and flashcards in about a minute.

Study guide maker