Multivariable Functions and Partial Derivatives

Overview

Calculus extends its inquiry into functions of multiple variables, shifting from the study of single-variable functions and their derivatives to exploring the terrain of multivariable functions. This progression is essential for delving into domains such as optimization and machine learning, where functions often depend on numerous variables.

Tangents: From Lines to Planes

Single Variable Context

Consider a univariate function, $f(x) = x^2$. Its derivative, $\frac{df}{dx}$, represents the slope of the tangent line at any given point on the curve. For instance, at a point $x = 0.2$, if $f(x) = 4$, then the slope of the tangent line at this point is $4$.

Multivariable Context

In contrast, for a bivariate function $f(x, y) = x^2 + y^2$, the concept of tangency expands from a line to a plane. To visualize this function and its tangent structures, one must employ a 3-dimensional plot, where the $x$ and $y$ axes define the plane and the $z$ axis represents the function value, $f(x, y)$.

Deriving the Tangent Plane

The construction of a tangent plane at a given point on the surface defined by $f(x, y)$ involves analyzing the function's behavior along two distinct paths that intersect at the point of interest.

Procedure

Fixing $y$

1. By fixing $y$ (e.g., $y = 4$), the function reduces to a single-variable context along the $x$-axis, resulting in a slice $f(x, 4) = x^2 + 16$.
2. The derivative of this slice with respect to $x$, $\frac{\partial f}{\partial x} = 2x$, gives the slope of the tangent line in the direction of the $x$-axis.

Fixing $x$

1. Similarly, by fixing $x$ (e.g., $x = 2$), and considering a slice along the $y$-axis, $f(2, y) = 4 + y^2$.
2. The derivative of this slice with respect to $y$, $\frac{\partial f}{\partial y} = 2y$, provides the slope of the tangent line in the direction of the $y$-axis.

Tangent Plane Synthesis

The tangent plane at a specific point is the geometric plane spanned by these two tangent lines in 3-dimensional space.

Partial Derivatives

Conceptual Overview

Consider a function $f(x, y)$ representing a surface in three-dimensional space. If we slice this surface with a plane parallel to either the $x$-axis or $y$-axis, we obtain a curve on the surface. The slope of the tangent to this curve at any point represents a partial derivative of the function at that point, depending on the direction of the slice.

Visualization Through Slicing

• Slicing Parallel to the $x$-axis: Fixing a value of $y$ and treating it as a constant transforms $f(x, y)$ into a function of a single variable $x$, represented by a curve on the surface. The slope of the tangent to this curve is the partial derivative of $f$ with respect to $x$, denoted as $\frac{\partial f}{\partial x}$ or $f_x$.
• Slicing Parallel to the $y$-axis: Similarly, fixing $x$ and treating it as a constant transforms $f(x, y)$ into a function of $y$ alone. The slope of the tangent to this curve is the partial derivative of $f$ with respect to $y$, denoted as $\frac{\partial f}{\partial y}$ or $f_y$.

Calculating Partial Derivatives

Example 1: Function $f(x, y) = x^2 + y^2$

• Partial Derivative with Respect to $x$: Treating $y$ as a constant, the partial derivative $\frac{\partial f}{\partial x}$ is obtained by differentiating $f(x, y)$ with respect to $x$, yielding $2x$.
• Partial Derivative with Respect to $y$: Treating $x$ as a constant, the partial derivative $\frac{\partial f}{\partial y}$ is $2y$.

General Method

1. Fix Other Variables: Treat all variables other than the one with respect to which differentiation is performed as constants.
2. Differentiate: Apply normal differentiation rules to the function with respect to the variable of interest.

Example 2: Function $f(x, y) = 3x^2y^3$

• Partial Derivative with Respect to $x$: Treating $y$ as constant, differentiate $f(x, y)$ with respect to $x$, leading to $6xy^3$.
• Partial Derivative with Respect to $y$: Treating $x$ as constant, differentiate $f(x, y)$ with respect to $y$, resulting in $9x^2y^2$.