Return to computing page for the first course APMA0330
Return to computing page for the second course APMA0340
Return to computing page for the fourth course APMA0360
Return to Mathematica tutorial for the first course APMA0330
Return to Mathematica tutorial for the second course APMA0340
Return to Mathematica tutorial for the fourth course APMA0360
Return to the main page for the course APMA0330
Return to the main page for the course APMA0340
Return to the main page for the course APMA0360
Introduction to Linear Algebra with Mathematica

Fourier's motivation


Although Fourier series bare his name, they were well known to the great analysists of the eighteenth century (including Euler), even if it was Fourier who first had the proper insight into the true nature of these expansions. The Fourier integral is entirely Fourier's own discovery---it appeared for the first time in Fourier's monograph Théorie analytique de la chaleur (The Analytic Theory of Heat in French, 1822) and it was he who recognized its fundamental significance. The Fourier integral is a tool to analyze operators with continuous spectrum, in which all frequencies are represented.

The Fourier series expansions are applied to the class of periodic functions defined on finite interval [−ℓ, ℓ]. But not every function is periodic. Of course, we are free to extend the function outside the given interval by any definition we want and no harm is done if we continue the function by periodic repetitions. However, a function may be given in an infinite range. Fourier had the ingenious idea to consider such a function as a periodic function whose period grows to infinity. More precisely, we make ℓ increasingly larger and larger and investigate what happens in the limit when ℓ becomes infinite.

We begin our analysis with considering a function f(x) that is defined on finite interval [−ℓ, ℓ]. If this function is absolutely integrable on this interval, its Fourier coefficients are well-defined:

\[ \begin{split} a_n = \frac{1}{\ell} \int_{-\ell}^{+\ell} f(x) \,\cos\left( n\frac{\pi}{\ell}x \right) {\text d}x , \qquad n= 0,1,2,\ldots , \\ b_n = \frac{1}{\ell} \int_{-\ell}^{+\ell} f(x) \,\sin\left( n\frac{\pi}{\ell}x \right) {\text d}x , \qquad n= 1,2,\ldots . \end{split} \]
Of course, we have no reason to assume that an arbitrary function would be reducible to strictly periodic functions. However, we have seen in the study of the Fourier series that an arbitrary continuous and piecewise differentiable function of a finite range could certainly be resolved into an infinite superposition of sine and cosine functions, whose frequencies were not even arbitrary, but multiples of one fundamental frequency:
\[ f(x) \,\sim\, \frac{a_0}{2} + \sum_{n=1}^{\infty} a_n \cos \left( n\frac{\pi}{\ell}x \right) + b_n \sin \left( n\frac{\pi}{\ell}x \right) . \]
Using Euler's formula, we can rewrite trigonometric functions in exponential form
\[ \cos kx = \frac{e^{{\bf j}kx} + e^{-{\bf j}kx}}{2} , \qquad \sin kx = \frac{e^{{\bf j}kx} - e^{-{\bf j}kx}}{2{\bf j}} . \]
Upon setting
\[ a_{-n} = a_n , \qquad b_{-n} = - b_n , \qquad n=1,2,\ldots , \]
we can introduce complex coefficients
\[ c_0 = \frac{a_0}{2} , \quad c_n = \frac{a_n - {\bf j} b_n}{2} = \frac{1}{2\ell} \int_{-\ell}^{+\ell} f(x)\,e^{-{\bf j}n\pi x/\ell} \,{\text d}x, \quad n \ne 0 . \]
These coefficients are common to denote as
\[ \hat{f}(n) = \hat{f}_n = \frac{1}{2\ell} \int_{-\ell}^{+\ell} f(t)\, e^{-{\bf j}n\pi t/\ell} {\text d}t = c_n = \frac{a_n - {\bf j} b_n}{2} , \quad n = 0, \pm 1, \pm 2m \ldots . \]
It is more convenient to rewrite the Fourier series in complex form
\[ f(x) \,\sim\,\sum_{n=0}^{\infty} \left( c_n e^{{\bf j}n\pi x/\ell} + c_n^{\ast} e^{-{\bf j} n\pi x/\ell} \right) = \mbox{VP} \sum_{n=-\infty}^{\infty} c_n e^{{\bf j}n\pi x/\ell} , \]
where c denotes the complex conjugate of c (in pure math, it is customary also denoted as \( \displaystyle \quad \overline{c} = \left( a + {\bf j}b \right)^{\ast} = \overline{a + {\bf j}b} = a - {\bf j}b \) ) and VP means the Cauchy principal value, so
\[ \mbox{V.P.} \sum_{n=-\infty}^{\infty} c_n e^{{\bf j}n\pi x/\ell} = \lim_{N\to +\infty}\sum_{n=-N}^{N} c_n e^{{\bf j}n\pi x/\ell} . \]
For Fourier series, Parseval's identity holds:
\[ \frac{1}{\ell} \int_{-\ell}^{\ell} | f(x) |^2 {\text d}x = \frac{1}{2}\, a_0^2 + \sum_{n\ge 1} \left( a_n^2 + b_n^2 \right) , \]
and for complex form,
\[ \frac{1}{2\ell} \int_{-\ell}^{\ell} | f(x) |^2 {\text d}x = \sum_{n=-\infty}^{\infty} \left\vert c_n \right\vert^2 = \sum_{n=-\infty}^{\infty} c_n \,c_n^{\ast} = \sum_{n=-\infty}^{\infty} \left\vert \hat{f}_n \right\vert^2 . \]
To analyze the Fourier series, it is particularly instructive to introduce the function
\[ F(\xi ) = \int_{-\ell}^{+\ell} f(x)\, e^{-{\bf j}\xi x} {\text d} x \]
in which ξ. can take any value, because for large ℓ the coefficients cₙ demand the function values
\[ c_n = \frac{1}{2\ell}\,F\left( n\frac{\pi}{\ell} \right) . \]
This means that the values of the function F{ξ) become a very dense in ℝ, although n still jumps in integers. The Fourier coefficients of the standard Fourier series (normalized by setting ℓ - π) can be written in the form
\[ c_n = \frac{1}{2\pi}\,F\left( n \right) , \]
which brings into evidence the fact that the Fourier components of the function f(x) are not some arbitrarily capricious numbers, but they are connected by the common bond that they belong to a continuous function F(ξ) that is uniquely tied to the given function f{x). This commonℓ becomes very large, approaching infinity, because in that case we do not restrict ourselves to the integer values of ξ, but to all values of aξ.

Now we extend the given function f{x) f from the range [−ℓ, ℓ] to a larger interval {−2ℓ, 2ℓ] by setting f{x) &equive; 0 outside the given range [−ℓ, ℓ]. In this zase, we need to evaluate integrals Fourier coefficients

\[ c_n = \frac{1}{4\ell}\,F\left( n\frac{\pi}{2\ell} \right) = \frac{1}{4\ell}\,\int_{-\ell}^{\ell} f(x)\, e^{-{\bf j}\xi x} {\text d} x . \]
Example 1: We start with a linear function f(x) = x on interval [−ℓ, ℓ]. Its Fourier series is \[ x = \frac{2\ell}{\pi}\,\sum_{n\ge 1} (-1)^{n+1} \frac{1}{n}\,\sin\left( n\frac{\pi}{\ell}x \right) . \] So \[ b_n = (-1)^{n+1} \frac{2\ell}{\pi} \cdot \frac{1}{n} , \qquad \hat{f}_n = (-1)^n {\bf j}\,\frac{\ell}{n\pi} . \] Their squares are \[ b_n^2 = \frac{4 \ell^2}{\pi^2 n^2} , \qquad \left\vert \hat{f}_n \right\vert^2 = = \frac{\ell^2}{n^2 \pi^2} = 4\,b_n^2 , \qquad n=1,2,\ldots . \]
Integrate[x*Sin[n*Pi*x/a], {x, -a, a}]/a
-((2 a (n \[Pi] Cos[n \[Pi]] - Sin[n \[Pi]]))/(n^2 \[Pi]^2))
Using Parseval's identity, we get \[ \frac{1}{\ell} \int_{-\ell}^{+\ell} x^2 {\text d} x = \frac{2}{3}\,\ell^2 = \sum_{n\ge 1} \frac{4 \ell^2}{\pi^2 n^2} = \frac{4 \ell^2}{\pi^2} \cdot \frac{\pi^2}{6} . \]
Sum[1/n^2 , {n, 1, Infinity}]
\[Pi]^2/6
Integrate[x^2 , {x, -a, a}]
(2 a^3)/3
   ■
End of Example 1
It was Fourier's discovery that a large class of functions of an infinite domain follow the same pattern, provided that f(x) remains absolutely integrable in the infinite interval. Let ℓ > 0 and consider a complex‑valued function
\[ f_{\ell} \ : \ [-\ell , \ell ] \rightarrow \mathbb{C} , \]
which is integrable and (for simplicity) piecewise smooth. Extend f periodically to all of ℝ with period 2ℓ:
\[ f_{\ell}(x+2\ell ) = f_{\ell}(x),\quad x\in \mathbb{R}. \]
The complex Fourier series of this 2ℓ‑periodic function is
\[ f_{\ell}(x) \sim \sum _{n=-\infty }^{\infty } c_n^{(\ell )} e^{{\bf j}k_n x}, \]
where the discrete frequencies are
\[ k_n = \frac{n\pi }{\ell},\quad n\in \mathbb{Z}, \]
and the Fourier coefficients are
\[ c_n^{(\ell )} =\frac{1}{2\ell} \int _{-\ell}^{\ell} f_{\ell}(x)\, e^{-{\bf j}k_n x}\, {\text d}x. \]
This is the standard complex Fourier series on [-ℓ,ℓ].

Embedding a nonperiodic function into this framework involves

\[ f\ :\ \mathbb{R}\rightarrow \mathbb{C} \]
with sufficient decay and regularity—for instance, assume f ∈ 𝔏¹(ℝ) ∩ ℭ¹(ℝ) and that f(x) → 0 as |x| → ∞. We want to represent f on all of points of ℝ.

Rewrite the series explicitly in a Riemann-sum form:

\[ f_{\ell}(x) \sim \sum _{n=-\infty }^{\infty }\left( \frac{1}{2\ell}\int _{-\ell}^{\ell} f(t)\, e^{-{\bf j}k_n t}\, {\text d}t\right) e^{{\bf j}k_n x}. \]
Introduce the spacing in frequency:
\[ \Delta k := k_{n+1}-k_n =\frac{\pi }{\ell}. \]
Then
\[ \frac{1}{2\ell} = \frac{\Delta k}{2\pi }. \]
So we can rewrite
\[ c_n^{(\ell )} = \frac{1}{2\ell} \int _{-\ell}^{\ell} f(t)\, e^{-{\bf j}k_n t}\, {\text d}t = \frac{\Delta k}{2\pi }\int _{-\ell}^{\ell} f(t)\, e^{-{\bf j}k_n t}\, {\text d}t. \]
Hence
\[ f_{\ell}(x)\sim \sum _{n=-\infty }^{\infty }c_n^{(\ell )}e^{{\bf j}k_n x} = \mbox{V.P.}\sum _{n=-\infty }^{\infty }\left[ \frac{\Delta k}{2\pi }\int _{-\ell}^{\ell} f(t)\, e^{-{\bf j}k_n t}\, {\text d}t\right] e^{{\bf j}k_n x}. \]
Factor the integral:
\[ f_{\ell} (x)\sim \int _{-\ell}^{\ell} f(t)\left[ \sum _{n=-\infty }^{\infty }\frac{\Delta k}{2\pi }e^{{\bf j}k_n (x-t)}\right] {\text d}t. \]
The bracketed term is a discrete approximation to a Fourier integral kernel.

As ℓ → ∞ : frequency becomes continuous.

Formally, the sum
\[ \sum _{n=-\infty}^{\infty} \frac{\Delta k}{2\pi}\, e^{{\bf j}k_n (x-t)} \]
is a Riemann sum for
\[ \frac{1}{2\pi }\int _{-\infty }^{\infty }e^{{\bf j}k(x-t)}\, {\text d}k. \]
Thus, under appropriate conditions on f (e.g., f ∈ 𝔏¹(ℝ) and some mild regularity), we expect
\[ \lim _{\ell\rightarrow \infty }f_{\ell}(x) = f(x) \]
for each continuity point x of f, and
\[ f(x) =\lim _{\ell\rightarrow \infty }\int _{-\ell}^{\ell} f(t)\left[ \sum _{n=-\infty }^{\infty }\frac{\Delta k}{2\pi }e^{{\bf j}k_n (x-t)}\right] {\text d}t = \int _{-\infty }^{\infty } f(t)\left[ \frac{1}{2\pi }\int _{-\infty }^{\infty } e^{{\bf j}k (x-t)}\, {\text d}k\right] {\text d}t. \]
Interchanging limit and integral is justified by dominated convergence or similar theorems when f has sufficient decay and regularity (e.g., f ∈ đť’®(ℝ)).

Identification of the Fourier transform. Define the Fourier transform (one of the standard normalizations) by

\[ \hat {f}(k) := \int _{-\infty }^{\infty }f(t)\, e^{-{\bf j}kt}\, {\text d}t. \]
Then
\[ \frac{1}{2\pi }\int _{-\infty }^{\infty }\hat {f}(k)\, e^{{\bf j}kx}\, {\text d}k = \frac{1}{2\pi }\int _{-\infty }^{\infty }\left( \int _{-\infty }^{\infty } f(t)\, e^{-{\bf j}kt}\, {\text d}t\right) e^{{\bf j}kx}\, {\text d}k. \]
Assuming Fubini’s theorem applies (e.g., f ∈ 𝕃¹(ℝ) ∩ 𝔏²(ℝ), we can interchange integrals (in distribution sense):
\[ \frac{1}{2\pi }\int _{-\infty }^{\infty }\hat {f}(k)\, e^{{\bf j}kx}\, {\text d}k = \int _{-\infty }^{\infty }f(t)\left[ \frac{1}{2\pi }\int _{-\infty }^{\infty }e^{{\bf j}k(x-t)}\, {\text d}k\right] {\text d}t. \]
Comparing with the limit obtained from the Fourier series, we arrive at the Fourier inversion formula:
\[ f(x) = \frac{1}{2\pi }\int _{-\infty }^{\infty }\hat {f}(k)\, e^{{\bf j}kx}\, {\text d}k, \]
for all x where f is continuous (and more generally in 𝔏²-sense).

Thus, the Fourier integral representation

\[ f(x) =\frac{1}{2\pi }\int _{-\infty }^{\infty }\left( \int _{-\infty }^{\infty }f(t)\, e^{-{\bf j}kt}\, {\text d}t\right) e^{{\bf j}kx}\, {\text d}k \]
is obtained as the rigorous limit of the Fourier series on [-ℓ,ℓ] as ℓ → ∞.

Summary in “series → integral” language:

This is the rigorous, academic transition from Fourier series (discrete spectrum on a finite interval) to the Fourier integral / Fourier transform (continuous spectrum on ℝ), with the Riemann-sum limit ℓ → ∞ as the bridge.

 

Another derivation


We present another derivation of the Fourier integral from Fourier series of different flavor for pedagogical reasons because education is mostly a repetition. We start with an absolutely integrable function f on interval [−π, π]. This condition, f ∈ 𝔏(−π, π), guarantees existence of Fourier coefficients
\[ \begin{split} a_k &= \frac{1}{\pi} \int_{-\pi}^{\pi} f(x)\,\cos (kx)\,{\text d}x , \qquad k=0,1,2,\ldots , \\ b_k &= \frac{1}{\pi} \int_{-\pi}^{\pi} f(x)\,\sin (kx)\,{\text d}x , \qquad k= 1,2,\ldots . \end{split} \]
The corresponding Fourier series is associated with function f:
\[ f(x) \,\sim \,\frac{a_0}{2} + \sum_{k=1}^{\infty} a_k \cos (kx) + b_k \sin (kx) . \]
We use the following notations:
\[ a_{-k} = a_k , \quad b_{-k} = - b_k , \qquad k=1,2,\ldots . \]
Then using \[ \cos (kx) = \frac{1}{2} \left[ e^{{\bf j}kx} + e^{-{\bf j}kx} \right] , \quad \sin (kx) = \frac{1}{2{\bf j}} \left[ e^{{\bf j}kx} - e^{-{\bf j}kx} \right] , \quad {\bf j}^2 = -1, \]
we set
\[ c_0 = \frac{a_0}{2} , \qquad c_k = \frac{a_k + {\bf j}\,b_k}{} , \quad k \ne 0 . \]
Recall that we denote by ⅉ or j the
imaginary unit on the complex plane ℂ. This allows us to rewrite the Fourier series in terms of exponential function:
\begin{align*} f(x) &\sim \frac{a_0}{2} + \sum_{k=1}^{\infty} a_k \cos (kx) + b_k \sin (kx) \\ &= c_0 + \sum_{k=1}^{\infty} \left( a_k \frac{e^{{\bf j} kx} + e^{-{\bf j} kx} }{2} + b_k \frac{e^{{\bf j} kx} - e^{-{\bf j} kx} }{2{\bf j}} \right) \\ &= c_0 + \sum_{k \ge 1} \left( \frac{a_k - {\bf j}\,b_k}{2} \, e^{{\bf j} kx} + \frac{a_k + {\bf j}\,b_k}{2} \, e^{-{\bf j} kx} \right) \\ &= c_0 + \sum_{k \ge 1} \left( c_{-k} e^{{\bf j} kx} + c_k e^{-{\bf j} kx} \right) \\ &= \mbox{V.P.} \sum_{k=-\infty}^{\infty} c_k e^{-{\bf j} kx} , \end{align*}
where "V.P." or just "VP" symbolizes the Cauchy principal value series regularization. Therefore, we can assign to every absolutely integrable function the corresponding Fourier series:
\[ f(x) \,\sim\, \mbox{V.P.}\sum_{k=-\infty}^{\infty} c_k e^{-{\bf j} kx} . \]
Suppose that this Fourier series converges uniformly, then we can multiply it term by term and integrate to obtain
\begin{align*} \int_{-\pi}^{\pi} f(x)\,e^{{\bf j}mx} {\text d}x &= \mbox{V.P.}\int_{-\pi}^{\pi} {\text d}x \left( \sum_{k=-\infty}^{\infty} c_k e^{{\bf j} \left( m -k \right) x} \right) \\ &= \mbox{V.P.} \sum_{k=-\infty}^{\infty} c_k \int_{-\pi}^{\pi} e^{{\bf j} \left( m -k \right) x} {\text d}x . \end{align*}
Evaluating integral, we get
\begin{align*} \int_{-\pi}^{\pi} e^{{\bf j} \left( m -k \right) x} {\text d}x &= \left. \frac{e^{{\bf j} \left( m -k \right) x} }{{\bf j} \left( m-k \right)} \right\vert_{x=-\pi}^{x=\pi} \\ &= \frac{1}{{\bf j} \left( m-k \right)} \left[ e^{{\bf j} \left( m -k \right) \pi} - e^{-{\bf j} \left( m -k \right) \pi} \right] \\ &= \frac{2}{m-k} \,\sin \left( (m-k)\,\pi \right) = 0 , \qquad m\ne k . \end{align*}
When m = k, we have
\[ \int_{-\pi}^{\pi} e^{{\bf j} \left( m -m \right) x} {\text d}x = \int_{-\pi}^{\pi} {\text d}x = 2\pi . \]
Hence, we obtain
\[ \int_{-\pi}^{\pi} e^{{\bf j} m x} f(x)\,{\text d}x = c_m 2\pi , \]
from which it follows
\[ c_k = \frac{1}{2\pi} \int_{-\pi}^{\pi} e^{{\bf j} kx} f(x)\,{\text d}x , \qquad k = 0, \pm 1, \pm 2, \ldots . \]

Let f(x) be absolutely integrable function on interval [−πℓ, πℓ]. We change variable x = uℓ, where u ∈ [−π, π]. In this case, function g(u) = f(uℓ) = ff(x)i>(x) is defined on interval [−π, π]. Its Fourier series becomes

\[ g(u) \,\sim\, \mbox{VP} \sum_{k=-\infty}^{\infty} c_k e^{-{\bf j} ku} , \quad c_k = \frac{1}{2\pi} \int_{-\pi}^{\pi} e^{{\bf j} ku} g(u)\,{\text d}u , \quad k = 0, \pm 1, \pm 2, \ldots . \]
Expressing Fourier coefficients through function f(x), we obtain
\[ c_k = \frac{1}{2\pi} \int_{-\pi\ell}^{\pi\ell} g\left( \frac{x}{\ell} \right) e^{{\bf j}kx/\ell} \frac{{\text d}x}{\ell} = \frac{1}{2\pi\ell} \int_{-\pi\ell}^{\pi\ell} f(x)\,e^{{\bf j}kx/\ell} {\text d}x . \]
This means that the following Fourier series corresponds to function f(x):
\[ f(x)\,\sim\, \mbox{V.P.} \sum_{k=-\infty}^{\infty} c_k e^{-{\bf j}kx/\ell} , \]
where Fourier coefficients are defined by
\[ c_k = \frac{1}{2\pi\ell} \int_{-\pi\ell}^{\pi\ell} f(x)\,e^{{\bf j}kx/\ell} {\text d}x , \quad k=0, \pm 1, \pm 2, \ldots . \]

 

  1. Stein, E.M. and Shakarchi, R., Fourier Analysis: An Introduction, World Book Publishing Company, 2011. Chapter 2, Section “From Fourier Series to the Fourier Transform”.
  2. Titchmarsh, E.C., Introduction to the Theory of Fourier Integrals, Oxford University Press, 1948.
  3. Zygmund, A., Trigonometric Series, Volumes I&II Combined, Cambridge University Press, 2nd edition, 1988.

 

Return to Mathematica page
Return to the main page (APMA0340)
Return to the Part 1 Basic Concepts
Return to the Part 2 Fourier Series
Return to the Part 3 Integral Transformations
Return to the Part 4 Parabolic PDEs
Return to the Part 5 Hyperbolic PDEs
Return to the Part 6 Elliptic PDEs
Return to the Part 6P Potential Theory
Return to the Part 7 Numerical Methods