Generalized Fourier series

A generalized Fourier series is the expansion of a square integrable function into a sum of square integrable orthogonal basis functions. The standard Fourier series uses an orthonormal basis of trigonometric functions, and the series expansion is applied to periodic functions. In contrast, a generalized Fourier series uses any set of orthogonal basis functions and can apply to any square integrable function.^[1][2]

Consider a set ${\displaystyle \Phi =\{\phi _{n}:[a,b]\to \mathbb {C} \}_{n=0}^{\infty }}$ of square-integrable complex valued functions defined on the closed interval ${\displaystyle [a,b]}$ that are pairwise orthogonal under the weighted inner product

${\displaystyle \langle f,g\rangle _{w}=\int _{a}^{b}f(x){\overline {g(x)}}w(x)dx,}$

where ${\displaystyle w(x)}$ is a weight function and ${\displaystyle {\overline {g}}}$ is the complex conjugate of ${\displaystyle g}$. Then, the generalized Fourier series of a function ${\displaystyle f}$ is $${\displaystyle f(x)=\sum _{n=0}^{\infty }c_{n}\phi _{n}(x),}$$where the coefficients are given by $${\displaystyle c_{n}={\langle f,\phi _{n}\rangle _{w} \over \|\phi _{n}\|_{w}^{2}}.}$$

Given the space ${\displaystyle L^{2}(a,b)}$ of square integrable functions defined on a given interval, one can find orthogonal bases by considering a class of boundary value problems on the interval ${\displaystyle [a,b]}$ called regular Sturm-Liouville problems. These are defined as follows, $${\displaystyle (rf')'+pf+\lambda wf=0}$$ $${\displaystyle B_{1}(f)=B_{2}(f)=0}$$ where ${\displaystyle r,r'}$ and ${\displaystyle p}$ are real and continuous on ${\displaystyle [a,b]}$ and ${\displaystyle r>0}$ on ${\displaystyle [a,b]}$, ${\displaystyle B_{1}}$ and ${\displaystyle B_{2}}$ are self-adjoint boundary conditions, and ${\displaystyle w}$ is a positive continuous functions on ${\displaystyle [a,b]}$.

Given a regular Sturm-Liouville problem as defined above, the set ${\displaystyle \{\phi _{n}\}_{1}^{\infty }}$ of eigenfunctions corresponding to the distinct eigenvalue solutions to the problem form an orthogonal basis for ${\displaystyle L^{2}(a,b)}$ with respect to the weighted inner product ${\displaystyle \langle \cdot ,\cdot \rangle _{w}}$. ^[3] We also have that for a function ${\displaystyle f\in L^{2}(a,b)}$ that satisfies the boundary conditions of this Sturm-Liouville problem, the series ${\displaystyle \sum _{n=1}^{\infty }\langle f,\phi _{n}\rangle \phi _{n}}$ converges uniformly to ${\displaystyle f}$. ^[4]

A function ${\displaystyle f(x)}$ defined on the entire number line is called periodic with period ${\displaystyle T}$ if a number ${\displaystyle T>0}$ exists such that, for any real number ${\displaystyle x}$, the equality ${\displaystyle f(x+T)=f(x)}$ holds.

If a function is periodic with period ${\displaystyle T}$, then it is also periodic with periods ${\displaystyle 2T}$, ${\displaystyle 3T}$, and so on. Usually, the period of a function is understood as the smallest such number ${\displaystyle T}$. However, for some functions, arbitrarily small values of ${\displaystyle T}$ exist.

The sequence of functions ${\displaystyle 1,\cos(x),\sin(x),\cos(2x),\sin(2x),...,\cos(nx),\sin(nx),...}$ is known as the trigonometric system. Any linear combination of functions of a trigonometric system, including an infinite combination (that is, a converging infinite series), is a periodic function with a period of 2π.

On any segment of length 2π (such as the segments [−π,π] and [0,2π]) the trigonometric system is an orthogonal system. This means that for any two functions of the trigonometric system, the integral of their product over a segment of length 2π is equal to zero. This integral can be treated as a scalar product in the space of functions that are integrable on a given segment of length 2π.

Let the function ${\displaystyle f(x)}$ be defined on the segment [−π, π]. Given appropriate smoothness and differentiability conditions, ${\displaystyle f(x)}$ may be represented on this segment as a linear combination of functions of the trigonometric system, also referred to as the expansion of the function ${\displaystyle f(x)}$ into a trigonometric Fourier series.

The Legendre polynomials ${\displaystyle P_{n}(x)}$ are solutions to the Sturm–Liouville eigenvalue problem

${\displaystyle \left((1-x^{2})P_{n}'(x)\right)'+n(n+1)P_{n}(x)=0.}$

As a consequence of Sturm-Liouville theory, these polynomials are orthogonal eigenfunctions with respect to the inner product with unit weight. This can be written as a generalized Fourier series (known in this case as a Fourier–Legendre series) involving the Legendre polynomials, so that

${\displaystyle f(x)\sim \sum _{n=0}^{\infty }c_{n}P_{n}(x),}$

${\displaystyle c_{n}={\langle f,P_{n}\rangle _{w} \over \|P_{n}\|_{w}^{2}}}$

As an example, the Fourier–Legendre series may be calculated for ${\displaystyle f(x)=\cos x}$ over ${\displaystyle [-1,1]}$. Then

${\displaystyle {\begin{aligned}c_{0}&={\int _{-1}^{1}\cos {x}\,dx \over \int _{-1}^{1}(1)^{2}\,dx}=\sin {1}\\c_{1}&={\int _{-1}^{1}x\cos {x}\,dx \over \int _{-1}^{1}x^{2}\,dx}={0 \over 2/3}=0\\c_{2}&={\int _{-1}^{1}{3x^{2}-1 \over 2}\cos {x}\,dx \over \int _{-1}^{1}{9x^{4}-6x^{2}+1 \over 4}\,dx}={6\cos {1}-4\sin {1} \over 2/5}\end{aligned}}}$

and a truncated series involving only these terms would be

${\displaystyle {\begin{aligned}c_{2}P_{2}(x)+c_{1}P_{1}(x)+c_{0}P_{0}(x)&={5 \over 2}(6\cos {1}-4\sin {1})\left({3x^{2}-1 \over 2}\right)+\sin 1\\&=\left({45 \over 2}\cos {1}-15\sin {1}\right)x^{2}+6\sin {1}-{15 \over 2}\cos {1}\end{aligned}}}$

which differs from ${\displaystyle \cos x}$ by approximately 0.003. In computational applications it may be advantageous to use such Fourier–Legendre series rather than Fourier series since the basis functions for the series expansion are all polynomials and hence the integrals and thus the coefficients may be easier to calculate.

Some theorems on the series coefficients ${\displaystyle c_{n}}$ include:

${\displaystyle \sum _{n=0}^{\infty }|c_{n}|^{2}\leq \int _{a}^{b}|f(x)|^{2}w(x)\,dx.}$

If Φ is a complete basis, then

${\displaystyle \sum _{n=0}^{\infty }|c_{n}|^{2}=\int _{a}^{b}|f(x)|^{2}w(x)\,dx.}$

• Banach space
• Eigenfunctions
• Fractional Fourier transform
• Function space
• Hilbert space
• Least-squares spectral analysis
• Orthogonal function
• Orthogonality
• Topological vector space
• Vector space

• Generalized Fourier Series at MathWorld
• Herman, Russell (2016). An Introductions to Fourier and Complex Analysis with Applications to the Spectral Analysis of Signals (PDF). p. 73-112.
• Folland, Gerald B. (1992). Fourier Analysis and Its Applications (PDF). Pacific Grove, California: Wadsworth & Brooks/Cole Advanced Books & Software. p. 62-97.