Template:Dablink
The mathematical concept of a Hilbert space, named after David Hilbert, generalizes the notion of Euclidean space. It extends the methods of vector algebra and calculus from the twodimensional Euclidean plane and threedimensional space to spaces with any finite or infinite number of dimensions. A Hilbert space is an abstract vector space possessing the structure of an inner product that allows length and angle to be measured. Furthermore, Hilbert spaces must be complete, a property that stipulates the existence of enough limits in the space to allow the techniques of calculus to be used.
Hilbert spaces arise naturally and frequently in mathematics, physics, and engineering, typically as infinitedimensional function spaces. The earliest Hilbert spaces were studied from this point of view in the first decade of the 20th century by David Hilbert, Erhard Schmidt, and Frigyes Riesz. They are indispensable tools in the theories of partial differential equations, quantum mechanics, Fourier analysis (which includes applications to signal processing and heat transfer)—and ergodic theory, which forms the mathematical underpinning of thermodynamics. John von Neumann coined the term Hilbert space for the abstract concept that underlies many of these diverse applications. The success of Hilbert space methods ushered in a very fruitful era for functional analysis. Apart from the classical Euclidean spaces, examples of Hilbert spaces include spaces of squareintegrable functions, spaces of sequences, Sobolev spaces consisting of generalized functions, and Hardy spaces of holomorphic functions.
Geometric intuition plays an important role in many aspects of Hilbert space theory. Exact analogs of the Pythagorean theorem and parallelogram law hold in a Hilbert space. At a deeper level, perpendicular projection onto a subspace (the analog of "dropping the altitude" of a triangle) plays a significant role in optimization problems and other aspects of the theory. An element of a Hilbert space can be uniquely specified by its coordinates with respect to a set of coordinate axes (an orthonormal basis), in analogy with Cartesian coordinates in the plane. When that set of axes is countably infinite, this means that the Hilbert space can also usefully be thought of in terms of infinite sequences that are squaresummable. Linear operators on a Hilbert space are likewise fairly concrete objects: in good cases, they are simply transformations that stretch the space by different factors in mutually perpendicular directions in a sense that is made precise by the study of their spectrum.
Definition and illustration
Motivating example: Euclidean space
One of the most familiar examples of a Hilbert space is the Euclidean space consisting of threedimensional vectors, denoted by R^{3}, and equipped with the dot product. The dot product takes two vectors x and y, and produces a real number x·y. If x and y are represented in Cartesian coordinates, then the dot product is defined by
 $(x\_1,x\_2,x\_3)\backslash cdot\; (y\_1,y\_2,y\_3)\; =\; x\_1y\_1+x\_2y\_2+x\_3y\_3.$
The dot product satisfies the properties:
 It is symmetric in x and y: x · y = y · x.
 It is linear in its first argument: (ax_{1} + bx_{2}) · y = ax_{1} · y + bx_{2} · y for any scalars a, b, and vectors x_{1}, x_{2}, and y.
 It is positive definite: for all vectors x, x · x ≥ 0, with equality if and only if x = 0.
An operation on pairs of vectors that, like the dot product, satisfies these three properties is known as a (real) inner product. A vector space equipped with such an inner product is known as a (real) inner product space. Every finitedimensional inner product space is also a Hilbert space. The basic feature of the dot product that connects it with Euclidean geometry is that it is related to both the length (or norm) of a vector, denoted x, and to the angle θ between two vectors x and y by means of the formula
 $\backslash mathbf\{x\}\backslash cdot\backslash mathbf\{y\}\; =\; \backslash \backslash mathbf\{x\}\backslash \backslash ,\backslash \backslash mathbf\{y\}\backslash \backslash ,\backslash cos\backslash theta.$
Multivariable calculus in Euclidean space relies on the ability to compute limits, and to have useful criteria for concluding that limits exist. A mathematical series
 $\backslash sum\_\{n=0\}^\backslash infty\; \backslash mathbf\{x\}\_n$
consisting of vectors in R^{3} is absolutely convergent provided that the sum of the lengths converges as an ordinary series of real numbers:^{[1]}
 $\backslash sum\_\{k=0\}^\backslash infty\; \backslash \backslash mathbf\{x\}\_k\backslash \; <\; \backslash infty.$
Just as with a series of scalars, a series of vectors that converges absolutely also converges to some limit vector L in the Euclidean space, in the sense that
 $\backslash left\backslash \backslash mathbf\{L\}\backslash sum\_\{k=0\}^N\backslash mathbf\{x\}\_k\backslash right\backslash \backslash to\; 0\backslash quad\backslash text\{as\; \}N\backslash to\backslash infty.$
This property expresses the completeness of Euclidean space: that a series that converges absolutely also converges in the ordinary sense.
Definition
A Hilbert space H is a real or complex inner product space that is also a complete metric space with respect to the distance function induced by the inner product.^{[2]} To say that H is a complex inner product space means that H is a complex vector space on which there is an inner product $\backslash langle\; x,y\backslash rangle$ associating a complex number to each pair of elements x,y of H that satisfies the following properties:
 The inner product of a pair of elements is equal to the complex conjugate of the inner product of the swapped elements:
 $\backslash langle\; y,x\backslash rangle\; =\; \backslash overline\{\backslash langle\; x,\; y\backslash rangle\}.$
 The inner product is linear in its first argument.^{[3]} For all complex numbers a and b,
 $\backslash langle\; ax\_1+bx\_2,\; y\backslash rangle\; =\; a\backslash langle\; x\_1,\; y\backslash rangle\; +\; b\backslash langle\; x\_2,\; y\backslash rangle.$
 $\backslash langle\; x,x\backslash rangle\; \backslash ge\; 0$
 where the case of equality holds precisely when x = 0.
It follows from properties 1 and 2 that a complex inner product is antilinear in its second argument, meaning that
 $\backslash langle\; x,\; ay\_1+by\_2\backslash rangle\; =\; \backslash bar\{a\}\backslash langle\; x,\; y\_1\backslash rangle\; +\; \backslash bar\{b\}\backslash langle\; x,\; y\_2\backslash rangle.$
A real inner product space is defined in the same way, except that H is a real vector space and the inner product takes real values. Such an inner product will be bilinear: that is, linear in each argument.
The norm is the realvalued function
 $\backslash x\backslash \; =\; \backslash sqrt\{\backslash langle\; x,x\; \backslash rangle\},$
and the distance d between two points x,y in H is defined in terms of the norm by
 $d(x,y)=\backslash xy\backslash \; =\; \backslash sqrt\{\backslash langle\; xy,xy\; \backslash rangle\}.$
That this function is a distance function means (1) that it is symmetric in x and y, (2) that the distance between x and itself is zero, and otherwise the distance between x and y must be positive, and (3) that the triangle inequality holds, meaning that the length of one leg of a triangle xyz cannot exceed the sum of the lengths of the other two legs:
 $d(x,z)\; \backslash le\; d(x,y)\; +\; d(y,z).$
This last property is ultimately a consequence of the more fundamental Cauchy–Schwarz inequality, which asserts
 $\backslash langle\; x,\; y\backslash rangle\; \backslash le\; \backslash x\backslash \backslash ,\backslash y\backslash $
with equality if and only if x and y are linearly dependent.
Relative to a distance function defined in this way, any inner product space is a metric space, and sometimes is known as a preHilbert space.^{[4]} Any preHilbert space that is additionally also a complete space is a Hilbert space. Completeness is expressed using a form of the Cauchy criterion for sequences in H: a preHilbert space H is complete if every Cauchy sequence converges with respect to this norm to an element in the space. Completeness can be characterized by the following equivalent condition: if a series of vectors $\backslash textstyle\{\backslash sum\_\{k=0\}^\backslash infty\; u\_k\}$ converges absolutely in the sense that
 $\backslash sum\_\{k=0\}^\backslash infty\backslash u\_k\backslash \; <\; \backslash infty,$
then the series converges in H, in the sense that the partial sums converge to an element of H.
As a complete normed space, Hilbert spaces are by definition also Banach spaces. As such they are topological vector spaces, in which topological notions like the openness and closedness of subsets are welldefined. Of special importance is the notion of a closed linear subspace of a Hilbert space that, with the inner product induced by restriction, is also complete (being a closed set in a complete metric space) and therefore a Hilbert space in its own right.
Second example: sequence spaces
The sequence space ℓ^{2} consists of all infinite sequences z = (z_{1},z_{2},...) of complex numbers such that the series
 $\backslash sum\_\{n=1\}^\backslash infty\; z\_n^2$
converges. The inner product on ℓ^{2} is defined by
 $\backslash langle\; \backslash mathbf\{z\},\backslash mathbf\{w\}\backslash rangle\; =\; \backslash sum\_\{n=1\}^\backslash infty\; z\_n\backslash overline\{w\_n\},$
with the latter series converging as a consequence of the Cauchy–Schwarz inequality.
Completeness of the space holds provided that whenever a series of elements from ℓ^{2} converges absolutely (in norm), then it converges to an element of ℓ^{2}. The proof is basic in mathematical analysis, and permits mathematical series of elements of the space to be manipulated with the same ease as series of complex numbers (or vectors in a finitedimensional Euclidean space).^{[5]}
History
Prior to the development of Hilbert spaces, other generalizations of Euclidean spaces were known to mathematicians and physicists. In particular, the idea of an abstract linear space had gained some traction towards the end of the 19th century:^{[6]} this is a space whose elements can be added together and multiplied by scalars (such as real or complex numbers) without necessarily identifying these elements with "geometric" vectors, such as position and momentum vectors in physical systems. Other objects studied by mathematicians at the turn of the 20th century, in particular spaces of sequences (including series) and spaces of functions,^{[7]} can naturally be thought of as linear spaces. Functions, for instance, can be added together or multiplied by constant scalars, and these operations obey the algebraic laws satisfied by addition and scalar multiplication of spatial vectors.
In the first decade of the 20th century, parallel developments led to the introduction of Hilbert spaces. The first of these was the observation, which arose during David Hilbert and Erhard Schmidt's study of integral equations,^{[8]} that two squareintegrable realvalued functions f and g on an interval [a,b] have an inner product
 $\backslash langle\; f,g\; \backslash rangle\; =\; \backslash int\_a^b\; f(x)g(x)\backslash ,dx$
which has many of the familiar properties of the Euclidean dot product. In particular, the idea of an orthogonal family of functions has meaning. Schmidt exploited the similarity of this inner product with the usual dot product to prove an analog of the spectral decomposition for an operator of the form
 $f(x)\; \backslash mapsto\; \backslash int\_a^b\; K(x,y)\; f(y)\backslash ,\; dy$
where K is a continuous function symmetric in x and y. The resulting eigenfunction expansion expresses the function K as a series of the form
 $K(x,y)\; =\; \backslash sum\_n\; \backslash lambda\_n\backslash varphi\_n(x)\backslash varphi\_n(y)\backslash ,$
where the functions φ_{n} are orthogonal in the sense that ⟨φ_{n},φ_{m}⟩ = 0 for all n ≠ m. The individual terms in this series are sometimes referred to as elementary product solutions. However, there are eigenfunction expansions that fail to converge in a suitable sense to a squareintegrable function: the missing ingredient, which ensures convergence, is completeness.^{[9]}
The second development was the Lebesgue integral, an alternative to the Riemann integral introduced by Henri Lebesgue in 1904.^{[10]} The Lebesgue integral made it possible to integrate a much broader class of functions. In 1907, Frigyes Riesz and Ernst Sigismund Fischer independently proved that the space L^{2} of square Lebesgueintegrable functions is a complete metric space.^{[11]} As a consequence of the interplay between geometry and completeness, the 19th century results of Joseph Fourier, Friedrich Bessel and MarcAntoine Parseval on trigonometric series easily carried over to these more general spaces, resulting in a geometrical and analytical apparatus now usually known as the Riesz–Fischer theorem.^{[12]}
Further basic results were proved in the early 20th century. For example, the Riesz representation theorem was independently established by Maurice Fréchet and Frigyes Riesz in 1907.^{[13]} John von Neumann coined the term abstract Hilbert space in his work on unbounded Hermitian operators.^{[14]} Although other mathematicians such as Hermann Weyl and Norbert Wiener had already studied particular Hilbert spaces in great detail, often from a physically motivated point of view, von Neumann gave the first complete and axiomatic treatment of them.^{[15]} Von Neumann later used them in his seminal work on the foundations of quantum mechanics,^{[16]} and in his continued work with Eugene Wigner. The name "Hilbert space" was soon adopted by others, for example by Hermann Weyl in his book on quantum mechanics and the theory of groups.^{[17]}
The significance of the concept of a Hilbert space was underlined with the realization that it offers one of the best mathematical formulations of quantum mechanics.^{[18]} In short, the states of a quantum mechanical system are vectors in a certain Hilbert space, the observables are hermitian operators on that space, the symmetries of the system are unitary operators, and measurements are orthogonal projections. The relation between quantum mechanical symmetries and unitary operators provided an impetus for the development of the unitary representation theory of groups, initiated in the 1928 work of Hermann Weyl.^{[17]} On the other hand, in the early 1930s it became clear that classical mechanics can be described in terms of Hilbert space (Koopman–von Neumann classical mechanics) and that certain properties of classical dynamical systems can be analyzed using Hilbert space techniques in the framework of ergodic theory.^{[19]}
The algebra of observables in quantum mechanics is naturally an algebra of operators defined on a Hilbert space, according to Werner Heisenberg's matrix mechanics formulation of quantum theory. Von Neumann began investigating operator algebras in the 1930s, as rings of operators on a Hilbert space. The kind of algebras studied by von Neumann and his contemporaries are now known as von Neumann algebras. In the 1940s, Israel Gelfand, Mark Naimark and Irving Segal gave a definition of a kind of operator algebras called C*algebras that on the one hand made no reference to an underlying Hilbert space, and on the other extrapolated many of the useful features of the operator algebras that had previously been studied. The spectral theorem for selfadjoint operators in particular that underlies much of the existing Hilbert space theory was generalized to C*algebras. These techniques are now basic in abstract harmonic analysis and representation theory.
Examples
Lebesgue spaces
Main article:
L^{p} space
Lebesgue spaces are function spaces associated to measure spaces (X, M, μ), where X is a set, M is a σalgebra of subsets of X, and μ is a countably additive measure on M. Let L^{2}(X, μ) be the space of those complexvalued measurable functions on X for which the Lebesgue integral of the square of the absolute value of the function is finite, i.e., for a function f in L^{2}(X,μ),
 $\backslash int\_X\; f^2\; d\; \backslash mu\; <\; \backslash infty,$
and where functions are identified if and only if they differ only on a set of measure zero.
The inner product of functions f and g in L^{2}(X, μ) is then defined as
 $\backslash langle\; f,g\backslash rangle=\backslash int\_X\; f(t)\; \backslash overline\{g(t)\}\; \backslash \; d\; \backslash mu(t).$
For f and g in L^{2}, this integral exists because of the Cauchy–Schwarz inequality, and defines an inner product on the space. Equipped with this inner product, L^{2} is in fact complete.^{[20]} The Lebesgue integral is essential to ensure completeness: on domains of real numbers, for instance, not enough functions are Riemann integrable.^{[21]}
The Lebesgue spaces appear in many natural settings. The spaces L^{2}(R) and L^{2}([0,1]) of squareintegrable functions with respect to the Lebesgue measure on the real line and unit interval, respectively, are natural domains on which to define the Fourier transform and Fourier series. In other situations, the measure may be something other than the ordinary Lebesgue measure on the real line. For instance, if w is any positive measurable function, the space of all measurable functions f on the interval [0, 1] satisfying
 $\backslash int\_0^1\; f(t)^2w(t)\backslash ,dt\; <\; \backslash infty$
is called the weighted L^{2} space L2
w([0,1]), and w is called the weight function. The inner product is defined by
 $\backslash langle\; f,g\backslash rangle=\backslash int\_0^1\; f(t)\; \backslash overline\{g(t)\}\; w(t)\; \backslash ,\; dt.$
The weighted space L2
w([0,1]) is identical with the Hilbert space L^{2}([0,1],μ) where the measure μ of a Lebesguemeasurable set A is defined by
 $\backslash mu(A)\; =\; \backslash int\_A\; w(t)\backslash ,dt.$
Weighted L^{2} spaces like this are frequently used to study orthogonal polynomials, because different families of orthogonal polynomials are orthogonal with respect to different weighting functions.
Sobolev spaces
Sobolev spaces, denoted by H^{s} or W^{ s, 2}, are Hilbert spaces. These are a special kind of function space in which differentiation may be performed, but that (unlike other Banach spaces such as the Hölder spaces) support the structure of an inner product. Because differentiation is permitted, Sobolev spaces are a convenient setting for the theory of partial differential equations.^{[22]} They also form the basis of the theory of direct methods in the calculus of variations.^{[23]}
For s a nonnegative integer and Ω ⊂ R^{n}, the Sobolev space H^{s}(Ω) contains L^{2} functions whose weak derivatives of order up to s are also L^{2}. The inner product in H^{s}(Ω) is
 $\backslash langle\; f,g\backslash rangle\; =\; \backslash int\_\backslash Omega\; f(x)\backslash bar\{g\}(x)\backslash ,dx\; +\; \backslash int\_\backslash Omega\; D\; f\backslash cdot\; D\backslash bar\{g\}(x)\backslash ,dx\; +\; \backslash cdots\; +\; \backslash int\_\backslash Omega\; D^s\; f(x)\backslash cdot\; D^s\; \backslash bar\{g\}(x)\backslash ,\; dx$
where the dot indicates the dot product in the Euclidean space of partial derivatives of each order. Sobolev spaces can also be defined when s is not an integer.
Sobolev spaces are also studied from the point of view of spectral theory, relying more specifically on the Hilbert space structure. If Ω is a suitable domain, then one can define the Sobolev space H^{s}(Ω) as the space of Bessel potentials;^{[24]} roughly,
 $H^s(\backslash Omega)\; =\; \backslash \{\; (1\backslash Delta)^\{s/2\}f\; \; f\backslash in\; L^2(\backslash Omega)\backslash \}.$
Here Δ is the Laplacian and (1 − Δ)^{−s/2} is understood in terms of the spectral mapping theorem. Apart from providing a workable definition of Sobolev spaces for noninteger s, this definition also has particularly desirable properties under the Fourier transform that make it ideal for the study of pseudodifferential operators. Using these methods on a compact Riemannian manifold, one can obtain for instance the Hodge decomposition, which is the basis of Hodge theory.^{[25]}
Spaces of holomorphic functions
 Hardy spaces
The Hardy spaces are function spaces, arising in complex analysis and harmonic analysis, whose elements are certain holomorphic functions in a complex domain.^{[26]} Let U denote the unit disc in the complex plane. Then the Hardy space H^{2}(U) is defined as the space of holomorphic functions f on U such that the means
 $M\_r(f)\; =\; \backslash frac\{1\}\{2\backslash pi\}\backslash int\_0^\{2\backslash pi\}f(re^\{i\backslash theta\})^2\backslash ,d\backslash theta$
remain bounded for r < 1. The norm on this Hardy space is defined by
 $\backslash f\backslash \_2\; =\; \backslash lim\_\{r\backslash to\; 1\}\; \backslash sqrt\{M\_r(f)\}.$
Hardy spaces in the disc are related to Fourier series. A function f is in H^{2}(U) if and only if
 $f(z)\; =\; \backslash sum\_\{n=0\}^\backslash infty\; a\_nz^n$
where
 $\backslash sum\_\{n=0\}^\backslash infty\backslash ,a\_n^2\; <\; \backslash infty.$
Thus H^{2}(U) consists of those functions that are L^{2} on the circle, and whose negative frequency Fourier coefficients vanish.
 Bergman spaces
The Bergman spaces are another family of Hilbert spaces of holomorphic functions.^{[27]} Let D be a bounded open set in the complex plane (or a higher dimensional complex space) and let L^{2,h}(D) be the space of holomorphic functions f in D that are also in L^{2}(D) in the sense that
 $\backslash f\backslash ^2\; =\; \backslash int\_D\; f(z)^2\backslash ,d\backslash mu(z)\; <\; \backslash infty,$
where the integral is taken with respect to the Lebesgue measure in D. Clearly L^{2, h}(D) is a subspace of L^{2}(D); in fact, it is a closed subspace, and so a Hilbert space in its own right. This is a consequence of the estimate, valid on compact subsets K of D, that
 $\backslash sup\_\{z\backslash in\; K\}\; f(z)\; \backslash le\; C\_K\; \backslash f\backslash \_2,$
which in turn follows from Cauchy's integral formula. Thus convergence of a sequence of holomorphic functions in L^{2}(D) implies also compact convergence, and so the limit function is also holomorphic. Another consequence of this inequality is that the linear functional that evaluates a function f at a point of D is actually continuous on L^{2,h}(D). The Riesz representation theorem implies that the evaluation functional can be represented as an element of L^{2,h}(D). Thus, for every z ∈ D, there is a function η_{z} ∈ L^{2,h}(D) such that
 $f(z)\; =\; \backslash int\_D\; f(\backslash zeta)\backslash overline\{\backslash eta\_z(\backslash zeta)\}\backslash ,d\backslash mu(\backslash zeta)$
for all f ∈ L^{2,h}(D). The integrand
 $K(\backslash zeta,z)\; =\; \backslash overline\{\backslash eta\_z(\backslash zeta)\}$
is known as the Bergman kernel of D. This integral kernel satisfies a reproducing property
 $f(z)\; =\; \backslash int\_D\; f(\backslash zeta)K(\backslash zeta,z)\backslash ,d\backslash mu(\backslash zeta).$
A Bergman space is an example of a reproducing kernel Hilbert space, which is a Hilbert space of functions along with a kernel K(ζ,z) that verifies a reproducing property analogous to this one. The Hardy space H^{2}(D) also admits a reproducing kernel, known as the Szegő kernel.^{[28]} Reproducing kernels are common in other areas of mathematics as well. For instance, in harmonic analysis the Poisson kernel is a reproducing kernel for the Hilbert space of squareintegrable harmonic functions in the unit ball. That the latter is a Hilbert space at all is a consequence of the mean value theorem for harmonic functions.
Applications
Many of the applications of Hilbert spaces exploit the fact that Hilbert spaces support generalizations of simple geometric concepts like projection and change of basis from their usual finite dimensional setting. In particular, the spectral theory of continuous selfadjoint linear operators on a Hilbert space generalizes the usual spectral decomposition of a matrix, and this often plays a major role in applications of the theory to other areas of mathematics and physics.
Sturm–Liouville theory
In the theory of ordinary differential equations, spectral methods on a suitable Hilbert space are used to study the behavior of eigenvalues and eigenfunctions of differential equations. For example, the Sturm–Liouville problem arises in the study of the harmonics of waves in a violin string or a drum, and is a central problem in ordinary differential equations.^{[29]} The problem is a differential equation of the form
 $\backslash frac\{d\}\{dx\}\backslash left[p(x)\backslash frac\{dy\}\{\; dx\}\backslash right]+q(x)y=\backslash lambda\; w(x)y$
for an unknown function y on an interval [a,b], satisfying general homogeneous Robin boundary conditions
 $\backslash begin\{cases\}$
\alpha y(a)+\alpha' y'(a)=0\\
\beta y(b) + \beta' y'(b)=0.
\end{cases}
The functions p, q, and w are given in advance, and the problem is to find the function y and constants λ for which the equation has a solution. The problem only has solutions for certain values of λ, called eigenvalues of the system, and this is a consequence of the spectral theorem for compact operators applied to the integral operator defined by the Green's function for the system. Furthermore, another consequence of this general result is that the eigenvalues λ of the system can be arranged in an increasing sequence tending to infinity.^{[30]}
Partial differential equations
Hilbert spaces form a basic tool in the study of partial differential equations.^{[22]} For many classes of partial differential equations, such as linear elliptic equations, it is possible to consider a generalized solution (known as a weak solution) by enlarging the class of functions. Many weak formulations involve the class of Sobolev functions, which is a Hilbert space. A suitable weak formulation reduces to a geometrical problem the analytic problem of finding a solution or, often what is more important, showing that a solution exists and is unique for given boundary data. For linear elliptic equations, one geometrical result that ensures unique solvability for a large class of problems is the Lax–Milgram theorem. This strategy forms the rudiment of the Galerkin method (a finite element method) for numerical solution of partial differential equations.^{[31]}
A typical example is the Poisson equation −Δu = g with Dirichlet boundary conditions in a bounded domain Ω in R^{2}. The weak formulation consists of finding a function u such that, for all continuously differentiable functions v in Ω vanishing on the boundary:
 $\backslash int\_\backslash Omega\; \backslash nabla\; u\backslash cdot\backslash nabla\; v\; =\; \backslash int\_\backslash Omega\; gv.$
This can be recast in terms of the Hilbert space H1
0(Ω) consisting of functions u such that u, along with its weak partial derivatives, are square integrable on Ω, and vanish on the boundary. The question then reduces to finding u in this space such that for all v in this space
 $a(u,v)\; =\; b(v)$
where a is a continuous bilinear form, and b is a continuous linear functional, given respectively by
 $a(u,v)\; =\; \backslash int\_\backslash Omega\; \backslash nabla\; u\backslash cdot\backslash nabla\; v,\backslash quad\; b(v)=\; \backslash int\_\backslash Omega\; gv.$
Since the Poisson equation is elliptic, it follows from Poincaré's inequality that the bilinear form a is coercive. The Lax–Milgram theorem then ensures the existence and uniqueness of solutions of this equation.
Hilbert spaces allow for many elliptic partial differential equations to be formulated in a similar way, and the Lax–Milgram theorem is then a basic tool in their analysis. With suitable modifications, similar techniques can be applied to parabolic partial differential equations and certain hyperbolic partial differential equations.
Ergodic theory
The field of ergodic theory is the study of the longterm behavior of chaotic dynamical systems. The protypical case of a field that ergodic theory applies to is thermodynamics, in which—though the microscopic state of a system is extremely complicated (it is impossible to understand the ensemble of individual collisions between particles of matter)—the average behavior over sufficiently long time intervals is tractable. The laws of thermodynamics are assertions about such average behavior. In particular, one formulation of the zeroth law of thermodynamics asserts that over sufficiently long timescales, the only functionally independent measurement that one can make of a thermodynamic system in equilibrium is its total energy, in the form of temperature.
An ergodic dynamical system is one for which, apart from the energy—measured by the Hamiltonian—there are no other functionally independent conserved quantities on the phase space. More explicitly, suppose that the energy E is fixed, and let Ω_{E} be the subset of the phase space consisting of all states of energy E (an energy surface), and let T_{t} denote the evolution operator on the phase space. The dynamical system is ergodic if there are no continuous nonconstant functions on Ω_{E} such that
 $f(T\_tw)\; =\; f(w)\backslash ,$
for all w on Ω_{E} and all time t. Liouville's theorem implies that there exists a measure μ on the energy surface that is invariant under the time translation. As a result, time translation is a unitary transformation of the Hilbert space L^{2}(Ω_{E},μ) consisting of squareintegrable functions on the energy surface Ω_{E} with respect to the inner product
 $\backslash langle\; f,g\backslash rangle\_\{L^2(\backslash Omega\_E,\backslash mu)\}\; =\; \backslash int\_E\; f\backslash bar\{g\}\backslash ,d\backslash mu.$
The von Neumann mean ergodic theorem^{[19]} states the following:
 If U_{t} is a (strongly continuous) oneparameter semigroup of unitary operators on a Hilbert space H, and P is the orthogonal projection onto the space of common fixed points of U_{t}, {x∈H  U_{t}x = x for all t > 0}, then
 $Px\; =\; \backslash lim\_\{T\backslash to\backslash infty\}\backslash frac\{1\}\{T\}\backslash int\_0^TU\_tx\backslash ,dt.$
For an ergodic system, the fixed set of the time evolution consists only of the constant functions, so the ergodic theorem implies the following:^{[32]} for any function f ∈ L^{2}(Ω_{E},μ),
 $\backslash underset\{T\backslash to\backslash infty\}\{L^2\backslash !\backslash !\backslash lim\}\; \backslash frac\{1\}\{T\}\backslash int\_0^T\; f(T\_tw)\backslash ,dt\; =\; \backslash int\_\{\backslash Omega\_E\}\; f(y)\backslash ,d\backslash mu(y).$
That is, the long time average of an observable f is equal to its expectation value over an energy surface.
Fourier analysis
One of the basic goals of Fourier analysis is to decompose a function into a (possibly infinite) linear combination of given basis functions: the associated Fourier series. The classical Fourier series associated to a function f defined on the interval [0, 1] is a series of the form
 $\backslash sum\_\{n=\backslash infty\}^\backslash infty\; a\_n\; e^\{2\backslash pi\; in\backslash theta\}$
where
 $a\_n\; =\; \backslash int\_0^1f(\backslash theta)e^\{2\backslash pi\; in\backslash theta\}\backslash ,d\backslash theta.$
The example of adding up the first few terms in a Fourier series for a sawtooth function is shown in the figure. The basis functions are sine waves with wavelengths λ/n (n=integer) shorter than the wavelength λ of the sawtooth itself (except for n=1, the fundamental wave). All basis functions have nodes at the nodes of the sawtooth, but all but the fundamental have additional nodes. The oscillation of the summed terms about the sawtooth is called the Gibbs phenomenon.
A significant problem in classical Fourier series asks in what sense the Fourier series converges, if at all, to the function f. Hilbert space methods provide one possible answer to this question.^{[33]} The functions e_{n}(θ) = e^{2πinθ} form an orthogonal basis of the Hilbert space L^{2}([0,1]). Consequently, any squareintegrable function can be expressed as a series
 $f(\backslash theta)\; =\; \backslash sum\_n\; a\_n\; e\_n(\backslash theta),\backslash quad\; a\_n\; =\; \backslash langle\; f,e\_n\backslash rangle$
and, moreover, this series converges in the Hilbert space sense (that is, in the L^{2} mean).
The problem can also be studied from the abstract point of view: every Hilbert space has an orthonormal basis, and every element of the Hilbert space can be written in a unique way as a sum of multiples of these basis elements. The coefficients appearing on these basis elements are sometimes known abstractly as the Fourier coefficients of the element of the space.^{[34]} The abstraction is especially useful when it is more natural to use different basis functions for a space such as L^{2}([0,1]). In many circumstances, it is desirable not to decompose a function into trigonometric functions, but rather into orthogonal polynomials or wavelets for instance,^{[35]} and in higher dimensions into spherical harmonics.^{[36]}
For instance, if e_{n} are any orthonormal basis functions of L^{2}[0,1], then a given function in L^{2}[0,1] can be approximated as a finite linear combination^{[37]}
 $f(x)\; \backslash approx\; f\_n\; (x)\; =\; a\_1\; e\_1\; (x)\; +\; a\_2\; e\_2(x)\; +\; \backslash cdots\; +\; a\_n\; e\_n\; (x)$
The coefficients {a_{j}} are selected to make the magnitude of the difference ƒ − ƒ_{n}^{2} as small as possible. Geometrically, the best approximation is the orthogonal projection of ƒ onto the subspace consisting of all linear combinations of the {e_{j}}, and can be calculated by^{[38]}
 $a\_j\; =\; \backslash int\_0^1\; \backslash overline\{e\_j(x)\}f\; (x)\; \backslash ,\; dx.$
That this formula minimizes the difference ƒ − ƒ_{n}^{2} is a consequence of Bessel's inequality and Parseval's formula.
In various applications to physical problems, a function can be decomposed into physically meaningful eigenfunctions of a differential operator (typically the Laplace operator): this forms the foundation for the spectral study of functions, in reference to the spectrum of the differential operator.^{[39]} A concrete physical application involves the problem of hearing the shape of a drum: given the fundamental modes of vibration that a drumhead is capable of producing, can one infer the shape of the drum itself?^{[40]} The mathematical formulation of this question involves the Dirichlet eigenvalues of the Laplace equation in the plane, that represent the fundamental modes of vibration in direct analogy with the integers that represent the fundamental modes of vibration of the violin string.
Spectral theory also underlies certain aspects of the Fourier transform of a function. Whereas Fourier analysis decomposes a function defined on a compact set into the discrete spectrum of the Laplacian (which corresponds to the vibrations of a violin string or drum), the Fourier transform of a function is the decomposition of a function defined on all of Euclidean space into its components in the continuous spectrum of the Laplacian. The Fourier transformation is also geometrical, in a sense made precise by the Plancherel theorem, that asserts that it is an isometry of one Hilbert space (the "time domain") with another (the "frequency domain"). This isometry property of the Fourier transformation is a recurring theme in abstract harmonic analysis, as evidenced for instance by the Plancherel theorem for spherical functions occurring in noncommutative harmonic analysis.
Quantum mechanics
In the mathematically rigorous formulation of quantum mechanics, developed by John von Neumann,^{[41]} the possible states (more precisely, the pure states) of a quantum mechanical system are represented by unit vectors (called state vectors) residing in a complex separable Hilbert space, known as the state space, well defined up to a complex number of norm 1 (the phase factor). In other words, the possible states are points in the projectivization of a Hilbert space, usually called the complex projective space. The exact nature of this Hilbert space is dependent on the system; for example, the position and momentum states for a single nonrelativistic spin zero particle is the space of all squareintegrable functions, while the states for the spin of a single proton are unit elements of the twodimensional complex Hilbert space of spinors. Each observable is represented by a selfadjoint linear operator acting on the state space. Each eigenstate of an observable corresponds to an eigenvector of the operator, and the associated eigenvalue corresponds to the value of the observable in that eigenstate.
The time evolution of a quantum state is described by the Schrödinger equation, in which the Hamiltonian, the operator corresponding to the total energy of the system, generates time evolution.
The inner product between two state vectors is a complex number known as a probability amplitude. During an ideal measurement of a quantum mechanical system, the probability that a system collapses from a given initial state to a particular eigenstate is given by the square of the absolute value of the probability amplitudes between the initial and final states. The possible results of a measurement are the eigenvalues of the operator—which explains the choice of selfadjoint operators, for all the eigenvalues must be real. The probability distribution of an observable in a given state can be found by computing the spectral decomposition of the corresponding operator.
For a general system, states are typically not pure, but instead are represented as statistical mixtures of pure states, or mixed states, given by density matrices: selfadjoint operators of trace one on a Hilbert space. Moreover, for general quantum mechanical systems, the effects of a single measurement can influence other parts of a system in a manner that is described instead by a positive operator valued measure. Thus the structure both of the states and observables in the general theory is considerably more complicated than the idealization for pure states.
Heisenberg's uncertainty principle is represented by the statement that the operators corresponding to certain observables do not commute, and gives a specific form that the commutator must have.
Properties
Pythagorean identity
Two vectors u and v in a Hilbert space H are orthogonal when $\backslash langle\; u,\; v\backslash rangle$ = 0. The notation for this is u ⊥ v. More generally, when S is a subset in H, the notation u ⊥ S means that u is orthogonal to every element from S.
When u and v are orthogonal, one has
 $\backslash u\; +\; v\backslash ^2\; =\; \backslash langle\; u\; +\; v,\; u\; +\; v\; \backslash rangle\; =\; \backslash langle\; u,\; u\; \backslash rangle\; +\; 2\; \backslash ,\; \backslash mathrm\{Re\}\; \backslash langle\; u,\; v\; \backslash rangle\; +\; \backslash langle\; v,\; v\; \backslash rangle=\; \backslash u\backslash ^2\; +\; \backslash v\backslash ^2.$
By induction on n, this is extended to any family u_{1},...,u_{n} of n orthogonal vectors,
 $\backslash u\_1\; +\; \backslash cdots\; +\; u\_n\backslash ^2\; =\; \backslash u\_1\backslash ^2\; +\; \backslash cdots\; +\; \backslash u\_n\backslash ^2.$
Whereas the Pythagorean identity as stated is valid in any inner product space, completeness is required for the extension of the Pythagorean identity to series. A series Σ u_{k} of orthogonal vectors converges in H if and only if the series of squares of norms converges, and
 $\backslash bigl\backslash \backslash sum\_\{k=0\}^\backslash infty\; u\_k\; \backslash bigr\backslash ^2\; =\; \backslash sum\_\{k=0\}^\backslash infty\; \backslash u\_k\backslash ^2.$
Furthermore, the sum of a series of orthogonal vectors is independent of the order in which it is taken.
Parallelogram identity and polarization
By definition, every Hilbert space is also a Banach space. Furthermore, in every Hilbert space the following parallelogram identity holds:
 $\backslash u+v\backslash ^2+\backslash uv\backslash ^2=2(\backslash u\backslash ^2+\backslash v\backslash ^2).$
Conversely, every Banach space in which the parallelogram identity holds is a Hilbert space, and the inner product is uniquely determined by the norm by the polarization identity.^{[42]} For real Hilbert spaces, the polarization identity is
 $\backslash langle\; u,v\backslash rangle\; =\; \backslash frac\{1\}\{4\}\backslash left(\backslash u+v\backslash ^2\backslash uv\backslash ^2\backslash right).$
For complex Hilbert spaces, it is
 $\backslash langle\; u,v\backslash rangle\; =\; \backslash frac\{1\}\{4\}\backslash left(\backslash u+v\backslash ^2\backslash uv\backslash ^2+i\backslash u+iv\backslash ^2i\backslash uiv\backslash ^2\backslash right).$
The parallelogram law implies that any Hilbert space is a uniformly convex Banach space.^{[43]}
Best approximation
If C is a nonempty closed convex subset of a Hilbert space H and x a point in H, there exists a unique point y ∈ C that minimizes the distance between x and points in C,^{[44]}
 $y\; \backslash in\; C,\; \backslash \; \backslash \; \backslash \; \backslash x\; \; y\backslash \; =\; \backslash mathrm\{dist\}(x,\; C)\; =\; \backslash min\; \backslash \{\; \backslash x\; \; z\backslash :\; z\; \backslash in\; C\; \backslash \}.$
This is equivalent to saying that there is a point with minimal norm in the translated convex set D = C − x. The proof consists in showing that every minimizing sequence (d_{n}) ⊂ D is Cauchy (using the parallelogram identity) hence converges (using completeness) to a point in D that has minimal norm. More generally, this holds in any uniformly convex Banach space.^{[45]}
When this result is applied to a closed subspace F of H, it can be shown that the point y ∈ F closest to x is characterized by^{[46]}
 $y\; \backslash in\; F,\; \backslash \; \backslash \; x\; \; y\; \backslash perp\; F.$
This point y is the orthogonal projection of x onto F, and the mapping P_{F} : x → y is linear (see Orthogonal complements and projections). This result is especially significant in applied mathematics, especially numerical analysis, where it forms the basis of least squares methods .
In particular, when F is not equal to H, one can find a nonzero vector v orthogonal to F (select x not in F and v = x − y). A very useful criterion is obtained by applying this observation to the closed subspace F generated by a subset S of H.
 A subset S of H spans a dense vector subspace if (and only if) the vector 0 is the sole vector v ∈ H orthogonal to S.
Duality
The dual space H* is the space of all continuous linear functions from the space H into the base field. It carries a natural norm, defined by
 $\backslash \backslash varphi\backslash \; =\; \backslash sup\_\{\backslash x\backslash =1,\; x\backslash in\; H\}\; \backslash varphi(x).$
This norm satisfies the parallelogram law, and so the dual space is also an inner product space. The dual space is also complete, and so it is a Hilbert space in its own right.
The Riesz representation theorem affords a convenient description of the dual. To every element u of H, there is a unique element φ_{u} of H*, defined by
 $\backslash varphi\_u(x)\; =\; \backslash langle\; x,u\backslash rangle.$
The mapping $u\backslash mapsto\; \backslash varphi\_u$ is an antilinear mapping from H to H*. The Riesz representation theorem states that this mapping is an antilinear isomorphism.^{[47]} Thus to every element φ of the dual H* there exists one and only one u_{φ} in H such that
 $\backslash langle\; x,\; u\_\backslash varphi\backslash rangle\; =\; \backslash varphi(x)$
for all x ∈ H. The inner product on the dual space H* satisfies
 $\backslash langle\; \backslash varphi,\; \backslash psi\; \backslash rangle\; =\; \backslash langle\; u\_\backslash psi,\; u\_\backslash varphi\; \backslash rangle.$
The reversal of order on the righthand side restores linearity in φ from the antilinearity of u_{φ}. In the real case, the antilinear isomorphism from H to its dual is actually an isomorphism, and so real Hilbert spaces are naturally isomorphic to their own duals.
The representing vector u_{φ} is obtained in the following way. When φ ≠ 0, the kernel F = Ker(φ) is a closed vector subspace of H, not equal to H, hence there exists a nonzero vector v orthogonal to F. The vector u is a suitable scalar multiple λv of v. The requirement that φ(v) = ⟨v, u⟩ yields
 $u\; =\; \backslash langle\; v,\; v\; \backslash rangle^\{1\}\; \backslash ,\; \backslash overline\{\backslash varphi\; (v)\}\; \backslash ,\; v.$
This correspondence φ ↔ u is exploited by the braket notation popular in physics. It is common in physics to assume that the inner product, denoted by ⟨xy⟩, is linear on the right,
 $\backslash langle\; x\; y\; \backslash rangle\; =\; \backslash langle\; y,\; x\; \backslash rangle.$
The result ⟨xy⟩ can be seen as the action of the linear functional ⟨x (the bra) on the vector y⟩ (the ket).
The Riesz representation theorem relies fundamentally not just on the presence of an inner product, but also on the completeness of the space. In fact, the theorem implies that the topological dual of any inner product space can be identified with its completion. An immediate consequence of the Riesz representation theorem is also that a Hilbert space H is reflexive, meaning that the natural map from H into its double dual space is an isomorphism.
Weakly convergent sequences
In a Hilbert space H, a sequence {x_{n}} is weakly convergent to a vector x ∈ H when
 $\backslash lim\_n\; \backslash langle\; x\_n,\; v\; \backslash rangle\; =\; \backslash langle\; x,\; v\; \backslash rangle$
for every v ∈ H.
For example, any orthonormal sequence {f_{n}} converges weakly to 0, as a consequence of Bessel's inequality. Every weakly convergent sequence {x_{n}} is bounded, by the uniform boundedness principle.
Conversely, every bounded sequence in a Hilbert space admits weakly convergent subsequences (Alaoglu's theorem).^{[48]} This fact may be used to prove minimization results for continuous convex functionals, in the same way that the Bolzano–Weierstrass theorem is used for continuous functions on R^{d}. Among several variants, one simple statement is as follows:^{[49]}
 If f: H → R is a convex continuous function such that f(x) tends to +∞ when x tends to ∞, then f admits a minimum at some point x_{0} ∈ H.
This fact (and its various generalizations) are fundamental for direct methods in the calculus of variations. Minimization results for convex functionals are also a direct consequence of the slightly more abstract fact that closed bounded convex subsets in a Hilbert space H are weakly compact, since H is reflexive. The existence of weakly convergent subsequences is a special case of the Eberlein–Šmulian theorem.
Banach space properties
Any general property of Banach spaces continues to hold for Hilbert spaces. The open mapping theorem states that a continuous surjective linear transformation from one Banach space to another is an open mapping meaning that it sends open sets to open sets. A corollary is the bounded inverse theorem, that a continuous and bijective linear function from one Banach space to another is an isomorphism (that is, a continuous linear map whose inverse is also continuous). This theorem is considerably simpler to prove in the case of Hilbert spaces than in general Banach spaces.^{[50]} The open mapping theorem is equivalent to the closed graph theorem, which asserts that a function from one Banach space to another is continuous if and only if its graph is a closed set.^{[51]} In the case of Hilbert spaces, this is basic in the study of unbounded operators (see closed operator).
The (geometrical) Hahn–Banach theorem asserts that a closed convex set can be separated from any point outside it by means of a hyperplane of the Hilbert space. This is an immediate consequence of the best approximation property: if y is the element of a closed convex set F closest to x, then the separating hyperplane is the plane perpendicular to the segment xy passing through its midpoint.^{[52]}
Operators on Hilbert spaces
Bounded operators
The continuous linear operators A : H_{1} → H_{2} from a Hilbert space H_{1} to a second Hilbert space H_{2} are bounded in the sense that they map bounded sets to bounded sets. Conversely, if an operator is bounded, then it is continuous. The space of such bounded linear operators has a norm, the operator norm given by
 $\backslash lVert\; A\; \backslash rVert\; =\; \backslash sup\; \backslash left\backslash \{\backslash ,\backslash lVert\; Ax\; \backslash rVert:\; \backslash lVert\; x\; \backslash rVert\; \backslash leq\; 1\backslash ,\backslash right\backslash \}.$
The sum and the composite of two bounded linear operators is again bounded and linear. For y in H_{2}, the map that sends x ∈ H_{1} to ⟨Ax, y⟩ is linear and continuous, and according to the Riesz representation theorem can therefore be represented in the form
 $\backslash langle\; x,\; A^*\; y\; \backslash rangle\; =\; \backslash langle\; Ax,\; y\; \backslash rangle$
for some vector A* y in H_{1}. This defines another bounded linear operator A*: H_{2} → H_{1}, the adjoint of A. One can see that A** = A.
The set B(H) of all bounded linear operators on H, together with the addition and composition operations, the norm and the adjoint operation, is a C*algebra, which is a type of operator algebra.
An element A of B(H) is called selfadjoint or Hermitian if A*= A. If A is Hermitian and ⟨Ax, x⟩ ≥ 0 for every x, then A is called nonnegative, written A ≥ 0; if equality holds only when x = 0, then A is called positive. The set of self adjoint operators admits a partial order, in which A ≥ B if A − B ≥ 0. If A has the form B* B for some B, then A is nonnegative; if B is invertible, then A is positive. A converse is also true in the sense that, for a nonnegative operator A, there exists a unique nonnegative square root B such that
 $A\; =\; B^2=B^*B.\backslash ,$
In a sense made precise by the spectral theorem, selfadjoint operators can usefully be thought of as operators that are "real". An element A of B(H) is called normal if A* A = A A*. Normal operators decompose into the sum of a selfadjoint operators and an imaginary multiple of a self adjoint operator
 $A\; =\; \backslash frac\{A+A^*\}\{2\}\; +\; i\backslash frac\{(AA^*)\}\{2i\}$
that commute with each other. Normal operators can also usefully be thought of in terms of their real and imaginary parts.
An element U of B(H) is called unitary if U is invertible and its inverse is given by U*. This can also be expressed by requiring that U be onto and ⟨Ux, Uy⟩ = ⟨x, y⟩ for all x and y in H. The unitary operators form a group under composition, which is the isometry group of H.
An element of B(H) is compact if it sends bounded sets to relatively compact sets. Equivalently, a bounded operator T is compact if, for any bounded sequence {x_{k}}, the sequence {Tx_{k}} has a convergent subsequence. Many integral operators are compact, and in fact define a special class of operators known as Hilbert–Schmidt operators that are especially important in the study of integral equations. Fredholm operators differ from a compact operator by a multiple of the identity, and are equivalently characterized as operators with a finite dimensional kernel and cokernel. The index of a Fredholm operator T is defined by
 $\backslash operatorname\{index\}\backslash ,\; T\; =\; \backslash dim\backslash ker\; T\; \; \backslash dim\backslash operatorname\{coker\}\backslash ,\; T.$
The index is homotopy invariant, and plays a deep role in differential geometry via the Atiyah–Singer index theorem.
Unbounded operators
Unbounded operators are also tractable in Hilbert spaces, and have important applications to quantum mechanics.^{[53]} An unbounded operator T on a Hilbert space H is defined as a linear operator whose domain D(T) is a linear subspace of H. Often the domain D(T) is a dense subspace of H, in which case T is known as a densely defined operator.
The adjoint of a densely defined unbounded operator is defined in essentially the same manner as for bounded operators. Selfadjoint unbounded operators play the role of the observables in the mathematical formulation of quantum mechanics. Examples of selfadjoint unbounded operators on the Hilbert space L^{2}(R) are:^{[54]}
 A suitable extension of the differential operator
 $(A\; f)(x)\; =\; i\; \backslash frac\{d\}\{dx\}\; f(x),\; \backslash ,$
 where i is the imaginary unit and f is a differentiable function of compact support.
 The multiplicationbyx operator:
 $(B\; f)\; (x)\; =\; x\; f(x).\backslash ,$
These correspond to the momentum and position observables, respectively. Note that neither A nor B is defined on all of H, since in the case of A the derivative need not exist, and in the case of B the product function need not be square integrable. In both cases, the set of possible arguments form dense subspaces of L^{2}(R).
Constructions
Direct sums
Two Hilbert spaces H_{1} and H_{2} can be combined into another Hilbert space, called the (orthogonal) direct sum,^{[55]} and denoted
 $H\_1\backslash oplus\; H\_2,$
consisting of the set of all ordered pairs (x_{1}, x_{2}) where x_{i} ∈ H_{i}, i = 1,2, and inner product defined by
 $\backslash langle\; (x\_1,x\_2),\; (y\_1,y\_2)\backslash rangle\_\{H\_1\backslash oplus\; H\_2\}\; =\; \backslash langle\; x\_1,y\_1\backslash rangle\_\{H\_1\}\; +\; \backslash langle\; x\_2,y\_2\backslash rangle\_\{H\_2\}.$
More generally, if H_{i} is a family of Hilbert spaces indexed by i ∈ I, then the direct sum of the H_{i}, denoted
 $\backslash bigoplus\_\{i\backslash in\; I\}H\_i$
consists of the set of all indexed families
 $x=(x\_i\backslash in\; H\_ii\backslash in\; I)\; \backslash in\; \backslash prod\_\{i\backslash in\; I\}H\_i$
in the Cartesian product of the H_{i} such that
 $\backslash sum\_\{i\backslash in\; I\}\; \backslash x\_i\backslash ^2\; <\; \backslash infty.$
The inner product is defined by
 $\backslash langle\; x,\; y\backslash rangle\; =\; \backslash sum\_\{i\backslash in\; I\}\; \backslash langle\; x\_i,\; y\_i\backslash rangle\_\{H\_i\}.$
Each of the H_{i} is included as a closed subspace in the direct sum of all of the H_{i}. Moreover, the H_{i} are pairwise orthogonal. Conversely, if there is a system of closed subspaces, V_{i}, i ∈ I, in a Hilbert space H, that are pairwise orthogonal and whose union is dense in H, then H is canonically isomorphic to the direct sum of V_{i}. In this case, H is called the internal direct sum of the V_{i}. A direct sum (internal or external) is also equipped with a family of orthogonal projections E_{i} onto the ith direct summand H_{i}. These projections are bounded, selfadjoint, idempotent operators that satisfy the orthogonality condition
 $E\_iE\_j\; =\; 0,\backslash quad\; i\backslash not=\; j.$
The spectral theorem for compact selfadjoint operators on a Hilbert space H states that H splits into an orthogonal direct sum of the eigenspaces of an operator, and also gives an explicit decomposition of the operator as a sum of projections onto the eigenspaces. The direct sum of Hilbert spaces also appears in quantum mechanics as the Fock space of a system containing a variable number of particles, where each Hilbert space in the direct sum corresponds to an additional degree of freedom for the quantum mechanical system. In representation theory, the Peter–Weyl theorem guarantees that any unitary representation of a compact group on a Hilbert space splits as the direct sum of finitedimensional representations.
Tensor products

If H_{1} and H_{2}, then one defines an inner product on the (ordinary) tensor product as follows. On simple tensors, let
 $\backslash langle\; x\_1\; \backslash otimes\; x\_2,\; \backslash ,\; y\_1\; \backslash otimes\; y\_2\; \backslash rangle\; =\; \backslash langle\; x\_1,\; y\_1\; \backslash rangle\; \backslash ,\; \backslash langle\; x\_2,\; y\_2\; \backslash rangle.$
This formula then extends by sesquilinearity to an inner product on H_{1} ⊗ H_{2}. The Hilbertian tensor product of H_{1} and H_{2}, sometimes denoted by $H\_1\backslash widehat\{\backslash otimes\}H\_2$, is the Hilbert space obtained by completing H_{1} ⊗ H_{2} for the metric associated to this inner product.^{[56]}
An example is provided by the Hilbert space L^{2}([0, 1]). The Hilbertian tensor product of two copies of L^{2}([0, 1]) is isometrically and linearly isomorphic to the space L^{2}([0, 1]^{2}) of squareintegrable functions on the square [0, 1]^{2}. This isomorphism sends a simple tensor $f\_1\; \backslash otimes\; f\_2$ to the function
 $(s,\; t)\; \backslash mapsto\; f\_1(s)\; \backslash ,\; f\_2(t)$
on the square.
This example is typical in the following sense.^{[57]} Associated to every simple tensor product x_{1} ⊗ x_{2} is the rank one operator
 $x^*\; \backslash in\; H\_1^*\; \backslash rightarrow\; x^*(x\_1)\; \backslash ,\; x\_2$
from the (continuous) dual H*_{1} to H_{2}. This mapping defined on simple tensors extends to a linear identification between H_{1} ⊗ H_{2} and the space of finite rank operators from H*_{1} to H_{2}. This extends to a linear isometry of the Hilbertian tensor product $H\_1\backslash widehat\{\backslash otimes\}H\_2$ with the Hilbert space HS(H*_{1}, H_{2}) of Hilbert–Schmidt operators from H*_{1} to H_{2}.
Orthonormal bases
The notion of an orthonormal basis from linear algebra generalizes over to the case of Hilbert spaces.^{[58]} In a Hilbert space H, an orthonormal basis is a family {e_{k}}_{k ∈ B} of elements of H satisfying the conditions:
 Orthogonality: Every two different elements of B are orthogonal: ⟨e_{k}, e_{j}⟩= 0 for all k, j in B with k ≠ j.
 Normalization: Every element of the family has norm 1:e_{k} = 1 for all k in B.
 Completeness: The linear span of the family e_{k}, k ∈ B, is dense in H.
A system of vectors satisfying the first two conditions basis is called an orthonormal system or an orthonormal set (or an orthonormal sequence if B is countable). Such a system is always linearly independent. Completeness of an orthonormal system of vectors of a Hilbert space can be equivalently restated as:
 if ⟨v, e_{k}⟩ = 0 for all k ∈ B and some v ∈ H then v = 0.
This is related to the fact that the only vector orthogonal to a dense linear subspace is the zero vector, for if S is any orthonormal set and v is orthogonal to S, then v is orthogonal to the closure of the linear span of S, which is the whole space.
Examples of orthonormal bases include:
 the set {(1,0,0), (0,1,0), (0,0,1)} forms an orthonormal basis of R^{3} with the dot product;
 the sequence {f_{n} : n ∈ Z} with f_{n}(x) = exp(2πinx) forms an orthonormal basis of the complex space L^{2}([0,1]);
In the infinitedimensional case, an orthonormal basis will not be a basis in the sense of linear algebra; to distinguish the two, the latter basis is also called a Hamel basis. That the span of the basis vectors is dense implies that every vector in the space can be written as the sum of an infinite series, and the orthogonality implies that this decomposition is unique.
Sequence spaces
The space ℓ^{ 2} of squaresummable sequences of complex numbers is the set of infinite sequences
 $(c\_1,\; c\_2,\; c\_3,\; \backslash dots)\; \backslash ,$
of complex numbers such that
 $c\_1^2\; +\; c\_2^2\; +\; c\_3^2\; +\; \backslash cdots\; <\; \backslash infty.\; \backslash ,$
This space has an orthonormal basis:
 $\backslash begin\{align\}$
e_1 &= (1,0,0,\dots)\\
e_2 &= (0,1,0,\dots)\\
& \ \ \vdots
\end{align}
More generally, if B is any set, then one can form a Hilbert space of sequences with index set B, defined by
 $\backslash ell^2(B)\; =\backslash big\backslash \{\; x:\; B\; \backslash xrightarrow\{x\}\; \backslash mathbb\{C\}\; \backslash mid\; \backslash sum\_\{b\; \backslash in\; B\}\; \backslash leftx\; (b)\backslash right^2\; \backslash infty\; \backslash big\backslash \}.$
The summation over B is here defined by
 $\backslash sum\_\{b\; \backslash in\; B\}\; \backslash leftx\; (b)\backslash right^2\; =\; \backslash sup\; \backslash sum\_\{n=1\}^N\; x(b\_n)^2$
the supremum being taken over all finite subsets of B. It follows that, for this sum to be finite, every element of ℓ^{ 2}(B) has only countably many nonzero terms. This space becomes a Hilbert space with the inner product
 $\backslash langle\; x,\; y\; \backslash rangle\; =\; \backslash sum\_\{b\; \backslash in\; B\}\; x(b)\backslash overline\{y(b)\}$
for all x and y in ℓ^{ 2}(B). Here the sum also has only countably many nonzero terms, and is unconditionally convergent by the Cauchy–Schwarz inequality.
An orthonormal basis of ℓ^{ 2}(B) is indexed by the set B, given by
 $e\_b(b\text{'})\; =\; \backslash begin\{cases\}$
1&\text{if } b=b'\\
0&\text{otherwise.}
\end{cases}
Bessel's inequality and Parseval's formula
Let f_{1}, …, f_{n} be a finite orthonormal system in H. For an arbitrary vector x in H, let
 $y\; =\; \backslash sum\_\{j=1\}^n\; \backslash ,\; \backslash langle\; x,\; f\_j\; \backslash rangle\; \backslash ,\; f\_j.$
Then ⟨x, f_{k}⟩ = ⟨y, f_{k}⟩ for every k = 1, …, n. It follows that x − y is orthogonal to each f_{k}, hence x − y is orthogonal to y. Using the Pythagorean identity twice, it follows that
 $\backslash x\backslash ^2\; =\; \backslash x\; \; y\backslash ^2\; +\; \backslash y\backslash ^2\; \backslash ge\; \backslash y\backslash ^2\; =\; \backslash sum\_\{j=1\}^n\backslash langle\; x,\; f\_j\; \backslash rangle^2.$
Let {f_{i} }, i ∈ I, be an arbitrary orthonormal system in H. Applying the preceding inequality to every finite subset J of I gives the Bessel inequality^{[59]}
 $\backslash sum\_\{i\; \backslash in\; I\}\backslash langle\; x,\; f\_i\; \backslash rangle^2\; \backslash le\; \backslash x\backslash ^2,\; \backslash quad\; x\; \backslash in\; H$
(according to the definition of the sum of an arbitrary family of nonnegative real numbers).
Geometrically, Bessel's inequality implies that the orthogonal projection of x onto the linear subspace spanned by the f_{i} has norm that does not exceed that of x. In two dimensions, this is the assertion that the length of the leg of a right triangle may not exceed the length of the hypotenuse.
Bessel's inequality is a stepping stone to the more powerful Parseval identity, which governs the case when Bessel's inequality is actually an equality. If {e_{k}}_{k ∈ B} is an orthonormal basis of H, then every element x of H may be written as
 $x\; =\; \backslash sum\_\{k\; \backslash in\; B\}\; \backslash ,\; \backslash langle\; x,\; e\_k\; \backslash rangle\; \backslash ,\; e\_k.$
Even if B is uncountable, Bessel's inequality guarantees that the expression is welldefined and consists only of countably many nonzero terms. This sum is called the Fourier expansion of x, and the individual coefficients ⟨x,e_{k}⟩ are the Fourier coefficients of x. Parseval's formula is then
 $\backslash x\backslash ^2\; =\; \backslash sum\_\{k\backslash in\; B\}\backslash langle\; x,\; e\_k\backslash rangle^2.$
Conversely, if {e_{k}} is an orthonormal set such that Parseval's identity holds for every x, then {e_{k}} is an orthonormal basis.
Hilbert dimension
As a consequence of Zorn's lemma, every Hilbert space admits an orthonormal basis; furthermore, any two orthonormal bases of the same space have the same cardinality, called the Hilbert dimension of the space.^{[60]} For instance, since ℓ^{2}(B) has an orthonormal basis indexed by B, its Hilbert dimension is the cardinality of B (which may be a finite integer, or a countable or uncountable cardinal number).
As a consequence of Parseval's identity, if {e_{k}}_{k ∈ B} is an orthonormal basis of H, then the map Φ : H → ℓ^{2}(B) defined by Φ(x) = (⟨x,e_{k}⟩)_{k∈B} is an isometric isomorphism of Hilbert spaces: it is a bijective linear mapping such that
 $\backslash langle\; \backslash Phi\; \backslash left(x\backslash right),\; \backslash Phi\backslash left(y\backslash right)\; \backslash rangle\_\{\backslash ell^2(B)\}\; =\; \backslash langle\; x,\; y\; \backslash rangle\_H$
for all x and y in H. The cardinal number of B is the Hilbert dimension of H. Thus every Hilbert space is isometrically isomorphic to a sequence space ℓ^{2}(B) for some set B.
Separable spaces
A Hilbert space is separable if and only if it admits a countable orthonormal basis. All infinitedimensional separable Hilbert spaces are therefore isometrically isomorphic to ℓ^{2}.
In the past, Hilbert spaces were often required to be separable as part of the definition.^{[61]} Most spaces used in physics are separable, and since these are all isomorphic to each other, one often refers to any infinitedimensional separable Hilbert space as "the Hilbert space" or just "Hilbert space".^{[62]} Even in quantum field theory, most of the Hilbert spaces are in fact separable, as stipulated by the Wightman axioms. However, it is sometimes argued that nonseparable Hilbert spaces are also important in quantum field theory, roughly because the systems in the theory possess an infinite number of degrees of freedom and any infinite Hilbert tensor product (of spaces of dimension greater than one) is nonseparable.^{[63]} For instance, a bosonic field can be naturally thought of as an element of a tensor product whose factors represent harmonic oscillators at each point of space. From this perspective, the natural state space of a boson might seem to be a nonseparable space.^{[63]} However, it is only a small separable subspace of the full tensor product that can contain physically meaningful fields (on which the observables can be defined). Another nonseparable Hilbert space models the state of an infinite collection of particles in an unbounded region of space. An orthonormal basis of the space is indexed by the density of the particles, a continuous parameter, and since the set of possible densities is uncountable, the basis is not countable.^{[63]}
Orthogonal complements and projections
If S is a subset of a Hilbert space H, the set of vectors orthogonal to S is defined by
 $S^\backslash perp\; =\; \backslash left\backslash \{\; x\; \backslash in\; H:\; \backslash langle\; x,\; s\; \backslash rangle\; =\; 0\backslash \; \backslash forall\; s\; \backslash in\; S\; \backslash right\backslash \}.$
S^{⊥} is a closed subspace of H (can be proved easily using the linearity and continuity of the inner product) and so forms itself a Hilbert space. If V is a closed subspace of H, then V^{⊥} is called the orthogonal complement of V. In fact, every x in H can then be written uniquely as x = v + w, with v in V and w in V^{⊥}. Therefore, H is the internal Hilbert direct sum of V and V^{⊥}.
The linear operator P_{V} : H → H that maps x to v is called the orthogonal projection onto V. There is a natural onetoone correspondence between the set of all closed subspaces of H and the set of all bounded selfadjoint operators P such that P^{2} = P. Specifically,
 Theorem. The orthogonal projection P_{V} is a selfadjoint linear operator on H of norm ≤ 1 with the property P^{2}_{V} = P_{V}. Moreover, any selfadjoint linear operator E such that E^{2} = E is of the form P_{V}, where V is the range of E. For every x in H, P_{V}(x) is the unique element v of V, which minimizes the distance x − v.
This provides the geometrical interpretation of P_{V}(x): it is the best approximation to x by elements of V.^{[64]}
Projections P_{U} and P_{V} are called mutually orthogonal if P_{U}P_{V} = 0. This is equivalent to U and V being orthogonal as subspaces of H. The sum of the two projections P_{U} and P_{V} is a projection only if U and V are orthogonal to each other, and in that case P_{U} + P_{V = PU+V. The composite PUPV is generally not a projection; in fact, the composite is a projection if and only if the two projections commute, and in that case PUPV = PU∩V.
}
By restricting the codomain to the Hilbert space V, the orthogonal projection P_{V} gives rise to a projection mapping π: H → V; it is the adjoint of the inclusion mapping
 $i:\; V\; \backslash to\; H,$
meaning that
 $\backslash langle\; i\; x,\; y\backslash rangle\_H\; =\; \backslash langle\; x,\; \backslash pi\; y\backslash rangle\_V$
for all x ∈ V and y ∈ H.
The operator norm of the orthogonal projection P_{V} onto a nonzero closed subspace V is equal to one:
 $\backslash P\_V\backslash \; =\; \backslash sup\_\{x\backslash in\; H,\; x\backslash not=0\}\; \backslash frac\{\backslash P\_V\; x\backslash \}\{\backslash x\backslash \}=1.$
Every closed subspace V of a Hilbert space is therefore the image of an operator P of norm one such that P^{2} = P. The property of possessing appropriate projection operators characterizes Hilbert spaces:^{[65]}
 A Banach space of dimension higher than 2 is (isometrically) a Hilbert space if and only if, for every closed subspace V, there is an operator P_{V} of norm one whose image is V such that $P\_V^2=P\_V.$
While this result characterizes the metric structure of a Hilbert space, the structure of a Hilbert space as a topological vector space can itself be characterized in terms of the presence of complementary subspaces:^{[66]}
 A Banach space X is topologically and linearly isomorphic to a Hilbert space if and only if, to every closed subspace V, there is a closed subspace W such that X is equal to the internal direct sum V ⊕ W.
The orthogonal complement satisfies some more elementary results. It is a monotone function in the sense that if U ⊂ V, then $V^\backslash perp\backslash subseteq\; U^\backslash perp$ with equality holding if and only if V is contained in the closure of U. This result is a special case of the Hahn–Banach theorem. The closure of a subspace can be completely characterized in terms of the orthogonal complement: If V is a subspace of H, then the closure of V is equal to $V^\{\backslash bot\backslash bot\}$. The orthogonal complement is thus a Galois connection on the partial order of subspaces of a Hilbert space. In general, the orthogonal complement of a sum of subspaces is the intersection of the orthogonal complements:^{[67]} $\backslash textstyle\{\backslash left(\backslash sum\_i\; V\_i\backslash right)^\backslash perp\; =\; \backslash bigcap\_i\; V\_i^\backslash perp\}$. If the V_{i} are in addition closed, then $\backslash textstyle\{\backslash overline\{\backslash sum\_i\; V\_i^\backslash perp\}\; =\; \backslash left(\backslash bigcap\_i\; V\_i\backslash right)^\backslash perp\}$.
Spectral theory
There is a welldeveloped spectral theory for selfadjoint operators in a Hilbert space, that is roughly analogous to the study of symmetric matrices over the reals or selfadjoint matrices over the complex numbers.^{[68]} In the same sense, one can obtain a "diagonalization" of a selfadjoint operator as a suitable sum (actually an integral) of orthogonal projection operators.
The spectrum of an operator T, denoted σ(T) is the set of complex numbers λ such that T − λ lacks a continuous inverse. If T is bounded, then the spectrum is always a compact set in the complex plane, and lies inside the disc $\backslash scriptstyle\{z\backslash le\backslash T\backslash .\}$ If T is selfadjoint, then the spectrum is real. In fact, it is contained in the interval [m,M] where
 $m=\backslash inf\_\{\backslash x\backslash =1\}\backslash langle\; Tx,\; x\backslash rangle,\backslash quad\; M=\backslash sup\_\{\backslash x\backslash =1\}\backslash langle\; Tx,\; x\backslash rangle.$
Moreover, m and M are both actually contained within the spectrum.
The eigenspaces of an operator T are given by
 $H\_\backslash lambda\; =\; \backslash ker(T\backslash lambda).\backslash $
Unlike with finite matrices, not every element of the spectrum of T must be an eigenvalue: the linear operator T − λ may only lack an inverse because it is not surjective. Elements of the spectrum of an operator in the general sense are known as spectral values. Since spectral values need not be eigenvalues, the spectral decomposition is often more subtle than in finite dimensions.
However, the spectral theorem of a selfadjoint operator T takes a particularly simple form if, in addition, T is assumed to be a compact operator. The spectral theorem for compact selfadjoint operators states:^{[69]}
 A compact selfadjoint operator T has only countably (or finitely) many spectral values. The spectrum of T has no limit point in the complex plane except possibly zero. The eigenspaces of T decompose H into an orthogonal direct sum:
 $H=\backslash bigoplus\_\{\backslash lambda\backslash in\backslash sigma(T)\}H\_\backslash lambda.$
 Moreover, if E_{λ} denotes the orthogonal projection onto the eigenspace H_{λ}, then
 $T\; =\; \backslash sum\_\{\backslash lambda\backslash in\backslash sigma(T)\}\; \backslash lambda\; E\_\backslash lambda,$
 where the sum converges with respect to the norm on B(H).
This theorem plays a fundamental role in the theory of integral equations, as many integral operators are compact, in particular those that arise from Hilbert–Schmidt operators.
The general spectral theorem for selfadjoint operators involves a kind of operatorvalued Riemann–Stieltjes integral, rather than an infinite summation.^{[70]} The spectral family associated to T associates to each real number λ an operator E_{λ}, which is the projection onto the nullspace of the operator (T − λ)^{+}, where the positive part of a selfadjoint operator is defined by
 $A^+\; =\; \backslash frac\{1\}\{2\}\backslash left(\backslash sqrt\{A^2\}+A\backslash right).$
The operators E_{λ} are monotone increasing relative to the partial order defined on selfadjoint operators; the eigenvalues correspond precisely to the jump discontinuities. One has the spectral theorem, which asserts
 $T\; =\; \backslash int\_\backslash mathbb\{R\}\; \backslash lambda\backslash ,\; dE\_\backslash lambda.$
The integral is understood as a Riemann–Stieltjes integral, convergent with respect to the norm on B(H). In particular, one has the ordinary scalarvalued integral representation
 $\backslash langle\; Tx,\; y\backslash rangle\; =\; \backslash int\_\{\backslash mathbb\{R\}\}\; \backslash lambda\backslash ,d\backslash langle\; E\_\backslash lambda\; x,y\backslash rangle.$
A somewhat similar spectral decomposition holds for normal operators, although because the spectrum may now contain nonreal complex numbers, the operatorvalued Stieltjes measure dE_{λ} must instead be replaced by a resolution of the identity.
A major application of spectral methods is the spectral mapping theorem, which allows one to apply to a selfadjoint operator T any continuous complex function f defined on the spectrum of T by forming the integral
 $f(T)\; =\; \backslash int\_\{\backslash sigma(T)\}\; f(\backslash lambda)\backslash ,dE\_\backslash lambda.$
The resulting continuous functional calculus has applications in particular to pseudodifferential operators.^{[71]}
The spectral theory of unbounded selfadjoint operators is only marginally more difficult than for bounded operators. The spectrum of an unbounded operator is defined in precisely the same way as for bounded operators: λ is a spectral value if the resolvent operator
 $R\_\backslash lambda\; =\; (T\backslash lambda)^\{1\}$
fails to be a welldefined continuous operator. The selfadjointness of T still guarantees that the spectrum is real. Thus the essential idea of working with unbounded operators is to look instead at the resolvent R_{λ} where λ is nonreal. This is a bounded normal operator, which admits a spectral representation that can then be transferred to a spectral representation of T itself. A similar strategy is used, for instance, to study the spectrum of the Laplace operator: rather than address the operator directly, one instead looks as an associated resolvent such as a Riesz potential or Bessel potential.
A precise version of the spectral theorem in this case is:^{[72]}
 Given a densely defined selfadjoint operator T on a Hilbert space H, there corresponds a unique resolution of the identity E on the Borel sets of R, such that
 $\backslash langle\; Tx,\; y\backslash rangle\; =\; \backslash int\_\backslash mathbb\{R\}\; \backslash lambda\backslash ,dE\_\{x,y\}(\backslash lambda)$
 for all x ∈ D(T) and y ∈ H. The spectral measure E is concentrated on the spectrum of T.
There is also a version of the spectral theorem that applies to unbounded normal operators.
See also
Notes
References
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .

 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 ..
 .
 Template:Springer.
 .
 .
 .
 .
 .
 .
 .
 .
 .
 ; originally published Monografje Matematyczne, vol. 7, Warszawa, 1937.
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
 .
External links
 Template:Springer
 Hilbert space at Mathworld
 Terence Tao
This article was sourced from Creative Commons AttributionShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, EGovernment Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a nonprofit organization.