The most familiar vector spaces are two- and three-dimensional Euclidean spaces. Vectors in these spaces can be represented by ordered pairs or triples of real numbers, and are isomorphic to geometric vectors—quantities with a magnitude and a direction, usually depicted as arrows. These vectors may be added together using the parallelogram rule (vector addition) or multiplied by real numbers (scalar multiplication). The behavior of geometric vectors under these operations provides a good intuitive model for the behavior of vectors in more abstract vector spaces, which need not have a geometric interpretation. For example, the set of (real) polynomials forms a vector space.
A much more extensive idea of what constitutes a vector space is found in the See also subsection for this article, which provides links to more abstract examples of this term.
The space R2 consisting of pairs of real numbers, (x, y), is a common example for a vector space. It is one, because any pair (here a vector) can be added:
satisfying the axioms below. Let u, v, w be arbitrary elements of V, and a, b be elements of F, respectively.
| Associativity of addition | u + (v + w) = (u + v) + w |
| Commutativity of addition | v + w = w + v |
| Identity element of addition | There exists an element 0 ∈ V, called the zero vector, such that v + 0 = v for all v ∈ V. |
| Inverse elements of addition | For all v ∈ V, there exists an element w ∈ V, called the additive inverse of v, such that v + w = 0. |
| Distributivity of scalar multiplication with respect to vector addition | a (v + w) = a v + a w |
| Distributivity of scalar multiplication with respect to field addition | (a + b) v = a v + b v |
| Compatibility of scalar multiplication with field multiplication | a (b v) = (ab) v |
| Identity element of scalar multiplication | 1 v = v, where 1 denotes the multiplicative identity in F |
Some sources choose to also include two axioms of closure u + v ∈ V and a v ∈ V for all a, u, and v. When the operations are interpreted as maps with codomain V, these closure axioms hold by definition, and do not need to be stated independently. Closure, however, must be checked to determine whether a subset of a vector space is a subspace.
Expressions of the form “v a”, where v ∈ V and a ∈ F, are, strictly speaking, not defined. Because of the commutativity of the underlying field, however, “a v” and “v a” are often treated synonymously. Additionally, if v ∈ V, w ∈ V, and a ∈ F where vector space V is additionally an algebra over the field F then a v w = v a w, which makes it convenient to consider “a v” and “v a” to represent the same vector.
There are a number of properties that follow easily from the vector space axioms. Some of them derive from elementary group theory, applied to the (additive) group of vectors: for example the zero vector 0 ∈ V and the additive inverse −v of a vector v are unique. Other properties can be derived from the distributive law, for example scalar multiplication by zero yields the zero vector and no other scalar multiplication yields the zero vector.
To achieve a geometric solutions without using coordinates, Bernhard Bolzano introduced in 1804 certain operations on points, lines and planes, which are predecessors of vectors. This work was considered in the concept of barycentric coordinates of August Ferdinand Möbius in 1827. The founding leg of the definition of vectors was the Bellavitis' definition of the bipoint, which is an oriented segment, one of whose ends is the origin and the other one a target.
The notion of vector was reconsidered with the presentation of complex numbers by Jean-Robert Argand and William Rowan Hamilton and the inception of quaternions by the latter mathematician, being elements in R2 and R4, respectively. Treating them using linear combinations goes back to Laguerre in 1867, who defined systems of linear equations.
In 1857, Cayley introduced the matrix notation which allows one to harmonize and simplify the writing of linear maps between vector spaces.
At the same time, Grassmann studied the barycentric calculus initiated by Möbius. He envisaged sets of abstract objects endowed with operations. His work exceeds the framework of vector spaces, since his introduction of multiplication led him to the concept of algebras. Nonetheless, the concepts of dimension and linear independence are present, as well as the scalar product (1844). The primacy of these discoveries was disputed with Cauchy's publication Sur les clefs algébriques.
Italian mathematician Peano, one of whose important contributions was the rigorous axiomatisation of extant concepts, in particular the construction of sets, was one of the first to give the modern definition of vector spaces around the end of 19th century.
An important development of this concept is due to the construction of function spaces by Henri Lebesgue. This was later formalized by David Hilbert and Stefan Banach, in his 1920 PhD thesis.
At this time, algebra and the new field of functional analysis began to interact, notably with key concepts such as spaces of p-integrable functions and Hilbert spaces. Also at this time, the first studies concerning infinite dimensional vector spaces were done.
An isomorphism is a linear map such that there exists an inverse map such that the two possible compositions and are identity maps. Equivalently, f is both one-to-one (injective) and onto (surjective). If there exists an isomorphism between V and W, the two spaces are said to be isomorphic; they are then essentially identical as vector spaces, since all identities holding in V are, via f, transported to similar ones in W, and vice versa via g.
Given any two vector spaces V and W, the set of linear maps V → W forms a vector space HomF(V, W) (also denoted L(V, W): two such maps f and g are added by adding them pointwise, i.e.
The case of W = F, the base field, is of particular interest. The space of linear maps from V to F is called the dual vector space, denoted V∗.
Matrices are a useful notion to encode linear maps. They are written as a rectangular array of scalars, i.e. elements of some field F. Any m-by-n matrix A gives rise to a linear map from Fn, the vector space consisting of n-tuples x = (x1, ..., xn) to Fm, by the following
The determinant of a square matrix tells whether the associated map is an isomorphism or not: to be so it is sufficient and necessary that the determinant is nonzero.
In general, a nonempty subset W of a vector space V that is closed under addition and scalar multiplication is called a subspace of V. Subspaces of V are vector spaces (over the same field) in their own right. The intersection of all subspaces containing a given set of vectors is called its span. Expressed in terms of elements, the span is the subspace consisting of finite sums (called linear combinations)
The counterpart to subspaces are quotient vector spaces. Given any subspace W ⊂ V, the quotient space V/W ("V modulo W") is defined as follows: as a set, it consists of v + W = {v + w, w ∈ W}, where v is an arbitrary vector in V. The sum of two such elements v1 + W and v2 + W is (v1 + v2) + W, and scalar multiplication is given by a · (v + W) = (a · v) + W. The key point in this definition is that v1 + W = v2 + W if and only if the difference of v1 and v2 lies in W. This way, the quotient space "forgets" information that is contained in the subspace W.
For any linear map f: V → W, the kernel ker(f) consists of elements v that are mapped to 0 in W. It, as well as the image im(f) = {f(v), v ∈ V}, are linear subspaces of V and W, respectively. There is a fundamental isomorphism
In a similar vein, the solutions of homogeneous linear differential equations, for example
The tensor product—one of the central notions of multilinear algebra—can be seen as the extension of the hierarchy of scalars, vectors and matrices. Via the fundamental isomorphism
In the important case V ⊗ V, the tensor product can be loosely thought of as adding formal "products" of vectors (which, ad hoc, don't exist in vector spaces). In general, there are no relations between the two tensors v1 ⊗ v2 and v2 ⊗ v1. Forcing two such elements to be equal leads to the symmetric algebra, whereas forcing v1 ⊗ v2 = − v2 ⊗ v1 yields the exterior algebra. The latter is the linear algebraic fundament of differential forms: they are elements of the exterior algebra of the cotangent space to manifolds. Tensors, i.e. element of some tensor product have various applications, for example the Riemann curvature tensor encodes all curvatures of a manifold at a time, which finds applications in general relativity, for example, where the Einstein curvature tensor describes the curvature of space-time.
If, in a (finite or infinite) set {vi}i ∈ I no vector can be removed without changing the span, the set is said to be linearly independent. Equivalently, an equation
A linearly independent set whose span is V is called a basis for V. Hence, every element can be expressed as a finite sum of basis elements, and any such representation is unique (once a basis is chosen). Vector spaces are sometimes introduced from this coordinatised viewpoint.
Using Zorn’s Lemma (which is equivalent to the axiom of choice), it can be proven that every vector space has a basis. It follows from the ultrafilter lemma, which is weaker than the axiom of choice, that all bases of a given vector space have the same cardinality. This cardinality is called the dimension of the vector space. Historically, the existence of bases was first shown by Felix Hausdorff. It is known that, given the rest of the axioms, this statement is in fact equivalent to the axiom of choice.
For example, the dimension of the coordinate space Fn is n, since any element in this space (x1, x2, ..., xn) can be uniquely expressed as a linear combination of n vectors e1 = (1, 0, ..., 0), e2 = (0, 1, 0, ..., 0), to en = (0, 0, ..., 0, 1), namely the sum
By the unicity of the decomposition of any element into a linear combination of chosen basis elements vi, linear maps are completely determined by specifying f(vi). Given two vector spaces, V and W, of the same dimension, a choice of bases of V and W and a bijection between the sets of bases gives rise to the map that maps any basis element of V to the corresponding basis element of W. This map is, by its very definition, an isomorphisms. Therefore, vector spaces over a given field are fixed up to isomorphism by the dimension. Thus any n-dimensional vector spaces over F is isomorphic to F0n.
Therefore, it is common to study vector spaces with certain additional structures. This is often necessary to recover ordinary notions from geometry or analysis.
Only in such topological vector spaces can one consider infinite sums of vectors, i.e. series, through the notion of convergence. For example, the term
A way of ensuring the existence of limits of infinite series as above is to restrict attention to complete vector spaces, i.e. any Cauchy sequence (which can be thought of as sequences that "should" possess a limit) do have a limit. Roughly, completeness means the absence of holes. E.g. the rationals are not complete, since there are series of rational numbers converging to irrational numbers such as . A less immediate example is provided by functions equipped with the Riemann integral.
In the realm of topological vector spaces, such as Banach and Hilbert spaces, all notions should be coherent with the topology. For example, instead of considering all linear maps (also called functionals) V → W, it is useful to require maps to be continuous. For example, the dual space V∗ consists of continuous functionals V → R (or C). If V is some vector space of (well-behaved) functions, this dual space, called space of distributions, which can be thought of as generalized functions, find applications in solving differential equations. Applying the dual construction twice yields the bidual V∗∗. There is always an natural, injective map V → V∗∗. This map may or may not be an isomorphism. If so, V is called reflexive.
Banach spaces, in honor of Stefan Banach, are complete normed vector spaces, i.e. the topology comes from a norm, a datum that allows to measure lengths of vectors.
A common example is the vector space lp consisting of infinite vectors with real entries x = (x1, x2, ...) whose p-norm (1 ≤ p ≤ ∞) given by
More generally, it is possible to consider functions endowed with a norm that replaces the sum in the above p-norm by an integral, specifically the Lebesgue integral
Since the above uses the Lebesgue integral (as opposed to the Riemann integral), these spaces are complete. Concretely this means that for any sequence of functions satisfying the condition
Imposing boundedness conditions not only on the function, but also on its derivatives leads to Sobolev spaces.
Slightly more special, but equally crucial to functional analysis is the case where the topology is induced by an inner product, which allows to measure angles between vectors. This entails, that lengths of vectors can be defined too, namely by . If such a space is complete, it is called Hilbert space, in honor of David Hilbert.
A key case is the Hilbert space L2(Ω), whose inner product is given by
Reversing this direction of thought, i.e. finding a sequence of functions fn that approximate a given function, is equally crucial. Early analysis, for example, in the guise of the Taylor approximation, established an approximation of differentiable functions f by polynomials. Ad hoc, this technique is local, i.e. approximating f closely at some point x may not approximate the function globally. The Stone-Weierstrass theorem, however, states that every continuous function on [a, b] can be approximated as closely as desired by a polynomial. More generally, and more conceptually, the theorem yields a simple description what "basic functions" suffice to generate a Hilbert space, in the sense that the closure of their span (i.e. finite sums and limits of those) is the whole space. For distinction, a basis in the linear algebraic sense as above is then called a Hamel basis. Not only does the theorem exhibit polynomials as sufficient for approximation purposes, it, together with the Gram-Schmidt process, also allows the construction of a basis of orthogonal polynomials. Orthogonality means that , i.e. the polynomials obtained don't interfer. Instead of polynomials, similar statements hold for Legendre polynomials, Bessel functions and Hypergeometric functions.
Resolving general functions into sums of trigonometric functions is known as the Fourier expansion, a technique much used in engineering. It is possible to describe any function f(x) on a bounded, closed interval (or equivalently, any periodic function) as the limit of the following sum
The solutions to various important differential equations can be interpreted in terms of Hilbert spaces. For example, a great many fields in physics and engineering lead to such equations and frequently solutions with particular physical properties are used as basis functions, often orthogonal, that serve as the axes in a corresponding Hilbert space.
As an example from physics, the time-dependent Schrödinger equation in quantum mechanics describes the change of physical properties in time, by means of a partial differential equation determining a wavefunction. Definite values for physical properties such as energy, or momentum, correspond to eigenvalues of an associated (linear) differential operator and the associated wavefunctions are called eigenstates. The spectral theorem describes the representation of linear operators that act upon functions in terms of these eigenfunctions and their eigenvalues.
In general, vector spaces do not possess a multiplication operation. (An exceptional case are finite-dimensional vector spaces over finite fields, which turn out to be (finite) fields, as well.) A vector space equipped with an additional bilinear operator defining the multiplication of two vectors is an algebra over a field. An important example is the ring of polynomials F[x] in one variable, x, with coefficients in a field F, or similarly with several variables. In this case the multiplication is both commutative and associative. These rings, and their quotient rings form the basis of algebraic geometry, because they are the rings of functions of algebraic geometric objects.
Another crucial example are Lie algebras, which are neither commutative, nor associative, but the failure to be so is measured by the constraints ([x, y] denotes multiplication of x and y):
A family of vector spaces, parametrised continuously by some topological space X, is a vector bundle. More precisely, a vector bundle E over X is given by a continuous map
The set of one-dimensional subspaces of a fixed vector space V is known as projective space, an important geometric object formalizing the idea of parallel lines intersecting at infinity. More generally, the Grassmann manifold consists of linear subspaces of higher (fixed) dimension n. Finally, flag manifolds parametrize flags, i.e. chains of subspaces (with fixed dimension)