Definitions

# Convergence of measures

In mathematics, there are various notions of the convergence of measures in measure theory. Broadly speaking, there are two kinds of convergence, strong convergence and weak convergence.

## Strong convergence of measures

Let $\left(X, mathcal\left\{F\right\}\right)$ be a measurable space. If the collection of all measures (or, frequently, just probability measures) on $\left(X, mathcal\left\{F\right\}\right)$ can be given some kind of metric, then convergence in this metric is usually referred to as strong convergence. Examples include the Radon metric
$rho \left(mu, nu\right) := sup left\left\{ left. int_\left\{X\right\} f\left(x\right) , mathrm\left\{d\right\} \left(mu - nu\right) \left(x\right) right| mathrm\left\{continuous,\right\} f : X to \left[-1, 1\right] subset mathbb\left\{R\right\} right\right\}$
and the total variation metric
$tau \left(mu, nu\right) := sup left\left\{ left. | mu \left(A\right) - nu \left(A\right) | right| A in mathcal\left\{F\right\} right\right\}.$

## Weak convergence of measures

In mathematics and statistics, weak convergence (also known as narrow convergence or weak-* convergence which is a more appropriate name from the point of view of functional analysis but less frequently used) is one of many types of convergence relating to the convergence of measures. It depends on a topology on the underlying space and thus is not a purely measure theoretic notion.

There are (at least) five definitions of weak convergence of a sequence of measures, some of which are more general than others. The following equivalence result is sometimes known as the portmanteau theorem, and shows the equivalence of four such definitions for probability measures on a general metrizable topological space, and a fifth condition, which makes sense only for distributions on the real line.

Let (Ω, T) be a topological space with its Borel σ-algebra Borel(Ω), and let P(Ω) denote the collection of all probability measures defined on (Ω, Borel(Ω)). Consider here the case of metrizable Ω (we need some restriction of the topology and second countable is not sufficient). If Ω is also separable, P(Ω) (with the weak topology defined below) is metrizable, for example by the Lévy-Prokhorov metric. Let μn, n = 1, 2, ..., be a sequence in P(Ω) and let μP(Ω). Then the following conditions are all equivalent:

1. $lim_\left\{n to infty\right\} int_\left\{Omega\right\} f , mathrm\left\{d\right\} mu_\left\{n\right\} = int_\left\{Omega\right\} f , mathrm\left\{d\right\} mu$ for all bounded and continuous functions f : Ω → R (sometimes referred to as "test functions");
2. limsupn→∞ μn(C) ≤ μ(C) for all closed subsets C of Ω;
3. liminfn→∞ μn(U) ≥ μ(U) for all open subsets U of Ω;
4. limn→∞ μn(A) = μ(A) for all so-called "μ-continuity" subsets A of Ω: those sets A with μ(∂A) = 0, where ∂A denotes the boundary of A;
5. in the case Ω = R with its usual topology, if Fn, F denote the cumulative distribution functions of the measures μn, μ respectively, then limn→∞ Fn(x) = F(x) for all points xR at which F is continuous.

### Definition and notation

If any (and hence all) of the above conditions hold, the sequence of measures $\left(mu_\left\{n\right\}\right)_\left\{n = 1\right\}^\left\{infty\right\}$ is said to converge weakly to $mu$. Weak convergence is also known as narrow convergence, convergence in distribution and convergence in law (the terms "convergence in distribution/law" are more frequently used when discussing weak convergence of random variables, as in the next section).

There are many "arrow notations" for this kind of convergence: the most frequently used are $mu_\left\{n\right\} Rightarrow mu$, $mu_\left\{n\right\} rightharpoonup mu$ and $mu_\left\{n\right\} xrightarrow\left\{mathcal\left\{D\right\}\right\} mu.$.

### Weak convergence of random variables

If $\left(Omega, mathcal\left\{F\right\}, mathbb\left\{P\right\}\right)$ is a probability space and $X_\left\{n\right\}, X : Omega to mathbb\left\{X\right\}$ are random variables, $X_\left\{n\right\}$ is said to converge weakly (or in distribution or in law) to $X$ as $n to infty$ if the sequence of pushforward measures $\left(X_\left\{n\right\}\right)_\left\{*\right\} \left(mathbb\left\{P\right\}\right)$ converges weakly to $X_\left\{*\right\} \left(mathbb\left\{P\right\}\right)$ in the sense of weak convergence of measures on $mathbb\left\{X\right\}$, as defined above.

## References

• Ambrosio, L., Gigli, N. & Savaré, G. (2005). Gradient Flows in Metric Spaces and in the Space of Probability Measures. Basel: ETH Zürich, Birkhäuser Verlag. ISBN 3-7643-2428-7.
• Billingsley, Patrick (1995). Probability and Measure. New York, NY: John Wiley & Sons, Inc.. ISBN 0-471-00710-2.
• Billingsley, Patrick (1999). Convergence of Probability Measures. New York, NY: John Wiley & Sons, Inc.. ISBN 0-471-19745-9.