View source for Central limit theorem

{{MSC|60F05}}

[[Category:Limit theorems]]

A common name for a number of limit theorems in probability theory stating conditions under which sums or other functions of a large number of independent or weakly-dependent random variables have a probability distribution close to the [[Normal distribution|normal distribution]].

The classical version of the central limit theorem is concerned with a sequence

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211801.png" /></td> <td valign="top" style="width:5%;text-align:right;">(1)</td></tr></table>

of independent random variables having finite (mathematical) expectations <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211802.png" />, and finite variances <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211803.png" />, and with the sums

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211804.png" /></td> <td valign="top" style="width:5%;text-align:right;">(2)</td></tr></table>

Suppose that <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211805.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211806.png" />. The distribution functions

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211807.png" /></td> </tr></table>

that is, the  "normalized"  sums

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211808.png" /></td> <td valign="top" style="width:5%;text-align:right;">(3)</td></tr></table>

which have expectation 0 and variance 1, are compared with the  "standard"  normal distribution function

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c0211809.png" /></td> </tr></table>

corresponding to the normal distribution with expectation 0 and variance 1. In this case the central limit theorem asserts that under certain conditions, as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118010.png" />, for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118011.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118012.png" /></td> </tr></table>

or, what is the same, for any interval <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118013.png" />:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118014.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118015.png" /></td> </tr></table>

(see [[Laplace theorem|Laplace theorem]]; [[Lyapunov theorem|Lyapunov theorem]]).

A clearer understanding of conditions for the emergence of a normal distribution as the limit of distributions of sums of independent random variables comes about by consisting a [[Triangular array|triangular array]] of random variables instead of a sequence (see [[#References|[4]]]). In this case one considers for every <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118016.png" /> a sequence of variables

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118017.png" /></td> </tr></table>

putting

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118018.png" /></td> </tr></table>

Then the random variables inside each sequence (row) are independent, and

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118019.png" /></td> </tr></table>

The usual conditions for applicability of the central limit theorem (such as Lyapunov's condition or the condition of the [[Lindeberg–Feller theorem|Lindeberg–Feller theorem]]) imply that <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118020.png" /> is asymptotically negligible. For example, from Lyapunov's condition with third moments, that is, from the condition that as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118021.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118022.png" /></td> <td valign="top" style="width:5%;text-align:right;">(4)</td></tr></table>

for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118023.png" /> the inequality

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118024.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118025.png" /></td> </tr></table>

follows as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118026.png" />, and the fact that the quantities at the left-hand side of this chain of inequalities tend to zero indicates the asymptotic negligibility of the random variables forming the array.

Suppose now that

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118027.png" /></td> <td valign="top" style="width:5%;text-align:right;">(5)</td></tr></table>

<img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118028.png" /> is an arbitrary triangular array of asymptotically-negligible random variables that are independent within each sequence. If the limit distribution for the sums <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118029.png" /> exists and is non-degenerate, then it is normal if and only if, as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118030.png" />, for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118031.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118032.png" /></td> <td valign="top" style="width:5%;text-align:right;">(6)</td></tr></table>

that is, if the maximal term in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118033.png" /> becomes vanishingly small in comparison with the whole sum. (Without condition (6) one can only assert that the limit law for <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118034.png" /> belongs to the class of infinitely-divisible distributions, cf. [[Infinitely-divisible distribution|Infinitely-divisible distribution]].) Two additional conditions that together with (6) are necessary and sufficient for the convergence of the distributions of the sums <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118035.png" /> to a limit can be found in the article [[Triangular array|Triangular array]].

When the condition of asymptotic negligibility of the variables in the triangular array considered above does not hold, the situation becomes complicated. The well-known theorem of H. Cramér that the sum of several independent random variables is normally distributed if and only if each of the summands is, makes it possible to assume (as P. Lévy did, see [[#References|[15]]], Chapt. 5, Theor. 38) that the sum of independent random variables has a distribution close to normal if the  "large"  terms are almost normal and if the collection of  "small"  terms is subject to the condition of  "normality"  of the distributions of the sums of the asymptotically-negligible terms. A precise form of an argument of this kind was first obtained for the triangular array (5) with <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118036.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118037.png" /> (see [[#References|[7]]]). Here, for the convergence of the distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118038.png" /> to the normal distribution function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118039.png" /> it is necessary and sufficient that the following two conditions hold simultaneously:

1) as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118040.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118041.png" /></td> </tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118042.png" /> is the Lévy distance (see [[Lévy metric|Lévy metric]]) between the distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118043.png" /> of the random variables <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118044.png" /> and the normal distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118045.png" /> with the same expectation and variance as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118046.png" />; and

2) for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118047.png" />, as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118048.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118049.png" /></td> </tr></table>

where the sum is over those <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118050.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118051.png" />, for which <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118052.png" />.

This form of the statement is quite close to the one originally proposed by Lévy. Other formulations are possible (see, for example, [[#References|[8]]]), which in a certain sense are more reminiscent of the Lindeberg–Feller theorem.

Nowadays this form of the central limit theorem can be obtained as a special case of a more general summation theorem on a triangular array without the condition of asymptotic negligibility.

In practical respects it is important to have an idea of the rate of convergence of the distributions of the sums to the normal distribution. For this purpose there are inequalities and asymptotic expansions (and also the theory of [[Probability of large deviations|probability of large deviations]]; see also [[Cramér theorem|Cramér theorem]]; [[Limit theorems|Limit theorems]]). In what follows, for simplicity of the exposition, a triangular array is considered, and the variables participating in (1) are assumed to be identically distributed. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118053.png" />. A typical example of inequalities for the deviation of the distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118054.png" /> of the normalized sum (2) from <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118055.png" /> is the Berry–Esseen inequality: For all <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118056.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118057.png" /></td> <td valign="top" style="width:5%;text-align:right;">(7)</td></tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118058.png" /> is an absolute constant. (The best possible value of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118059.png" /> is not known at present (1984); however, it does not exceed 0.7655.) Inequalities like (7) become less informative if the terms <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118060.png" /> themselves are  "almost normal" . Thus, if they are actually normal, then the left-hand side of (7) is zero, while the right-hand side is <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118061.png" />. Therefore, from the beginning of the 1960's onwards one proposed analogues of (7) in which on the right-hand side instead of the moments of the random variables <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118062.png" /> other characteristics stand, similar to the moments but determined by the difference

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118063.png" /></td> </tr></table>

in such a way that they become smaller, the smaller this difference. On the right-hand side of (7) and its generalizations one can put a function of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118064.png" /> that decreases unboundedly as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118065.png" /> (so-called inhomogeneous estimators). One considers (see [[#References|[6]]]) also other methods of measuring the  "proximity"  of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118066.png" /> to <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118067.png" />, for example, in the sense of the space <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118068.png" /> (in so-called global versions of the central limit theorem) or methods based on a comparison of local characteristics of the distributions (see [[Local limit theorems|Local limit theorems]]).

The asymptotic expansion for the difference <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118069.png" /> has the form (see [[#References|[4]]], [[#References|[3]]]) for <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118070.png" />:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118071.png" /></td> </tr></table>

Here <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118072.png" /> are polynomials of degree <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118073.png" /> in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118074.png" /> with coefficients depending only on the first <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118075.png" /> moments of the terms. For the binomial distribution, the first term of the asymptotic expansion was indicated by P. Laplace in 1812, and, completely, but without a rigorous justification, the expansion was described by P.L. Chebyshev in 1887. The first estimate of the remainder, under the assumption that the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118076.png" />-th moment <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118077.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118078.png" />, is finite and that

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118079.png" /></td> </tr></table>

the so-called Cramér condition, was given by Cramér in 1928. This result, in a somewhat stronger form, asserts that

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118080.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118081.png" /></td> </tr></table>

uniformly in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118082.png" />. This asymptotic expansion serves as the basis for the construction of a broad class of transformations of random variables (cf. [[Random variables, transformations of|Random variables, transformations of]]).

The central limit theorem can be extended to the case when (1) (or the triangular array generalizing it) is formed by vectors in the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118083.png" />-dimensional Euclidean space <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118084.png" />. Suppose, for example, that the random vectors (1) are independent, identically distributed and with probability 1 do not lie in some hypersurface, and that <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118085.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118086.png" /> with the usual Euclidean norm in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118087.png" />. Under these conditions, as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118088.png" />, the probability distributions of the normalized sums

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118089.png" /></td> </tr></table>

converge weakly (see [[Convergence of distributions|Convergence of distributions]]) to the normal distribution <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118090.png" /> in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118091.png" /> with expectation equal to the zero vector and covariance matrix <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118092.png" /> equal to that of the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118093.png" />. Moreover, this convergence is uniform on broad classes of subsets of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118094.png" /> (see [[#References|[10]]]). For example, it is uniform on the class <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118095.png" /> of all convex Borel subsets of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118096.png" />: As <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118097.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118098.png" /></td> <td valign="top" style="width:5%;text-align:right;">(8)</td></tr></table>

Under additional assumptions the rate of the convergence (8) can be estimated.

The central limit theorem can also be extended to sequences (and arrays) of independent random vectors with values in infinite-dimensional spaces. The central limit theorem in the  "customary"  form need not hold. (Here the influence of the  "geometry"  of the space manifests itself, see [[Random element|Random element]].) Of special interest is the case when the terms of (1) take values in a separable Hilbert space <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c02118099.png" />. The assertion quoted above on the weak convergence in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180100.png" /> of the distributions of the normalized sums <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180101.png" /> to the normal distribution remain verbally true in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180102.png" />. The convergence is uniform on comparatively narrow classes (for example, on the class of all balls with centre at the origin, or balls the centres of which lie in some fixed ball; the convergence on the class of all balls need not be uniform). Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180103.png" /> be the ball in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180104.png" /> of radius <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180105.png" /> with centre at the origin. Here an analogue of (7) is an inequality of the following type. Suppose that

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180106.png" /></td> </tr></table>

and that the distribution of the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180107.png" /> is not concentrated on any finite-dimensional subspace of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180108.png" />; then in special cases (similar to the one analyzed in the example below)

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180109.png" /></td> </tr></table>

Under the condition <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180110.png" />, where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180111.png" /> is a fixed and not too-small number, it can be asserted that for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180112.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180113.png" /></td> </tr></table>

(this is true, for example, when <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180114.png" />).

Quite specific problems, e.g. of mathematical statistics, may lead to a central limit theorem in infinite-dimensional spaces, in particular, in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180115.png" />.

Example. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180116.png" /> be a sequence of independent random variables that are uniformly distributed on the interval <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180117.png" />. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180118.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180119.png" /> be random elements in the space <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180120.png" /> (the space of functions with integrable squares with respect to the Lebesgue measure on <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180121.png" />) given as follows:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180122.png" /></td> </tr></table>

Then <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180123.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180124.png" />, and

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180125.png" /></td> </tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180126.png" /> is the empirical distribution function constructed from the sample <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180127.png" /> of size <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180128.png" /> from a uniform distribution on <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180129.png" />. Here the square of the norm,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180130.png" /></td> </tr></table>

coincides with the statistic <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180131.png" /> of the Cramér–von Mises–Smirnov test (see [[Cramér–von Mises test|Cramér–von Mises test]]). In accordance with the central limit theorem there exists a limit distribution for the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180132.png" /> as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180133.png" />. It coincides with the distribution of the square of the norm of a certain normally-distributed vector in <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180134.png" /> and is known as the [[Omega-squared distribution| "omega-squared"  distribution]]. Thus, the central limit theorem justifies the replacement for large <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180135.png" /> of the distribution <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180136.png" /> by <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180137.png" />, and this is at the basis of applications of the statistical tests mentioned above.

Numerous versions are known of generalizations of the central limit theorem to sums of dependent variables. (In the case of homogeneous finite Markov chains, the simplest non-homogeneous chains with two states, and certain other schemes; this was done by Markov himself in 1907–1911, subsequent generalizations are connected in the first instance with the name of S.N. Bernshtein [[#References|[12]]].) A basic feature peculiar to all generalizations of this kind of the central limit theorem (if one is concerned with a triangular array) consists in the fact that the dependence between the events determined by <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180138.png" />, and those determined by <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180139.png" /> becomes vanishingly small when <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021180/c021180140.png" /> grows indefinitely.

As regards the methods of proof of the central limit theorem, in the case of independent terms the most powerful is, generally, the method of characteristic functions; it completes and occasionally replaces the so-called  "method of compositions"  (see [[#References|[11]]]) (and also the method known as that of  "metric distances" ). In the case of dependent variables the most effective method, on the whole, is the method of semi-invariants (see, for example, [[#References|[14]]]). This method is suitable for the study of functions of random variables more general than sums or linear functions (for example, for quadratic and other forms).

Concerning the central limit theorem in number theory see [[Number theory, probabilistic methods in|Number theory, probabilistic methods in]]. The central limit theorem is also applicable in certain problems in function theory and in the theory of dynamical systems.

====References====
<table><TR><TD valign="top">[1]</TD> <TD valign="top">  B.V. Gnedenko,   "A course of probability theory" , Moscow  (1969)  (In Russian)</TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top">  W. Feller,   "An introduction to probability theory and its applications" , '''1–2''' , Wiley  (1957–1971)</TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top">  H. Cramér,   "Mathematical methods of statistics" , Princeton Univ. Press  (1946)</TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top">  B.V. Gnedenko,   A.N. Kolmogorov,   "Limit distributions for sums of independent random variables" , Addison-Wesley  (1954)  (Translated from Russian)</TD></TR><TR><TD valign="top">[5]</TD> <TD valign="top">  I.A. Ibragimov,   Yu.V. Linnik,   "Independent and stationary sequences of random variables" , Wolters-Noordhoff  (1971)  (Translated from Russian)</TD></TR><TR><TD valign="top">[6]</TD> <TD valign="top">  V.V. Petrov,   "Sums of independent random variables" , Springer  (1975)  (Translated from Russian)</TD></TR><TR><TD valign="top">[7]</TD> <TD valign="top">  V.M. Zolotarev,   "A generalization of the Lindeberg–Feller theorem"  ''Theory Probab. Appl.'' , '''12'''  (1967)  pp. 608–618  ''Teor. Veroyatnost. i Primenen.'' , '''12''' :  4  (1967)  pp. 666–677</TD></TR><TR><TD valign="top">[8]</TD> <TD valign="top">  V.I. Rotar',   "An extension of the Lindeberg–Feller theorem"  ''Math. Notes'' , '''18'''  (1975)  pp. 123–128  ''Mat. Zametki'' , '''18''' :  1  (1975)  pp. 129–135</TD></TR><TR><TD valign="top">[9]</TD> <TD valign="top">  P.L. Chebyshev,   "Selected works" , Moscow  (1955)  (In Russian)</TD></TR><TR><TD valign="top">[10]</TD> <TD valign="top">  R.N. Bhattacharya,   R. Ranga Rao,   "Normal approximations and asymptotic expansions" , Wiley  (1976)</TD></TR><TR><TD valign="top">[11]</TD> <TD valign="top">  V.V. Sazonov,   "Normal aproximation: some recent advances" , Springer  (1981)  (Translated from Russian)</TD></TR><TR><TD valign="top">[12]</TD> <TD valign="top">  S.N. Bernshtein,   "Collected works" , '''4''' , Moscow  (1964)  (In Russian)</TD></TR><TR><TD valign="top">[13]</TD> <TD valign="top">  A.A. Markov,   "Selected works" , Moscow-Leningrad  (1951)  (In Russian)</TD></TR><TR><TD valign="top">[14]</TD> <TD valign="top">  V.A. Statulyavichus,   ''Teor. Veroyatnost. i Primenen.'' , '''5''' :  2  (1960)</TD></TR><TR><TD valign="top">[15]</TD> <TD valign="top">  P. Lévy,   "Théorie de l'addition des variables aléatoires" , Gauthier-Villars  (1937)</TD></TR></table>



====Comments====


====References====
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  M. Loève,   "Probability theory" , v. Nostrand  (1963)</TD></TR></table>