Namespaces
Variants
Actions

Difference between revisions of "Distribution, type of"

From Encyclopedia of Mathematics
Jump to: navigation, search
(Importing text file)
 
(TeX)
 
(One intermediate revision by one other user not shown)
Line 1: Line 1:
A set of probability distributions of random variables, each obtainable from the others by means of linear transformations. An exact definition in the one-dimensional case is as follows: Probability distributions of random variables <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335401.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335402.png" /> are said to have the same type if there are constants <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335403.png" /> such that the distributions of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335404.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335405.png" /> coincide. The corresponding distribution functions are then connected by the relation
+
{{TEX|done}}
 +
A set of probability distributions of random variables, each obtainable from the others by means of linear transformations. An exact definition in the one-dimensional case is as follows: Probability distributions of random variables $X_1$ and $X_2$ are said to have the same type if there are constants $A,B>0$ such that the distributions of $X_2$ and $BX_1+A$ coincide. The corresponding distribution functions are then connected by the relation
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335406.png" /></td> </tr></table>
+
$$F_2(x)=F_1\left(\frac{x-A}{B}\right)=F_1(bx+a),$$
  
where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335407.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335408.png" />.
+
where $b=1/B$ and $a=-A/B$.
  
 
Thus the set of distribution functions decomposes into mutually disjoint types. For example, all normal distributions form one type, and all uniform distributions form another.
 
Thus the set of distribution functions decomposes into mutually disjoint types. For example, all normal distributions form one type, and all uniform distributions form another.
  
The concept of type is widely used in [[Limit theorems|limit theorems]] of probability theory. The distributions of the sums <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d0335409.png" /> of independent random variables often  "unboundedly diverge"  as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354010.png" />, and the convergence to a limit distribution (such as a normal distribution) is possible only after linear  "normalization" , i.e. for sums <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354011.png" />, where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354012.png" /> are constants and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354013.png" /> as <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354014.png" />. In addition, if for random variables <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354015.png" /> the distributions of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354016.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354017.png" /> converge to non-degenerate limit distributions, then these must be of the same type. Therefore it is possible to give the following definition of convergence of types (A.Ya. Khinchin, 1938). Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354018.png" /> be the type of the distribution function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354019.png" /> (the degenerate type is excluded from this discussion, that is, the type of degenerate distributions). One says that a sequence of types <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354020.png" /> converges to a type <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354021.png" /> if there is a sequence of distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354022.png" /> that is (weakly) convergent to a distribution function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354023.png" />. The set of types topologized in this way is a non-regular Hausdorff space and is thus non-metrizable (W. Doeblin, 1939).
+
The concept of type is widely used in [[Limit theorems|limit theorems]] of probability theory. The distributions of the sums $S_n$ of independent random variables often  "unboundedly diverge"  as $n\to\infty$, and the convergence to a limit distribution (such as a normal distribution) is possible only after linear  "normalization" , i.e. for sums $(S_n-a_n)/b_n$, where $a_n,b_n>0$ are constants and $b_n\to\infty$ as $n\to\infty$. In addition, if for random variables $X_n$ the distributions of $(X_n-a_n)/b_n$ and $(X_n-a_n')/b_n'$ converge to non-degenerate limit distributions, then these must be of the same type. Therefore it is possible to give the following definition of convergence of types (A.Ya. Khinchin, 1938). Let $T(F)$ be the type of the distribution function $F$ (the degenerate type is excluded from this discussion, that is, the type of degenerate distributions). One says that a sequence of types $T_n$ converges to a type $T$ if there is a sequence of distribution functions $F_n\in T_n$ that is (weakly) convergent to a distribution function $F\in T$. The set of types topologized in this way is a non-regular Hausdorff space and is thus non-metrizable (W. Doeblin, 1939).
  
Now, let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354024.png" /> be sums of independent identically-distributed random variables with corresponding distribution functions <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354025.png" />. Then the class of limit types of the <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354026.png" /> coincides with the class of all stable types, i.e. types <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354027.png" /> such that whenever <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354028.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354029.png" /> belong to <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354030.png" />, so does the convolution of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354031.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354032.png" /> (in other words, the sum of two independent random variables with distributions of type <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354033.png" /> again has type <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354034.png" />; see [[Stable distribution|Stable distribution]]).
+
Now, let $S_n$ be sums of independent identically-distributed random variables with corresponding distribution functions $F_n$. Then the class of limit types of the $T(F_n)$ coincides with the class of all stable types, i.e. types $T$ such that whenever $F_1$ and $F_2$ belong to $T$, so does the convolution of $F_1$ and $F_2$ (in other words, the sum of two independent random variables with distributions of type $T$ again has type $T$; see [[Stable distribution|Stable distribution]]).
  
The concept of a type of distribution can be extended to the multi-dimensional case. However, this extension is ambiguous. For any subgroup <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354035.png" /> of the full matrix group one obtains a corresponding concept of a type of distribution. Random vectors <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354036.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354037.png" /> with values from <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354038.png" /> are said to have the same <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354040.png" />-type if there is a transformation <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354041.png" /> such that <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354042.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354043.png" /> have the same distribution. In a corresponding way it is possible to introduce the concept of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/d/d033/d033540/d03354045.png" />-stability of a type of distribution. With respect to the full matrix group, only normal distributions are stable (G. Sakovich, 1960).
+
The concept of a type of distribution can be extended to the multi-dimensional case. However, this extension is ambiguous. For any subgroup $G$ of the full matrix group one obtains a corresponding concept of a type of distribution. Random vectors $X_1$ and $X_2$ with values from $\mathbf R^n$ are said to have the same $G$-type if there is a transformation $g\in G$ such that $X_2$ and $gX_1$ have the same distribution. In a corresponding way it is possible to introduce the concept of $G$-stability of a type of distribution. With respect to the full matrix group, only normal distributions are stable (G. Sakovich, 1960).
  
 
====References====
 
====References====
Line 22: Line 23:
  
 
====References====
 
====References====
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  M. Loève,  "Probability theory" , Princeton Univ. Press  (1963)</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top">  W. Feller,   "An introduction to probability theory and its applications" , '''2''' , Wiley  (1971)</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top">  M. Sharpe,  "Operator stable distributions on vector groups"  ''Trans. Amer. Math. Soc.'' , '''136'''  (1969)  pp. 51–65</TD></TR></table>
+
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  M. Loève,  "Probability theory" , Princeton Univ. Press  (1963)</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top">  W. Feller, [[Feller, "An introduction to probability theory and its applications"|"An introduction to probability theory and its  applications"]] , '''2''' , Wiley  (1971)</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top">  M. Sharpe,  "Operator stable distributions on vector groups"  ''Trans. Amer. Math. Soc.'' , '''136'''  (1969)  pp. 51–65</TD></TR></table>

Latest revision as of 14:15, 17 April 2014

A set of probability distributions of random variables, each obtainable from the others by means of linear transformations. An exact definition in the one-dimensional case is as follows: Probability distributions of random variables $X_1$ and $X_2$ are said to have the same type if there are constants $A,B>0$ such that the distributions of $X_2$ and $BX_1+A$ coincide. The corresponding distribution functions are then connected by the relation

$$F_2(x)=F_1\left(\frac{x-A}{B}\right)=F_1(bx+a),$$

where $b=1/B$ and $a=-A/B$.

Thus the set of distribution functions decomposes into mutually disjoint types. For example, all normal distributions form one type, and all uniform distributions form another.

The concept of type is widely used in limit theorems of probability theory. The distributions of the sums $S_n$ of independent random variables often "unboundedly diverge" as $n\to\infty$, and the convergence to a limit distribution (such as a normal distribution) is possible only after linear "normalization" , i.e. for sums $(S_n-a_n)/b_n$, where $a_n,b_n>0$ are constants and $b_n\to\infty$ as $n\to\infty$. In addition, if for random variables $X_n$ the distributions of $(X_n-a_n)/b_n$ and $(X_n-a_n')/b_n'$ converge to non-degenerate limit distributions, then these must be of the same type. Therefore it is possible to give the following definition of convergence of types (A.Ya. Khinchin, 1938). Let $T(F)$ be the type of the distribution function $F$ (the degenerate type is excluded from this discussion, that is, the type of degenerate distributions). One says that a sequence of types $T_n$ converges to a type $T$ if there is a sequence of distribution functions $F_n\in T_n$ that is (weakly) convergent to a distribution function $F\in T$. The set of types topologized in this way is a non-regular Hausdorff space and is thus non-metrizable (W. Doeblin, 1939).

Now, let $S_n$ be sums of independent identically-distributed random variables with corresponding distribution functions $F_n$. Then the class of limit types of the $T(F_n)$ coincides with the class of all stable types, i.e. types $T$ such that whenever $F_1$ and $F_2$ belong to $T$, so does the convolution of $F_1$ and $F_2$ (in other words, the sum of two independent random variables with distributions of type $T$ again has type $T$; see Stable distribution).

The concept of a type of distribution can be extended to the multi-dimensional case. However, this extension is ambiguous. For any subgroup $G$ of the full matrix group one obtains a corresponding concept of a type of distribution. Random vectors $X_1$ and $X_2$ with values from $\mathbf R^n$ are said to have the same $G$-type if there is a transformation $g\in G$ such that $X_2$ and $gX_1$ have the same distribution. In a corresponding way it is possible to introduce the concept of $G$-stability of a type of distribution. With respect to the full matrix group, only normal distributions are stable (G. Sakovich, 1960).

References

[1] B.V. Gnedenko, A.N. Kolmogorov, "Limit distributions for sums of independent random variables" , Addison-Wesley (1954) (Translated from Russian)


Comments

Concerning (weak) convergence of distribution functions see Distributions, convergence of; Weak convergence of probability measures.

References

[a1] M. Loève, "Probability theory" , Princeton Univ. Press (1963)
[a2] W. Feller, "An introduction to probability theory and its applications" , 2 , Wiley (1971)
[a3] M. Sharpe, "Operator stable distributions on vector groups" Trans. Amer. Math. Soc. , 136 (1969) pp. 51–65
How to Cite This Entry:
Distribution, type of. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Distribution,_type_of&oldid=12790
This article was adapted from an original article by Yu.V. Prokhorov (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article