Infinitely-divisible distribution

2020 Mathematics Subject Classification: Primary: 60E07 [MSN][ZBL]

A probability distribution which, for any $ n = 2, 3 \dots $ may be represented as a composition (convolution) of $ n $ identical probability distributions. The definition of an infinitely-divisible distribution is applicable to an equal degree to a distribution on the straight line, on a finite-dimensional Euclidean space and to a number of other, even more general, cases. The one-dimensional case will be considered below.

The characteristic function $ f( t) $ of an infinitely-divisible distribution is called infinitely divisible. Such a function may be represented, for any value of $ n $, as the $ n $- th power of some other characteristic function:

$$ f( t) = ( f _ {n} ( t)) ^ {n} . $$

Examples of infinitely-divisible distributions include the normal distribution, the Poisson distribution, the Cauchy distribution, and the "chi-squared" distribution. The property of infinite divisibility is most easily tested by using characteristic functions. The composition of infinitely-divisible distributions and the limit of weakly-convergent sequences of infinitely-divisible distributions are again infinitely divisible.

A random variable, defined on some probability space, is called infinitely divisible if it can be represented, for any $ n $, as a sum of $ n $ independent identically-distributed random variables defined on that space. The distribution of each such variable is infinitely divisible, but the converse is not always true. Consider, e.g., the discrete probability space formed by $ \{ 0, 1, 2 ,\dots \} $ with Poisson probabilities

$$ P ( m ) = \frac{\lambda ^ {m} }{m!} e ^ {- \lambda } \ \ ( m = 0 , 1 ,\dots ) . $$

The random variable $ X( m) = m $ is not infinitely divisible, even though its probability distribution (Poisson distribution) is infinitely divisible.

Infinitely-divisible distributions first appeared in connection with the study of stochastically-continuous homogeneous stochastic processes with stationary independent increments (cf. Stochastic process with stationary increments; Stochastic process with independent increments) [Fin], [Ko], [L]. This is the name of processes $ X ( \tau ) $, $ \tau \geq 0 $, which satisfy the following requirements: 1) $ X( 0) = 0 $; 2) the probability distribution of the increment $ X ( \tau _ {2} ) - X ( \tau _ {1} ) $, $ \tau _ {2} > \tau _ {1} $, depends only on $ \tau _ {2} - \tau _ {1} $; 3) for $ \tau _ {1} \leq \dots \leq \tau _ {k} $ the differences

$$ X ( \tau _ {2} ) - X ( \tau _ {1} ) \dots X ( \tau _ {k} ) - X ( \tau _ {k-1} ) $$

are mutually-independent random variables; 4) for any $ \epsilon > 0 $,

$$ {\mathsf P} ( | X ( \tau ) | > \epsilon ) \rightarrow 0 $$

as $ \tau \rightarrow 0 $. For such a process the value $ X( \tau ) $ for any $ \tau $ will be an infinitely-divisible random variable, and the corresponding characteristic function satisfies the relation

$$ f _ \tau ( t) = ( f _ {1} ( t)) ^ \tau . $$

The general form of $ f _ \tau ( t) $ for such processes — on the assumption that the variances $ {\mathsf D} X ( \tau ) $ are finite — was found by A.N. Kolmogorov [Ko] (a special case of the canonical representation of infinitely-divisible distributions presented below).

The characteristic function of an infinitely-divisible distribution never vanishes, and its logarithm (in the sense of the principal value) permits a representation of the form:

$$ \tag{* } \mathop{\rm ln} f ( t ) = \ i \gamma t + \int\limits _ {- \infty } ^ { + \infty } L( u, t) \frac{1+ u ^ {2} }{u ^ {2} } dG( u) $$

(the so-called Lévy–Khinchin canonical representation), where

$$ L( u, t ) = e ^ {itu} - 1 - \frac{itu}{1+ u ^ {2} } , $$

$ \gamma $ is some real constant and $ G( u) $ is a non-decreasing function of bounded variation with $ G ( - \infty ) = 0 $. The integrand is taken to be equal to $ - t ^ {2} /2 $ for $ u = 0 $. Whatever the value of the constant $ \gamma $ and of the function $ G $ with the above properties, formula (*) defines the logarithm of the characteristic function of some infinitely-divisible distribution. The correspondence between infinitely-divisible distributions and pairs $ ( \gamma , G ) $ is one-to-one and is also bicontinuous. This means that an infinitely-divisible distribution is weakly convergent towards an infinitely-divisible limit distribution if and only if $ \gamma _ {n} \rightarrow \gamma $ and $ G _ {n} $ converges to $ G $ as $ n \rightarrow \infty $.

Examples. Let $ U( x) = 0 $, $ x \leq 0 $, $ U( x) = 1 $, $ x > 0 $. Then, in order to have a normal distribution with mathematical expectation $ a $ and variance $ \sigma ^ {2} $ in formula (*), one must put

$$ \gamma = a ,\ \ G( x) = \frac{\sigma ^ {2} }{2} U ( x) . $$

For a Poisson distribution with parameter $ \lambda $ one has

$$ \gamma = \frac \lambda {2} ,\ \ G( x) = \frac \lambda {2} U ( x- 1). $$

For a Cauchy distribution with density

$$ p( x) = \frac{1}{\pi ( 1+ x ^ {2} ) } $$

one has $ \gamma = 0 $,

$$ G( x) = \frac{1} \pi \ \mathop{\rm arctan} x + { \frac{1}{2} } . $$

The canonical representation (*) is convenient from a purely "technical" point of view (owing to the fact that $ G $ has bounded variation), but the function $ G $ has no direct probabilistic interpretation. For this reason another form of representation of infinitely-divisible distributions, which permits a direct probabilistic interpretation, is employed as well. Let the functions $ M( u) $ and $ N( u) $ be defined, for $ u < 0 $ and $ u > 0 $ respectively, by the formulas:

$$ dM( u) = \frac{1+ u ^ {2} }{u ^ {2} } dG( u), $$

$$ dN( u) = \frac{1+ u ^ {2} }{u ^ {2} } dG( u), $$

$$ M(- \infty ) = N ( \infty ) = 0 . $$

These functions are non-decreasing, $ M( u) \geq 0 $ for $ u < 0 $, and $ N( u) \leq 0 $ for $ u > 0 $; in a neighbourhood of zero the functions may be unbounded. If one denotes by $ \sigma ^ {2} $ the jump of $ G $ at zero, formula (*) may be rewritten as follows:

$$ \mathop{\rm ln} f( t) = i \gamma t - \frac{1}{2} \sigma ^ {2} t ^ {2} + \int\limits _ {- \infty } ^ {-0} L( u, t) dM( u) + $$

$$ + \int\limits_{+0}^ \infty L ( u, t) dN ( u) $$

(Lévy's canonical representation). The functions $ M $ and $ N $ describe, roughly speaking, the frequency of the jumps of varying quantities in the homogeneous process $ X ( \tau ) $ with independent increments for which

$$ \mathop{\rm ln} f _ \tau ( t) = \tau \mathop{\rm ln} f( t). $$

The importance of the role played in the limit theorems of probability theory by infinitely-divisible distributions is due to the fact that these and only these distributions can be the limit distributions for sums of independent random variables subject to the requirement of asymptotic negligibility. Consider the triangular array $ X _ {n1 } \dots X _ {nk _ {n} } $, $ n = 1, 2 \dots $ of mutually-independent random variables and select mutually-independent random variables $ Y _ {n1 } \dots Y _ {nk _ {n} } $ with infinitely-divisible distributions (the so-called accompanying infinitely-divisible distributions); the characteristic function $ g _ {nk } ( t) $ of the variable $ Y _ {nk } $ is defined in terms of the characteristic function $ f _ {nk } ( t) $ of the variable $ X _ {nk } $ so as to preserve the following basic property: The distributions of the sums

$$ \sum_{k=1}^ { {k _ n} } X _ {nk} - A _ {n} $$

converge to the same limit distribution (for a certain selection of the constants $ A _ {n} $) if and only if the sums

$$ \sum_{k=1}^ { {k _ n} } Y _ {nk} - A _ {n} $$

converge to a limit distribution. For a symmetric distribution $ X _ {nk } $ it is assumed that

$$ g _ {nk} ( t) = \mathop{\rm exp} ( f _ {nk} ( t) - 1) . $$

In other cases the expression for $ g _ {nk } $ is more complex, and contains the so-called truncated mathematical expectations of $ X _ {nk } $. The properties of infinitely-divisible distributions are described in terms of functions forming part of the canonical representations. For instance, an infinitely-divisible distribution function $ F( x) $ is continuous if and only if $ \int _ {- \infty } ^ {+ \infty } u ^ {-2} dG ( u) = \infty $.

An important special case of infinitely-divisible distributions are the so-called stable distributions (cf. Stable distribution). See also Infinitely-divisible distributions, factorization of.

References

[Fin]	D. de Finetti, "Sulla funzione a incremento aleatorio" Atti Accad. Naz. Lincei Sez. 1 (6) , 10 (1929) pp. 163–168
[Ko]	A.N. Kolmogorov, "Ancora sulla forma generale di un processo stocastico omogeneo" Atti Accad. Naz. Lincei Sez. 1 (6) , 15 (1932) pp. 866–869
[L]	P. Lévy, "Sur les intégrales dont les éléments sont des variables aléatoires indépendantes" Ann. Scuola Norm. Sup. Pisa Ser. 2 , 3 (1934) pp. 337–366 MR1556734 Zbl 0010.07004 Zbl 60.1157.01
[L2]	P. Lévy, "Théorie de l'addition des variables aléatoires" , Gauthier-Villars (1937)
[Kh]	A.Ya. Khinchin, "Limit laws for sums of independent random variables" , Moscow-Leningrad (1938) (In Russian)
[GK]	B.V. Gnedenko, A.N. Kolmogorov, "Limit distributions for sums of independent random variables" , Addison-Wesley (1954) (Translated from Russian) MR0062975 Zbl 0056.36001
[Fis]	M. Fisz, "Infinitely divisible distributions: recent results and applications" Ann. of Math. Statist. , 33 (1962) pp. 68–84 MR0139188 Zbl 0102.35103
[P]	V.V. Petrov, "Sums of independent random variables" , Springer (1975) (Translated from Russian) MR0388499 Zbl 0322.60043 Zbl 0322.60042
[ST]	V.V. Sazonov, V.N. Tutubalin, "Probability distributions on topological groups" Theory Probab. Appl. , 11 : 1 (1966) pp. 1–45 Teor. Veroyatnost. i Primenen. , 11 : 1 (1966) pp. 3–55 MR0199872 Zbl 0171.38701

References

[S]	F.W. Steutel, "Infinite divisibility in theory and practice" Scand. J. Statist., 6 (1979) pp. 57–64 MR0538596 Zbl 0402.62007
[F]	W. Feller, "An introduction to probability theory and its applications", 1–2, Wiley (1968–1971)