Namespaces
Variants
Actions

Difference between revisions of "Probability of large deviations"

From Encyclopedia of Mathematics
Jump to: navigation, search
(Importing text file)
 
m (MR/ZBL numbers added)
Line 18: Line 18:
  
 
====References====
 
====References====
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> M. Loève,   "Probability theory" , Springer (1977)</TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top"> V.V. Petrov,   "Sums of independent random variables" , Springer (1975) (Translated from Russian)</TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top"> I.A. Ibragimov,   Yu.V. Linnik,   "Independent and stationary sequences of random variables" , Wolters-Noordhoff (1971) (Translated from Russian)</TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top"> Yu.V. Prokhorov,   "Multidimensional distributions: inequalities and limit theorems" ''J. Soviet Math.'' , '''2''' : 5 (1976) pp. 475–488 ''Itogi Nauk. i Tekhn.'' , '''10''' (1972) pp. 5–24</TD></TR><TR><TD valign="top">[5]</TD> <TD valign="top"> V.V. Yurinskii,   "Exponential bounds for large deviations" ''Theory Probab. Appl.'' , '''19''' : 1 (1974) pp. 154–159 ''Teor. Veroyatnost. i Primenen.'' , '''19''' : 1 (1974) pp. 152–153</TD></TR></table>
+
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> M. Loève, "Probability theory" , Springer (1977) {{MR|0651017}} {{MR|0651018}} {{ZBL|0359.60001}} </TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top"> V.V. Petrov, "Sums of independent random variables" , Springer (1975) (Translated from Russian) {{MR|0388499}} {{ZBL|0322.60043}} {{ZBL|0322.60042}} </TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top"> I.A. Ibragimov, Yu.V. Linnik, "Independent and stationary sequences of random variables" , Wolters-Noordhoff (1971) (Translated from Russian) {{MR|0322926}} {{ZBL|0219.60027}} </TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top"> Yu.V. Prokhorov, "Multidimensional distributions: inequalities and limit theorems" ''J. Soviet Math.'' , '''2''' : 5 (1976) pp. 475–488 ''Itogi Nauk. i Tekhn.'' , '''10''' (1972) pp. 5–24</TD></TR><TR><TD valign="top">[5]</TD> <TD valign="top"> V.V. Yurinskii, "Exponential bounds for large deviations" ''Theory Probab. Appl.'' , '''19''' : 1 (1974) pp. 154–159 ''Teor. Veroyatnost. i Primenen.'' , '''19''' : 1 (1974) pp. 152–153</TD></TR></table>
  
  
Line 28: Line 28:
  
 
====References====
 
====References====
<table><TR><TD valign="top">[a1]</TD> <TD valign="top"> R.S. Ellis,   "Entropy, large deviations, and statistical mechanics" , Springer (1985)</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top"> D.W. Stroock,   "An introduction to the theory of large deviations" , Springer (1984)</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top"> A.D. [A.D. Ventsel'] Wentzell,   "Limit theorems on large deviations for Markov stochastic processes" , Kluwer (1990) (Translated from Russian)</TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top"> H. Cramér,   "Sur un nouveau théorème-limite de la théorie des probabilités" , ''Act. Sci. et Ind.'' , '''736''' , Hermann (1938) pp. 5–24</TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top"> P. Groeneboom,   J. Oosterhoff,   F.H. Ruymgaart,   "Large deviation theorems for empirical probability measures" ''Ann. Probl.'' , '''7''' (1979) pp. 553–586</TD></TR></table>
+
<table><TR><TD valign="top">[a1]</TD> <TD valign="top"> R.S. Ellis, "Entropy, large deviations, and statistical mechanics" , Springer (1985) {{MR|0793553}} {{ZBL|0566.60097}} </TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top"> D.W. Stroock, "An introduction to the theory of large deviations" , Springer (1984) {{MR|0755154}} {{MR|0758258}} {{ZBL|0552.60022}} </TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top"> A.D. [A.D. Ventsel'] Wentzell, "Limit theorems on large deviations for Markov stochastic processes" , Kluwer (1990) (Translated from Russian) {{MR|1135113}} {{ZBL|0743.60029}} </TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top"> H. Cramér, "Sur un nouveau théorème-limite de la théorie des probabilités" , ''Act. Sci. et Ind.'' , '''736''' , Hermann (1938) pp. 5–24 {{MR|}} {{ZBL|64.0529.01}} </TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top"> P. Groeneboom, J. Oosterhoff, F.H. Ruymgaart, "Large deviation theorems for empirical probability measures" ''Ann. Probl.'' , '''7''' (1979) pp. 553–586 {{MR|0537208}} {{ZBL|0425.60021}} </TD></TR></table>

Revision as of 10:31, 27 March 2012

A probability of the type

where

is a sequence of independent random variables, and and are two numerical sequences such that , and in probability.

If the random variables have the same distribution with mathematical expectation zero and finite variance , one may write and , where as . Cramér's theorem and strengthened versions of it are particularly important in this connection (cf. Cramér theorem).

To obtain guaranteed bounds for the probability of large deviations one uses inequalities of the type of the Chebyshev inequality in probability theory; these provide the so-called exponential bounds for the probability of large deviations. For instance, if the random variables are independent, , , with probability one, and , then the estimate

the right-hand side of which decreases exponentially with increasing , is valid for all .

References

[1] M. Loève, "Probability theory" , Springer (1977) MR0651017 MR0651018 Zbl 0359.60001
[2] V.V. Petrov, "Sums of independent random variables" , Springer (1975) (Translated from Russian) MR0388499 Zbl 0322.60043 Zbl 0322.60042
[3] I.A. Ibragimov, Yu.V. Linnik, "Independent and stationary sequences of random variables" , Wolters-Noordhoff (1971) (Translated from Russian) MR0322926 Zbl 0219.60027
[4] Yu.V. Prokhorov, "Multidimensional distributions: inequalities and limit theorems" J. Soviet Math. , 2 : 5 (1976) pp. 475–488 Itogi Nauk. i Tekhn. , 10 (1972) pp. 5–24
[5] V.V. Yurinskii, "Exponential bounds for large deviations" Theory Probab. Appl. , 19 : 1 (1974) pp. 154–159 Teor. Veroyatnost. i Primenen. , 19 : 1 (1974) pp. 152–153


Comments

There are substantial new developments which link the rate of exponential decay to entropy. These developments find widespread use in statistical physics and in statistics. Cf. Limit theorems and [a1], [a2].

A second recent development concerns the development of limit theorems and large deviation theory for stochastic processes instead of sums of independent random variables, cf. [a3].

References

[a1] R.S. Ellis, "Entropy, large deviations, and statistical mechanics" , Springer (1985) MR0793553 Zbl 0566.60097
[a2] D.W. Stroock, "An introduction to the theory of large deviations" , Springer (1984) MR0755154 MR0758258 Zbl 0552.60022
[a3] A.D. [A.D. Ventsel'] Wentzell, "Limit theorems on large deviations for Markov stochastic processes" , Kluwer (1990) (Translated from Russian) MR1135113 Zbl 0743.60029
[a4] H. Cramér, "Sur un nouveau théorème-limite de la théorie des probabilités" , Act. Sci. et Ind. , 736 , Hermann (1938) pp. 5–24 Zbl 64.0529.01
[a5] P. Groeneboom, J. Oosterhoff, F.H. Ruymgaart, "Large deviation theorems for empirical probability measures" Ann. Probl. , 7 (1979) pp. 553–586 MR0537208 Zbl 0425.60021
How to Cite This Entry:
Probability of large deviations. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Probability_of_large_deviations&oldid=16113
This article was adapted from an original article by V.V. PetrovV.V. Yurinskii (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article