Namespaces
Variants
Actions

Difference between revisions of "Bernoulli theorem"

From Encyclopedia of Mathematics
Jump to: navigation, search
(→‎References: Bernoulli: Zbl)
m (tex encoded by computer)
 
(2 intermediate revisions by one other user not shown)
Line 1: Line 1:
 +
<!--
 +
b0156801.png
 +
$#A+1 = 25 n = 0
 +
$#C+1 = 25 : ~/encyclopedia/old_files/data/B015/B.0105680 Bernoulli theorem
 +
Automatically converted into TeX, above some diagnostics.
 +
Please remove this comment and the {{TEX|auto}} line below,
 +
if TeX found to be correct.
 +
-->
 +
 +
{{TEX|auto}}
 +
{{TEX|done}}
 +
 
{{MSC|60F05}}  
 
{{MSC|60F05}}  
  
 
[[Category:Limit theorems]]
 
[[Category:Limit theorems]]
  
The (historically) original form of the (weak) [[Law of large numbers|law of large numbers]]. The theorem appeared in the fourth part of Jacob Bernoulli's book Ars conjectandi (The art of conjecturing). This part may be considered as the first serious study ever of probability theory. The book was published in 1713 by N. Bernoulli (a nephew of Jacob Bernoulli). The theorem deals with sequences of independent trials, in each one of which the probability of occurrence of some event ( "success" ) is <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156801.png" />. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156802.png" /> be the number of trials and let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156803.png" /> be the random variable equal to the number of successful events. The Bernoulli theorem states that, whatever the value of the positive numbers <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156804.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156805.png" />, the probability <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156806.png" /> of the inequality
+
The (historically) original form of the (weak) [[Law of large numbers|law of large numbers]]. The theorem appeared in the fourth part of Jacob Bernoulli's book Ars conjectandi (The art of conjecturing). This part may be considered as the first serious study ever of probability theory. The book was published in 1713 by N. Bernoulli (a nephew of Jacob Bernoulli). The theorem deals with sequences of independent trials, in each one of which the probability of occurrence of some event ( "success" ) is $  p $.  
 +
Let $  n $
 +
be the number of trials and let $  m $
 +
be the random variable equal to the number of successful events. The Bernoulli theorem states that, whatever the value of the positive numbers $  \epsilon $
 +
and $  \eta $,  
 +
the probability $  {\mathsf P} $
 +
of the inequality
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156807.png" /></td> </tr></table>
+
$$
 +
- \epsilon  \leq 
 +
\frac{m}{n}
 +
- p  \leq  \epsilon
 +
$$
  
will be higher than <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156808.png" /> for all sufficiently large <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b0156809.png" /> (<img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568010.png" />). The proof of this theorem, which was given by Bernoulli and which was exclusively based on a study of the decrease of probabilities in the binomial distribution as one moves away from the most probable value, was accompanied by an inequality which made it possible to point out a certain bound for the given <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568011.png" /> if <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568012.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568013.png" /> were given. Thus, it was found by Bernoulli that if <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568014.png" />, the probability of the inequality
+
will be higher than $  1 - \eta $
 +
for all sufficiently large $  n $(
 +
$  n \geq  n _ {0} $).  
 +
The proof of this theorem, which was given by Bernoulli and which was exclusively based on a study of the decrease of probabilities in the binomial distribution as one moves away from the most probable value, was accompanied by an inequality which made it possible to point out a certain bound for the given $  n _ {0} $
 +
if $  \epsilon $
 +
and $  \eta $
 +
were given. Thus, it was found by Bernoulli that if $  p = 2/5 $,  
 +
the probability of the inequality
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568015.png" /></td> </tr></table>
+
$$
 +
{-  
 +
\frac{1}{50}
 +
}  \leq  {
 +
\frac{m}{n}
 +
} -
 +
{
 +
\frac{2}{5}
 +
}  \leq  {
 +
\frac{1}{50}
 +
}
 +
$$
  
will be higher than 0.999 if <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568016.png" />. By introducing a slight improvement in the original reasoning of Bernoulli, it is possible to conclude that it is sufficient to select a value of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568017.png" /> obeying the condition
+
will be higher than 0.999 if $  n \geq  25,550 $.  
 +
By introducing a slight improvement in the original reasoning of Bernoulli, it is possible to conclude that it is sufficient to select a value of $  n $
 +
obeying the condition
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568018.png" /></td> </tr></table>
+
$$
 +
>
 +
\frac{1 + \epsilon }{\epsilon  ^ {2} }
 +
\
 +
{ \mathop{\rm log} 
 +
\frac{1} \eta
 +
+
 +
\frac{1} \epsilon
 +
} ,
 +
$$
  
which gives in turn, for the probability <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568019.png" /> of the inequality
+
which gives in turn, for the probability $  1 - {\mathsf P} $
 +
of the inequality
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568020.png" /></td> </tr></table>
+
$$
 +
{\left |
 +
\frac{m}{n}
 +
- p \right | }  > \epsilon ,
 +
$$
  
 
an estimate of the form
 
an estimate of the form
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568021.png" /></td> </tr></table>
+
$$
 +
2  \mathop{\rm exp} \left \{ - {
 +
\frac{1}{2}
 +
} n \epsilon  ^ {2} \right \} .
 +
$$
  
The condition obtained for the above example is <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568022.png" /> (more sophisticated estimates show that it is sufficient to take <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568023.png" />; one may note, for the sake of comparison, that the de Moivre–Laplace theorem yields 6498 as the approximate value of <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568024.png" />). Other estimates for <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/b/b015/b015680/b01568025.png" /> may be obtained using the [[Bernstein inequality|Bernstein inequality]] and its analogues. See also [[Binomial distribution|Binomial distribution]].
+
The condition obtained for the above example is $  n \geq  17,665 $(
 +
more sophisticated estimates show that it is sufficient to take $  n \geq  6502 $;  
 +
one may note, for the sake of comparison, that the de Moivre–Laplace theorem yields 6498 as the approximate value of $  n _ {0} $).  
 +
Other estimates for $  1 - {\mathsf P} $
 +
may be obtained using the [[Bernstein inequality|Bernstein inequality]] and its analogues. See also [[Binomial distribution|Binomial distribution]].
  
 
====References====
 
====References====
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> J. Bernoulli, "Ars conjectandi" , ''Werke'' , '''3''' , Birkhäuser (1975) pp. 107–286 (Original: Basle, 1713) {{MR|2195221}} {{ZBL|0365.01016}}</TD></TR>
+
{|
<TR><TD valign="top">[2]</TD> <TD valign="top"> A.A. Markov, "Wahrscheinlichkeitsrechung" , Teubner (1912) (Translated from Russian) {{MR|}} {{ZBL|39.0292.02}} </TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top"> S.N. Bernshtein, "Probability theory" , Moscow-Leningrad (1946) (In Russian) {{MR|}} {{ZBL|53.0492.01}} </TD></TR></table>
+
|valign="top"|{{Ref|Bi}}|| J. Bernoulli, "Ars conjectandi" , ''Werke'' , '''3''' , Birkhäuser (1975) pp. 107–286 (Original: Basle, 1713) {{MR|2195221}} {{ZBL|0365.01016}}
 +
|-
 +
|valign="top"|{{Ref|M}}|| A.A. Markov, "Wahrscheinlichkeitsrechung" , Teubner (1912) (Translated from Russian) {{MR|}} {{ZBL|}}
 +
|-
 +
|valign="top"|{{Ref|Bn}}|| S.N. Bernshtein, "Probability theory" , Moscow-Leningrad (1946) (In Russian) {{MR|}} {{ZBL|53.0492.01}}
 +
|}
  
 
====Comments====
 
====Comments====
 
  
 
====References====
 
====References====
<table><TR><TD valign="top">[a1]</TD> <TD valign="top"> W. Feller, [[Feller, "An introduction to probability theory and its  applications"|"An introduction to probability theory and its  applications"]], '''1''' , Wiley (1965)</TD></TR>
+
{|
<TR><TD valign="top">[a2]</TD> <TD valign="top"> R.J. Serfling, "Approximation theorems of mathematical statistics" , Wiley (1980) pp. 6, 96 {{MR|0595165}} {{ZBL|0538.62002}} </TD></TR></table>
+
|valign="top"|{{Ref|F}}|| W. Feller, [[Feller, "An introduction to probability theory and its  applications"|"An introduction to probability theory and its  applications"]], '''1''' , Wiley (1965)
 +
|-
 +
|valign="top"|{{Ref|S}}|| R.J. Serfling, "Approximation theorems of mathematical statistics" , Wiley (1980) pp. 6, 96 {{MR|0595165}} {{ZBL|0538.62002}}
 +
|}

Latest revision as of 10:58, 29 May 2020


2020 Mathematics Subject Classification: Primary: 60F05 [MSN][ZBL]

The (historically) original form of the (weak) law of large numbers. The theorem appeared in the fourth part of Jacob Bernoulli's book Ars conjectandi (The art of conjecturing). This part may be considered as the first serious study ever of probability theory. The book was published in 1713 by N. Bernoulli (a nephew of Jacob Bernoulli). The theorem deals with sequences of independent trials, in each one of which the probability of occurrence of some event ( "success" ) is $ p $. Let $ n $ be the number of trials and let $ m $ be the random variable equal to the number of successful events. The Bernoulli theorem states that, whatever the value of the positive numbers $ \epsilon $ and $ \eta $, the probability $ {\mathsf P} $ of the inequality

$$ - \epsilon \leq \frac{m}{n} - p \leq \epsilon $$

will be higher than $ 1 - \eta $ for all sufficiently large $ n $( $ n \geq n _ {0} $). The proof of this theorem, which was given by Bernoulli and which was exclusively based on a study of the decrease of probabilities in the binomial distribution as one moves away from the most probable value, was accompanied by an inequality which made it possible to point out a certain bound for the given $ n _ {0} $ if $ \epsilon $ and $ \eta $ were given. Thus, it was found by Bernoulli that if $ p = 2/5 $, the probability of the inequality

$$ {- \frac{1}{50} } \leq { \frac{m}{n} } - { \frac{2}{5} } \leq { \frac{1}{50} } $$

will be higher than 0.999 if $ n \geq 25,550 $. By introducing a slight improvement in the original reasoning of Bernoulli, it is possible to conclude that it is sufficient to select a value of $ n $ obeying the condition

$$ n > \frac{1 + \epsilon }{\epsilon ^ {2} } \ { \mathop{\rm log} \frac{1} \eta + \frac{1} \epsilon } , $$

which gives in turn, for the probability $ 1 - {\mathsf P} $ of the inequality

$$ {\left | \frac{m}{n} - p \right | } > \epsilon , $$

an estimate of the form

$$ 2 \mathop{\rm exp} \left \{ - { \frac{1}{2} } n \epsilon ^ {2} \right \} . $$

The condition obtained for the above example is $ n \geq 17,665 $( more sophisticated estimates show that it is sufficient to take $ n \geq 6502 $; one may note, for the sake of comparison, that the de Moivre–Laplace theorem yields 6498 as the approximate value of $ n _ {0} $). Other estimates for $ 1 - {\mathsf P} $ may be obtained using the Bernstein inequality and its analogues. See also Binomial distribution.

References

[Bi] J. Bernoulli, "Ars conjectandi" , Werke , 3 , Birkhäuser (1975) pp. 107–286 (Original: Basle, 1713) MR2195221 Zbl 0365.01016
[M] A.A. Markov, "Wahrscheinlichkeitsrechung" , Teubner (1912) (Translated from Russian)
[Bn] S.N. Bernshtein, "Probability theory" , Moscow-Leningrad (1946) (In Russian) Zbl 53.0492.01

Comments

References

[F] W. Feller, "An introduction to probability theory and its applications", 1 , Wiley (1965)
[S] R.J. Serfling, "Approximation theorems of mathematical statistics" , Wiley (1980) pp. 6, 96 MR0595165 Zbl 0538.62002
How to Cite This Entry:
Bernoulli theorem. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Bernoulli_theorem&oldid=23725
This article was adapted from an original article by Yu.V. Prokhorov (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article