Bernoulli theorem
[ 2010 Mathematics Subject Classification MSN: 60F05 | MSCwiki: 60F05 ]
The (historically) original form of the (weak) law of large numbers. The theorem appeared in the fourth part of Jacob Bernoulli's book Ars conjectandi (The art of conjecturing). This part may be considered as the first serious study ever of probability theory. The book was published in 1713 by N. Bernoulli (a nephew of Jacob Bernoulli). The theorem deals with sequences of independent trials, in each one of which the probability of occurrence of some event ( "success" ) is 
. Let 
be the number of trials and let 
be the random variable equal to the number of successful events. The Bernoulli theorem states that, whatever the value of the positive numbers 
and 
, the probability 
of the inequality
 |
will be higher than 
for all sufficiently large 
(
). The proof of this theorem, which was given by Bernoulli and which was exclusively based on a study of the decrease of probabilities in the binomial distribution as one moves away from the most probable value, was accompanied by an inequality which made it possible to point out a certain bound for the given 
if 
and 
were given. Thus, it was found by Bernoulli that if 
, the probability of the inequality
 |
will be higher than 0.999 if 
. By introducing a slight improvement in the original reasoning of Bernoulli, it is possible to conclude that it is sufficient to select a value of 
obeying the condition
 |
which gives in turn, for the probability 
of the inequality
 |
an estimate of the form
 |
The condition obtained for the above example is 
(more sophisticated estimates show that it is sufficient to take 
; one may note, for the sake of comparison, that the de Moivre–Laplace theorem yields 6498 as the approximate value of 
). Other estimates for 
may be obtained using the Bernstein inequality and its analogues. See also Binomial distribution.
References
| [1] | J. Bernoulli, "Ars conjectandi" , Werke , 3 , Birkhäuser (1975) pp. 107–286 (Original: Basle, 1713) |
| [2] | A.A. Markov, "Wahrscheinlichkeitsrechung" , Teubner (1912) (Translated from Russian) |
| [3] | S.N. Bernshtein, "Probability theory" , Moscow-Leningrad (1946) (In Russian) |
Comments
References
| [a1] | W. Feller, "An introduction to probability theory and its applications" , 1 , Wiley (1965) |
| [a2] | R.J. Serfling, "Approximation theorems of mathematical statistics" , Wiley (1980) pp. 6, 96 |
Bernoulli theorem. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Bernoulli_theorem&oldid=20665