View source for Chebyshev inequality in probability theory

''Bienaymé–Chebyshev inequality''

{{MSC|60E15}}

[[Category:Distribution theory]]

An inequality in probability theory that gives a bound on the probability of deviation of a given random variable from its mathematical expectation in terms of its variance. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218901.png" /> be a random variable with finite mathematical expectation <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218902.png" /> and variance <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218903.png" />. Chebyshev's inequality states that for any <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218904.png" /> the probability of the event

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218905.png" /></td> </tr></table>

does not exceed <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218906.png" />, or

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218907.png" /></td> <td valign="top" style="width:5%;text-align:right;">(1)</td></tr></table>

This inequality was discovered independently by I. Bienaymé (1853) and P.L. Chebyshev (1866). In modern literature this inequality is usually referred to as Chebyshev's inequality, possibly because the name of Chebyshev is associated with an application of it in the proof of the [[Law of large numbers|law of large numbers]] (a theorem of Chebyshev).

Chebyshev's inequality is a representative of a whole class of inequalities of this type, the simplest of which asserts that for a non-negative random variable <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218908.png" /> with finite mathematical expectation <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c0218909.png" />,

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189010.png" /></td> <td valign="top" style="width:5%;text-align:right;">(2)</td></tr></table>

(this is sometimes called Markov's inequality). This implies an inequality for arbitrary random variables, which depends on the moments:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189011.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189012.png" /></td> </tr></table>

(for <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189013.png" /> this is just the Chebyshev inequality), and also the more general inequality

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189014.png" /></td> <td valign="top" style="width:5%;text-align:right;">(3)</td></tr></table>

for a non-negative even function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189015.png" /> that is non-decreasing for positive <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189016.png" />. Inequality (3) indicates a way to obtain new inequalities of the same type, for example the exponential inequality

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189017.png" /></td> </tr></table>

It has become traditional to consider all these inequalities to be of Chebyshev type, and even to call them Chebyshev inequalities. There is a general principle for obtaining Chebyshev inequalities by imposing conditions on the moments, based on the use of the system of Chebyshev polynomials (cf. [[#References|[4]]]). For arbitrary random variables the Chebyshev inequalities give precise and best possible bounds, but in certain concrete situations these bounds can be improved. For example, if <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189018.png" /> has a unimodal distribution with mode <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189019.png" /> coinciding with the mathematical expectation, then Gauss' inequality holds:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189020.png" /></td> </tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189021.png" />.

The importance of Chebyshev's inequality in probability theory lies not so much in its exactness, but in its simplicity and universality. Chebyshev's inequality and its modifications, applied to sums of random variables, played a large part in the proofs of various forms of the law of large numbers and the law of the iterated logarithm. Chebyshev's inequality for sums of independent random variables has been subject to generalization and improvement in two different directions. The first of these is connected with the transition from the Chebyshev inequality

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189022.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189023.png" /></td> </tr></table>

to the significantly stronger inequality

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189024.png" /></td> </tr></table>

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189025.png" /></td> </tr></table>

which was proved by A.N. Kolmogorov and applied by him to prove the [[Strong law of large numbers|strong law of large numbers]] (cf. [[Kolmogorov inequality|Kolmogorov inequality]]).

The second direction is concerned with replacing the power in Chebyshev's inequality by something with exponential decay, and leads to the Bernshtein–Kolmogorov inequality:

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189026.png" /></td> </tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189027.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189028.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189029.png" /> (cf. [[Bernstein inequality|Bernstein inequality]]). Such improvements of Chebyshev inequalities are obtained under additional restrictions on the summands <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/c/c021/c021890/c02189030.png" />.

Multi-dimensional analogues have been obtained of some of the inequalities stated here (cf. [[#References|[5]]]).

====References====
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> P.L. Chebyshev, ''Mat. Sb.'' , '''2''' (1867) pp. 1–9</TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top"> A.A. Markov, "Wahrscheinlichkeitsrechung" , Teubner (1912) (Translated from Russian) {{MR|}} {{ZBL|39.0292.02}} </TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top"> A.N. Kolmogorov, "Foundations of the theory of probability" , Chelsea, reprint (1950) (Translated from German) {{MR|0032961}} {{ZBL|}} </TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top"> S. Karlin, V. Studden, "Tchebycheff systems: with applications in analysis and statistics" , Interscience (1966) {{MR|0204922}} {{ZBL|0153.38902}} </TD></TR><TR><TD valign="top">[5]</TD> <TD valign="top"> Yu.V. Prokhorov, "Multivariate distributions: inequalities and limit theorems" ''J. Soviet Math.'' , '''2''' (1974) pp. 475–488 ''Itogi Nauk. i Tekhn. Teor. Veroyatnost. Mat. Stat. Teoret. Kibernet.'' , '''10''' (1972) pp. 5–24 {{MR|}} {{ZBL|0295.60013}} </TD></TR></table>