Namespaces
Variants
Actions

Difference between revisions of "A posteriori distribution"

From Encyclopedia of Mathematics
Jump to: navigation, search
(TeX)
m
 
(One intermediate revision by one other user not shown)
Line 2: Line 2:
 
A conditional probability distribution of a random variable, to be contrasted with its unconditional or [[A priori distribution|a priori distribution]].
 
A conditional probability distribution of a random variable, to be contrasted with its unconditional or [[A priori distribution|a priori distribution]].
  
Let $\Theta$ be a random parameter with an a priori density $p(\theta)$, let $X$ be a random result of observations and let $p(x|\theta)$ be the conditional density of $X$ when $\Theta=\theta$; then the a posteriori distribution of $\Theta$ for a given $X=x$, according to the [[Bayes formula|Bayes formula]], has the density
+
Let $\Theta$ be a random parameter with an a priori density $p(\theta)$, let $X$ be a random result of observations and let $p(x\mid\theta)$ be the conditional density of $X$ when $\Theta=\theta$; then the a posteriori distribution of $\Theta$ for a given $X=x$, according to the [[Bayes formula|Bayes formula]], has the density
  
$$p(\theta|x)=\frac{p(\theta)p(x|\theta)}{\int\limits_{-\infty}^\infty p(\theta)p(x|\theta)d\theta}.$$
+
$$p(\theta\mid x)=\frac{p(\theta)p(x\mid\theta)}{\int\limits_{-\infty}^\infty p(\theta)p(x\mid\theta)\,d\theta}.$$
  
If $T(x)$ is a [[Sufficient statistic|sufficient statistic]] for the family of distributions with densities $p(x|\theta)$, then the a posteriori distribution depends not on $x$ itself, but on $T(x)$. The asymptotic behaviour of the a posteriori distribution $p(\theta|x_1,\dots,x_n)$ as $n\to\infty$, where $x_j$ are the results of independent observations with density $p(x|\theta_0)$, is  "almost independent"  of the a priori distribution of $\Theta$.
+
If $T(x)$ is a [[Sufficient statistic|sufficient statistic]] for the family of distributions with densities $p(x\mid\theta)$, then the a posteriori distribution depends not on $x$ itself, but on $T(x)$. The asymptotic behaviour of the a posteriori distribution $p(\theta\mid x_1,\dots,x_n)$ as $n\to\infty$, where $x_j$ are the results of independent observations with density $p(x\mid\theta_0)$, is  "almost independent"  of the a priori distribution of $\Theta$.
  
For the role played by a posteriori distributions in the theory of statistical decisions, see [[Bayesian approach|Bayesian approach]].
+
For the role played by a posteriori distributions in the [[statistical decision theory]], see [[Bayesian approach|Bayesian approach]].
  
 
====References====
 
====References====

Latest revision as of 21:34, 1 January 2019

A conditional probability distribution of a random variable, to be contrasted with its unconditional or a priori distribution.

Let $\Theta$ be a random parameter with an a priori density $p(\theta)$, let $X$ be a random result of observations and let $p(x\mid\theta)$ be the conditional density of $X$ when $\Theta=\theta$; then the a posteriori distribution of $\Theta$ for a given $X=x$, according to the Bayes formula, has the density

$$p(\theta\mid x)=\frac{p(\theta)p(x\mid\theta)}{\int\limits_{-\infty}^\infty p(\theta)p(x\mid\theta)\,d\theta}.$$

If $T(x)$ is a sufficient statistic for the family of distributions with densities $p(x\mid\theta)$, then the a posteriori distribution depends not on $x$ itself, but on $T(x)$. The asymptotic behaviour of the a posteriori distribution $p(\theta\mid x_1,\dots,x_n)$ as $n\to\infty$, where $x_j$ are the results of independent observations with density $p(x\mid\theta_0)$, is "almost independent" of the a priori distribution of $\Theta$.

For the role played by a posteriori distributions in the statistical decision theory, see Bayesian approach.

References

[1] S.N. Bernshtein, "Probability theory" , Moscow-Leningrad (1946) (In Russian)


Comments

References

[a1] E. Sverdrup, "Laws and chance variations" , 1 , North-Holland (1967) pp. 214ff
How to Cite This Entry:
A posteriori distribution. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=A_posteriori_distribution&oldid=33451
This article was adapted from an original article by Yu.V. Prokhorov (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article