Difference between revisions of "Kolmogorov equation"
Ulf Rehmann (talk | contribs) m (MR/ZBL numbers added) |
Ulf Rehmann (talk | contribs) m (tex encoded by computer) |
||
(2 intermediate revisions by one other user not shown) | |||
Line 1: | Line 1: | ||
+ | <!-- | ||
+ | k0557001.png | ||
+ | $#A+1 = 48 n = 0 | ||
+ | $#C+1 = 48 : ~/encyclopedia/old_files/data/K055/K.0505700 Kolmogorov equation | ||
+ | Automatically converted into TeX, above some diagnostics. | ||
+ | Please remove this comment and the {{TEX|auto}} line below, | ||
+ | if TeX found to be correct. | ||
+ | --> | ||
+ | |||
+ | {{TEX|auto}} | ||
+ | {{TEX|done}} | ||
+ | |||
{{MSC|60J35}} | {{MSC|60J35}} | ||
Line 5: | Line 17: | ||
An equation of the form | An equation of the form | ||
− | + | $$ \tag{1 } | |
+ | |||
+ | \frac{\partial f }{\partial s } | ||
+ | = - A _ {s} f | ||
+ | $$ | ||
+ | |||
+ | (the inverse, backward or first, equation; $ s < t $), | ||
+ | or of the form | ||
− | + | $$ \tag{2 } | |
− | + | \frac{\partial f }{\partial t } | |
+ | = A _ {t} ^ {*} f | ||
+ | $$ | ||
− | (the direct, forward or second, equation; | + | (the direct, forward or second, equation; $ t > s $), |
+ | for the [[Transition function|transition function]] $ f = P ( s , x ; t , \Gamma ) $, | ||
+ | $ 0 \leq s\leq t < \infty $, | ||
+ | $ x \in E $, | ||
+ | $ \Gamma \in \mathfrak B $, | ||
+ | $ ( E , \mathfrak B ) $ | ||
+ | being a measurable space, or its density $ f = p ( s , x ; t, \Gamma ) $, | ||
+ | if it exists. For the transition function $ P ( s , x ; t , \Gamma ) $ | ||
+ | the condition | ||
− | + | $$ | |
+ | \lim\limits _ {s \uparrow t } \ | ||
+ | P ( s , x ; t , \Gamma ) = I _ \Gamma ( x) | ||
+ | $$ | ||
is adjoined to equation (1), and the condition | is adjoined to equation (1), and the condition | ||
− | + | $$ | |
+ | \lim\limits _ {t \downarrow s } \ | ||
+ | P ( s , x ; t , \Gamma ) = I _ \Gamma ( x) | ||
+ | $$ | ||
− | is adjoined to equation (2), where | + | is adjoined to equation (2), where $ I _ \Gamma ( x) $ |
+ | is the indicator function of the set $ \Gamma $; | ||
+ | in this case the operator $ A _ {s} $ | ||
+ | is an operator acting in a function space, while $ A _ {t} ^ {*} $ | ||
+ | acts in a space of generalized measures. | ||
− | For a [[Markov process|Markov process]] with a countable set of states, the transition function is completely determined by the transition probabilities | + | For a [[Markov process|Markov process]] with a countable set of states, the transition function is completely determined by the transition probabilities $ p _ {ij} ( s , t ) = P ( s , i ; t , \{ j \} ) $( |
+ | from the state $ i $ | ||
+ | at instant $ s $ | ||
+ | to the state $ j $ | ||
+ | at instant $ t $), | ||
+ | for which the backward and forward Kolmogorov equations have (under certain extra assumptions) the form | ||
− | + | $$ \tag{3 } | |
− | + | \frac{\partial p _ {ij} ( s , t ) }{\partial s } | |
+ | = \ | ||
+ | \sum _ { k } | ||
+ | \alpha _ {ik} ( s) p _ {kj} ( s , t ) ,\ s < t , | ||
+ | $$ | ||
+ | |||
+ | $$ \tag{4 } | ||
+ | |||
+ | \frac{\partial p ^ {ij} ( s , t ) }{\partial t } | ||
+ | = \ | ||
+ | \sum _ { k } p _ {ik} ( s , t ) \alpha _ {kj} ( t) ,\ t > s , | ||
+ | $$ | ||
where | where | ||
− | + | $$ \tag{5 } | |
+ | \alpha _ {ij} ( s) = \ | ||
+ | \lim\limits _ {\begin{array}{c} | ||
+ | s _ {1} \uparrow s \\ | ||
+ | s _ {2} \uparrow s | ||
+ | \end{array} | ||
+ | } \ | ||
+ | |||
+ | \frac{p _ {ij} ( s _ {1} , s _ {2} ) - \delta _ {ij} }{s _ {2} - s _ {1} } | ||
+ | . | ||
+ | $$ | ||
In the case of a finite number of states, equations (3) and (4) hold, provided that the limits in (5) exist. | In the case of a finite number of states, equations (3) and (4) hold, provided that the limits in (5) exist. | ||
− | Another important class of processes for which the question of the validity of equations (1) and (2) has been studied in detail is the class of processes of diffusion type. These are defined by the condition that their transition functions | + | Another important class of processes for which the question of the validity of equations (1) and (2) has been studied in detail is the class of processes of diffusion type. These are defined by the condition that their transition functions $ P ( s , x ; t , \Gamma ) $, |
+ | $ x \in \mathbf R $, | ||
+ | $ \Gamma \in \mathfrak B ( \mathbf R ) $, | ||
+ | satisfy the following conditions: | ||
− | a) for each | + | a) for each $ x \in \mathbf R $ |
+ | and $ \epsilon > 0 $, | ||
− | + | $$ | |
+ | \int\limits _ {| x - y | > \epsilon } | ||
+ | P ( s , x ; t , d y ) = \ | ||
+ | o ( t - s ) , | ||
+ | $$ | ||
− | uniformly in | + | uniformly in $ s $, |
+ | $ s < t $; | ||
− | b) there exist functions | + | b) there exist functions $ a ( s , x ) $ |
+ | and $ b ( s , x ) $ | ||
+ | such that for every $ x $ | ||
+ | and $ \epsilon > 0 $, | ||
− | + | $$ | |
+ | \int\limits _ {| x - y | \leq \epsilon } | ||
+ | ( y - x ) P ( s , x ; t , d y ) | ||
+ | = a ( s , x ) ( t - s ) + o ( t - s ) , | ||
+ | $$ | ||
− | + | $$ | |
+ | \int\limits _ {| x - y | \leq \epsilon } ( y - x ) ^ {2} P ( s , x ; t | ||
+ | , d y ) = b ( s , x ) ( t - s ) + o ( t - s ) , | ||
+ | $$ | ||
− | uniformly in | + | uniformly in $ s $, |
+ | $ s < t $. | ||
+ | If the density $ p = p ( s , x ; t , y ) $ | ||
+ | exists, then (under certain extra assumptions) the forward equation | ||
− | + | $$ | |
− | + | \frac{\partial p }{\partial t } | |
+ | = - | ||
− | + | \frac \partial {\partial y } | |
+ | ( a p ) + | ||
+ | \frac{1}{2} | ||
− | + | \frac{\partial ^ {2} }{\partial y ^ {2} } | |
− | + | ( b p ) | |
+ | $$ | ||
+ | |||
+ | holds (for $ t > s $ | ||
+ | and $ y \in \mathbf R $) | ||
+ | (also called the Fokker–Planck equation), while the backward equation (for $ s < t $ | ||
+ | and $ x \in \mathbf R $) | ||
+ | has the form | ||
+ | |||
+ | $$ | ||
+ | - | ||
+ | \frac{\partial p }{\partial s } | ||
+ | = \ | ||
+ | a | ||
+ | \frac{\partial p }{\partial x } | ||
+ | + | ||
+ | \frac{1}{2} | ||
+ | b | ||
+ | \frac{\partial ^ {2} p }{\partial x ^ {2} } | ||
+ | . | ||
+ | $$ | ||
+ | ====References==== | ||
+ | {| | ||
+ | |valign="top"|{{Ref|K}}|| A.N. Kolmogorov, "Ueber die analytischen Methoden in der Wahrscheinlichkeitsrechnung" ''Math. Ann.'' , '''104''' (1931) pp. 415–458 | ||
+ | |- | ||
+ | |valign="top"|{{Ref|GS}}|| I.I. Gihman, A.V. Skorohod, "The theory of stochastic processes" , '''2''' , Springer (1979) (Translated from Russian) {{MR|0651014}} {{MR|0651015}} {{ZBL|0404.60061}} | ||
+ | |} | ||
====Comments==== | ====Comments==== | ||
Line 66: | Line 182: | ||
====References==== | ====References==== | ||
− | + | {| | |
+ | |valign="top"|{{Ref|L}}|| P. Lévy, "Processus stochastiques et mouvement Brownien" , Gauthier-Villars (1965) {{MR|0190953}} {{ZBL|0137.11602}} | ||
+ | |- | ||
+ | |valign="top"|{{Ref|D}}|| E.B. Dynkin, "Markov processes" , '''1''' , Springer (1965) pp. Sect. 5.26 (Translated from Russian) {{MR|0193671}} {{ZBL|0132.37901}} | ||
+ | |- | ||
+ | |valign="top"|{{Ref|F}}|| W. Feller, [[Feller, "An introduction to probability theory and its applications"|"An introduction to probability theory and its applications"]] , '''1''' , Wiley (1966) pp. Chapt. XV.13 | ||
+ | |} |
Latest revision as of 22:14, 5 June 2020
2020 Mathematics Subject Classification: Primary: 60J35 [MSN][ZBL]
An equation of the form
$$ \tag{1 } \frac{\partial f }{\partial s } = - A _ {s} f $$
(the inverse, backward or first, equation; $ s < t $), or of the form
$$ \tag{2 } \frac{\partial f }{\partial t } = A _ {t} ^ {*} f $$
(the direct, forward or second, equation; $ t > s $), for the transition function $ f = P ( s , x ; t , \Gamma ) $, $ 0 \leq s\leq t < \infty $, $ x \in E $, $ \Gamma \in \mathfrak B $, $ ( E , \mathfrak B ) $ being a measurable space, or its density $ f = p ( s , x ; t, \Gamma ) $, if it exists. For the transition function $ P ( s , x ; t , \Gamma ) $ the condition
$$ \lim\limits _ {s \uparrow t } \ P ( s , x ; t , \Gamma ) = I _ \Gamma ( x) $$
is adjoined to equation (1), and the condition
$$ \lim\limits _ {t \downarrow s } \ P ( s , x ; t , \Gamma ) = I _ \Gamma ( x) $$
is adjoined to equation (2), where $ I _ \Gamma ( x) $ is the indicator function of the set $ \Gamma $; in this case the operator $ A _ {s} $ is an operator acting in a function space, while $ A _ {t} ^ {*} $ acts in a space of generalized measures.
For a Markov process with a countable set of states, the transition function is completely determined by the transition probabilities $ p _ {ij} ( s , t ) = P ( s , i ; t , \{ j \} ) $( from the state $ i $ at instant $ s $ to the state $ j $ at instant $ t $), for which the backward and forward Kolmogorov equations have (under certain extra assumptions) the form
$$ \tag{3 } \frac{\partial p _ {ij} ( s , t ) }{\partial s } = \ \sum _ { k } \alpha _ {ik} ( s) p _ {kj} ( s , t ) ,\ s < t , $$
$$ \tag{4 } \frac{\partial p ^ {ij} ( s , t ) }{\partial t } = \ \sum _ { k } p _ {ik} ( s , t ) \alpha _ {kj} ( t) ,\ t > s , $$
where
$$ \tag{5 } \alpha _ {ij} ( s) = \ \lim\limits _ {\begin{array}{c} s _ {1} \uparrow s \\ s _ {2} \uparrow s \end{array} } \ \frac{p _ {ij} ( s _ {1} , s _ {2} ) - \delta _ {ij} }{s _ {2} - s _ {1} } . $$
In the case of a finite number of states, equations (3) and (4) hold, provided that the limits in (5) exist.
Another important class of processes for which the question of the validity of equations (1) and (2) has been studied in detail is the class of processes of diffusion type. These are defined by the condition that their transition functions $ P ( s , x ; t , \Gamma ) $, $ x \in \mathbf R $, $ \Gamma \in \mathfrak B ( \mathbf R ) $, satisfy the following conditions:
a) for each $ x \in \mathbf R $ and $ \epsilon > 0 $,
$$ \int\limits _ {| x - y | > \epsilon } P ( s , x ; t , d y ) = \ o ( t - s ) , $$
uniformly in $ s $, $ s < t $;
b) there exist functions $ a ( s , x ) $ and $ b ( s , x ) $ such that for every $ x $ and $ \epsilon > 0 $,
$$ \int\limits _ {| x - y | \leq \epsilon } ( y - x ) P ( s , x ; t , d y ) = a ( s , x ) ( t - s ) + o ( t - s ) , $$
$$ \int\limits _ {| x - y | \leq \epsilon } ( y - x ) ^ {2} P ( s , x ; t , d y ) = b ( s , x ) ( t - s ) + o ( t - s ) , $$
uniformly in $ s $, $ s < t $. If the density $ p = p ( s , x ; t , y ) $ exists, then (under certain extra assumptions) the forward equation
$$ \frac{\partial p }{\partial t } = - \frac \partial {\partial y } ( a p ) + \frac{1}{2} \frac{\partial ^ {2} }{\partial y ^ {2} } ( b p ) $$
holds (for $ t > s $ and $ y \in \mathbf R $) (also called the Fokker–Planck equation), while the backward equation (for $ s < t $ and $ x \in \mathbf R $) has the form
$$ - \frac{\partial p }{\partial s } = \ a \frac{\partial p }{\partial x } + \frac{1}{2} b \frac{\partial ^ {2} p }{\partial x ^ {2} } . $$
References
[K] | A.N. Kolmogorov, "Ueber die analytischen Methoden in der Wahrscheinlichkeitsrechnung" Math. Ann. , 104 (1931) pp. 415–458 |
[GS] | I.I. Gihman, A.V. Skorohod, "The theory of stochastic processes" , 2 , Springer (1979) (Translated from Russian) MR0651014 MR0651015 Zbl 0404.60061 |
Comments
Besides in a probabilistic context, Kolmogorov equations of course also occur as equations modelling real diffusions, such as the diffusion of molecules of a substance through porous material or the spread of some property through a biological structured population.
See also (the editorial comments to) Einstein–Smoluchowski equation.
References
[L] | P. Lévy, "Processus stochastiques et mouvement Brownien" , Gauthier-Villars (1965) MR0190953 Zbl 0137.11602 |
[D] | E.B. Dynkin, "Markov processes" , 1 , Springer (1965) pp. Sect. 5.26 (Translated from Russian) MR0193671 Zbl 0132.37901 |
[F] | W. Feller, "An introduction to probability theory and its applications" , 1 , Wiley (1966) pp. Chapt. XV.13 |
Kolmogorov equation. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Kolmogorov_equation&oldid=23613