Namespaces
Variants
Actions

Difference between revisions of "Hamilton-Jacobi theory"

From Encyclopedia of Mathematics
Jump to: navigation, search
m (tex encoded by computer)
 
Line 1: Line 1:
 +
<!--
 +
h0462301.png
 +
$#A+1 = 33 n = 0
 +
$#C+1 = 33 : ~/encyclopedia/old_files/data/H046/H.0406230 Hamilton\ANDJacobi theory
 +
Automatically converted into TeX, above some diagnostics.
 +
Please remove this comment and the {{TEX|auto}} line below,
 +
if TeX found to be correct.
 +
-->
 +
 +
{{TEX|auto}}
 +
{{TEX|done}}
 +
 
A branch of classical variational calculus and analytical mechanics in which the task of finding extremals (or the task of integrating a Hamiltonian system of equations) is reduced to the integration of a first-order partial differential equation — the so-called Hamilton–Jacobi equation. The fundamentals of the Hamilton–Jacobi theory were developed by W. Hamilton in the 1820s for problems in wave optics and geometrical optics. In 1834 Hamilton extended his ideas to problems in dynamics, and C.G.J. Jacobi (1837) applied the method to the general problems of classical variational calculus.
 
A branch of classical variational calculus and analytical mechanics in which the task of finding extremals (or the task of integrating a Hamiltonian system of equations) is reduced to the integration of a first-order partial differential equation — the so-called Hamilton–Jacobi equation. The fundamentals of the Hamilton–Jacobi theory were developed by W. Hamilton in the 1820s for problems in wave optics and geometrical optics. In 1834 Hamilton extended his ideas to problems in dynamics, and C.G.J. Jacobi (1837) applied the method to the general problems of classical variational calculus.
  
The starting points of the Hamilton–Jacobi theory were established in the 17th century by P. Fermat and Chr. Huygens, who used the subject of geometrical optics for this purpose (cf. [[Fermat principle|Fermat principle]]; [[Huygens principle|Huygens principle]]). Below the footsteps of Hamilton are followed and the problem of propagation of light through an inhomogeneous (but, for the sake of simplicity, isotropic) medium, is considered where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462301.png" /> is the local velocity of light at a point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462302.png" />. According to Fermat's principle, light propagates from point to point in an inhomogeneous medium in shortest possible time. Let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462303.png" /> be the starting point, and let <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462304.png" /> be the shortest possible time for the light to traverse the distance from <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462305.png" /> to <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462306.png" />. The function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462307.png" /> is known as the eikonal or the optical length of the path. It is assumed that during a short time <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462308.png" /> the light travels from the point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h0462309.png" /> to the point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623010.png" />. According to the [[Huygens principle|Huygens principle]], light will travel, apart from small magnitudes of a higher order, along the normal to the level surface of the function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623011.png" />. Thus, the equation
+
The starting points of the Hamilton–Jacobi theory were established in the 17th century by P. Fermat and Chr. Huygens, who used the subject of geometrical optics for this purpose (cf. [[Fermat principle|Fermat principle]]; [[Huygens principle|Huygens principle]]). Below the footsteps of Hamilton are followed and the problem of propagation of light through an inhomogeneous (but, for the sake of simplicity, isotropic) medium, is considered where $  v( x) $
 +
is the local velocity of light at a point $  x $.  
 +
According to Fermat's principle, light propagates from point to point in an inhomogeneous medium in shortest possible time. Let $  x _ {0} \in E $
 +
be the starting point, and let $  W( x) $
 +
be the shortest possible time for the light to traverse the distance from $  x _ {0} $
 +
to $  x $.  
 +
The function $  W( x) $
 +
is known as the eikonal or the optical length of the path. It is assumed that during a short time $  dt $
 +
the light travels from the point $  x $
 +
to the point $  x + dx $.  
 +
According to the [[Huygens principle|Huygens principle]], light will travel, apart from small magnitudes of a higher order, along the normal to the level surface of the function $  W ( x) $.  
 +
Thus, the equation
 +
 
 +
$$
 +
W \left (
 +
x +
 +
\frac{W  ^  \prime  ( x) }{| W  ^  \prime  ( x) | }
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623012.png" /></td> </tr></table>
+
v ( x)  dt
 +
\right )  = \
 +
W ( x) + dt + o ( dt)
 +
$$
  
 
is satisfied, and the Hamilton–Jacobi equation for problems in geometrical optics follows:
 
is satisfied, and the Hamilton–Jacobi equation for problems in geometrical optics follows:
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623013.png" /></td> </tr></table>
+
$$
 +
| W  ^  \prime  ( x) |  ^ {2}  = \
 +
{
 +
\frac{1}{v  ^ {2} ( x) }
 +
} \  \iff \ \
 +
\sum _ {i = 1 } ^ { 3 }
 +
\left (
 +
 
 +
\frac{\partial  W ( x) }{\partial  x _ {i} }
 +
 
 +
\right )  ^ {2}  = \
 +
{
 +
\frac{1}{v  ^ {2} ( x) }
 +
} .
 +
$$
  
 
In analytical mechanics the role of Fermat's principle is played by the variational [[Hamilton–Ostrogradski principle|Hamilton–Ostrogradski principle]], while the role of the eikonal is played by the action functional, i.e. by the integral
 
In analytical mechanics the role of Fermat's principle is played by the variational [[Hamilton–Ostrogradski principle|Hamilton–Ostrogradski principle]], while the role of the eikonal is played by the action functional, i.e. by the integral
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623014.png" /></td> <td valign="top" style="width:5%;text-align:right;">(1)</td></tr></table>
+
$$ \tag{1 }
 +
S ( t, x)  = \
 +
\int\limits _  \gamma  L  dt,\ \
 +
x = ( x _ {1} \dots x _ {n} ),
 +
$$
  
along a trajectory <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623015.png" /> connecting a given point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623016.png" /> with the point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623017.png" />, where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623018.png" /> is the Lagrange function of the mechanical system.
+
along a trajectory $  \gamma $
 +
connecting a given point $  ( t _ {0} , x _ {0} ) $
 +
with the point $  ( t, x) $,  
 +
where $  L $
 +
is the Lagrange function of the mechanical system.
  
It was suggested by Jacobi that a function resembling the action functional (1) should be used in solving all problems of classical variational calculus. The extremals of the problem <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623019.png" /> issuing from the point <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623020.png" /> intersect the level surface of the principal function transversally (cf. [[Transversality condition|Transversality condition]]); the form of the differential of the action functional
+
It was suggested by Jacobi that a function resembling the action functional (1) should be used in solving all problems of classical variational calculus. The extremals of the problem $  \int L  d t \rightarrow \inf $
 +
issuing from the point $  ( t _ {0} , x _ {0} ) $
 +
intersect the level surface of the principal function transversally (cf. [[Transversality condition|Transversality condition]]); the form of the differential of the action functional
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623021.png" /></td> </tr></table>
+
$$
 +
dS  = ( p \mid  dx) - H  dt
 +
$$
  
is deduced from this condition. Here <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623022.png" />, and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623023.png" /> is the [[Hamilton function|Hamilton function]] (see also [[Legendre transform|Legendre transform]]).
+
is deduced from this condition. Here $  p = L _ {\dot{x} }  $,  
 +
and $  H = p \dot{x} - L $
 +
is the [[Hamilton function|Hamilton function]] (see also [[Legendre transform|Legendre transform]]).
  
The last-mentioned relation yields the following equation for the function <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623024.png" />:
+
The last-mentioned relation yields the following equation for the function $  S $:
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623025.png" /></td> <td valign="top" style="width:5%;text-align:right;">(2)</td></tr></table>
+
$$ \tag{2 }
 +
 
 +
\frac{\partial  S }{\partial  t }
 +
+ H
 +
\left ( t, x,\
 +
 
 +
\frac{\partial  S }{\partial  x }
 +
 
 +
\right )  = 0.
 +
$$
  
 
This is the Hamilton–Jacobi equation.
 
This is the Hamilton–Jacobi equation.
  
The most important result of the Hamilton–Jacobi theory is Jacobi's theorem, which states that a complete integral of equation (2), i.e. the solution <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623026.png" /> of this equation, which will depend on the parameters <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623027.png" /> (provided that <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623028.png" />), makes it possible to obtain the complete integral of the equation for the Euler functional (1) or, which is the same thing, of the Hamiltonian system connected with this functional, by the formulas <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623029.png" />, <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623030.png" />. The application of Jacobi's theorem to the integration of Hamiltonian systems is usually based on the method of separation of variables in special coordinates.
+
The most important result of the Hamilton–Jacobi theory is Jacobi's theorem, which states that a complete integral of equation (2), i.e. the solution $  S ( t, x, \alpha ) $
 +
of this equation, which will depend on the parameters $  \alpha = ( \alpha _ {1} \dots \alpha _ {n} ) $(
 +
provided that $  \mathop{\rm det}  | \partial  ^ {2} S / \partial  x \partial  \alpha | \neq 0 $),  
 +
makes it possible to obtain the complete integral of the equation for the Euler functional (1) or, which is the same thing, of the Hamiltonian system connected with this functional, by the formulas $  \partial  S / \partial  x = p $,
 +
$  \partial  S / \partial  \alpha = \beta $.  
 +
The application of Jacobi's theorem to the integration of Hamiltonian systems is usually based on the method of separation of variables in special coordinates.
  
 
Despite the fact that the integration of partial differential equations is usually more difficult than solving ordinary equations, the Hamilton–Jacobi theory proved to be a powerful tool in the study of problems of optics, mechanics and geometry. The essence of Huygens' principle was used by R. Bellman in solving problems on optimal control.
 
Despite the fact that the integration of partial differential equations is usually more difficult than solving ordinary equations, the Hamilton–Jacobi theory proved to be a powerful tool in the study of problems of optics, mechanics and geometry. The essence of Huygens' principle was used by R. Bellman in solving problems on optimal control.
Line 35: Line 108:
 
====References====
 
====References====
 
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> , ''Variational principles of mechanics'' , Moscow  (1959)  (In Russian)</TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top">  L.A. Pars,  "A treatise on analytical dynamics" , Heinemann , London  (1965)</TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top">  V.I. Arnol'd,  "Mathematical methods of classical mechanics" , Springer  (1978)  (Translated from Russian)</TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top">  N.I. Akhiezer,  "The calculus of variations" , Blaisdell  (1962)  (Translated from Russian)</TD></TR></table>
 
<table><TR><TD valign="top">[1]</TD> <TD valign="top"> , ''Variational principles of mechanics'' , Moscow  (1959)  (In Russian)</TD></TR><TR><TD valign="top">[2]</TD> <TD valign="top">  L.A. Pars,  "A treatise on analytical dynamics" , Heinemann , London  (1965)</TD></TR><TR><TD valign="top">[3]</TD> <TD valign="top">  V.I. Arnol'd,  "Mathematical methods of classical mechanics" , Springer  (1978)  (Translated from Russian)</TD></TR><TR><TD valign="top">[4]</TD> <TD valign="top">  N.I. Akhiezer,  "The calculus of variations" , Blaisdell  (1962)  (Translated from Russian)</TD></TR></table>
 
 
  
 
====Comments====
 
====Comments====
 
In optimal control the Hamilton–Jacobi equation takes, for instance, the form
 
In optimal control the Hamilton–Jacobi equation takes, for instance, the form
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623031.png" /></td> </tr></table>
+
$$
 +
 
 +
\frac{\partial  V }{\partial  t }
 +
+
 +
H \left ( t , x ,
 +
\frac{\partial  V }{\partial  x }
 +
\right )  = 0 ,\ \
 +
V ( t _ {1} , x )  = \phi ( t _ {1} , x ) ,\ \
 +
t _ {0} \leq  t \leq  t _ {1} ,
 +
$$
  
 
where
 
where
  
<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623032.png" /></td> </tr></table>
+
$$
 +
H \left ( t , x ,
 +
\frac{\partial  V }{\partial  x }
 +
\right )  = \min
 +
\left \{ {\left (
 +
\frac{\partial  V }{\partial  x }
 +
, f ( t , x , u ) \right ) +
 +
f ^ { 0 } ( t , x , u ) } : {u \in U } \right \}
 +
.
 +
$$
  
Cf., for instance, [[Optimal synthesis control|Optimal synthesis control]]. In this setting it is often referred to as the Bellman equation (especially in the engineering literature) or the Hamilton–Jacobi–Bellman equation. There is also a version for optimal stochastic control, cf. [[Controlled stochastic process|Controlled stochastic process]]. Because classical (everywhere <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/h/h046/h046230/h04623033.png" />) solutions of the Hamilton–Jacobi equation often do not exist, it becomes necessary to consider various kinds of generalized solutions, such as [[Viscosity solutions|viscosity solutions]].
+
Cf., for instance, [[Optimal synthesis control|Optimal synthesis control]]. In this setting it is often referred to as the Bellman equation (especially in the engineering literature) or the Hamilton–Jacobi–Bellman equation. There is also a version for optimal stochastic control, cf. [[Controlled stochastic process|Controlled stochastic process]]. Because classical (everywhere $  C  ^ {1} $)  
 +
solutions of the Hamilton–Jacobi equation often do not exist, it becomes necessary to consider various kinds of generalized solutions, such as [[Viscosity solutions|viscosity solutions]].
  
 
====References====
 
====References====
 
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  H. Goldstein,  "Classical mechanics" , Addison-Wesley  (1950)</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top">  P.L. Lions,  "Generalized solutions of Hamilton–Jacobi equations" , Pitman  (1982)</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top">  W.H. Fleming,  R.W. Rishel,  "Deterministic and stochastic optimal control" , Springer  (1975)</TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top">  P.L. Lions,  "On the Hamilton–Jacobi–Bellman equations"  ''Acta. Appl. Math.'' , '''1'''  (1983)  pp. 17–41</TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top">  S.H. Benton jr.,  "The Hamilton–Jacobi equation: a global approach" , Acad. Press  (1977)</TD></TR></table>
 
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  H. Goldstein,  "Classical mechanics" , Addison-Wesley  (1950)</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top">  P.L. Lions,  "Generalized solutions of Hamilton–Jacobi equations" , Pitman  (1982)</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top">  W.H. Fleming,  R.W. Rishel,  "Deterministic and stochastic optimal control" , Springer  (1975)</TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top">  P.L. Lions,  "On the Hamilton–Jacobi–Bellman equations"  ''Acta. Appl. Math.'' , '''1'''  (1983)  pp. 17–41</TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top">  S.H. Benton jr.,  "The Hamilton–Jacobi equation: a global approach" , Acad. Press  (1977)</TD></TR></table>

Latest revision as of 19:43, 5 June 2020


A branch of classical variational calculus and analytical mechanics in which the task of finding extremals (or the task of integrating a Hamiltonian system of equations) is reduced to the integration of a first-order partial differential equation — the so-called Hamilton–Jacobi equation. The fundamentals of the Hamilton–Jacobi theory were developed by W. Hamilton in the 1820s for problems in wave optics and geometrical optics. In 1834 Hamilton extended his ideas to problems in dynamics, and C.G.J. Jacobi (1837) applied the method to the general problems of classical variational calculus.

The starting points of the Hamilton–Jacobi theory were established in the 17th century by P. Fermat and Chr. Huygens, who used the subject of geometrical optics for this purpose (cf. Fermat principle; Huygens principle). Below the footsteps of Hamilton are followed and the problem of propagation of light through an inhomogeneous (but, for the sake of simplicity, isotropic) medium, is considered where $ v( x) $ is the local velocity of light at a point $ x $. According to Fermat's principle, light propagates from point to point in an inhomogeneous medium in shortest possible time. Let $ x _ {0} \in E $ be the starting point, and let $ W( x) $ be the shortest possible time for the light to traverse the distance from $ x _ {0} $ to $ x $. The function $ W( x) $ is known as the eikonal or the optical length of the path. It is assumed that during a short time $ dt $ the light travels from the point $ x $ to the point $ x + dx $. According to the Huygens principle, light will travel, apart from small magnitudes of a higher order, along the normal to the level surface of the function $ W ( x) $. Thus, the equation

$$ W \left ( x + \frac{W ^ \prime ( x) }{| W ^ \prime ( x) | } v ( x) dt \right ) = \ W ( x) + dt + o ( dt) $$

is satisfied, and the Hamilton–Jacobi equation for problems in geometrical optics follows:

$$ | W ^ \prime ( x) | ^ {2} = \ { \frac{1}{v ^ {2} ( x) } } \ \iff \ \ \sum _ {i = 1 } ^ { 3 } \left ( \frac{\partial W ( x) }{\partial x _ {i} } \right ) ^ {2} = \ { \frac{1}{v ^ {2} ( x) } } . $$

In analytical mechanics the role of Fermat's principle is played by the variational Hamilton–Ostrogradski principle, while the role of the eikonal is played by the action functional, i.e. by the integral

$$ \tag{1 } S ( t, x) = \ \int\limits _ \gamma L dt,\ \ x = ( x _ {1} \dots x _ {n} ), $$

along a trajectory $ \gamma $ connecting a given point $ ( t _ {0} , x _ {0} ) $ with the point $ ( t, x) $, where $ L $ is the Lagrange function of the mechanical system.

It was suggested by Jacobi that a function resembling the action functional (1) should be used in solving all problems of classical variational calculus. The extremals of the problem $ \int L d t \rightarrow \inf $ issuing from the point $ ( t _ {0} , x _ {0} ) $ intersect the level surface of the principal function transversally (cf. Transversality condition); the form of the differential of the action functional

$$ dS = ( p \mid dx) - H dt $$

is deduced from this condition. Here $ p = L _ {\dot{x} } $, and $ H = p \dot{x} - L $ is the Hamilton function (see also Legendre transform).

The last-mentioned relation yields the following equation for the function $ S $:

$$ \tag{2 } \frac{\partial S }{\partial t } + H \left ( t, x,\ \frac{\partial S }{\partial x } \right ) = 0. $$

This is the Hamilton–Jacobi equation.

The most important result of the Hamilton–Jacobi theory is Jacobi's theorem, which states that a complete integral of equation (2), i.e. the solution $ S ( t, x, \alpha ) $ of this equation, which will depend on the parameters $ \alpha = ( \alpha _ {1} \dots \alpha _ {n} ) $( provided that $ \mathop{\rm det} | \partial ^ {2} S / \partial x \partial \alpha | \neq 0 $), makes it possible to obtain the complete integral of the equation for the Euler functional (1) or, which is the same thing, of the Hamiltonian system connected with this functional, by the formulas $ \partial S / \partial x = p $, $ \partial S / \partial \alpha = \beta $. The application of Jacobi's theorem to the integration of Hamiltonian systems is usually based on the method of separation of variables in special coordinates.

Despite the fact that the integration of partial differential equations is usually more difficult than solving ordinary equations, the Hamilton–Jacobi theory proved to be a powerful tool in the study of problems of optics, mechanics and geometry. The essence of Huygens' principle was used by R. Bellman in solving problems on optimal control.

See also Hilbert invariant integral.

References

[1] , Variational principles of mechanics , Moscow (1959) (In Russian)
[2] L.A. Pars, "A treatise on analytical dynamics" , Heinemann , London (1965)
[3] V.I. Arnol'd, "Mathematical methods of classical mechanics" , Springer (1978) (Translated from Russian)
[4] N.I. Akhiezer, "The calculus of variations" , Blaisdell (1962) (Translated from Russian)

Comments

In optimal control the Hamilton–Jacobi equation takes, for instance, the form

$$ \frac{\partial V }{\partial t } + H \left ( t , x , \frac{\partial V }{\partial x } \right ) = 0 ,\ \ V ( t _ {1} , x ) = \phi ( t _ {1} , x ) ,\ \ t _ {0} \leq t \leq t _ {1} , $$

where

$$ H \left ( t , x , \frac{\partial V }{\partial x } \right ) = \min \left \{ {\left ( \frac{\partial V }{\partial x } , f ( t , x , u ) \right ) + f ^ { 0 } ( t , x , u ) } : {u \in U } \right \} . $$

Cf., for instance, Optimal synthesis control. In this setting it is often referred to as the Bellman equation (especially in the engineering literature) or the Hamilton–Jacobi–Bellman equation. There is also a version for optimal stochastic control, cf. Controlled stochastic process. Because classical (everywhere $ C ^ {1} $) solutions of the Hamilton–Jacobi equation often do not exist, it becomes necessary to consider various kinds of generalized solutions, such as viscosity solutions.

References

[a1] H. Goldstein, "Classical mechanics" , Addison-Wesley (1950)
[a2] P.L. Lions, "Generalized solutions of Hamilton–Jacobi equations" , Pitman (1982)
[a3] W.H. Fleming, R.W. Rishel, "Deterministic and stochastic optimal control" , Springer (1975)
[a4] P.L. Lions, "On the Hamilton–Jacobi–Bellman equations" Acta. Appl. Math. , 1 (1983) pp. 17–41
[a5] S.H. Benton jr., "The Hamilton–Jacobi equation: a global approach" , Acad. Press (1977)
How to Cite This Entry:
Hamilton-Jacobi theory. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Hamilton-Jacobi_theory&oldid=47166
This article was adapted from an original article by V.M. Tikhomirov (originator), which appeared in Encyclopedia of Mathematics - ISBN 1402006098. See original article