Time-optimal control problem

One of the problems in the mathematical theory of optimal control (cf. Optimal control, mathematical theory of), consisting in the determination of the minimum time

(1)

in which a controlled object, the movement of which is described by a system of ordinary differential equations

can be transferred from a given initial position to a given final position . Here, is the -dimensional vector of phase coordinates, while is the -dimensional vector of controlling parameters (controls) which, for any , belong to a given closed admissible domain of controls .

The required minimum time is the functional (1) depending on the chosen control . As the class of admissible controls, in which the time-optimal control is to be found, it is sufficient, for the majority of applications, to examine piecewise-continuous controls , i.e. functions which are continuous for all values of being considered, with the exception of a finite number of moments of time, at which they can have discontinuities of the first kind. Theoretically, strictly speaking, the more general class of Lebesgue-measurable functions , , should be considered.

The time-optimal control problem can be considered as a particular instance of the Bolza problem or the Mayer problem in variational calculus, and is obtained from these problems by the special form of the functional to be optimized. The time-optimal control must satisfy the Pontryagin maximum principle, which is a necessary condition that generalizes the necessary conditions of Euler, Clebsch and Weierstrass, used in classical variational calculus.

For linear time-optimal control problems, certain conclusions can be drawn from the necessary conditions regarding the qualitative structure of the optimal control. Problems which satisfy the following three conditions are called linear time-optimal control problems ([1], [2]):

1) the controls of the movement of the object are linear in and :

where and are constant - and -matrices, respectively;

2) the final position coincides with the coordinate origin, which is an equilibrium position of the object if ;

3) the domain of controls is a -dimensional convex polyhedron, such that the coordinate origin of the -space belongs to but is not a vertex of it.

Let the condition of general position be fulfilled, consisting of the linear independence of the vectors

where is an arbitrary -dimensional vector parallel to an edge of the polyhedron . Then a control , , transferring the object from a given initial position to an equilibrium position (the coordinate origin in the -space) is a time-optimal control if and only if the Pontryagin maximum principle holds for it. Furthermore, the optimal control in the linear time-optimal control problem is piecewise constant, and the vertices of the polyhedron are its only values.

In general, the number of jumps of , although finite, can be arbitrary. In the following important case, the number of jumps permits an upper bound.

If the polyhedron is the -dimensional parallelopipedon

and all the eigenvalues of the matrix are real, then every one of the components , , of the optimal control is a piecewise-constant function, taking only the values and and having at most jumps, i.e. at most intervals of constancy.

The problem of time-optimal control can also be studied for non-autonomous systems, i.e. for systems whose right-hand side depends on the time .

In those cases where this works, it is useful to look at the problem of time-optimal control not only in its programming formulation as described above, but also in a positional formulation in the form of a synthesis problem (see Optimal synthesis control). The solution of this synthesis problem provides a qualitative representation of the structure of the time-optimal control transferring the system from any point in a neighbourhood of an initial starting point to a given final position .

References

[1]	L.S. Pontryagin, V.G. Boltayanskii, R.V. Gamkrelidze, E.F. Mishchenko, "The mathematical theory of optimal processes" , Wiley (1962) (Translated from Russian)
[2]	V.G. Boltyanskii, "Mathematical methods of optimal control" , Holt, Rinehart & Winston (1971) (Translated from Russian)

Comments

The concept of a reachable set is a useful aid for visualizing properties of the optimal control. The reachable set is a function of the time, , and consists of all points that can be reached at time , starting from , and using admissible controls only. For linear time-optimal control problems this set is compact and convex for any . The minimum time obviously satisfies . For more information on the number of jumps (switches) see [a2].

References

[a1]	J.P. LaSalle, "Functional analysis and time optimal control" , Acad. Press (1969)
[a2]	G.J. Olsder, "Time-optimal control of multivariable systems near the origin" J. Optim. Theory & Appl. , 15 (1975) pp. 497–517