Lagrange multipliers
Variables with the help of which one constructs a Lagrange function for investigating problems on conditional extrema. The use of Lagrange multipliers and a Lagrange function makes it possible to obtain in a uniform way necessary optimality conditions in problems on conditional extrema. The method of obtaining necessary conditions in the problem of determining an extremum of a function
![]() | (1) |
under the constraints
![]() | (2) |
consisting of the use of Lagrange multipliers ,
, the construction of the Lagrange function
![]() |
and equating its partial derivatives with respect to the and
to zero, is called the Lagrange method. In this method the optimal value
is found together with the vector of Lagrange multipliers
corresponding to it by solving the system of
equations. The Lagrange multipliers
,
, have the following interpretation [1]. Suppose that
provides a relative extremum of the function (1) under the constraints (2):
. The values of
,
and
depend on the values of the
, the right-hand sides of the constraints (2). One has formulated quite general assumptions under which all the
and
are continuously-differentiable functions of the vector
in some
-neighbourhood of its value specified in (2). Under these assumptions the function
is also continuously differentiable with respect to the
. The partial derivatives of
with respect to the
are equal to the corresponding Lagrange multipliers
, calculated for the given
:
![]() | (3) |
In applied problems is often interpreted as profit or cost, and the right-hand sides,
, as losses of certain resources. Then the absolute value of
is the ratio of the unit cost to the unit
-th resource. The numbers
show how the maximum profit (or maximum cost) changes if the amount of the
-th resource is increased by one. This interpretation of Lagrange multipliers can be extended to the case of constraints in the form of inequalities and to the case when the variables
are subject to the requirement of being non-negative.
In the calculus of variations one conveniently obtains by means of Lagrange multipliers necessary conditions for optimality in the problem on a conditional extremum as necessary conditions for an unconditional extremum of a certain composite functional. Lagrange multipliers in the calculus of variations are not constants, but certain functions. In the theory of optimal control and in the Pontryagin maximum principle, Lagrange multipliers have been called conjugate variables.
References
[1] | G.F. Hadley, "Nonlinear and dynamic programming" , Addison-Wesley (1964) |
[2] | G.A. Bliss, "Lectures on the calculus of variations" , Chicago Univ. Press (1947) |
Comments
The same arguments as used above lead to the interpretation of the Lagrange multiplier values as sensitivity coefficients (with respect to changes in the
).
References
[a1] | A.E. Bryson, Y.-C. Ho, "Applied optimal control" , Blaisdell (1969) |
[a2] | R.T. Rockafellar, "Convex analysis" , Princeton Univ. Press (1970) |
Lagrange multipliers. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Lagrange_multipliers&oldid=24258