Difference between revisions of "Evolutionarily stable strategy"
m (link) |
m (→References: expand bibliodata) |
||
Line 44: | Line 44: | ||
====References==== | ====References==== | ||
− | <table><TR><TD valign="top">[a1]</TD> <TD valign="top"> A. Abakucs, "Conditions for evolutionarily stable strategies" ''J. Appl. Probab.'' , '''17''' (1980) pp. 559–562</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top"> E. Akin, "Exponential families and game dynamics" ''Canadian J. Math.'' , '''34''' (1982) pp. 374–405</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top"> R. Axelrod, "Further evolution of co-operation" ''Science'' , '''242''' (1988) pp. 1385–1390</TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top"> D.T. Bishop, C. Cannings, "A generalised war of attrition" ''J. Theor. Biol'' , '''70''' (1978) pp. 85–124</TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top"> I.M. Bomze, B.M. Potschner, "Game theoretical foundations of evolutionary stability" , ''Lecture Notes Econom. and Math. Systems'' , Springer (1998)</TD></TR><TR><TD valign="top">[a6]</TD> <TD valign="top"> M. Broom, C. Cannings, G.T. Vickers, "Sequential methods in patterns of ESS's" ''J. Math. Biol.'' , '''22''' (1994) pp. 597–615</TD></TR><TR><TD valign="top">[a7]</TD> <TD valign="top"> C. Cannings, "Topics in the theory of ESS's" S. Lessard (ed.) , ''Proc. NATO Advanced Study Institute (Montreal, 1987)'' , Kluwer Acad. Publ. (1990)</TD></TR><TR><TD valign="top">[a8]</TD> <TD valign="top"> R. Cressman, "The stability concept of evolutionary game theory" , Springer (1992)</TD></TR><TR><TD valign="top">[a9]</TD> <TD valign="top"> I. Eshel, M.W. Feldman, "Initial increase of new mutants and continuity properties of ESS in two-locus systems" ''Amer. Nat.'' , '''124''' (1984) pp. 631–640</TD></TR><TR><TD valign="top">[a10]</TD> <TD valign="top"> J. Haigh, "Game theory and evolution" ''Advances Appl. Probab.'' , '''7''' (1975) pp. 8–10</TD></TR><TR><TD valign="top">[a11]</TD> <TD valign="top"> J. Haigh, C. Cannings, "The | + | <table> |
+ | <TR><TD valign="top">[a1]</TD> <TD valign="top"> A. Abakucs, "Conditions for evolutionarily stable strategies" ''J. Appl. Probab.'' , '''17''' (1980) pp. 559–562</TD></TR> | ||
+ | <TR><TD valign="top">[a2]</TD> <TD valign="top"> E. Akin, "Exponential families and game dynamics" ''Canadian J. Math.'' , '''34''' (1982) pp. 374–405</TD></TR> | ||
+ | <TR><TD valign="top">[a3]</TD> <TD valign="top"> R. Axelrod, "Further evolution of co-operation" ''Science'' , '''242''' (1988) pp. 1385–1390</TD></TR> | ||
+ | <TR><TD valign="top">[a4]</TD> <TD valign="top"> D.T. Bishop, C. Cannings, "A generalised war of attrition" ''J. Theor. Biol'' , '''70''' (1978) pp. 85–124 {{DOI|10.1016/0022-5193(78)90304-1}}</TD></TR> | ||
+ | <TR><TD valign="top">[a5]</TD> <TD valign="top"> I.M. Bomze, B.M. Potschner, "Game theoretical foundations of evolutionary stability" , ''Lecture Notes Econom. and Math. Systems'' , Springer (1998)</TD></TR> | ||
+ | <TR><TD valign="top">[a6]</TD> <TD valign="top"> M. Broom, C. Cannings, G.T. Vickers, "Sequential methods in patterns of ESS's" ''J. Math. Biol.'' , '''22''' (1994) pp. 597–615</TD></TR> | ||
+ | <TR><TD valign="top">[a7]</TD> <TD valign="top"> C. Cannings, "Topics in the theory of ESS's" S. Lessard (ed.) , ''Proc. NATO Advanced Study Institute (Montreal, 1987)'' , Kluwer Acad. Publ. (1990)</TD></TR> | ||
+ | <TR><TD valign="top">[a8]</TD> <TD valign="top"> R. Cressman, "The stability concept of evolutionary game theory" , Springer (1992)</TD></TR> | ||
+ | <TR><TD valign="top">[a9]</TD> <TD valign="top"> I. Eshel, M.W. Feldman, "Initial increase of new mutants and continuity properties of ESS in two-locus systems" ''Amer. Nat.'' , '''124''' (1984) pp. 631–640</TD></TR> | ||
+ | <TR><TD valign="top">[a10]</TD> <TD valign="top"> J. Haigh, "Game theory and evolution" ''Advances Appl. Probab.'' , '''7''' (1975) pp. 8–10</TD></TR> | ||
+ | <TR><TD valign="top">[a11]</TD> <TD valign="top"> J. Haigh, C. Cannings, "The $n$-person war of attrition" ''Acta Applic. Math.'' , '''14''' (1989) pp. 59–74</TD></TR> | ||
+ | <TR><TD valign="top">[a12]</TD> <TD valign="top"> J. Haigh, M.R. Rose, "Evolutionary game auctions" ''J. Theor. Biol.'' , '''85''' (1980) pp. 381–397</TD></TR> | ||
+ | <TR><TD valign="top">[a13]</TD> <TD valign="top"> P. Hammerstein, "Darwinian adaptation, population genetics and the streetcar theory of evolution" ''J. Math. Biol.'' , '''34''' (1996) pp. 511–532</TD></TR> | ||
+ | <TR><TD valign="top">[a14]</TD> <TD valign="top"> W.G.S. Hines, D. Anfossi, "A discusson of evolutionarily stable strategies" S. Lessard (ed.) , ''Proc. NATO Adv. Study Inst. (Montreal, 1987)'' , Kluwer Acad. Publ. (1990)</TD></TR> | ||
+ | <TR><TD valign="top">[a15]</TD> <TD valign="top"> J. Hofbauer, K. Sigmund, "The theory of evolution and dynamical systems" , Cambridge Univ. Press (1988)</TD></TR> | ||
+ | <TR><TD valign="top">[a16]</TD> <TD valign="top"> J. Maynard Smith, "The theory of games and the evolution of animal conflicts" ''J. Theor. Biol.'' , ''',47''' (1974) pp. 209–221 {{DOI|10.1016/0022-5193(74)90110-6}}</TD></TR> | ||
+ | <TR><TD valign="top">[a17]</TD> <TD valign="top"> J. Maynard Smith, "Evolution and the theory of games" , Cambridge Univ. Press (1982)</TD></TR> | ||
+ | <TR><TD valign="top">[a18]</TD> <TD valign="top"> J. Maynard Smith, G.E. Parker, "The logic of asymmetric conflicts" ''Animal Behavior'' , '''24''' (1976) pp. 159–175</TD></TR> | ||
+ | <TR><TD valign="top">[a19]</TD> <TD valign="top"> J. Maynard Smith, G.R. Price, "The logic of animal conflict" ''Nature'' , '''246''' (1973) pp. 15–18</TD></TR> | ||
+ | <TR><TD valign="top">[a20]</TD> <TD valign="top"> M.A. Nowak, R.M. May, "Evolutionary games and spatial chaos" ''Nature'' , '''359''' (1992) pp. 826–829</TD></TR> | ||
+ | <TR><TD valign="top">[a21]</TD> <TD valign="top"> J.G. Riley, "Evolutionary equilibrium strategies" ''J. Theor. Biol.'' , '''76''' (1979) pp. 109–123 {{DOI|10.1016/0022-5193(79)90365-5}}</TD></TR> | ||
+ | <TR><TD valign="top">[a22]</TD> <TD valign="top"> K. Sigmund, "Games of life" , Oxford Univ. Press (1993)</TD></TR> | ||
+ | <TR><TD valign="top">[a23]</TD> <TD valign="top"> G.T. Vickers, C. Cannings, "On the definition of an evolutionarily stable strategy" ''J. Theor. Biol.'' , '''129''' (1987) pp. 349–353</TD></TR> | ||
+ | <TR><TD valign="top">[a24]</TD> <TD valign="top"> G.T. Vickers, C. Cannings, "Patterns of ESS's 1" ''J. Theor. Biol.'' , '''132''' (1988) pp. 387–408</TD></TR> | ||
+ | <TR><TD valign="top">[a25]</TD> <TD valign="top"> F.J. Weissing, "Genetic versus phenotypic models of selection: Can genetics be neglected in a long term perspective?" ''J. Math. Biol.'' , '''34''' (1996) pp. 533–555</TD></TR> | ||
+ | <TR><TD valign="top">[a26]</TD> <TD valign="top"> E.C. Zeeman, "Population dynamics from game theory" A. Nitecki (ed.) C. Robinson (ed.) , ''Global Theory of Dynamical Systems'' , Springer (1980)</TD></TR> | ||
+ | </table> |
Latest revision as of 06:43, 27 September 2016
Conflicts between organisms are often modelled as games (cf. also Games, theory of). Here, attention is confined to conflicts between con-specifics, which are also symmetric in the sense that each player has available the same set of strategies (cf. Strategy (in game theory)) and the same pay-off function. (Important texts in this area are [a5], [a8], [a15], [a17], [a22].)
Consider first two-player conflicts (cf. also Two-person zero-sum game). Suppose there exists a set of possible strategies , and a pay-off function
, where
, the pay-off to a player who plays
against one who plays
. One extends the set of available strategies to some
, where each
is a weight function defined on the elements of
; e.g. a probability function if
is discrete. One supposes that the extension of the pay-off function is linear, i.e. for
,
![]() |
where denotes summation or integration (as appropriate) and
is the weight attached to
by
.
A concept of solution of an evolutionarily stable strategy was introduced in [a19]. Such a strategy, if adopted by the whole of the (infinite) population (see [a21] for the finite case), cannot be invaded by any alternate strategy introduced at low frequency.
A strategy is said to be evolutionarily stable with respect to
if:
1) ;
2) implies
.
A strategy is said to be evolutionarily stable if
is evolutionarily stable with respect to
for all
. For a discussion of the definition see also [a5] and [a23]. Let
denote the support of
. If
is such that
for all
while
for all
, then
is a strict Nash equilibrium (cf. also Nash theorem (in game theory)). It follows that
, so
is evolutionarily stable against
for all
such that
,
being the empty set. Thus, in the generic case an evolutionarily stable strategy is a strict Nash equilibrium with the additional condition that for all
such that
one requires that
, or, equivalently, that for all
such that
one requires that
, with equality if and only if
.
For conditions for to be an evolutionarily stable strategy in the finite (i.e. matrix) case, see [a10] (generic) and [a1] (non-generic). If
is an evolutionarily stable strategy and
is such that
, then
is not an evolutionarily stable strategy (the Bishop–Cannings theorem, [a4]).
The war of attrition was introduced in [a16], where and
and
if
,
if
and
if
. Thus, individuals contest for a reward
by choosing a single value, perhaps display time, the winner being the one choosing the larger value but the cost to each only being the lesser; i.e. the contest ends immediately when the first individual retreats. In this case there is a unique evolutionarily stable strategy, given by
,
, where
. This follows since
,
,
with equality if and only if
, which ensures that
is an evolutionarily stable strategy, and this is unique by the Bishop–Cannings theorem. If
, i.e. individuals essentially commit themselves irrevocable to their choice, as might occur for a choice of size, then there is no evolutionarily stable strategy [a18]. A hybrid model with
has been treated by [a12].
Finite conflicts.
As stated above, [a10] gives conditions in the finite (i.e. matrix) case for to be an evolutionarily stable strategy. Suppose
and
. For
, an evolutionarily stable strategy with
exists if and only if
and
. See, in particular, [a19] for the hawk–dove scenario, where there is a reward
for winning, a hawk always beats a dove, doves share the reward, while hawks share the reward but also incur damage (cost
). Thus,
![]() |
and there is an evolutionarily stable strategy with both hawk and dove if , demonstrating that organisms need not adopt aggressive strategies. On the other hand, if
, then
is an evolutionarily stable strategy, while if
, then
is an evolutionarily stable strategy. Thus there is always at least one evolutionarily stable strategy.
For , [a10] has given examples of the possible sets of evolutionarily stable strategies, it being possible that there be no evolutionarily stable strategy. More generally, suppose that
, where
,
denoting the power set. Then
is called a pattern. If there exists an
-matrix
with
evolutionarily stable strategies with supports
, then
is said to be attainable on
. The Bishop–Cannings theorem ensures that an attainable pattern is a Sperner family. Various restrictions on the set of attainable patterns have been derived in [a24]; in it, it is conjectured that if
is attainable and
, then
is also attainable on
. This conjecture is still (1996) open, although in [a6] it has been proved that
is attainable for some
.
Dynamics.
A major criticisism of the evolutionarily stable strategy solution concept is that it is a static, rather than a dynamic concept. However, for the continuous replicator dynamics, if there is an interior evolutionarily stable strategy , then convergence to that evolutionarily stable strategy is assured, where
[a26], and, more generally, if
is such that
is a convex combination of some subset of its elements, then convergence is assured to the linear manifold defined by
[a2]. If the players can choose
itself, then convergence is assured even for more general dynamics [a7]. For further discussion of dynamics see [a14], which uses a covariance approach and for an examination of the embedding of such dynamics within a genetic system, and a discussion of whether evolution can find the evolutionarily stable strategy, see [a9], [a13], [a25].
Iterated conflicts, spatial conflicts and cooperation.
The classic paradigm for examining the evolution of cooperation is the prisoner dilemma [a3] (see [a22] for an excellent overview). Here the defect strategy dominates the cooperate strategy (). However, if the conflict consists not of a single play, but of a series of random (geometrically distributed) length, then cooperation can evolve. A series of strategies (tit-for-tat, i.e. imitate the opponent's last play, two-tits-for-tat, generous-tit-for-tat, etc.) has been developed, and although none of these is an evolutionarily stable strategy, studies suggest that cooperation, in some form, may evolve. In a related way, spatial structure (players are located at the points of a grid, interact with some set of neighbours and imitate the best local strategy in the next round) may lead to the persistence of both strategies [a20].
Multi-player conflicts.
A multi-player war of attrition model is discussed in [a11]. This necessitates the extension of the notion of an evolutionarily stable strategy to players. Assume that the pay-off for playing
against
opponents depends only on the membership of the set of strategies and not on any ordering within the set. Thus, the pay-off to an individual who plays
while
of the
opponents play
and
play
can be written as
. A strategy
is said to be evolutionarily stable with respect to
in a
-player conflict if there exists a
such that
1) , for
;
2) . An evolutionarily stable strategy is then defined as for the two-player conflict in terms of evolutionary stability. Note that the definition, while only referring to two strategies, implicitly deals with the case of several strategies. There are then situations in which no evolutionarily stable strategy exists in the war of attrition, e.g. if players are allowed to re-assess their play when some other player quits. It is clear that the study of multi-player conflicts and their application to the establishment and maintenance of dominance hierarchies, to mate selection, etc., is an area of considerable importance.
References
[a1] | A. Abakucs, "Conditions for evolutionarily stable strategies" J. Appl. Probab. , 17 (1980) pp. 559–562 |
[a2] | E. Akin, "Exponential families and game dynamics" Canadian J. Math. , 34 (1982) pp. 374–405 |
[a3] | R. Axelrod, "Further evolution of co-operation" Science , 242 (1988) pp. 1385–1390 |
[a4] | D.T. Bishop, C. Cannings, "A generalised war of attrition" J. Theor. Biol , 70 (1978) pp. 85–124 DOI 10.1016/0022-5193(78)90304-1 |
[a5] | I.M. Bomze, B.M. Potschner, "Game theoretical foundations of evolutionary stability" , Lecture Notes Econom. and Math. Systems , Springer (1998) |
[a6] | M. Broom, C. Cannings, G.T. Vickers, "Sequential methods in patterns of ESS's" J. Math. Biol. , 22 (1994) pp. 597–615 |
[a7] | C. Cannings, "Topics in the theory of ESS's" S. Lessard (ed.) , Proc. NATO Advanced Study Institute (Montreal, 1987) , Kluwer Acad. Publ. (1990) |
[a8] | R. Cressman, "The stability concept of evolutionary game theory" , Springer (1992) |
[a9] | I. Eshel, M.W. Feldman, "Initial increase of new mutants and continuity properties of ESS in two-locus systems" Amer. Nat. , 124 (1984) pp. 631–640 |
[a10] | J. Haigh, "Game theory and evolution" Advances Appl. Probab. , 7 (1975) pp. 8–10 |
[a11] | J. Haigh, C. Cannings, "The $n$-person war of attrition" Acta Applic. Math. , 14 (1989) pp. 59–74 |
[a12] | J. Haigh, M.R. Rose, "Evolutionary game auctions" J. Theor. Biol. , 85 (1980) pp. 381–397 |
[a13] | P. Hammerstein, "Darwinian adaptation, population genetics and the streetcar theory of evolution" J. Math. Biol. , 34 (1996) pp. 511–532 |
[a14] | W.G.S. Hines, D. Anfossi, "A discusson of evolutionarily stable strategies" S. Lessard (ed.) , Proc. NATO Adv. Study Inst. (Montreal, 1987) , Kluwer Acad. Publ. (1990) |
[a15] | J. Hofbauer, K. Sigmund, "The theory of evolution and dynamical systems" , Cambridge Univ. Press (1988) |
[a16] | J. Maynard Smith, "The theory of games and the evolution of animal conflicts" J. Theor. Biol. , ,47 (1974) pp. 209–221 DOI 10.1016/0022-5193(74)90110-6 |
[a17] | J. Maynard Smith, "Evolution and the theory of games" , Cambridge Univ. Press (1982) |
[a18] | J. Maynard Smith, G.E. Parker, "The logic of asymmetric conflicts" Animal Behavior , 24 (1976) pp. 159–175 |
[a19] | J. Maynard Smith, G.R. Price, "The logic of animal conflict" Nature , 246 (1973) pp. 15–18 |
[a20] | M.A. Nowak, R.M. May, "Evolutionary games and spatial chaos" Nature , 359 (1992) pp. 826–829 |
[a21] | J.G. Riley, "Evolutionary equilibrium strategies" J. Theor. Biol. , 76 (1979) pp. 109–123 DOI 10.1016/0022-5193(79)90365-5 |
[a22] | K. Sigmund, "Games of life" , Oxford Univ. Press (1993) |
[a23] | G.T. Vickers, C. Cannings, "On the definition of an evolutionarily stable strategy" J. Theor. Biol. , 129 (1987) pp. 349–353 |
[a24] | G.T. Vickers, C. Cannings, "Patterns of ESS's 1" J. Theor. Biol. , 132 (1988) pp. 387–408 |
[a25] | F.J. Weissing, "Genetic versus phenotypic models of selection: Can genetics be neglected in a long term perspective?" J. Math. Biol. , 34 (1996) pp. 533–555 |
[a26] | E.C. Zeeman, "Population dynamics from game theory" A. Nitecki (ed.) C. Robinson (ed.) , Global Theory of Dynamical Systems , Springer (1980) |
Evolutionarily stable strategy. Encyclopedia of Mathematics. URL: http://encyclopediaofmath.org/index.php?title=Evolutionarily_stable_strategy&oldid=35904