The role of diversity in the evolution of cooperation
Highlights
► Evolution of cooperation benefits from general forms of diversity, such as. ► Diversity in the number of social interactions each one engages (heterogeneous networks). ► Diversity of contributions due to the social context one is embedded in. ► Diversity in the choice of role models to imitate. ► In all cases diversity renders the social dilemma more favorable to cooperation.
Introduction
Merriam Webster defines diversity as “the condition of having or being composed of differing elements”. Considering the broad scope of the term, it may legitimately be pointed out that the title of this manuscript is perhaps far more presumptuous than its actual contents. Indeed, we scratch at most of the surface of diversity in its relation to the evolution of cooperation. Even so, we find something that may be seen at first as counter-intuitive: Diversity promotes the evolution of cooperation. Or, at least, when one considers the different aspects of diversity that have been investigated so far.
Historically, the evolution of cooperation has been studied in the absence of diversity (Hardin, 1968, Axelrod and Hamilton, 1981, Hofbauer and Sigmund, 1998, Nowak and Sigmund, 2004, Nowak, 2006b, Nowak, 2006a, Sigmund, 2010). It was found more reasonable to deal with the evolution of cooperation in a population of (primitively) identical individuals, as defined by conventional evolutionary game theory (EGT) (Maynard-Smith, 1982, Hofbauer and Sigmund, 1998, Sigmund, 2010). Every individual can potentially interact with anybody else in an infinite population, having access to the same portfolio of actions (a.k.a. strategies): for instance, to cooperate or to defect. Such cooperators (Cs) and defectors (Ds) typically engage in binary encounters where success is determined by games like the (in)famous Prisoner's dilemma (PD), in which case the evolutionary dynamics relentlessly condemns Cs to extinction. Even when spatial reciprocity (Axelrod, 1984, Nowak and May, 1992, Szabó and Fáth, 2007) was unveiled as a viable mechanism for the emergence of cooperation, Cs and Ds were lined up in an ordered, military-like parade with toroidal endings (for the muse of mathematicians) where each myopic agent interacted only with her four (or eight) immediate neighbors (see for instance Fig. 1B). As such every agent was topologically identical to any other agent in the population. The success of this framework was immense since it showed that cooperation is evolutionary viable within a narrow window of game parameters. Still this approach ignored something as natural as diversity in the neighborhood structure (Amaral et al., 2000, Albert and Barabási, 2002, Dorogotsev and Mendes, 2003, Onnela et al., 2007). Indeed, empirical studies have shown that modern societies are grounded in strongly diverse and heterogeneous networks of exchange and cooperation, in which some individuals play radically different roles depending on their social position, which may or may not be related to the number of actual interactions (see example in Fig. 1a). Incorporating this diversity into the EGT context introduced differences in the way the dilemma is perceived by each individual (Santos and Pacheco, 2005, Santos and Pacheco, 2006, Santos et al., 2011, Pacheco et al., 2009a), as it becomes contingent on her social context. Within EGT, this diversity in interaction patterns is only a first form. In addition, diversity can also exist in the collection of strategic and learning behaviors. In case of the first, we will address in the following the effect of differences in cooperative investment (Santos et al., 2011, Pacheco et al., 2009a). In case of the latter, some individuals, may simply be chosen more frequently as role models than others, producing a significant effect in the flow of behavioral changes caused by the evolutionary dynamics. In addition, diversity in individuals' game strategy (McNamara et al., 2004), imitation capacity (Szolnoki and Szabó, 2007, Perc and Szolnoki, 2008, Szolnoki and Perc, 2008, Szolnoki et al., 2008c) or learning approach (Van Segbroeck et al., 2010b) may produce significantly different outcomes in equivalent games.
As we show in the following, the combined effects resulting from heterogeneous social interactions may lead not only to a boost in the overall levels of cooperation (Abramson and Kuperman, 2001, Santos and Pacheco, 2005, Santos and Pacheco, 2006, Santos et al., 2006b, Santos et al., 2008, Gómez-Gardeñes et al., 2007, Masuda, 2007, Poncela et al., 2007, Szabó and Fáth, 2007, Szolnoki et al., 2008b, Perc and Szolnoki, 2010), but also to a symmetry breaking of the game itself, as well as the introduction of large variance in the distribution of wealth, associated here with the ensuing accumulated game payoffs (Santos et al., 2008, Pacheco et al., 2009a).
After showing how the combined influence of both the number and frequency of interactions contributes to enlarge the chances of Cs, one may naturally wonder what are the origins of such diversity. To address this point, let us imagine for a second that individuals engage in a game of cooperation. Both Cs and Ds prefer to interact with Cs, given the benefit of such an interaction for their own payoff. Let us imagine each individual has the choice to break up the links with those who “hurt” her, maintaining the links with those that do not. Figs. 1b and c show what happens.
As soon as individuals have a choice, the corseted symmetry of the underlying network of contacts is broken, no matter how they break the contacts or to whom they re-direct their attention. In other words, diversity in frequency and number of interactions emerges naturally when humans make decisions, even when one starts from a non-diverse setup (Skyrms and Pemantle, 2000, Ebel and Bornholdt, 2002, Eguiluz et al., 2005, Pacheco et al., 2006a, Santos et al., 2006a, Hanaki et al., 2007, Tanimoto, 2007, Gross and Blasius, 2008, Szolnoki et al., 2008a, Poncela et al., 2009, Szolnoki and Perc, 2009, Van Segbroeck et al., 2009). Clearly, the so-called heterogeneous networks, which arise naturally whenever people make decisions, constitute an ubiquitous feature of the pattern of contacts between individuals in general, and humans in particular, whenever individuals may impose their preferences in what concerns their social ties. In the following sections, we will show that diversity, in its different guises, promotes cooperation.
Section snippets
Staging cooperation in an evolutionary and diverse setting
In a black and white world of unconditional behaviors, individuals may decide to behave as Cs or Ds. When pairs of individuals interact, the outcome can often be conveniently described in terms of a symmetric two-player game of cooperation. When both decide to cooperate, each receives a reward R for mutual cooperation, whereas mutual defection results in a punishment value P for both. Also, if one player cooperates while the other defects, then the D player receives a payoff T – often described
Context dependent investments and symmetry breaking of the Prisoner's dilemma
At the heart of any study grounded on the Prisoner's dilemma game is the assumption that an act of cooperation entails a certain cost. As a result, the recipient of a cooperative act receives a benefit, whereas the conflict between individual and collective interests relies on the fact that the benefit is larger than the cost. In all these studies, every C pays a fixed cost c per game, providing the same benefit to the partner. However, in a heterogeneous setting there is no reason to assume
Evolving diversity
So far, we have discussed the diversity effects emerging from heterogeneous social networks, neglecting the possibility that the social dynamics itself may play an important role in the origins of such diversity. As already argued in the introduction (see also Fig. 1), the feedback loop between behavior and network structure, may give rise to a significant topological diversity. Moreover, even if both Cs and Ds are unsatisfied by interacting with Ds, and seek Cs to cooperate and exploit
Mind your neighbors, but react differently
In the previous sections, we focused on the effects of diversity in the local environment of Cs and Ds and showed how this diversity might emerge from individual myopic preferences regarding their partners. Invariably, however, in all these models Cs (and Ds) exhibit no differences of behavior among themselves. This situation contrasts with most social systems, where we recognize a large behavioral diversity: two Cs (Ds) may behave differently when confronted with the same situation. In
Conclusions
In this manuscript, we present an overview of diversity in its different guises, as such providing a ground for understanding the impact of diversity as a whole, and its role as a fundamental mechanism in promoting the emergence and maintenance of cooperation. Diversity at the level of interactions and behaviors provides new clues concerning the mechanisms that supply Humans with one of the key social features responsible for our evolutionary success: Cooperation.
In Section 2 we have addressed
Acknowledgments
The authors acknowledge the financial support of FCT-Portugal (FCS, FLP and JMP) and the FNRS, Belgium (TL).
References (89)
- et al.
Imitation processes with small mutations
J. Econ. Theory
(2006) The genetical evolution of social behaviour. I.
J. Theor. Biol.
(1964)- et al.
Active linking in evolutionary games
J. Theor. Biol.
(2006) - et al.
Repeated games and direct reciprocity under active linking
J. Theor. Biol.
(2008) - et al.
Coevolutionary games—a mini review
BioSystems
(2010) - et al.
Co-evolution of pre-play signaling and cooperation
J. Theor. Biol.
(2011) - et al.
Evolutionary games on graphs
Phys. Rep.
(2007) - et al.
Towards effective payoffs in the prisoner's dilemma game on scale-free networks
Physica A
(2008) - et al.
Escaping the tragedy of the commons via directed investments
J. Theor. Biol.
(2011) - et al.
Evolutionary explanations for cooperation
Curr. Biol.
(2007)
Social games in a social network
Phys. Rev. E
Statistical mechanics of complex networks
Rev. Mod. Phys.
Classes of small-world networks
Proc. Natl. Acad. Sci. USA
The evolution of cooperation
The evolution of cooperation
Science
Emergence of scaling in random networks
Science
Hierarchy in the forest: The evolution of egalitarian behavior
Globalization and human cooperation
Proc. Natl. Acad. Sci.
Cooperation in an evolutionary Prisoner's dilemma on networks with degree-degree correlations
Phys. Rev. E
Evolution of Networks: From Biological Nets to the Internet and WWW
Size-dependent degree distribution of a scale-free growing network
Phys. Rev. E
Lectures on Complex Networks
Coevolutionary games on networks
Phys. Rev. E
Cooperation and the emergence of role differentiation in the dynamics of social networks
Am. J. Sociol.
Cooperation and punishment in public good experiments
Am. Econ. Rev.
Cooperative behavior cascades in human social networks
Proc. Natl. Acad. Sci. USA
Partner switching stabilizes cooperation in coevolutionary prisonerís dilemma
Phys. Rev. E
Dynamical organization of cooperation in complex topologies
Phys. Rev. Lett.
Adaptive coevolutionary networks: a review
J. R. Soc. Interface
Cooperation in evolving social networks
Manage. Sci.
The tragedy of the commons
Science
Evolutionary Games and Population Dynamics
Evolutionary cycles of cooperation and defection
Proc. Natl. Acad. Sci. USA
Social dilemmas: the anatomy of cooperation
Annu. Rev. Sociol.
Learning dynamics in social dilemmas
Proc. Natl. Acad. Sci. USA
Participation costs dismiss the advantage of heterogeneous networks in evolution of cooperation
Proc. R. Soc. B
Evolution and the Theory of Games
Variation in behaviour promotes cooperation in the Prisoner's Dilemma game
Nature
Reputation helps solve the ‘tragedy of the commons’
Nature
A critical point for random degree graphs with a given degree sequence
Random Struct. Algorithm
Five rules for the evolution of cooperation
Science
Evolutionary dynamics: exploring the equations of life
Cited by (175)
The impact of reputation-based heterogeneous evaluation and learning on cooperation in spatial public goods game
2024, Chaos, Solitons and FractalsEffects of interdependent network reciprocity on the evolution of public cooperation
2023, Applied Mathematics and ComputationDouble cyclic dominance promotes cooperation in spatial social dilemmas
2023, Chaos, Solitons and FractalsHeterogeneous negotiation undermines cooperation in prisoner's dilemma game
2023, Physica A: Statistical Mechanics and its ApplicationsInequal dependence on members stabilizes cooperation in spatial public goods game
2022, Chaos, Solitons and Fractals