Elsevier

Journal of Theoretical Biology

Volume 299, 21 April 2012, Pages 88-96
Journal of Theoretical Biology

The role of diversity in the evolution of cooperation

https://doi.org/10.1016/j.jtbi.2011.09.003Get rights and content

Abstract

Understanding the evolutionary mechanisms that promote and maintain cooperative behavior is recognized as a major theoretical problem where the intricacy increases with the complexity of the participating individuals. This is epitomized by the diverse nature of Human interactions, contexts, preferences and social structures. Here we discuss how social diversity, in several of its flavors, catalyzes cooperative behavior. From the diversity in the number of interactions an individual is involved to differences in the choice of role models and contributions, diversity is shown to significantly increase the chances of cooperation. Individual diversity leads to an overall population dynamics in which the underlying dilemma of cooperation is changed, benefiting the society as whole. In addition, we show how diversity in social contexts can arise from the individual capacity for organizing their social ties. As such, Human diversity, on a grand scale, may be instrumental in shaping us as the most sophisticated cooperative entities on this planet.

Highlights

► Evolution of cooperation benefits from general forms of diversity, such as. ► Diversity in the number of social interactions each one engages (heterogeneous networks). ► Diversity of contributions due to the social context one is embedded in. ► Diversity in the choice of role models to imitate. ► In all cases diversity renders the social dilemma more favorable to cooperation.

Introduction

Merriam Webster defines diversity as “the condition of having or being composed of differing elements”. Considering the broad scope of the term, it may legitimately be pointed out that the title of this manuscript is perhaps far more presumptuous than its actual contents. Indeed, we scratch at most of the surface of diversity in its relation to the evolution of cooperation. Even so, we find something that may be seen at first as counter-intuitive: Diversity promotes the evolution of cooperation. Or, at least, when one considers the different aspects of diversity that have been investigated so far.

Historically, the evolution of cooperation has been studied in the absence of diversity (Hardin, 1968, Axelrod and Hamilton, 1981, Hofbauer and Sigmund, 1998, Nowak and Sigmund, 2004, Nowak, 2006b, Nowak, 2006a, Sigmund, 2010). It was found more reasonable to deal with the evolution of cooperation in a population of (primitively) identical individuals, as defined by conventional evolutionary game theory (EGT) (Maynard-Smith, 1982, Hofbauer and Sigmund, 1998, Sigmund, 2010). Every individual can potentially interact with anybody else in an infinite population, having access to the same portfolio of actions (a.k.a. strategies): for instance, to cooperate or to defect. Such cooperators (Cs) and defectors (Ds) typically engage in binary encounters where success is determined by games like the (in)famous Prisoner's dilemma (PD), in which case the evolutionary dynamics relentlessly condemns Cs to extinction. Even when spatial reciprocity (Axelrod, 1984, Nowak and May, 1992, Szabó and Fáth, 2007) was unveiled as a viable mechanism for the emergence of cooperation, Cs and Ds were lined up in an ordered, military-like parade with toroidal endings (for the muse of mathematicians) where each myopic agent interacted only with her four (or eight) immediate neighbors (see for instance Fig. 1B). As such every agent was topologically identical to any other agent in the population. The success of this framework was immense since it showed that cooperation is evolutionary viable within a narrow window of game parameters. Still this approach ignored something as natural as diversity in the neighborhood structure (Amaral et al., 2000, Albert and Barabási, 2002, Dorogotsev and Mendes, 2003, Onnela et al., 2007). Indeed, empirical studies have shown that modern societies are grounded in strongly diverse and heterogeneous networks of exchange and cooperation, in which some individuals play radically different roles depending on their social position, which may or may not be related to the number of actual interactions (see example in Fig. 1a). Incorporating this diversity into the EGT context introduced differences in the way the dilemma is perceived by each individual (Santos and Pacheco, 2005, Santos and Pacheco, 2006, Santos et al., 2011, Pacheco et al., 2009a), as it becomes contingent on her social context. Within EGT, this diversity in interaction patterns is only a first form. In addition, diversity can also exist in the collection of strategic and learning behaviors. In case of the first, we will address in the following the effect of differences in cooperative investment (Santos et al., 2011, Pacheco et al., 2009a). In case of the latter, some individuals, may simply be chosen more frequently as role models than others, producing a significant effect in the flow of behavioral changes caused by the evolutionary dynamics. In addition, diversity in individuals' game strategy (McNamara et al., 2004), imitation capacity (Szolnoki and Szabó, 2007, Perc and Szolnoki, 2008, Szolnoki and Perc, 2008, Szolnoki et al., 2008c) or learning approach (Van Segbroeck et al., 2010b) may produce significantly different outcomes in equivalent games.

As we show in the following, the combined effects resulting from heterogeneous social interactions may lead not only to a boost in the overall levels of cooperation (Abramson and Kuperman, 2001, Santos and Pacheco, 2005, Santos and Pacheco, 2006, Santos et al., 2006b, Santos et al., 2008, Gómez-Gardeñes et al., 2007, Masuda, 2007, Poncela et al., 2007, Szabó and Fáth, 2007, Szolnoki et al., 2008b, Perc and Szolnoki, 2010), but also to a symmetry breaking of the game itself, as well as the introduction of large variance in the distribution of wealth, associated here with the ensuing accumulated game payoffs (Santos et al., 2008, Pacheco et al., 2009a).

After showing how the combined influence of both the number and frequency of interactions contributes to enlarge the chances of Cs, one may naturally wonder what are the origins of such diversity. To address this point, let us imagine for a second that individuals engage in a game of cooperation. Both Cs and Ds prefer to interact with Cs, given the benefit of such an interaction for their own payoff. Let us imagine each individual has the choice to break up the links with those who “hurt” her, maintaining the links with those that do not. Figs. 1b and c show what happens.

As soon as individuals have a choice, the corseted symmetry of the underlying network of contacts is broken, no matter how they break the contacts or to whom they re-direct their attention. In other words, diversity in frequency and number of interactions emerges naturally when humans make decisions, even when one starts from a non-diverse setup (Skyrms and Pemantle, 2000, Ebel and Bornholdt, 2002, Eguiluz et al., 2005, Pacheco et al., 2006a, Santos et al., 2006a, Hanaki et al., 2007, Tanimoto, 2007, Gross and Blasius, 2008, Szolnoki et al., 2008a, Poncela et al., 2009, Szolnoki and Perc, 2009, Van Segbroeck et al., 2009). Clearly, the so-called heterogeneous networks, which arise naturally whenever people make decisions, constitute an ubiquitous feature of the pattern of contacts between individuals in general, and humans in particular, whenever individuals may impose their preferences in what concerns their social ties. In the following sections, we will show that diversity, in its different guises, promotes cooperation.

Section snippets

Staging cooperation in an evolutionary and diverse setting

In a black and white world of unconditional behaviors, individuals may decide to behave as Cs or Ds. When pairs of individuals interact, the outcome can often be conveniently described in terms of a symmetric two-player game of cooperation. When both decide to cooperate, each receives a reward R for mutual cooperation, whereas mutual defection results in a punishment value P for both. Also, if one player cooperates while the other defects, then the D player receives a payoff T – often described

Context dependent investments and symmetry breaking of the Prisoner's dilemma

At the heart of any study grounded on the Prisoner's dilemma game is the assumption that an act of cooperation entails a certain cost. As a result, the recipient of a cooperative act receives a benefit, whereas the conflict between individual and collective interests relies on the fact that the benefit is larger than the cost. In all these studies, every C pays a fixed cost c per game, providing the same benefit to the partner. However, in a heterogeneous setting there is no reason to assume

Evolving diversity

So far, we have discussed the diversity effects emerging from heterogeneous social networks, neglecting the possibility that the social dynamics itself may play an important role in the origins of such diversity. As already argued in the introduction (see also Fig. 1), the feedback loop between behavior and network structure, may give rise to a significant topological diversity. Moreover, even if both Cs and Ds are unsatisfied by interacting with Ds, and seek Cs to cooperate and exploit

Mind your neighbors, but react differently

In the previous sections, we focused on the effects of diversity in the local environment of Cs and Ds and showed how this diversity might emerge from individual myopic preferences regarding their partners. Invariably, however, in all these models Cs (and Ds) exhibit no differences of behavior among themselves. This situation contrasts with most social systems, where we recognize a large behavioral diversity: two Cs (Ds) may behave differently when confronted with the same situation. In

Conclusions

In this manuscript, we present an overview of diversity in its different guises, as such providing a ground for understanding the impact of diversity as a whole, and its role as a fundamental mechanism in promoting the emergence and maintenance of cooperation. Diversity at the level of interactions and behaviors provides new clues concerning the mechanisms that supply Humans with one of the key social features responsible for our evolutionary success: Cooperation.

In Section 2 we have addressed

Acknowledgments

The authors acknowledge the financial support of FCT-Portugal (FCS, FLP and JMP) and the FNRS, Belgium (TL).

References (89)

  • G. Abramson et al.

    Social games in a social network

    Phys. Rev. E

    (2001)
  • R. Albert et al.

    Statistical mechanics of complex networks

    Rev. Mod. Phys.

    (2002)
  • L.A. Amaral et al.

    Classes of small-world networks

    Proc. Natl. Acad. Sci. USA

    (2000)
  • R. Axelrod

    The evolution of cooperation

    (1984)
  • R. Axelrod et al.

    The evolution of cooperation

    Science

    (1981)
  • A.L. Barabási et al.

    Emergence of scaling in random networks

    Science

    (1999)
  • C. Boehm

    Hierarchy in the forest: The evolution of egalitarian behavior

    (1999)
  • N.R. Buchan et al.

    Globalization and human cooperation

    Proc. Natl. Acad. Sci.

    (2009)
  • Carman, K.G., 2003. Social infuences and the private provision of public goods: Evidence from charitable contributions...
  • S. Devlin et al.

    Cooperation in an evolutionary Prisoner's dilemma on networks with degree-degree correlations

    Phys. Rev. E

    (2009)
  • S.N. Dorogotsev et al.

    Evolution of Networks: From Biological Nets to the Internet and WWW

    (2003)
  • S.N. Dorogotsev et al.

    Size-dependent degree distribution of a scale-free growing network

    Phys. Rev. E

    (2001)
  • S.N. Dorogovtsev

    Lectures on Complex Networks

    (2010)
  • H. Ebel et al.

    Coevolutionary games on networks

    Phys. Rev. E

    (2002)
  • Eckel, C., Wilson, R.K., 2004. Whom to trust? Choice of partner in a trust game. Technical Report: Virginia Polytechnic...
  • V.M. Eguiluz et al.

    Cooperation and the emergence of role differentiation in the dynamics of social networks

    Am. J. Sociol.

    (2005)
  • E. Fehr et al.

    Cooperation and punishment in public good experiments

    Am. Econ. Rev.

    (2000)
  • J.H. Fowler et al.

    Cooperative behavior cascades in human social networks

    Proc. Natl. Acad. Sci. USA

    (2010)
  • F. Fu et al.

    Partner switching stabilizes cooperation in coevolutionary prisonerís dilemma

    Phys. Rev. E

    (2009)
  • J. Gómez-Gardeñes et al.

    Dynamical organization of cooperation in complex topologies

    Phys. Rev. Lett.

    (2007)
  • T. Gross et al.

    Adaptive coevolutionary networks: a review

    J. R. Soc. Interface

    (2008)
  • N. Hanaki et al.

    Cooperation in evolving social networks

    Manage. Sci.

    (2007)
  • G. Hardin

    The tragedy of the commons

    Science

    (1968)
  • J. Hofbauer et al.

    Evolutionary Games and Population Dynamics

    (1998)
  • L.A. Imhof et al.

    Evolutionary cycles of cooperation and defection

    Proc. Natl. Acad. Sci. USA

    (2005)
  • P. Kollock

    Social dilemmas: the anatomy of cooperation

    Annu. Rev. Sociol.

    (1998)
  • M.W. Macy et al.

    Learning dynamics in social dilemmas

    Proc. Natl. Acad. Sci. USA

    (2002)
  • N. Masuda

    Participation costs dismiss the advantage of heterogeneous networks in evolution of cooperation

    Proc. R. Soc. B

    (2007)
  • J. Maynard-Smith

    Evolution and the Theory of Games

    (1982)
  • J.M. McNamara et al.

    Variation in behaviour promotes cooperation in the Prisoner's Dilemma game

    Nature

    (2004)
  • M. Milinski et al.

    Reputation helps solve the ‘tragedy of the commons’

    Nature

    (2002)
  • M. Molloy et al.

    A critical point for random degree graphs with a given degree sequence

    Random Struct. Algorithm

    (1995)
  • M.A. Nowak

    Five rules for the evolution of cooperation

    Science

    (2006)
  • M.A. Nowak

    Evolutionary dynamics: exploring the equations of life

    (2006)
  • Cited by (175)

    • Heterogeneous negotiation undermines cooperation in prisoner's dilemma game

      2023, Physica A: Statistical Mechanics and its Applications
    View all citing articles on Scopus
    View full text