Skip to main content

How Models Fail

A Critical Look at the History of Computer Simulations of the Evolution of Cooperation

  • Chapter
Collective Agency and Cooperation in Natural and Artificial Systems

Part of the book series: Philosophical Studies Series ((PSSP,volume 122))

Abstract

Simulation models of the Reiterated Prisoner’s Dilemma have been popular for studying the evolution of cooperation since more than 30 years now. However, there have been practically no successful instances of empirical application of any of these models. At the same time this lack of empirical testing and confirmation has almost entirely been ignored by the modelers community. In this paper, I examine some of the typical narratives and standard arguments with which these models are justified by their authors despite the lack of empirical validation. I find that most of the narratives and arguments are not at all compelling. None the less they seem to serve an important function in keeping the simulation business running despite its empirical shortcomings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A referee pointed out to me that there is a tension in my paper between the reliance on a Popperian falsificationism and the implicit use of Kuhn’s paradigm concept. However, both can be reconciled if the former is understood in a normative and the latter in a descriptive sense. Popper’s falsificationism requires, though, that paradigms are not completely incommensurable. But then, there are many good reasons that speak against a strong reading of the incommensurability-thesis, anyway. (See the very enlightening remarks about Kuhn and Duhem-Quine in the case study by Zacharias (2013, 11ff., 305ff.).)

  2. 2.

    More detailed descriptions of the RPD-model and Axelrod’s tournament can be found in Axelrod (1984), Binmore (1994, 1998) or Arnold (2008).

  3. 3.

    The details of this simulation are described in Schüßler (1997, 61ff.) and in a simpler form in Arnold (2008, 291ff.). For the curious: Schüßler achieves his effect, because the non-cooperators that break off the interaction are forced to pick a new partner from a pool that mostly contains non-cooperators from which it is impossible to rip a high payoff.

  4. 4.

    This is my translation. The German original reads: “Eine der zentralen, klassischen Annahmen der normativistischen Soziologie besagt, daß in einer Austauschgesellschaft rationaler Egoisten keine stabilen Kooperationsverhältnisse entstehen können (vgl. Durkheim 1977, Parsons 1949). Angebliche Nachweise für diese These versuchen zu zeigen, daß bereits einfache, analystische Überlegungen zu diesem Schluß ausreichen. Die vorliegende Simulation sollte geeignet sein, diese Sicherheit zu erschüttern.” (Schüßler, 1997, 91)

  5. 5.

    This was partly due to an inadvertency in the design of the model, where OBSERVE moves could – due to random errors – serve much the same function as INNOVATE moves. The authors of the study did, however, verify that their results are not just due to this particular effect Rendell et al (2010a).

References

  • Arnold, Eckhart. 2006. The dark side of the force. When computer simulations lead us astray and model think narrows our imagination. In Pre conference draft for the models and simulations conference, Paris, 12–14 June 2006. http://www.eckhartarnold.de/papers/2006_simulations/Simulations_preconference.html. Accessed 15 Sept 2014.

  • Arnold, Eckhart. 2008. Explaining altruism. A simulation-based approach and its limits. Heusenstamm: Ontos Verlag.

    Book  Google Scholar 

  • Arnold, Eckhart. 2013. Simulation models of the evolution of cooperation as proofs of logical possibilities. How useful are they? Etica & Politica/Ethics & Politics 15(2): 101–138.

    Google Scholar 

  • Arnold, Eckhart. 2014. What’s wrong with social simulations? The Monist 97(3): 361–379.

    Article  Google Scholar 

  • Ashworth, Tony. 1980. Trench warfare 1914–1918. The live and let live system. London: MacMillan Press Ltd.

    Google Scholar 

  • Axelrod, Robert. 1984. The evolution of cooperation. New York: Basic Books.

    Google Scholar 

  • Binmore, Ken. 1994. Game theory and the social contract. I. Playing fair. Cambridge, MA/London: MIT Press.

    Google Scholar 

  • Binmore, Ken. 1998. Game theory and the social contract. II. Just playing. Cambridge, MA/London: MIT Press.

    Google Scholar 

  • Dugatkin, Lee Alan. 1997. Cooperation among animals. New York: Oxford University Press.

    Google Scholar 

  • Dugatkin, Lee Alan. 1998. Game theory and cooperation. In Game theory and animal behavior, ed. Dugatkin Lee Alan and Reeve Hudson Kern, 38–63. New York/Oxford: Oxford University Press.

    Google Scholar 

  • Dugatkin, Lee Alan, and Kern Reeve Hudson. 1998. Game theory and animal behavior. New York/Oxford: Oxford University Press.

    Google Scholar 

  • Durkheim, Émile. 1977. Über die Teilung der sozialen Arbeit. Frankfurt am Main: Suhrkamp.

    Google Scholar 

  • Epstein, Joshua M. 2008. Why model? http://www.santafe.edu/research/publications/workingpapers/08-09-040.pdf. Accessed 15 Sept 2014. (Based on the author’s 2008 Bastille Day keynote address to the Second World Congress on Social Simulation, George Mason University, and earlier addresses at the Institute of Medicine, the University of Michigan, and the Santa Fe Institute.)

  • Green, Donald P., and Ian Shapiro. 1994. Pathologies of rational choice theory. A critique of applications in political science. New Haven/London: Yale University Press.

    Google Scholar 

  • Hammerstein, Peter. 2003. Why is reciprocity so rare in social animals? A protestant appeal. In Genetic and cultural evolution, ed. Hammerstein Peter, 83–94. Cambridge, MA/London: MIT Press.

    Google Scholar 

  • Heath, Brian, Raymond Hill, and Frank Ciarallo. 2009. A survey of agent-based modeling practices (January 1998 to July 2008). Journal of Artificial Societies and Social Simulation 12(4):9. http://jasss.soc.surrey.ac.uk/12/4/9.html. Accessed 15 Sept 2014.

  • Hoffmann, Robert. 2000. Twenty years on: The evolution of cooperation revisited. Journal of Artificial Societies and Social Simulation 3(2). http://jasss.soc.surrey.ac.uk/3/2/forum/1.html. Accessed 15 Sept 2014.

  • Milinski, Manfred. 1987. Tit for tat in sticklebacks and the evolution of cooperation. Nature 325: 433–435.

    Article  Google Scholar 

  • Milinski, Manfred, and Geoffrey A. Parker. 1997. Cooperation under predation risk: A data-based ESS analysis. Proceedings of the Royal Society 264: 1239–1247.

    Article  Google Scholar 

  • Moses, Jonthon W., and Torbjørn L. Knutsen. 2012. Ways of knowing. Competing methodologies in social and political research. London: Palgrave MacMillan.

    Google Scholar 

  • Osborne, Martin J. 2004. An introduction to game theory. New York: Oxford University Press.

    Google Scholar 

  • Parsons, Talcott. 1949. The structure of social action. Glencoe: Free Press, first published: 1937 edition.

    Google Scholar 

  • Popper, Karl R. 1971. Logik der Forschung. Tübingen: Mohr.

    Google Scholar 

  • Rangoni, Ruggero. 2013. Heterogeneous strategy learning in the iterated prisoner’s dilemma. Etica & Politica/Ethics & Politics 15(2): 42–57.

    Google Scholar 

  • Rendell, Luke, R. Boyd, D. Cownden, M. Enquist, K. Eriksson, M.W. Feldman, L. Fogarty, S. Ghirlanda, T. Lillicrap, and Kevin N. Laland. 2010a. Why copy others? Insights from the social learning strategies tournament. Science 328: 208–213.

    Article  Google Scholar 

  • Rendell, Luke, R. Boyd, D. Cownden, M. Enquist, K. Eriksson, M.W. Feldman, L. Fogarty, S. Ghirlanda, T. Lillicrap, and Kevin N. Laland. 2010b. Supporting online material for: Why copy others? Insights from the social learning strategies tournament. Science 328: 2–53.

    Article  Google Scholar 

  • Schurz, Gerhard. 2011. Evolution in Natur und Kultur. Heidelberg: Spektrum Akademischer Verlag.

    Book  Google Scholar 

  • Schüßler, Rudolf. 1997. Kooperation unter Egoisten: Vier Dilemmata. München: R. Oldenbourg Verlag.

    Book  Google Scholar 

  • Trivers, Robert L. 1971. The evolution of reciprocal altruism. The Quarterly Review of Biology 46: 35–57.

    Article  Google Scholar 

  • Zacharias, Sebastian. 2013. The Darwin revolution as a knowledge reorganisation. A historical-epistemological analysis and a reception analysis based on a novel model of scientific theories. Ph.D. thesis, Max-Planck-Institute for the History of Science, Berlin.

    Google Scholar 

  • Zollman, Kevin. 2009. Review of Eckhart Arnold, explaining altruism: A simulation-based approach and its limits. Notre Dame Philosophical Reviews 3. https://ndpr.nd.edu/news/23961-explaining-altruism-a-simulation-based-approach-and-its-limits. Accessed 15 Sept 2014.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eckhart Arnold .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Arnold, E. (2015). How Models Fail. In: Misselhorn, C. (eds) Collective Agency and Cooperation in Natural and Artificial Systems. Philosophical Studies Series, vol 122. Springer, Cham. https://doi.org/10.1007/978-3-319-15515-9_14

Download citation

Publish with us

Policies and ethics