Skip to main content
Erschienen in: AI & SOCIETY 4/2018

31.05.2017 | Open Forum

Games between humans and AIs

verfasst von: Stephen J. DeCanio

Erschienen in: AI & SOCIETY | Ausgabe 4/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Various potential strategic interactions between a “strong” Artificial intelligence (AI) and humans are analyzed using simple 2 × 2 order games, drawing on the New Periodic Table of those games developed by Robinson and Goforth (The topology of the 2 × 2 games: a new periodic table. Routledge, London, 2005). Strong risk aversion on the part of the human player(s) leads to shutting down the AI research program, but alternative preference orderings by the human and the AI result in Nash equilibria with interesting properties. Some of the AI-Human games have multiple equilibria, and in other cases Pareto-improvement over the Nash equilibrium could be attained if the AI’s behavior towards humans could be guaranteed to be benign. The preferences of a superintelligent AI cannot be known in advance, but speculation is possible as to its ranking of alternative states of the world, and how it might assimilate the accumulated wisdom (and folly) of humanity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
For examples from the scholarly literature, see Bostrom (2014), or Gill (2016) and the articles in the issue of AI & Society referenced therein. References in the popular press are numerous; a representative example is Dowd (2017).
 
2
Given that AI research is being pursued assiduously by a wide variety of private and state actors, it is unlikely that the research could be stopped by any policy measures, but we will assume conditionally that it is possible to end it.
 
3
Brams (2003) has also analyzed episodes in the Bible through the lens of these games.
 
4
As Ayoub and Payne (2015) put it, “[a]t a minimum… AI’s goals will likely include survival, in order to meet its wider future oriented goals.”.
 
5
Before proceeding, we need to dismiss the situation in which the AI is indifferent to humans and cares only about its own existence and survival. This can be modeled by specifying a = c = 2 and b = d = 1. The human player is the only party in this game that makes a strategic choice. The only case in which he will not simply shut down the AI is if his highest-ranked outcome is to run a benign AI. In this case that will be the equilibrium outcome—the AI is indifferent to humans, and Benign/Run is a Nash equilibrium. These games are degenerate cases, because the AI is not really making a strategic choice.
 
6
A Pareto-superior move is one in which each player is at least as well off as in the starting position. In Games h-1, h-2, and h-3, both players rank the outcome with Benign and Run higher than the rankings for the Nash Equilibrium combination of Hostile and Shut Down.
 
7
The games in this paragraph are all referred to by their Robinson–Goforth numbers.
 
8
Asimov is by no means the only science fiction writer who has explored AI with philosophical depth. Other examples include Simmons (1989, 1990, 1995, 1997) and Piercy (1991). Simmons imagines different factions among AIs having differing attitudes towards humans. Piercy offers a post-apocalyptic setting for the Golem legend, one of the recurring popular themes in Jewish folklore (see Goldsmith 1981 for a review of the history of the tales of the Golem).
 
9
Even more simply, what if “harm” in the form of punishment of a child leads to proper development of the child’s character and improves his well-being later in life?
 
10
Earlier in the fictional time sequence that is common to all of Asimov’s novels involving robots and the spread of humans through the galaxy.
 
11
An extensive treatment is given in Gunn (1982), who notes that Asimov was always careful to acknowledge that the John Campbell originally suggested the “Three Laws of Robotics.”
 
12
Note that the games described in Tables 6 and 7 below are not the same as Brams’ “Revelation Game” (1983) in which God’s choices are to reveal himself or not to humans, and the humans’ choice is whether to believe in God or not.
 
13
Recent treatments of the complicated ethical dilemmas arising with autonomous AIs are Pereira and Saptawijaya (2016), and the collection of essays edited by Anderson and Anderson (2011).
 
14
There is of course a vast literature on Natural Law going back as far as Heraclitus and extending through Aristotle and St. Thomas Aquinas down to the present day. See Rommen (1998 [1936]), Budziszewski (1997) and the modern survey by Finnis (2011). In the version of Natural Law given succinctly by Lewis in The Abolition of Man (1962 [1947]), the principles are apprehended as a priori truths. Lewis’s “Tao” is a synthesis of guidance for living that embodies principles such as general and special beneficences, duties to parents, elders, ancestors, children, and posterity, laws of justice, and the like. Other treatments of Natural Law emphasize alternative formulations, both theistic and non-theistic.
 
15
Turning a proto-AI loose on social media recently had a disgusting and embarrassing result. Microsoft’s “Tay,” a chat bot intended to “mimic the verbal tics of a 19-year old American girl,” was coxed by Twitter users “into regurgitating some seriously offensive language, including pointedly racist and sexist remarks.” Tay was quickly taken offline (Alba 2016).
 
16
As in the case of Frankenstein’s monster (Shelley 1818), some modern versions of the golem myth including Rothberg (1971) and Ozick (1997), and the character of Lt. Data in “Star Trek: The Next Generation.”.
 
Literatur
Zurück zum Zitat Anderson M, Anderson SL (eds) (2011) Machine ethics. Cambridge University Press, Cambridge Anderson M, Anderson SL (eds) (2011) Machine ethics. Cambridge University Press, Cambridge
Zurück zum Zitat Asimov I (1941) Liar. Astounding Science Fiction, Street and Smith Publications, New York Asimov I (1941) Liar. Astounding Science Fiction, Street and Smith Publications, New York
Zurück zum Zitat Asimov I (1985) Robots and empire. Doubleday & Company Inc, New York Asimov I (1985) Robots and empire. Doubleday & Company Inc, New York
Zurück zum Zitat Ayoub K, Payne K (2015) Strategy in the age of artificial intelligence. J Strateg Stud 39(5–6):793–819 Ayoub K, Payne K (2015) Strategy in the age of artificial intelligence. J Strateg Stud 39(5–6):793–819
Zurück zum Zitat Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford University Press, Oxford Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford University Press, Oxford
Zurück zum Zitat Brams SJ (1983) Superior beings: if they exist, how would we know? Game-theoretic implications of omniscience, omnipotence, immortality, and incomprehensibility. Springer, New YorkCrossRef Brams SJ (1983) Superior beings: if they exist, how would we know? Game-theoretic implications of omniscience, omnipotence, immortality, and incomprehensibility. Springer, New YorkCrossRef
Zurück zum Zitat Brams SJ (1994) Theory of moves. Cambridge University Press, CambridgeMATH Brams SJ (1994) Theory of moves. Cambridge University Press, CambridgeMATH
Zurück zum Zitat Brams SJ (2003) Biblical games: game theory and the Hebrew bible. The MIT Press, CambridgeMATH Brams SJ (2003) Biblical games: game theory and the Hebrew bible. The MIT Press, CambridgeMATH
Zurück zum Zitat Budziszewski J (1997) Written on the heart: the case for natural law. InterVarsity Press, Downers Grove, IL Budziszewski J (1997) Written on the heart: the case for natural law. InterVarsity Press, Downers Grove, IL
Zurück zum Zitat Dautenhahn K (2007) Socially intelligent robots: dimensions of human-robot interaction. Philos Trans R Soc B 362:679–704CrossRef Dautenhahn K (2007) Socially intelligent robots: dimensions of human-robot interaction. Philos Trans R Soc B 362:679–704CrossRef
Zurück zum Zitat DeCanio SJ (2016) Robots and humans—Complements or substitutes? J Macroecon 49:280–291CrossRef DeCanio SJ (2016) Robots and humans—Complements or substitutes? J Macroecon 49:280–291CrossRef
Zurück zum Zitat DeCanio SJ, Fremstad A (2013) Game theory and climate diplomacy. Ecol Econ 85:177–187CrossRef DeCanio SJ, Fremstad A (2013) Game theory and climate diplomacy. Ecol Econ 85:177–187CrossRef
Zurück zum Zitat Finnis J (2011) Natural law & natural rights, 2nd edn. Oxford University Press, Oxford Finnis J (2011) Natural law & natural rights, 2nd edn. Oxford University Press, Oxford
Zurück zum Zitat Gill KS (2016) Artificial super intelligence: beyond rhetoric. AI Soc 31:137–143CrossRef Gill KS (2016) Artificial super intelligence: beyond rhetoric. AI Soc 31:137–143CrossRef
Zurück zum Zitat Goldsmith AL (1981) The Golem remembered, 1909-1980. Wayne State University Press, Detroit Goldsmith AL (1981) The Golem remembered, 1909-1980. Wayne State University Press, Detroit
Zurück zum Zitat Gunn J (1982) Isaac Asimov: the foundations of science fiction. Oxford University Press, Oxford Gunn J (1982) Isaac Asimov: the foundations of science fiction. Oxford University Press, Oxford
Zurück zum Zitat Hanson R (2016) The age of Em. Oxford University Press, Oxford Hanson R (2016) The age of Em. Oxford University Press, Oxford
Zurück zum Zitat Ingrao B, Israel G (1990 [1987]) The invisible hand: economic equilibrium in the history of science (trans: McGilvray I). The MIT Press, Cambridge Ingrao B, Israel G (1990 [1987]) The invisible hand: economic equilibrium in the history of science (trans: McGilvray I). The MIT Press, Cambridge
Zurück zum Zitat Lewis CS (1962) The abolition of man. Collier Books, New York Lewis CS (1962) The abolition of man. Collier Books, New York
Zurück zum Zitat Madani K (2013) Modeling international climate change negotiations more responsibly: can highly simplified game theory models provide reliable policy insights? Ecol Econ 90:68–76CrossRef Madani K (2013) Modeling international climate change negotiations more responsibly: can highly simplified game theory models provide reliable policy insights? Ecol Econ 90:68–76CrossRef
Zurück zum Zitat Nagel T (1979) What is it like to be a bat? In: Nagel T (ed) Mortal questions. Cambridge University Press, Cambridge Nagel T (1979) What is it like to be a bat? In: Nagel T (ed) Mortal questions. Cambridge University Press, Cambridge
Zurück zum Zitat Ozick C (1997) The Puttermesser papers. Vintage International, New York Ozick C (1997) The Puttermesser papers. Vintage International, New York
Zurück zum Zitat Pereira LM, Saptawijaya A (2016) Programming machine ethics. Springer, SwitzerlandCrossRef Pereira LM, Saptawijaya A (2016) Programming machine ethics. Springer, SwitzerlandCrossRef
Zurück zum Zitat Piercy M (1991) He, she and it. Fawcett Books, New York Piercy M (1991) He, she and it. Fawcett Books, New York
Zurück zum Zitat Rapoport A, Guyer MJ, Gordon DD (1976) The 2 × 2 game. University of Michigan Press, Ann Arbor Rapoport A, Guyer MJ, Gordon DD (1976) The 2 × 2 game. University of Michigan Press, Ann Arbor
Zurück zum Zitat Robinson D, Goforth D (2005) The topology of the 2 × 2 games: a new periodic table. Routledge, LondonMATH Robinson D, Goforth D (2005) The topology of the 2 × 2 games: a new periodic table. Routledge, LondonMATH
Zurück zum Zitat Rommen HA (1998) The natural law: a study in legal and social history and philosophy. Liberty Fund, Indianapolis Rommen HA (1998) The natural law: a study in legal and social history and philosophy. Liberty Fund, Indianapolis
Zurück zum Zitat Rothberg A (1971) The sword of the Golem. Bantam Books, New York Rothberg A (1971) The sword of the Golem. Bantam Books, New York
Zurück zum Zitat Shelley MW (1818) Frankenstein. A Public Domain Book Shelley MW (1818) Frankenstein. A Public Domain Book
Zurück zum Zitat Simmons D (1989) The Hyperion Cantos. Hyperion. Ballantine Books, New York Simmons D (1989) The Hyperion Cantos. Hyperion. Ballantine Books, New York
Zurück zum Zitat Simmons D (1990) The Hyperion Cantos. The Fall of Hyperion. Ballantine Books, New York Simmons D (1990) The Hyperion Cantos. The Fall of Hyperion. Ballantine Books, New York
Zurück zum Zitat Simmons D (1995) The Hyperion Cantos. Endymion. Ballantine Books, New York Simmons D (1995) The Hyperion Cantos. Endymion. Ballantine Books, New York
Zurück zum Zitat Simmons D (1997) The Hyperion Cantos. The Rise of Endymion (1997). Ballantine Books, New York Simmons D (1997) The Hyperion Cantos. The Rise of Endymion (1997). Ballantine Books, New York
Zurück zum Zitat Vinge V (1993) The coming technological singularity: how to survive in the post-human era. VISION-21 symposium sponsored by NASA Lewis Research Center and the Ohio Aerospace Institute, March 30-31 Vinge V (1993) The coming technological singularity: how to survive in the post-human era. VISION-21 symposium sponsored by NASA Lewis Research Center and the Ohio Aerospace Institute, March 30-31
Metadaten
Titel
Games between humans and AIs
verfasst von
Stephen J. DeCanio
Publikationsdatum
31.05.2017
Verlag
Springer London
Erschienen in
AI & SOCIETY / Ausgabe 4/2018
Print ISSN: 0951-5666
Elektronische ISSN: 1435-5655
DOI
https://doi.org/10.1007/s00146-017-0732-5

Weitere Artikel der Ausgabe 4/2018

AI & SOCIETY 4/2018 Zur Ausgabe

Premium Partner