Skip to main content
Erschienen in: AI & SOCIETY 4/2020

25.04.2020 | Original Article

Artificial virtue: the machine question and perceptions of moral character in artificial moral agents

verfasst von: Patrick Gamez, Daniel B. Shank, Carson Arnold, Mallory North

Erschienen in: AI & SOCIETY | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Virtue ethics seems to be a promising moral theory for understanding and interpreting the development and behavior of artificial moral agents. Virtuous artificial agents would blur traditional distinctions between different sorts of moral machines and could make a claim to membership in the moral community. Accordingly, we investigate the “machine question” by studying whether virtue or vice can be attributed to artificial intelligence; that is, are people willing to judge machines as possessing moral character? An experiment describes situations where either human or AI agents engage in virtuous or vicious behavior and experiment participants then judge their level of virtue or vice. The scenarios represent different virtue ethics domains of truth, justice, fear, wealth, and honor. Quantitative and qualitative analyses show that moral attributions are weakened for AIs compared to humans, and the reasoning and explanations for the attributions are varied and more complex. On “relational” views of membership in the moral community, virtuous machines would indeed be included, even if they are indeed weakened. Hence, while our moral relationships with artificial agents may be of the same types, they may yet remain substantively different than our relationships to human beings.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
A fourth type discussed by Moor, “ethical-impact machines,” are not autonomous in the ways that would make them relevant to the discussion here.
 
2
The point of the distinction seems designed to mark a gap between machines that simply produce good outcomes or do not wrong us, and machines that approximate moral agency insofar as they are at least causally responsible for the decisions they make, actions they take, and consequences they produce, just as the further distinction between explicit and full moral agents seems intended to forestall intuitions about human (moral) exceptionality. But thinking about explicit ethical agency in terms of explicit ethical reasoning makes serious presumptions about the nature of ethics, ethical reasoning, and moral psychology. After all, it seems that human beings are capable of behaving ethically without anything like the explicit, conscious representation of ethical rules (Hitlin 2008). We seem to be able to respond morally to situations on the go without deliberation in all sorts of situations.
 
3
It might be the case that machine learning could allow for the instantiation of a utilitarian or deontological AMA; such an algorithm, properly trained, would act in ways that would be, in fact, the same as one would arrive at by the proper and consistent application of the principle of utility or, say, the Categorical Imperative, respectively. Thanks to an anonymous referee for making explicit this possibility. But insofar as the actual application of the rules is genuinely opaque—say, in the way that the behavior of AlphaGO was opaque—it seems to us that this would be, in appearance, similar enough to the acquisition of the virtues, i.e., responding reliably to salient features of a situation, as to be the same sort of moral agent we are interested in. In any case, we do not intend to claim that a moral machine must look like a virtuous agent, but only to suggest that it seems a plausible candidate, and to draw out some implications.
 
4
An analogous worry about the authenticity of care, or feelings in general, on the part of machines, can be found in Turkle (2011).
 
5
From a virtue ethics perspective, it might be that the very language of “full moral agents” isn’t quite adequate; it’s clearly beyond the scope of this paper to propose or defend a replacement concept, but it seems like the thrust of the argument of this paper doesn’t depend on these sorts of details.
 
6
For an example that sketches how this might be done in the case of environmental ethics, see Gamez (2018).
 
Literatur
Zurück zum Zitat Annas J (2016) Learning virtue rules: the issue of thick concepts. In: Annas J, Narvaez D, Snow NE (eds) Developing the virtues: integrating perspectives. Oxford University Press, New York, pp 224–234CrossRef Annas J (2016) Learning virtue rules: the issue of thick concepts. In: Annas J, Narvaez D, Snow NE (eds) Developing the virtues: integrating perspectives. Oxford University Press, New York, pp 224–234CrossRef
Zurück zum Zitat Aristotle (2011) Aristotle’s nicomachean ethics (trans and ed: Bartlett RC, Collins SD). University of Chicago, Chicago Aristotle (2011) Aristotle’s nicomachean ethics (trans and ed: Bartlett RC, Collins SD). University of Chicago, Chicago
Zurück zum Zitat Berberich N, Diepold K (2018) The virtuous machine-old ethics for new technology? arXiv preprint arXiv:1806.10322 Berberich N, Diepold K (2018) The virtuous machine-old ethics for new technology? arXiv preprint arXiv:1806.10322
Zurück zum Zitat Boden MA (2006) Mind as machine: a history of cognitive science. Clarendon Press, Oxford Boden MA (2006) Mind as machine: a history of cognitive science. Clarendon Press, Oxford
Zurück zum Zitat Boden MA (2016) AI: its nature and future. Oxford University Press, New York Boden MA (2016) AI: its nature and future. Oxford University Press, New York
Zurück zum Zitat Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford, New York Bostrom N (2014) Superintelligence: paths, dangers, strategies. Oxford, New York
Zurück zum Zitat Coeckelbergh M (2010) Robot rights? Towards a social-relational justification of moral consideration. Ethics Inf Technol 12(3):209–221CrossRef Coeckelbergh M (2010) Robot rights? Towards a social-relational justification of moral consideration. Ethics Inf Technol 12(3):209–221CrossRef
Zurück zum Zitat Danaher J (2016) The threat of algocracy: reality, resistance, and accommodation. Philos Technol 29:245–268CrossRef Danaher J (2016) The threat of algocracy: reality, resistance, and accommodation. Philos Technol 29:245–268CrossRef
Zurück zum Zitat Dastur F (2011) The question of the other in French phenomenology. Cont Philos Rev 44(2):165–178CrossRef Dastur F (2011) The question of the other in French phenomenology. Cont Philos Rev 44(2):165–178CrossRef
Zurück zum Zitat Eubanks V (2018) Automating inequality: how high-tech tools profile, police, and punish the poor. St Martin’s, New York Eubanks V (2018) Automating inequality: how high-tech tools profile, police, and punish the poor. St Martin’s, New York
Zurück zum Zitat Gamez P (2018) Metaphysics or metaphors for the anthropocene? Scientific naturalism and the agency of things. Open Philos 1(1):191–212CrossRef Gamez P (2018) Metaphysics or metaphors for the anthropocene? Scientific naturalism and the agency of things. Open Philos 1(1):191–212CrossRef
Zurück zum Zitat Govindarajulu NS, Bringsjord S, Ghosh R, Sarathy V (2019) Toward the engineering of virtuous machines. In: Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, pp 29–35. ACM Govindarajulu NS, Bringsjord S, Ghosh R, Sarathy V (2019) Toward the engineering of virtuous machines. In: Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, pp 29–35. ACM
Zurück zum Zitat Gunkel DJ (2012) The machine question: critical perspectives on AI, robots, and ethics. MIT Press, CambridgeCrossRef Gunkel DJ (2012) The machine question: critical perspectives on AI, robots, and ethics. MIT Press, CambridgeCrossRef
Zurück zum Zitat Hitlin S (2008) Moral selves, evil selves: the social psychology of conscience. Palgrave Macmillan, New YorkCrossRef Hitlin S (2008) Moral selves, evil selves: the social psychology of conscience. Palgrave Macmillan, New YorkCrossRef
Zurück zum Zitat Howard D, Muntean I (2017) Artificial moral cognition: moral functionalism and autonomous moral agency. In: Philos Comput, pp 121–159. Springer, Cham Howard D, Muntean I (2017) Artificial moral cognition: moral functionalism and autonomous moral agency. In: Philos Comput, pp 121–159. Springer, Cham
Zurück zum Zitat Hursthouse R (1999) On virtue ethics. OUP, Oxford Hursthouse R (1999) On virtue ethics. OUP, Oxford
Zurück zum Zitat Keown D (2005) Buddhist ethics: a very short introduction. Oxford University Press, New YorkCrossRef Keown D (2005) Buddhist ethics: a very short introduction. Oxford University Press, New YorkCrossRef
Zurück zum Zitat Knobe J (2003a) Intentional action in folk psychology: an experimental investigation. Philos Psychol 16(2):309–324CrossRef Knobe J (2003a) Intentional action in folk psychology: an experimental investigation. Philos Psychol 16(2):309–324CrossRef
Zurück zum Zitat Knobe J (2003b) Intentional action and side effects in ordinary language. Analysis 63(3):190–194CrossRef Knobe J (2003b) Intentional action and side effects in ordinary language. Analysis 63(3):190–194CrossRef
Zurück zum Zitat Large W (2015) Levinas’ “Totality and Infinity”: a reader’s guide. Bloomsbury Publishing, New York Large W (2015) Levinas’ “Totality and Infinity”: a reader’s guide. Bloomsbury Publishing, New York
Zurück zum Zitat Moor J (2006) The nature, importance, and difficulty of machine ethics. IEEE Intell Syst 21(4):18–21CrossRef Moor J (2006) The nature, importance, and difficulty of machine ethics. IEEE Intell Syst 21(4):18–21CrossRef
Zurück zum Zitat Malle BF, Magar ST, Scheutz M (2019) AI in the sky: how people morally evaluate human and machine decisions in a lethal strike dilemma. In: Ferreira IA, Sequeira JS, Virk GS, Kadar EE, Tokhi O (eds) Robots and eell-being. Springer Verlag, Berlin, pp 111–133CrossRef Malle BF, Magar ST, Scheutz M (2019) AI in the sky: how people morally evaluate human and machine decisions in a lethal strike dilemma. In: Ferreira IA, Sequeira JS, Virk GS, Kadar EE, Tokhi O (eds) Robots and eell-being. Springer Verlag, Berlin, pp 111–133CrossRef
Zurück zum Zitat McDermott D (2011) What matters to a machine?. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 88–114CrossRef McDermott D (2011) What matters to a machine?. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 88–114CrossRef
Zurück zum Zitat Morgan ML (2007) Discovering levinas. Cambridge University Press, New YorkCrossRef Morgan ML (2007) Discovering levinas. Cambridge University Press, New YorkCrossRef
Zurück zum Zitat Nass C, Moon Y (2000) Machines and Mindlessness: Social Responses to Computers. J Soc Issues 56(1):81–103CrossRef Nass C, Moon Y (2000) Machines and Mindlessness: Social Responses to Computers. J Soc Issues 56(1):81–103CrossRef
Zurück zum Zitat Noble S (2018) Algorithms of oppression: how search engines reinforce racism. NYU, New YorkCrossRef Noble S (2018) Algorithms of oppression: how search engines reinforce racism. NYU, New YorkCrossRef
Zurück zum Zitat O’Neil C (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. Crown, New YorkMATH O’Neil C (2016) Weapons of math destruction: how big data increases inequality and threatens democracy. Crown, New YorkMATH
Zurück zum Zitat Regan T (1987) The case for animal rights. In: Adv Anim Welf Sci, pp 179–189. Springer, Dordrecht Regan T (1987) The case for animal rights. In: Adv Anim Welf Sci, pp 179–189. Springer, Dordrecht
Zurück zum Zitat Shank DB (2013) Are computers good or bad for business? How mediated customer-computer interaction alters emotion, impressions, and patronage toward organizations. Comput Hum Behav 29(3):715–725CrossRef Shank DB (2013) Are computers good or bad for business? How mediated customer-computer interaction alters emotion, impressions, and patronage toward organizations. Comput Hum Behav 29(3):715–725CrossRef
Zurück zum Zitat Shank DB (2014) Impressions of computer and human agents after interaction: computer identity weakens power but not goodness impressions. Int J Hum Comput Stud 72(10–11):747–756CrossRef Shank DB (2014) Impressions of computer and human agents after interaction: computer identity weakens power but not goodness impressions. Int J Hum Comput Stud 72(10–11):747–756CrossRef
Zurück zum Zitat Sejnowski M (2018) The deep learning revolution: machine intelligence meets human intelligence. The MIT Press, CambridgeCrossRef Sejnowski M (2018) The deep learning revolution: machine intelligence meets human intelligence. The MIT Press, CambridgeCrossRef
Zurück zum Zitat Sim M (2017) Confucian and daoist virtue ethics. In: Carr D, Arthur J, Kristjánsson K (eds) Varieties of virtue ethics. Palgrave Macmillan, London, pp 105–121CrossRef Sim M (2017) Confucian and daoist virtue ethics. In: Carr D, Arthur J, Kristjánsson K (eds) Varieties of virtue ethics. Palgrave Macmillan, London, pp 105–121CrossRef
Zurück zum Zitat Singer P (1975) Animal liberation: a new ethics for the treatment of animals. New York Review, New York Singer P (1975) Animal liberation: a new ethics for the treatment of animals. New York Review, New York
Zurück zum Zitat Smith H (2012) Using moral principles to guide actions. Philos Investig 22:369–386 Smith H (2012) Using moral principles to guide actions. Philos Investig 22:369–386
Zurück zum Zitat Strawson PF (1962) Freedom and resentment. In: Watson G (ed) Proceedings of the British Academy, Oxford, vol 48, pp 1–25 Strawson PF (1962) Freedom and resentment. In: Watson G (ed) Proceedings of the British Academy, Oxford, vol 48, pp 1–25
Zurück zum Zitat Torrance S (2011) Machine ethics and the idea of a more-than-human moral world. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 115–137CrossRef Torrance S (2011) Machine ethics and the idea of a more-than-human moral world. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 115–137CrossRef
Zurück zum Zitat Turkle S (2011) Authenticity in the age of digital companions. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 62–76CrossRef Turkle S (2011) Authenticity in the age of digital companions. In: Anderson M, Anderson SL (eds) Machine ethics. Cambridge University Press, New York, pp 62–76CrossRef
Zurück zum Zitat Vallor S (2016) Technology and the virtues: a philosophical guide to a future worth wanting. Oxford University Press, OxfordCrossRef Vallor S (2016) Technology and the virtues: a philosophical guide to a future worth wanting. Oxford University Press, OxfordCrossRef
Zurück zum Zitat van Wynsberghe A, Robbins S (2019) Critiquing the reasons for making moral machines. Sci Eng Ethics 25:719–735CrossRef van Wynsberghe A, Robbins S (2019) Critiquing the reasons for making moral machines. Sci Eng Ethics 25:719–735CrossRef
Zurück zum Zitat Wallach W, Allen C (2009) Moral machines: teaching robots right from wrong. Oxford University Press, OxfordCrossRef Wallach W, Allen C (2009) Moral machines: teaching robots right from wrong. Oxford University Press, OxfordCrossRef
Zurück zum Zitat Yampolskiy R (2013) Artificial intelligence safety engineering: why machine ethics is a wrong approach. In: Müller V (ed) Philosophy and theory of artificial intelligence. Springer, New York, pp 389-396CrossRef Yampolskiy R (2013) Artificial intelligence safety engineering: why machine ethics is a wrong approach. In: Müller V (ed) Philosophy and theory of artificial intelligence. Springer, New York, pp 389-396CrossRef
Metadaten
Titel
Artificial virtue: the machine question and perceptions of moral character in artificial moral agents
verfasst von
Patrick Gamez
Daniel B. Shank
Carson Arnold
Mallory North
Publikationsdatum
25.04.2020
Verlag
Springer London
Erschienen in
AI & SOCIETY / Ausgabe 4/2020
Print ISSN: 0951-5666
Elektronische ISSN: 1435-5655
DOI
https://doi.org/10.1007/s00146-020-00977-1

Weitere Artikel der Ausgabe 4/2020

AI & SOCIETY 4/2020 Zur Ausgabe

Premium Partner