Skip to main content
Erschienen in: Ethics and Information Technology 3/2018

08.06.2018 | Original Paper

What has the Trolley Dilemma ever done for us (and what will it do in the future)? On some recent debates about the ethics of self-driving cars

verfasst von: Andreas Wolkenstein

Erschienen in: Ethics and Information Technology | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Self-driving cars currently face a lot of technological problems that need to be solved before the cars can be widely used. However, they also face ethical problems, among which the question of crash-optimization algorithms is most prominently discussed. Reviewing current debates about whether we should use the ethics of the Trolley Dilemma as a guide towards designing self-driving cars will provide us with insights about what exactly ethical research does. It will result in the view that although we need the ethics of the Trolley Dilemma as important input for self-driving cars, the route towards simply implementing it into automated cars is blocked.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Per November 2016; see http://​perma.​cc/​F9N2-N6QS.
 
2
This claim can be understood in more than one way, as one reviewer rightly pointed out. One reading would see a triviality in claiming that usefulness depends on use. Usefulness, however, is different from use since the former, but not the latter, is an evaluative term. Here, however, I want to express the idea that particularly with regard to SDCs, their promise to reduce traffic fatalities depends on their widespread use because we cannot reap the SDCs full benefits if they are not used by everyone. The reason is that only to the extent that SDCs interact with other SDCs on the road without the interference of humans who happen to make mistakes can they work according to their purpose (which is: to make traffic safer). The same holds true with regard to vaccination, for example: only if a majority of people are vaccinated, the usefulness of vaccination is fully implemented.”
 
3
Some of the voices discussed below were not raised in an academic journal, but, for example, in publicly accessible blogs. Nevertheless, they deserve serious attention since they reflect (and probably influence) the public opinion about SDCs.
 
4
This is not to say that just because humans happen to reason that way, it is the correct way, as one reviewer remarked. However, the argument pursued here goes a step further and argues that there is some reason behind the fact that humans sometimes judge and act in a utilitarian way.
 
5
Thanks to an anonymous reviewer for making this point.
 
6
One reason to assume the truth of this thesis is the fact that we are able to talk about morality, rightness and goodness, even in the face of widespread pluralism. The fact that we can and do discuss moral issues is explained by a shared concept of morality, as opposed to differing conceptions of morality. I want to thank an anonymous reviewer for pressing me to clarify this extremely important issue.
 
7
An argument somewhat similar to the one advanced by Nyholm and Smids can be found in Hevelke and Nida-Rümelin (2015). In their view, the ethics of SDCs is not accessible using the TD. They argue that a utilitarian algorithm can be ethically justified as long as the victim’s identity (i.e. those to whom the SDC directs its trajectory) is not fixed prior to the crash and the algorithms reduces the total number of victims. In this case, SDCs realize a general decrease of the risk of dying in an accident, without being biased towards one group of persons or an individual having a higher risk of getting hurt by a SDC. Hevelke and Nida-Rümelin argue that this situation differs from a Trolley Dilemma where the identity of the actual and possible victims are known, thus the ethics of SDCs should rather not make use of the Trolley Dilemma to come to an ethical conclusion about crash-optimizing algorithms. However, when a group decides about the rules guiding SDCs in their community, no one knows on which side s/he will end up when it comes to a crash: they can end up in the group consisting of five persons or they can be the single person on the track (or be the passenger of the SDC). This means that should we try to find a rule guiding the behavior of SDCs in advance, the TD can actually be used to describe that situation with the same results that Hevelke and Nida-Rümelin find. See also Wolkenstein (2017b) for a discussion of this kind of argument.
 
8
That the TD is important might seem like a weak conclusion, as a reviewer has pointed out. However, since there are voices that wish to downplay the role of and research into the TD, this article has provided arguments to support the TD. Moreover, since it has revealed a few insights into what ethical research can do, it has cleared the path towards locating ethics more properly in technology development (see below).
 
9
“Widespread acceptance” has to be understood in the context of the promise that SDCs make: They can reduce traffic-related fatalities to the extent that the human factor is eliminated and only (or mostly) SDCs are on the streets.
 
Literatur
Zurück zum Zitat Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016). The social dilemma of autonomous vehicles. Science, 352(6293), 1573–1576.CrossRef Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016). The social dilemma of autonomous vehicles. Science, 352(6293), 1573–1576.CrossRef
Zurück zum Zitat Brennan, J., & Jaworski, P. M. (2016). Markets without limits. Moral virtues and commercial interests. New York: Routledge. Brennan, J., & Jaworski, P. M. (2016). Markets without limits. Moral virtues and commercial interests. New York: Routledge.
Zurück zum Zitat Collingridge, D. (1980). The social control of technology. London: Frances Pinter. Collingridge, D. (1980). The social control of technology. London: Frances Pinter.
Zurück zum Zitat Foot, P. (1967). The problem of abortion and the doctrine of double effect. Oxford Review, 5, 5–15. Foot, P. (1967). The problem of abortion and the doctrine of double effect. Oxford Review, 5, 5–15.
Zurück zum Zitat Greene, J. (2013). Moral tribes: Emotion, reason, and the gap between us and them. New York: Penguin. Greene, J. (2013). Moral tribes: Emotion, reason, and the gap between us and them. New York: Penguin.
Zurück zum Zitat Joyce, R. (2006). The evolution of morality. Cambridge, MA: MIT Press. Joyce, R. (2006). The evolution of morality. Cambridge, MA: MIT Press.
Zurück zum Zitat Kamm, F. (2015). The trolley mysteries. Oxford: Oxford University Press.CrossRef Kamm, F. (2015). The trolley mysteries. Oxford: Oxford University Press.CrossRef
Zurück zum Zitat Knobe, J. (2003). Intentional action and side effects in ordinary language. Analysis, 63, 190–193.CrossRef Knobe, J. (2003). Intentional action and side effects in ordinary language. Analysis, 63, 190–193.CrossRef
Zurück zum Zitat Knobe, J. (2008). The concept of intentional action. A case study in the uses of folk psychology. In J. Knobe & S. Nichols (Eds.), Experimental philosophy (pp. 129–148). Oxford: Oxford University Press. Knobe, J. (2008). The concept of intentional action. A case study in the uses of folk psychology. In J. Knobe & S. Nichols (Eds.), Experimental philosophy (pp. 129–148). Oxford: Oxford University Press.
Zurück zum Zitat Lin, P. (2016). Why ethics matters for autonomous driving. In M. Maurer, J. C. Gerdes, B. Lenz & H. Winner (Eds.), Autonomous driving. Technical, legal and social aspects (pp. 69–85). Berlin: Springer. Lin, P. (2016). Why ethics matters for autonomous driving. In M. Maurer, J. C. Gerdes, B. Lenz & H. Winner (Eds.), Autonomous driving. Technical, legal and social aspects (pp. 69–85). Berlin: Springer.
Zurück zum Zitat Liu, H.-Y. (2016). Structural discrimination and autonomous vehicles: Immunity devices, trump cards and crash optimisation. In J. Seibt, M. Norskov & S. Schack Andersen (Eds.), What social robots can and should do (pp. 164–173). Amsterdam: IOS Press. Liu, H.-Y. (2016). Structural discrimination and autonomous vehicles: Immunity devices, trump cards and crash optimisation. In J. Seibt, M. Norskov & S. Schack Andersen (Eds.), What social robots can and should do (pp. 164–173). Amsterdam: IOS Press.
Zurück zum Zitat Malle, B. F., Scheutz, M., Arnold, T., Voiklis, J., & Cusimano, C. (2015). Sacrifice one for the good of many? People apply different moral norms to human and robot agents. Paper presented at the HRI 15, Portland, OG, USA. Malle, B. F., Scheutz, M., Arnold, T., Voiklis, J., & Cusimano, C. (2015). Sacrifice one for the good of many? People apply different moral norms to human and robot agents. Paper presented at the HRI 15, Portland, OG, USA.
Zurück zum Zitat Maurer, M., Gerdes, J. C., Lenz, B., & Winner, H. (Eds.). (2015). Autonomes Fahren. Technische, rechtliche und gesellschaftliche Aspekte. Berlin: Springer Vieweg. Maurer, M., Gerdes, J. C., Lenz, B., & Winner, H. (Eds.). (2015). Autonomes Fahren. Technische, rechtliche und gesellschaftliche Aspekte. Berlin: Springer Vieweg.
Zurück zum Zitat Mikhail, J. (2013). Elements of moral cognition. Cambridge: Cambridge University Press. Mikhail, J. (2013). Elements of moral cognition. Cambridge: Cambridge University Press.
Zurück zum Zitat Navarette, C. D., MacDonald, M. M., Mott, M. L., & Asher, B. (2012). Virtual morality: Emotion and action in a simulated three-dimensional “Trolley problem”. Emotion, 12(2), 364–370.CrossRef Navarette, C. D., MacDonald, M. M., Mott, M. L., & Asher, B. (2012). Virtual morality: Emotion and action in a simulated three-dimensional “Trolley problem”. Emotion, 12(2), 364–370.CrossRef
Zurück zum Zitat Pan, X., & Slater, M. (2011a). Confronting a moral dilemma in virtual reality: A pilot study. In HCI 2011, the 25th BCS Conference on Human Computer Interaction, July 4–8, 2011, Newcastle Upon Tyne, 2011. Pan, X., & Slater, M. (2011a). Confronting a moral dilemma in virtual reality: A pilot study. In HCI 2011, the 25th BCS Conference on Human Computer Interaction, July 4–8, 2011, Newcastle Upon Tyne, 2011.
Zurück zum Zitat Pan, X., & Slater, M. (2011b). Computer-based video and virtual environments in the study of the role of emotions in moral behavior. In S. D’Mello, A. Graesser, B. Schuller, & J.-C. Martin (Eds.), Affective Computing and Intelligent Interaction. Fourth International Conference ACII 2011, October 9–12, 2011, Proceedings Part II, Memphis, TN, USA, 2011 (pp. 52–61). Pan, X., & Slater, M. (2011b). Computer-based video and virtual environments in the study of the role of emotions in moral behavior. In S. D’Mello, A. Graesser, B. Schuller, & J.-C. Martin (Eds.), Affective Computing and Intelligent Interaction. Fourth International Conference ACII 2011, October 9–12, 2011, Proceedings Part II, Memphis, TN, USA, 2011 (pp. 52–61).
Zurück zum Zitat Pan, X., & Slater, M. (2011c). Should you push the switch, and would you? An experimental study on a moral dilemma in virtual reality. Paper presented at the Moral Emotions and Intuitions (MEI), The Hague, Netherlands. Pan, X., & Slater, M. (2011c). Should you push the switch, and would you? An experimental study on a moral dilemma in virtual reality. Paper presented at the Moral Emotions and Intuitions (MEI), The Hague, Netherlands.
Zurück zum Zitat Society of Automotive Engineers. (2016). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles (J3016_201609): SAE International. Society of Automotive Engineers. (2016). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles (J3016_201609): SAE International.
Zurück zum Zitat Thierer, A. (2016). Permissionless innovation. The continuing case for comprehensive technological freedom. Revised and expanded edition. Arlington, VA: Mercatus Center at George Mason University. Thierer, A. (2016). Permissionless innovation. The continuing case for comprehensive technological freedom. Revised and expanded edition. Arlington, VA: Mercatus Center at George Mason University.
Zurück zum Zitat Thomson, J. J. (1985). The trolley problem. Yale Law Journal, 94(5), 1395–1515.CrossRef Thomson, J. J. (1985). The trolley problem. Yale Law Journal, 94(5), 1395–1515.CrossRef
Zurück zum Zitat Thomson, J. J. (2008). Turning the trolley. Philosophy and Public Affairs, 36(4), 359–374.CrossRef Thomson, J. J. (2008). Turning the trolley. Philosophy and Public Affairs, 36(4), 359–374.CrossRef
Metadaten
Titel
What has the Trolley Dilemma ever done for us (and what will it do in the future)? On some recent debates about the ethics of self-driving cars
verfasst von
Andreas Wolkenstein
Publikationsdatum
08.06.2018
Verlag
Springer Netherlands
Erschienen in
Ethics and Information Technology / Ausgabe 3/2018
Print ISSN: 1388-1957
Elektronische ISSN: 1572-8439
DOI
https://doi.org/10.1007/s10676-018-9456-6

Weitere Artikel der Ausgabe 3/2018

Ethics and Information Technology 3/2018 Zur Ausgabe