Skip to main content
Erschienen in: Ethics and Information Technology 4/2012

01.12.2012 | Original Paper

Intending to err: the ethical challenge of lethal, autonomous systems

verfasst von: Mark S. Swiatek

Erschienen in: Ethics and Information Technology | Ausgabe 4/2012

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Current precursors in the development of lethal, autonomous systems (LAS) point to the use of biometric devices for assessing, identifying, and verifying targets. The inclusion of biometric devices entails the use of a probabilistic matching program that requires the deliberate targeting of noncombatants as a statistically necessary function of the system. While the tactical employment of the LAS may be justified on the grounds that the deliberate killing of a smaller number of noncombatants is better than the accidental killing of a larger number, it may nonetheless contravene a reemerging conception of right intention. Originally framed by Augustine of Hippo, this lesser-known formulation has served as the foundation for chivalric code, canon law, jus in bello criteria, and the law of armed conflict. Thus it serves as a viable measure to determine whether the use of lethal autonomy would accord with these other laws and principles. Specifically, examinations of the LAS through the lenses of collateral damage, the principle of double effect, and the principle of proportionality, reveal the need for more attention to be paid to the moral issues now, so that the promise of this emerging technology—that it will perform better than human beings—might actually come to pass.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
For example, Plato’s guardians were to act as “correctors, not enemies” (Bloom 1991:151), but that was only with regard to other Greeks, and not necessarily extended to barbarians.
 
2
Merely providing the vocabulary doesn’t ensure the soldiers’ compliance with right intention, but it does constitute a necessary step in the process of having the soldiers internalize or buy into the concept.
 
3
Thus, the “strategic corporal,” a term coined in January, 1999 by Gen. Charles C. Krulak in an article for the Marines Magazine titled “The Strategic Corporal: Leadership in the Three Block War.” Incidents such as the abuse of prisoners in Abu Gahrib and the massacre of 17 Afghans outside the city of Kandahar exemplify the damage relatively low-ranking individuals can do to the strategic goals of conventional forces.
 
4
Others have dedicated the fuller attention this topic deserves. See, for example, Col (USA) Tony Pfaff’s “Risk, Military Ethics and Irregular Warfare” on the Foreign Policy Research Institute’s website; http://​www.​fpri.​org/​enotes/​2011/​201112.​pfaff.​irregularwarfare​.​html.
 
5
We should note that risk to combatants wasn’t a concern for Augustine, as combatants had no right to self-defense. Under the early Christian doctrine of that time, warriors fought on behalf of others, not themselves. Their path to salvation was tenuous, as their calling exposed them to grave evil, but so long as they remained properly oriented in battle, they retained their admissibility into a peaceful afterlife. Today, the secular perspective on right intention is more pragmatic.
 
6
The dynamic was graphically demonstrated in a televised report by CNN in April of 2003 (prior to the development of COIN operations) when US combat soldiers from the 101st Airborne Division avoided a violent confrontation with a mob of followers of the Grand Ayatollah Sistani in Najaf, Iraq by taking a knee and pointing their weapons down.
 
7
In setting the case study that follows, I’ve chosen to focus on the relatively near-term potential for technological development, approximately 5–10 years. There are two reasons for this approach: first, taking a longer view (beyond 10 years) would require the consideration of hypotheticals, such as the development of artificial intelligence, which would require more speculation than concrete analysis. Second, analyzing the ethical issues of employing LAS that may appear on the battlefield in the near future might better serve the larger discussion about whether this technology should be pursued for military applications, and if it is, about how to resolve the ethical issues.
 
8
The information on biometrics in sections II and III was derived from the author’s work with the Army Science Board from 2010 to 2012 as a report writer for the Tactical, Non-Cooperative Biometrics Study (Heinz et al. 2012).
 
9
Combining biometric data; either across modalities or with that of other systems.
 
10
Patrick Lin provides a comprehensive look at several of these issues in his article, “Military 2.0: Ethical Blowback from Emerging Technologies,” published in the December 2010 issue of the Journal of Military Ethics.
 
11
The statistics for any match algorithm are derived by developing match score distributions for two populations: a genuine population (in which the subject sample resides in the database) and an imposter population (in which the subject is not in the database). These two distributions overlap (if they did not, the algorithm would be perfect in providing correct matches), which means the score for some imposters exceeds the score for some genuine subjects. A threshold can be set to determine the score used to declare a match. If the threshold is lowered, the area under the imposter distribution increases, increasing the probability of false match, but also increasing the probability of declaring a match.
 
12
In the case of fusion algorithms, one common approach statistically combines match scores (probability of a valid match) from each biometric device. The same problems with transparency exist, so while we know fusion works with the high scores obtained through controlled, cooperative techniques, it’s not clear that the same approach will work with low scores from non-cooperative technology. For example, it may be possible for several low-match scores to combine and raise the fused score above the pre-determined threshold, indicating a valid match.
 
13
We’ve already established one positive outcome, the reduction, or more accurately, removal of risk to the combatant, but that fails to satisfy our present need, because it merely recirculates the question of our intention. That is, if right intention is demonstrated through increased acceptance of combatant risk, and the LAS removes combatant risk, then we need some account of our intention in fielding the LAS.
 
Literatur
Zurück zum Zitat Augustine. (1986). Concerning the City of God against the Pagans. New York: Penguin Classics. Augustine. (1986). Concerning the City of God against the Pagans. New York: Penguin Classics.
Zurück zum Zitat Bellamy, A. J. (2006). Just wars, from Cicero to Iraq. Malden, MA: Polity Press. Bellamy, A. J. (2006). Just wars, from Cicero to Iraq. Malden, MA: Polity Press.
Zurück zum Zitat Bloom, A. D. (Trans.) (1991). The republic of Plato, 2nd edn. New York: Basic Books. Bloom, A. D. (Trans.) (1991). The republic of Plato, 2nd edn. New York: Basic Books.
Zurück zum Zitat Department of the Army/US Marine Corps. Headquarters Department of the Army/Marine Corps Combat Development Command (2006). FM 3-24/MCWP 3-33.5—Counterinsurgency. Washington, DC. Department of the Army/US Marine Corps. Headquarters Department of the Army/Marine Corps Combat Development Command (2006). FM 3-24/MCWP 3-33.5Counterinsurgency. Washington, DC.
Zurück zum Zitat Heinz, M. H., Jette, B., Smith, T. B., & Department of the Army, Assistant Secretary of the Army (Acquisition, Logistics and Technology). (2012). Tactical non-cooperative biometric systems. Fort Belvoir: Defense Technical Information Center. Heinz, M. H., Jette, B., Smith, T. B., & Department of the Army, Assistant Secretary of the Army (Acquisition, Logistics and Technology). (2012). Tactical non-cooperative biometric systems. Fort Belvoir: Defense Technical Information Center.
Zurück zum Zitat Johnson, J. T. (1975). Ideology, Reason, and the Limitation of War, Religious and Secular Concepts, 1200–1740. Princeton, NJ: Princeton University Press. Johnson, J. T. (1975). Ideology, Reason, and the Limitation of War, Religious and Secular Concepts, 1200–1740. Princeton, NJ: Princeton University Press.
Zurück zum Zitat McChrystal, S. International Security Assistance Force (ISAF) Tactical Directive dated 6 July 2009. McChrystal, S. International Security Assistance Force (ISAF) Tactical Directive dated 6 July 2009.
Zurück zum Zitat Orend, B. (2006). The morality of war. Peterborough, ON: Broadview Press. Orend, B. (2006). The morality of war. Peterborough, ON: Broadview Press.
Zurück zum Zitat Patrick, L. (2010). Ethical blowback from emerging technologies. Journal of Military Ethics, 9(4), 313–331.CrossRef Patrick, L. (2010). Ethical blowback from emerging technologies. Journal of Military Ethics, 9(4), 313–331.CrossRef
Zurück zum Zitat Reichberg, G. M., Syse, H., & Begby, E. (2008). The Ethics of War, Classic and Contemporary Readings. Malden, MA: Wiley-Blackwell. Reichberg, G. M., Syse, H., & Begby, E. (2008). The Ethics of War, Classic and Contemporary Readings. Malden, MA: Wiley-Blackwell.
Zurück zum Zitat Shaw, P. M. (1997). Collateral Damage and the US Air Force. Informally published manuscript, School of Advanced Airpower Studies, Air University, Montgomery, Alabama USA. Shaw, P. M. (1997). Collateral Damage and the US Air Force. Informally published manuscript, School of Advanced Airpower Studies, Air University, Montgomery, Alabama USA.
Zurück zum Zitat Walker, R. J., & Minister of National Defence, Directorate of Land Concepts and Design. (2009). Duty with discernment: CLS guidance on ethics in operations. Ottowa, Canada: Directorate Army Public Affairs. Walker, R. J., & Minister of National Defence, Directorate of Land Concepts and Design. (2009). Duty with discernment: CLS guidance on ethics in operations. Ottowa, Canada: Directorate Army Public Affairs.
Zurück zum Zitat Walzer, M. (1977). Just and unjust wars (3rd ed.). New York: Basic Books. Walzer, M. (1977). Just and unjust wars (3rd ed.). New York: Basic Books.
Metadaten
Titel
Intending to err: the ethical challenge of lethal, autonomous systems
verfasst von
Mark S. Swiatek
Publikationsdatum
01.12.2012
Verlag
Springer Netherlands
Erschienen in
Ethics and Information Technology / Ausgabe 4/2012
Print ISSN: 1388-1957
Elektronische ISSN: 1572-8439
DOI
https://doi.org/10.1007/s10676-012-9302-1

Weitere Artikel der Ausgabe 4/2012

Ethics and Information Technology 4/2012 Zur Ausgabe