Beishui Liao
Marija Slavkovik
Leendert van der Torre
ABSTRACT
An autonomous system is constructed by a manufacturer, operates in a society subject to norms and laws, and is interacting with end-users. We address the challenge of how the moral values and views of all stakeholders can be integrated and reflected in the moral behavior of the autonomous system. We propose an artificial moral agent architecture that uses techniques from normative systems and formal argumentation to reach moral agreements among stakeholders. We show how our architecture can be used not only for ethical practical reasoning and collaborative decision-making, but also for the explanation of such moral behavior.
- C. E. Alchourron. 1991. Conflcits of norms and revision of normative systems. Law and Philosophy, Vol. 10 (1991), 413--425.Google Scholar
Cross Ref
- M. Anderson and S. Leigh Anderson. 2014. GenEth: A General Ethical Dilemma Analyzer. In Proceedings of the 28th AAAI Conference on AI. 253--261. http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/view/8308 Google ScholarDigital Library
- R.C. Arkin, P. Ulam, and A. R. Wagner. 2012. Moral Decision Making in Autonomous Systems: Enforcement, Moral Emotions, Dignity, Trust, and Deception. Proc. of the IEEE, Vol. 100, 3 (2012), 571--589.Google ScholarCross Ref
- P. Baroni, D. Gabbay, M. Giacomin, and L. van der Torre (Eds.). 2018. Handbook of Formal Argumentation .College Publications.Google Scholar
- T. Bench-Capon, K. Atkinson, and A. Chorley. 2005. Persuasion and Value in Legal Argument. Journal of Logic and Computation Comput., Vol. 15, 6 (2005), 1075--1097. Google ScholarDigital Library
- O. Biran and C. Cotton. 2017. Explanation and Justification in Machine Learning: A Survey. In Proceedings of the IJCAI Workshop on Explainable Artificial Intelligence (XAI 2017). 8--13.Google Scholar
- R. Booth, M. Caminada, and B. Marshall. 2018. DISCO: A Web-Based Implementation of Discussion Games for Grounded and Preferred Semantics. In COMMA (Frontiers in Artificial Intelligence and Applications), Vol. 305. IOS Press, 453--454.Google Scholar
- S. Bringsjord, K. Arkoudas, and P. Bello. 2008. Toward a general logicist methodology for engineering ethically correct robots. IEEE Intelligent Systems, Vol. 21, 4 (2008), 38--44. Google ScholarDigital Library
- V. Charisi, L.A. Dennis, M. Fisher, R. Lieck, A. Matthias, M. Slavkovik, J. Sombetzki, A.F.T. Winfield, and R. Yampolskiy. 2017. Towards Moral Autonomous Systems. CoRR, Vol. abs/1703.04741 (2017). http://arxiv.org/abs/1703.04741Google Scholar
- A. Chopra, L. van der Torre, H. Verhagen, and S. Villata. 2018. Handbook of normative multiagent systems .College Publications.Google Scholar
- O. Cocarascu, K. vCyras, and F. Toni. 2018. Explanatory Predictions with Artificial Neural Networks and Argumentation. In Proceedings of the IJCAI/ECAI Workshop on Explainable Artificial Intelligence (XAI 2018). 26--32.Google Scholar
- L. A. Dennis, M. Fisher, M. Slavkovik, and M. P. Webster. 2016. Formal Verification of Ethical Choices in Autonomous Systems. Robotics and Autonomous Systems, Vol. 77 (2016), 1--14. Google ScholarDigital Library
- L. A. Dennis, M. Fisher, and A. F. T. Winfield. 2015. Towards Verifiably Ethical Robot Behaviour. In Proceedings of AAAI Workshop on AI and Ethics. http://aaai.org/ocs/index.php/WS/AAAIW15/paper/view/10119.Google Scholar
- V. Dignum. 2017. Responsible Autonomy. In Proceedings of the 26th IIJCAI. 4698--4704. Google ScholarDigital Library
- P. M. Dung. 1995. On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games. Artificial Intelligence, Vol. 77, 2 (1995), 321--358. Google ScholarDigital Library
- S. Dyrkolbotn, T. Pedersen, and M. Slavkovik. 2018. On the distinction between implicit and explicit ethical agency. In AAAI/ACM AIES conference. New Orleans, USA. Google ScholarDigital Library
- A. Etzioni and O. Etzioni. 2017. Incorporating Ethics into Artificial Intelligence. The Journal of Ethics (2017), 1--16.Google Scholar
- International Society of Automotive Engineers. 2016. September 2016, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. http://standards.sae.org/j3016_201609/.Google Scholar
- F. Lindner and M.M. Bentzen. 2017. The Hybrid Ethical Reasoning Agent IMMANUEL. In Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, HRI 2017, Vienna, Austria, March 6--9, 2017. 187--188. Google ScholarDigital Library
- B. F. Malle, M. Scheutz, T. Arnold, J. Voiklis, and C. Cusimano. 2015. Sacrifice One For the Good of Many?: People Apply Different Moral Norms to Human and Robot Agents. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15). ACM, 117--124. Google ScholarDigital Library
- T. Miller. 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. CoRR, Vol. abs/1706.07269 (2017). arxiv: 1706.07269 http://arxiv.org/abs/1706.07269Google Scholar
- S. Modgil and H. Prakken. 2013. A general account of argumentation with preferences. Artificial Intelligence, Vol. 195 (2013), 361--397. Google ScholarDigital Library
- J. H. Moor. 2006. The Nature, Importance, and Difficulty of Machine Ethics. IEEE Intelligent Systems, Vol. 21, 4 (July 2006), 18--21. Google ScholarDigital Library
- E. Pires Bjørgen, S. Øvervatn Madsen, T. Skaar Bjørknes, F. Vonheim Heimsæter, R. Håvik, M. Linderud, P.N. Longberg, L.A. Dennis, and M. Slavkovik. 2018. Cake, death, and trolleys: dilemmas as benchmarks of ethical decision-making. In AAAI/ACM AIES Conference. New Orleans, USA. Google ScholarDigital Library
- A. Sergeant. 2013. Automatic Argumentation Extraction. In The Semantic Web: Semantics and Big Data, P. Cimiano, O. Corcho, V. Presutti, L. Hollink, and S. Rudolph (Eds.). Springer ß, Berlin, Heidelberg, 656--660.Google Scholar
- D. Vanderelst and A. Winfield. 2017. An architecture for ethical robots inspired by the simulation theory of cognition. Cognitive Systems Research (2017).Google Scholar
- K. vCyras, K. Satoh, and F. Toni. 2016. Explanation for Case-Based Reasoning via Abstract Argumentation. In Computational Models of Argument - Proceedings of COMMA. 243--254.Google Scholar
- G. Vreeswijk and H. Prakken. 2000. Credulous and Sceptical Argument Games for Preferred Semantics. In JELIA (LNCS), Vol. 1919. Springer, 239--253. Google ScholarDigital Library
- W. Wallach and C. Allen. 2008. Moral Machines: Teaching Robots Right from Wrong .Oxford University Press. Google ScholarDigital Library
- D. Walton. 2011. A dialogue system specification for explanation. Synthese, Vol. 182, 3 (2011), 349--374.Google ScholarCross Ref
- D. Walton. 2012. Using Argumentation Schemes for Argument Extraction: A Bottom-Up Method. Internat. Journal of Cognitive Informatics and Natural Intelligence, Vol. 3 (2012).Google Scholar
- P. Ziafati. 2015. Information Engineering in Autonomous Robot Software. Ph.D. Dissertation. University of Luxembourg.Google Scholar
Index Terms
- Building Jiminy Cricket: An Architecture for Moral Agreements Among Stakeholders
Recommendations
Robots: ethical by design
Among ethicists and engineers within robotics there is an ongoing discussion as to whether ethical robots are possible or even desirable. We answer both of these questions in the positive, based on an extensive literature study of existing arguments. ...
Artificial systems with moral capacities? A research design and its implementation in a geriatric care system
AbstractThe development of increasingly intelligent and autonomous technologies will eventually lead to these systems having to face morally problematic situations. This gave rise to the development of artificial morality, an emerging field in ...
Particularism, Analogy, and Moral Cognition
`Particularism' and `generalism' refer to families of positions in the philosophy of moral reasoning, with the former playing down the importance of principles, rules or standards, and the latter stressing their importance. Part of the debate has taken ...
Comments