Abstract
Autonomous robots can be difficult to design and understand. Designers have difficulty decoding the behaviour of their own robots simply by observing them. Naive users of robots similarly have difficulty deciphering robot behaviour simply through observation. In this paper we review relevant robot systems architecture, design, and transparency literature, and report on a programme of research to investigate practical approaches to improve robot transparency. We report on the investigation of real-time graphical and vocalised outputs as a means for both designers and end users to gain a better mental model of the internal state and decision making processes taking place within a robot. This approach, combined with a graphical approach to behaviour design, offers improved transparency for robot designers. We also report on studies of users’ understanding, where significant improvement has been achieved using both graphical and vocalisation transparency approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Design details and software for the R5 Robot:Â http://www.robwortham.com/r5- robot/.
- 2.
The Instinct Planner and iVDL are available on an open source basis, see:Â http:// www.robwortham.com/instinct-planner/.
- 3.
References
Arduino: Arduino Website (2016). https://www.arduino.cc/
Beck, K.: Extreme Programming Explained: Embrace Change. Addison-Wesley, Reading (2000)
Boden, M., Bryson, J., Caldwell, D., Dautenhahn, K., Edwards, L., Kember, S., Newman, P., Parry, V., Pegman, G., Rodden, T., Sorell, T., Wallis, M., Whitby, B., Winfield, A.: Principles of robotics. The United Kingdom’s Engineering and Physical Sciences Research Council (EPSRC), April 2011. Web publication
Boden, M.A.: Creativity and artificial intelligence. Artif. Intell. 103(1–2), 347–356 (1998)
Brom, C., Gemrot, J., BĂda, M., Burkert, O., Partington, S.J., Bryson, J.J.: POSH tools for game agent development by students and non-programmers. In: Mehdi, Q., Mtenzi, F., Duggan, B., McAtamney, H. (eds.) The Ninth International Computer Games Conference: AI, Mobile, Educational and Serious Games, pp. 126–133. University of Wolverhampton, November 2006
Brom, C., Gemrot, J., Michal, B., Ondrej, B., Partington, S.J., Bryson, J.J.: Posh tools for game agent development by students and non-programmers. In: The Nineth International Computer Games Conference: AI, Mobile, Educational and Serious Games, pp. 1–8 (2006)
Brooks, R.A.: Intelligence without representation. Artif. Intell. 47(1), 139–159 (1991)
Bryson, J.: Cross-paradigm analysis of autonomous agent architecture. J. Exp. Theoret. Artif. Intell. 12(2), 165–189 (2000). http://www.tandfonline.com/doi/abs/10.1080/095281300409829
Bryson, J.J.: The study of sequential and hierarchical organisation of behaviour via artificial mechanisms of action selection. M. Phil., University of Edinburgh (2000). https://www.cs.bath.ac.uk/~jjb/ftp/mphil.pdf
Bryson, J.J.: Intelligence by design: principles of modularity and coordination for engineering complex adaptive agents. Ph.D. thesis, MIT, Department of EECS, Cambridge, MA, AI Technical report 2001–2003, June 2001
Bryson, J.J.: Advanced Behavior Oriented Design Environment (ABODE) (2013). http://www.cs.bath.ac.uk/~jjb/web/BOD/abode.html
Bryson, J.J., Gaudl, S.: jyPOSH (2013). https://sourceforge.net/projects/jyposh/
David, E.W., Karen, L.M., John, D.L., Wesley, L.P.: Planning and reacting in uncertain and dynamic environments. J. Exp. Theoret. Artif. Intell. 7(1), 121–152 (1995). http://dx.doi.org/10.1080/09528139508953802
Finzi, A., Ingrand, F., Muscettola, N.: Model-based executive control through reactive planning for autonomous rovers. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), vol. 1, pp. 879–884 (2004). http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=1389463
Fodor, J.A.: The Modularity of Mind: An Essay on Faculty Psychology. A Bradford book. MIT Press, Cambridge, Mass (1983). http://books.google.co.uk/books?id=e7nrSeibJZYC
Gaudl, S., Bryson, J.J.: The extended ramp goal module: low-cost behaviour arbitration for real-time controllers based on biological models of dopamine cells. In: Computational Intelligence in Games 2014 (2014). http://opus.bath.ac.uk/40056/
Gaudl, S., Davies, S., Bryson, J.: Behaviour oriented design for real-time-strategy games: an approach on iterative development for STARCRAFT AI. In: Foundations of Digital Games Conference, pp. 198–205 (2013)
Lyons, J.B.: Being Transparent about transparency: a model for human-robot interaction. Trust and Autonomous Systems: Papers from the 2013 AAAI Spring Symposium, pp. 48–53 (2013)
Minsky, M.: The Society of Mind. Simon and Schuster Inc., New York (1985)
Ruckert, J.H., Kahn, P.H., Kanda, T., Ishiguro, H., Shen, S., Gary, H.E.: Designing for sociality in HRI by means of multiple personas in robots. In: ACM/IEEE International Conference on Human-Robot Interaction, pp. 217–218 (2013)
Sakagami, Y., Watanabe, R., Aoyama, C., Matsunaga, S., Higaki, N., Fujimura, K.: The intelligent ASIMO: system overview and integration. IEEE/RSJ Int. Conf. Intell. Robots Syst. 3(October), 2478–2483 (2002)
Shingo, S., Dillon, A.P.: A Study of the Toyota Production System: From an Industrial Engineering Viewpoint. Produce What Is Needed, When It’s Needed. Taylor & Francis, New York (1989). https://books.google.co.uk/books?id=RKWU7WElJ7oC
Theodorou, A.: ABOD3: a graphical visualization and real-time debugging tool for bod agents. In: EUCognition 2016, Vienna, Austria, December 2016. http://opus.bath.ac.uk/53506/
Theodorou, A., Wortham, R., Bryson, J.J.: Designing and implementing transparency for real time inspection of autonomous robots. Connection Sci. 29 (2017). http://opus.bath.ac.uk/55250/
Wortham, R.H., Gaudl, S.E., Bryson, J.J.: Instinct: a biologically inspired reactive planner for embedded environments. In: Proceedings of ICAPS 2016 PlanRob Workshop, London, UK (2016). http://icaps16.icaps-conference.org/proceedings/planrob16.pdf
Wortham, R.H., Rogers, V.E.: The Muttering Robot: Improving Robot Transparency Though Vocalisation of Reactive Plan Execution (2017, in prep)
Wortham, R.H., Theodorou, A.: Robot transparency, trust and utility. Connection Sci. 29(3), 242–248 (2017)
Wortham, R.H., Theodorou, A., Bryson, J.J.: What does the robot think? Transparency as a fundamental design requirement for intelligent systems. In: IJCAI-2016 Ethics for Artificial Intelligence Workshop, New York, USA (2016). http://opus.bath.ac.uk/50294/1/WorthamTheodorouBryson_EFAI16.pdf
Wortham, R.H., Theodorou, A., Bryson, J.J.: Improving robot transparency: real-time visualisation of robot AI substantially improves understanding in naive observers. In: IEEE RO-MAN 2017, Lisbon, Portugal (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wortham, R.H., Theodorou, A., Bryson, J.J. (2017). Robot Transparency: Improving Understanding of Intelligent Behaviour for Designers and Users. In: Gao, Y., Fallah, S., Jin, Y., Lekakou, C. (eds) Towards Autonomous Robotic Systems. TAROS 2017. Lecture Notes in Computer Science(), vol 10454. Springer, Cham. https://doi.org/10.1007/978-3-319-64107-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-64107-2_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-64106-5
Online ISBN: 978-3-319-64107-2
eBook Packages: Computer ScienceComputer Science (R0)