skip to main content
research-article

Pedestrians and Visual Signs of Intent: Towards Expressive Autonomous Passenger Shuttles

Authors Info & Claims
Published:09 September 2019Publication History
Skip Abstract Section

Abstract

Autonomous Passenger Shuttles (APS) are rapidly becoming an urban public transit alternative. Traversing populous commercial and residential centers, these shuttles are already operating in several cities. In the absence of a human driver and embedded means of communicating the autonomous shuttle's intent, the task of seamlessly navigating crosswalks and pedestrian-friendly zones becomes a challenging pursuit for pedestrians.

We contribute to the emerging notion of AV-Pedestrian Interaction by examining the context of autonomous passenger shuttles (APS) in real-world settings, and by comparing four different classes of visual signals -- namely instructional, symbolic, metaphorical, and anthropomorphic -- designed to communicate the shuttle's intentions. Following a participatory methodology involving local residents and public transport service provider, and working within the framework of inflexible road traffic regulations concerning the operation and testing of autonomous vehicles, we conducted a participatory design workshop, a qualitative, and a survey study. The findings revealed differences across these four classes of signals in terms of pedestrians' subjective perceptions. Anthropomorphic signals were identified as the preferred and effective modality in terms of pedestrians' interpretation of the communicated intent and their perceived sense of attention, confidence, and calmness. Additionally, pedestrians' experiences while judging the intention of transitionary vehicular states (starting/slowing) were reported as perplexing and evoked stress. These findings were translated into design and policy implications in collaboration with other stakeholders, and exemplify a viable way for assimilating human factors research in urban mobility.

Skip Supplemental Material Section

Supplemental Material

References

  1. Hamed S. Alavi, Farzaneh Bahrami, Himanshu Verma, and Denis Lalanne. 2017. Is Driverless Car Another Weiserian Mistake?. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS '17 Companion). ACM, New York, NY, USA, 249--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 3, 13 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. James M Anderson, Kalra Nidhi, Karlyn D Stanley, Paul Sorensen, Constantine Samaras, and Oluwatobi A Oluwatola. 2014. Autonomous vehicle technology: A guide for policymakers. Rand Corporation.Google ScholarGoogle Scholar
  4. F Gregory Ashby and Nancy A Perrin. 1988. Toward a unified theory of similarity and recognition. Psychological review 95, 1 (1988), 124.Google ScholarGoogle Scholar
  5. Jimi Beckwith. 2018. Jaguar Land Rover gives driverless pods 'eyes' to signal road users. https://www.autocar.co.uk/car-news/new-cars/jaguar-land-rover-gives-driverless-pods-eyes-signal-road-users. {Online; accessed 3-September-2018}.Google ScholarGoogle Scholar
  6. Brett Berk. 2015. How Nissan's Using Anthropology to Make Autonomous Cars Safe. http://www.thedrive.com/tech/999/how-nissans-using-anthropology-to-make-autonomous-cars-safe. {Online; accessed 3-September-2018}.Google ScholarGoogle Scholar
  7. The League of American Bicyclists Bikeleague. 2014. Autonomous and Connected Vehicles: Implications for Bicyclists and Pedestrians. https://bikeleague.org/sites/default/files/Bike_Ped_Connected_Vehicles.pdf. {Online; accessed 26-April-2019}.Google ScholarGoogle Scholar
  8. Laurens Boer and Jared Donovan. 2012. Provotypes for participatory innovation. In Proceedings of the designing interactive systems conference. ACM, 388--397. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Patrick M Boesch, Francesco Ciari, and Kay W Axhausen. 2016. Autonomous vehicle fleet sizes required to serve different levels of demand. Transportation Research Record: Journal of the Transportation Research Board 2542 (2016), 111--119.Google ScholarGoogle ScholarCross RefCross Ref
  10. Patrick M Bösch, Felix Becker, Henrik Becker, and Kay W Axhausen. 2018. Cost-based analysis of autonomous mobility services. Transport Policy 64 (2018), 76--91.Google ScholarGoogle ScholarCross RefCross Ref
  11. Lawrence D Burns. 2013. Sustainable mobility: a vision of our transport future. Nature 497, 7448 (2013), 181.Google ScholarGoogle Scholar
  12. Stephen M. Casner, Edwin L. Hutchins, and Don Norman. 2016. The Challenges of Partially Automated Driving. Commun. ACM 59, 5 (April 2016), 70--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Chia-Ming Chang, Koki Toda, Daisuke Sakamoto, and Takeo Igarashi. 2017. Eyes on a Car: An Interface Design for Communication Between an Autonomous Car and a Pedestrian. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). 65--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Vicky Charisi, Azra Habibovic, Jonas Andersson, Jamy Li, and Vanessa Evers. 2017. Children's Views on Identification and Intention Communication of Self-driving Vehicles. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17). ACM, New York, NY, USA, 399--404. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Michael Clamann, Miles Aubert, and Mary L Cummings. 2017. Evaluation of vehicle-to-pedestrian communication displays for autonomous vehicles. Technical Report.Google ScholarGoogle Scholar
  16. Debargha Dey, Marieke Martens, Berry Eggen, and Jacques Terken. 2017. The Impact of Vehicle Appearance and Vehicle Behavior on Pedestrian Interaction with Autonomous Vehicles. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct (AutomotiveUI '17). ACM, New York, NY, USA, 158--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Grace Eden. 2018. Transforming Cars into Computers: Interdisciplinary Opportunities for HCI. In Proceedings of 32nd BCS HCI Conference, Belfast, UK, 2018. British Human Computer Interaction (BHCI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Grace Eden, Benjamin Nanchen, Randolf Ramseyer, and Florian Evéquoz. 2017. On the road with an autonomous passenger shuttle: integration in public spaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1569--1576. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Daniel J Fagnant and Kara Kockelman. 2015. Preparing a nation for autonomous vehicles: opportunities, barriers and policy recommendations. Transportation Research Part A: Policy and Practice 77 (2015), 167--181.Google ScholarGoogle ScholarCross RefCross Ref
  20. Moran Furman and Xiao-Jing Wang. 2008. Similarity effect and optimal control of multiple-choice decision making. Neuron 60, 6 (2008), 1153--1168.Google ScholarGoogle ScholarCross RefCross Ref
  21. Nikhil Gowda, Wendy Ju, and Kirstin Kohler. 2014. Dashboard Design for an Autonomous Car. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 1--4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Nicolas Guéguen, Sébastien Meineri, and Chloé Eyssartier. 2015. A pedestrian's stare and drivers' stopping behavior: A field experiment at the pedestrian crossing. Safety science 75 (2015), 87--89.Google ScholarGoogle Scholar
  23. Azra Habibovic, Victor Malmsten Lundgren, Jonas Andersson, Maria KlingegÃěrd, Tobias LagstrÃűm, Anna Sirkka, Johan FagerlÃűnn, Claes Edgren, Rikard Fredriksson, Stas Krupenia, Dennis SaluÃd'Ãdr, and Pontus Larsson. 2018. Communicating Intent of Automated Vehicles to Pedestrians. Frontiers in Psychology 9 (2018), 1336.Google ScholarGoogle ScholarCross RefCross Ref
  24. Jeffrey Heer and Michael Bostock. 2010. Crowdsourcing graphical perception: using mechanical turk to assess visualization design. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 203--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Kyeil Kim, Guy Rousseau, Joel Freedman, and Jonathan Nicholson. 2015. The travel impact of autonomous vehicles in metro atlanta through activity-based modeling. In The 15th TRB National Transportation Planning Applications Conference.Google ScholarGoogle Scholar
  26. Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 4 (2015), 269--275.Google ScholarGoogle ScholarCross RefCross Ref
  27. Miltos Kyriakidis, Riender Happee, and Joost CF de Winter. 2015. Public opinion on automated driving: Results of an international questionnaire among 5000 respondents. Transportation research part F: traffic psychology and behaviour 32 (2015), 127--140.Google ScholarGoogle Scholar
  28. T Lagstrom and Victor Malmsten Lundgren. 2015. AVIP-Autonomous vehicles interaction with pedestrians. Master of Science Thesis, Chalmers University of Technology (2015).Google ScholarGoogle Scholar
  29. John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50--80.Google ScholarGoogle Scholar
  30. Duri Long, Mikhail Jacob, and Brian Magerko. 2019. Designing Co-Creative AI for Public Spaces. In Proceedings of the 2019 on Creativity and Cognition (C&C '19). ACM, New York, NY, USA, 271--284. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Victor Malmsten Lundgren, Azra Habibovic, Jonas Andersson, Tobias Lagström, Maria Nilsson, Anna Sirkka, Johan Fagerlönn, Rikard Fredriksson, Claes Edgren, Stas Krupenia, et al. 2017. Will There Be New Communication Needs When Introducing Automated Vehicles to the Urban Context? In Advances in Human Aspects of Transportation. Springer, 485--497.Google ScholarGoogle Scholar
  32. Karthik Mahadevan, Elaheh Sanoubari, Sowmya Somanath, James E. Young, and Ehud Sharlin. 2019. AV-Pedestrian Interaction Design Using a Pedestrian Mixed Traffic Simulator. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19). ACM, New York, NY, USA, 475--486. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Karthik Mahadevan, Sowmya Somanath, and Ehud Sharlin. 2018. Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 429, 12 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Milecia Matthews, Girish Chowdhary, and Emily Kieson. 2017. Intent Communication between Autonomous Vehicles and Pedestrians. arXiv preprint arXiv:1708.07123 (2017).Google ScholarGoogle Scholar
  35. Alexander Meschtscherjakov, Alina Krischkowsky, Katja Neureiter, Alexander Mirnig, Axel Baumgartner, Verena Fuchsberger, and Manfred Tscheligi. 2016. Active corners: Collaborative in-car interaction design. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 1136--1147. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Jonas Meyer, Henrik Becker, Patrick M Bösch, and Kay W Axhausen. 2017. Autonomous vehicles: The next jump in accessibilities? Research in Transportation Economics 62 (2017), 80--91.Google ScholarGoogle ScholarCross RefCross Ref
  37. Adam Millard-Ball. 2018. Pedestrians, Autonomous Vehicles, and Cities. Journal of Planning Education and Research 38, 1 (2018), 6--12.Google ScholarGoogle ScholarCross RefCross Ref
  38. Sina Nordhoff, Joost de Winter, Ruth Madigan, Natasha Merat, Bart van Arem, and Riender Happee. 2018. User acceptance of automated shuttles in Berlin-Schöneberg: A questionnaire study. Transportation Research Part F: Traffic Psychology and Behaviour 58 (2018), 843--854.Google ScholarGoogle ScholarCross RefCross Ref
  39. Robert M Nosofsky. 1986. Attention, similarity, and the identification-categorization relationship. Journal of experimental psychology: General 115, 1 (1986), 39.Google ScholarGoogle ScholarCross RefCross Ref
  40. Enrica Papa and António Ferreira. 2018. Sustainable Accessibility and the Implementation of Automated Vehicles: Identifying Critical Decisions. Urban Science 2, 1 (2018), 5.Google ScholarGoogle ScholarCross RefCross Ref
  41. Anantha Krishna Pillai. 2017. Virtual Reality based Study to Analyse Pedestrian attitude towards Autonomous Vehicles.Google ScholarGoogle Scholar
  42. Ioannis Politis, Stephen Brewster, and Frank Pollick. 2015. Language-based Multimodal Displays for the Handover of Control in Autonomous Cars. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). ACM, New York, NY, USA, 3--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Amir Rasouli, Iuliia Kotseruba, and John K Tsotsos. 2017. Agreeing to cross: How drivers and pedestrians communicate. In Intelligent Vehicles Symposium (IV), 2017 IEEE. IEEE, 264--269.Google ScholarGoogle ScholarCross RefCross Ref
  44. Amir Rasouli, Iuliia Kotseruba, and John K Tsotsos. 2018. Understanding pedestrian behavior in complex traffic scenes. IEEE Transactions on Intelligent Vehicles 3, 1 (2018), 61--70.Google ScholarGoogle ScholarCross RefCross Ref
  45. Amir Rasouli and John K Tsotsos. 2019. Autonomous vehicles that interact with pedestrians: A survey of theory and practice. IEEE Transactions on Intelligent Transportation Systems (2019).Google ScholarGoogle Scholar
  46. Zeheng Ren, Xiaobei Jiang, and Wuhong Wang. 2016. Analysis of the Influence of Pedestrians' eye Contact on Drivers' Comfort Boundary During the Crossing Conflict. Procedia engineering 137 (2016), 399--406.Google ScholarGoogle Scholar
  47. Malte Risto, Colleen Emmenegger, Erik Vinkhuyzen, Melissa Cefkin, and Jim Hollan. 2017. Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination. (2017).Google ScholarGoogle Scholar
  48. Yvonne Rogers. 2011. Interaction design gone wild: striving for wild theory. interactions 18, 4 (2011), 58--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Dirk Rothenbücher, Jamy Li, David Sirkin, Brian Mok, and Wendy Ju. 2016. Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles. In Robot and Human Interactive Communication (RO-MAN), 2016 25th IEEE International Symposium on. IEEE, 795--802.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Brandon Schoettle and Michael Sivak. 2014. Public opinion about self-driving vehicles in China, India, Japan, the US, the UK, and Australia. (2014).Google ScholarGoogle Scholar
  51. Brandon Schoettle and Michael Sivak. 2014. A survey of public opinion about autonomous and self-driving vehicles in the US, the UK, and Australia. (2014).Google ScholarGoogle Scholar
  52. Christopher Stanton and Catherine J Stevens. 2014. Robot pressure: the impact of robot eye gaze and lifelike bodily movements upon decision-making and trust. In International Conference on Social Robotics. Springer, 330--339.Google ScholarGoogle ScholarCross RefCross Ref
  53. Andrea Thomaz, Guy Hoffman, Maya Cakmak, et al. 2016. Computational human-robot interaction. Foundations and Trends® in Robotics 4, 2-3 (2016), 105--223. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Marcel Walch, Kristin Lange, Martin Baumann, and Michael Weber. 2015. Autonomous Driving: Investigating the Feasibility of Car-driver Handover Assistance. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). 11--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Wei Xu. 2019. Toward human-centered AI: a perspective from human-computer interaction. interactions 26, 4 (2019), 42--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Rosemarie E Yagoda and Douglas J Gillan. 2012. You want me to trust a ROBOT? The development of a human-robot interaction trust scale. International Journal of Social Robotics 4, 3 (2012), 235--248.Google ScholarGoogle ScholarCross RefCross Ref
  57. Su Yang. 2017. Driver behavior impact on pedestrians' crossing experience in the conditionally autonomous driving context.Google ScholarGoogle Scholar
  58. Raphael Zimmermann and Reto Wettach. 2017. First Step into Visceral Interaction with Autonomous Vehicles. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 58--64. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Pedestrians and Visual Signs of Intent: Towards Expressive Autonomous Passenger Shuttles

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 3, Issue 3
      September 2019
      1415 pages
      EISSN:2474-9567
      DOI:10.1145/3361560
      Issue’s Table of Contents

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 September 2019
      Published in imwut Volume 3, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader