Brian Y. Lim
Anind K. Dey
ABSTRACT
Context-aware applications use sensing and inference to attempt to determine users' contexts, and take appropriate action. However, they are prone to uncertainty, and this may compromise the trust users have in them. Providing intelligibility has been proposed to help explain to users how context-aware applications work in order to improve user impressions of them. However, we hypothesize that intelligibility may actually be harmful for applications that are very uncertain of their actions. We conducted a large controlled study of a location-aware and a sound-aware application, investigating the impact of intelligibility on understanding, and user impression of applications with varying certainty. We found that intelligibility impacts user impressions, depending on the application's certainty and behavior appropriateness. Intelligibility is helpful for applications with high certainty, but it is harmful if applications behave appropriately, yet display low certainty.
Supplemental Material
- Antifakos, S. et al. (2004). Evaluating the Effects of Displaying Uncertainty in Context-Aware Applications. Ubicomp 04, 54--69.Google Scholar
- Antifakos, S. et al. (2005). Towards improving trust in context-aware systems by displaying system confidence. MobileHCI 05, 9--14. Google ScholarDigital Library
- Bellotti, V. & Edwards, W.K. (2001). Intelligibility and Accountability: Human Considerations in Context-Aware Systems, Human-Computer Interaction, 16(2-4): 193--212. Google ScholarDigital Library
- Chalmers, M. & MacColl, I. (2003). Seamful and seamless design in ubiquitous computing. In Workshop: At the Crossroads: The Interaction of HCI and Systems Issues, Ubicomp 03.Google Scholar
- Cheverst, K. et al. (2005). Exploring issues of user model transparency and proactive behavior in an office environment control system. UMUAI 05, 15(3-4), 235--273. Google ScholarDigital Library
- Dearman, D. et al. (2007). An exploration of location error estimation. Ubicomp 07, 181--198. Google ScholarDigital Library
- Dey, A.K., Abowd, G.D. & Salber, D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. HCI Journal, 16(2-4): 97--166. Google ScholarDigital Library
- Dey, A. et al. (2002). Distributed mediation of ambiguous context in aware environments. UIST 02, 121--130. Google ScholarDigital Library
- Dzindolet, M. et al. (2003). The role of trust in automation reliance, International Journal of Human-Computer Studies, 58(6): 697--718. Google ScholarDigital Library
- Greenberg, S. (2001). Context as a dynamic construct. HCI 16(2), 257--268. Google ScholarDigital Library
- 1Kittur, A. et al. Crowdsourcing user studies with Mechanical Turk. CHI 08, 453--456. Google ScholarDigital Library
- Kulesza, T. et al. (2009). Fixing the Program My Computer Learned: Barriers for End-users, Challenges for the Machine. IUI 09, 187--196. Google ScholarDigital Library
- Lemelson, H., et al. (2008). A Study on User Acceptance of Error Visualization Techniques. HUCUBIS 08. Google ScholarDigital Library
- Lim, B.Y. et al. (2009). Why and why not explanations improve the intelligibility of context-aware intelligent systems. CHI 09, 2119--2128. Google ScholarDigital Library
- Lim, B.Y., Dey, A.K. (2009). Assessing Demand for Intelligibility in Context-Aware Applications. Ubicomp 09, 195--204. Google ScholarDigital Library
- Lim, B.Y., Dey, A.K. (2011). Design of an Intelligible Mobile Context-Aware Application. To appear in MobileHCI 11. Google ScholarDigital Library
- Lu, H. et al. (2009). SoundSense: scalable sound sensing for people-centric applications on mobile phones. MobiSys 09, 165--178. Google ScholarDigital Library
- Muir, B. (1994). Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37(11): 1905--1922.Google ScholarCross Ref
- Rukzio, E. et al. (2006). Visualization of uncertainty in context aware mobile applications. MobileHCI 06, 247--250. Google ScholarDigital Library
- Tullio, J. et al. (2007). How it works: A field study of non-technical users interacting with an intelligent system. CHI 07, 31--40. Google ScholarDigital Library
- 2Weiser, M. & Brown, J.S. (1997). The coming age of calm technology. Beyond Calculation: the Next Fifty Years, 75--85. Google ScholarDigital Library
- 2Yan, Z. et al. (2010). Effects of displaying trust information on mobile application usage. ATC 10, 107--121. Google ScholarDigital Library
Index Terms
- Investigating intelligibility for uncertain context-aware applications
Recommendations
Assessing demand for intelligibility in context-aware applications
UbiComp '09: Proceedings of the 11th international conference on Ubiquitous computingIntelligibility can help expose the inner workings and inputs of context-aware applications that tend to be opaque to users due to their implicit sensing and actions. However, users may not be interested in all the information that the applications can ...
Toolkit to support intelligibility in context-aware applications
UbiComp '10: Proceedings of the 12th ACM international conference on Ubiquitous computingContext-aware applications should be intelligible so users can better understand how they work and improve their trust in them. However, providing intelligibility is non-trivial and requires the developer to understand how to generate explanations from ...
Improving trust in context-aware applications with intelligibility
UbiComp '10 Adjunct: Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - AdjunctSince context-aware applications use implicit sensing and increasingly complex decision making, they may make mistakes or users may misunderstand their actions. This may hinder trust and adoption of context-aware applications. We hypothesize that making ...
Comments