Brian Y. Lim
Anind K. Dey
ABSTRACT
Intelligibility can help expose the inner workings and inputs of context-aware applications that tend to be opaque to users due to their implicit sensing and actions. However, users may not be interested in all the information that the applications can produce. Using scenarios of four real-world applications that span the design space of context-aware computing, we conducted two experiments to discover what information users are interested in. In the first experiment, we elicit types of information demands that users have and under what moderating circumstances they have them. In the second experiment, we verify the findings by soliciting users about which types they would want to know and establish whether receiving such information would satisfy them. We discuss why users demand certain types of information, and provide design implications on how to provide different intelligibility types to make context-aware applications intelligible and acceptable to users.
- Abowd, G.D., Atkeson, C.G., Hong, J., Long, S., Kooper, R.&Pinkerton, M. (1997). Cyberguide: a mobile context-aware tour guide. Wireless Networks 3(5), 421--433. Google Scholar
Digital Library
- Abowd, G.D., Mynatt, E.D.&Rodden, T. (2002). The Human Experience, IEEE Pervasive Computing 1(1), 48--57. Google ScholarDigital Library
- Antifakos, S. Kern, N., Schiele, B.&Schwaninger, A. (2005). Towards improving trust in context-aware systems by displaying system confidence. Proc. MobileHCI 2005, 9--14. Google ScholarDigital Library
- Avrahami, D.&Hudson, S.E. (2006). Responsiveness in Instant Messaging: Predictive Models Supporting Inter-Personal Communication. Proc. CHI'06, 731--740. Google ScholarDigital Library
- Barkhuus, L.&Dey, A.K. (2003). Is context-aware computing taking control away from the user? Three levels of interactivity examined. Proc. Ubicomp 2003, 149--156.Google Scholar
- Bellotti, V.&Edwards, W.K. (2001). Intelligibility and Accountability: Human Considerations in Context-Aware Systems, Human--Computer Interaction, 16(2-4): 193--212. Google ScholarDigital Library
- Cheverst, K., Byun, H.E., Fitton, D., Sas, C., Kray, C.&Villar, N. (2005). Exploring issues of user model transparency and proactive behavior in an office environment control system. User Modeling and User-Adapted Interaction 15(3-4), 235--273. Google ScholarDigital Library
- Dey, A.K.&Abowd, G.D. (2000). CybreMinder: A Context-Aware System for Supporting Reminders. Proc. Handheld and Ubiquitous Computing, 172--186. Google ScholarDigital Library
- Dey, A.K., Abowd, G.D.&Salber, D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16(2-4): 97--166. Google ScholarDigital Library
- Dey, A.K., Sohn, T., Streng, S.&Kodama, J (2006). iCAP: Interactive Prototyping of Context-Aware Applications. Proc. Pervasive 2006, 254--271. Google ScholarDigital Library
- Dzindolet, M., Peterson, S., Pomranky, S. Pierce, L.&Beck, H. (2003). The role of trust in automation reliance, International Journal of Human-Computer Studies, 58(6): 697--718. Google ScholarDigital Library
- Fogarty, J., Hudson, S.E., Atkeson, C.G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J.C.&Yang, J. (2005). Predicting human interruptibility with sensors. ACM Transactions on Computer-Human Interaction 12(1), 119--146. Google ScholarDigital Library
- Froehlich, J., Dillahunt, T., Klasnja, P., Mankoff, J., Consolvo, S., Harrison, B., and Landay, J.A. (2009). UbiGreen: investigating a mobile tool for tracking and supporting green transportation habits. Proc.CHI 2009, 1043--1052. Google ScholarDigital Library
- Glass, A., McGuinness, D.&Wolverton, M. (2008). Toward establishing trust in adaptive agents. Proc.IUI'08. 227--236. Google ScholarDigital Library
- Graesser, A.C.&McMahen, C.L. (1993). Anomalous information triggers questions when adults solve quantitative problems and comprehend stories. Journal of Educational Psychology, 85, 136--151.Google ScholarCross Ref
- Gregor, S.&Benbasat, I. (1999). Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice. MIS Quarterly 23(4): 497--530. Google ScholarDigital Library
- Herlocker, J., Konstan, J.&Riedl, J. (2000). Explaining collaborative filtering recommendations. Proc. CSCW 2000, 241--250. Google ScholarDigital Library
- Ko, A.J.&Myers, B.A. (2009). Finding causes of program output with the Java Whyline. Proc. CHI '09, 1569--1578. Google ScholarDigital Library
- Kuleza T., Wong, W.K., Stumpf, S., Perona, S., White, R., Burnett, M.M., Oberst, I.&Ko. A.J. (2009). Fixing the Program My Computer Learned: Barriers for End Users, Challenges for the Machine. Proc. IUI 2009, 187--196. Google ScholarDigital Library
- Lim, B.Y., Dey, A.K.&Avrahami, D. (2009). Why and why not explanations improve the intelligibility of context-aware intelligent systems. Proc. CHI 2009, 2119--2128. Google ScholarDigital Library
- McGuinness, D.L., Glass, A., Wolverton, M.&Pinheiro da Silva, P. (2007). A Categorization of Explanation Questions for Task Processing Systems. AAAI Workshop on Explanation-Aware Computing (ExaCt-07).Google Scholar
- Muir, B. (1994). Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37(11): 1905--1922.Google ScholarCross Ref
- Mynatt, E.D., Rowan, J., Craighill, S.&Jacobs, A. (2001). Digital family portraits: supporting peace of mind for extended family members. Proc. CHI '01, 333--340. Google ScholarDigital Library
- Orlikowski, W. J. (2000). Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations. Organization Science 11(4), 404--428. Google ScholarDigital Library
- Schonlau, M., Soest, A.V., Kapteyn, A.,&Couper, M.P. (2006). Selection bias in web surveys and the use of propensity scores. Sociological Methods&Research, 37(3): 291--318.Google Scholar
- Strauss, A.L.&Corbin, J.M. (1990). Basics of Qualitative Research: Grounded theory procedures and techniques. Newbury Park, CA: Sage Publications.Google Scholar
- Van der Meik, H. (1987). Assumptions of information-seeking questions. Questioning Exchange 1, 111--118.Google Scholar
Index Terms
- Assessing demand for intelligibility in context-aware applications
Recommendations
Investigating intelligibility for uncertain context-aware applications
UbiComp '11: Proceedings of the 13th international conference on Ubiquitous computingContext-aware applications use sensing and inference to attempt to determine users' contexts, and take appropriate action. However, they are prone to uncertainty, and this may compromise the trust users have in them. Providing intelligibility has been ...
Toolkit to support intelligibility in context-aware applications
UbiComp '10: Proceedings of the 12th ACM international conference on Ubiquitous computingContext-aware applications should be intelligible so users can better understand how they work and improve their trust in them. However, providing intelligibility is non-trivial and requires the developer to understand how to generate explanations from ...
Improving trust in context-aware applications with intelligibility
UbiComp '10 Adjunct: Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - AdjunctSince context-aware applications use implicit sensing and increasingly complex decision making, they may make mistakes or users may misunderstand their actions. This may hinder trust and adoption of context-aware applications. We hypothesize that making ...
Comments