Rafal Kocielnik
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Mobile, wearable and other connected devices allow people to collect and explore large amounts of data about their own activities, behavior, and well-being. Yet, learning from-, and acting upon such data remain a challenge. The process of reflection has been identified as a key component of such learning. However, most tools do not explicitly design for reflection, carrying an implicit assumption that providing access to self-tracking data is sufficient. In this paper, we present Reflection Companion, a mobile conversational system that supports engaging reflection on personal sensed data, specifically physical activity data collected with fitness trackers. Reflection Companion delivers daily adaptive mini-dialogues and graphs to users' mobile phones to promote reflection. To generate our system's mini dialogues, we conducted a set of workshops with fitness trackers users, producing a diverse corpus of 275 reflection questions synthesized into a set of 25 reflection mini dialogues. In a 2-week field deployment with 33 active Fitbit users, we examined our system's ability to engage users in reflection through dialog. Results suggest that the mini-dialogues were successful in triggering reflection and that this reflection led to increased motivation, empowerment, and adoption of new behaviors. As a strong indicator of our system's value, 16 of the 33 participants elected to continue using the system for two additional weeks without compensation. We present our findings and describe implications for the design of technology-supported dialog systems for reflection on data.
Supplemental Material
Available for Download
zip
kocielnik.zip (129.7 KB)
Supplemental movie, appendix, image and software files for, Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity
- Jakob Åberg. 2017. Chatbots As A Mean To Motivate Behavior Change: How To Inspire Pro-Environmental Attitude with Chatbot Interfaces. Retrieved from http://www.diva-portal.org/smash/record.jsf?pid=diva2:1106358Google Scholar
- Icek Ajzen. 1991. The theory of planned behavior. Organizational behavior and human decision processes 50, 2: 179--211.Google Scholar
- George A. Akerlof and Rachel Kranton. 2010. Identity economics. The Economists' Voice 7, 2. Retrieved from https://www.degruyter.com/downloadpdf/j/ev.2010.7.2/ev.2010.7.2.1762/ev.2010.7.2.1762.xmlGoogle ScholarCross Ref
- Sue Atkins and Kathy Murphy. 1993. Reflection: a review of the literature. Journal of advanced nursing 18, 8: 1188--1192.Google ScholarCross Ref
- John D. Bain, Roy Ballantyne, Jan Packer, and Colleen Mills. 1999. Using journal writing to enhance student teachers' reflectivity during field experience placements. Teachers and Teaching 5, 1: 51--73.Google ScholarCross Ref
- Scott Bateman, Jaime Teevan, and Ryen W. White. 2012. The search dashboard: how reflection and comparison impact search behavior. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1785--1794. Google ScholarDigital Library
- Eric P.S. Baumer. 2015. Reflective Informatics: Conceptual Dimensions for Designing Technologies of Reflection. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 585--594. Google ScholarDigital Library
- Eric PS Baumer, Vera Khovanskaya, Mark Matthews, Lindsay Reynolds, Victoria Schwanda Sosik, and Geri Gay. 2014. Reviewing reflection: on the use of reflection in interactive system design. In Proceedings of the 2014 conference on Designing interactive systems, 93--102. Retrieved January 31, 2017 from http://dl.acm.org/citation.cfm?id=2598598 Google ScholarDigital Library
- Bridgette M. Bewick, Karen Trusler, Michael Barkham, Andrew J. Hill, Jane Cahill, and Brendan Mulhern. 2008. The effectiveness of web-based interventions designed to decrease alcohol consumption---a systematic review. Preventive medicine 47, 1: 17--26.Google Scholar
- Timothy Bickmore and Toni Giorgino. 2006. Health dialog systems for patients and consumers. Journal of biomedical informatics 39, 5: 556--571. Google ScholarDigital Library
- Timothy Bickmore, Daniel Schulman, and Langxuan Yin. 2010. Maintaining Engagement in Long-Term Interventions with Relational Agents. Applied Artificial Intelligence 24, 6: 648--666. Google ScholarDigital Library
- Timothy W. Bickmore and Rosalind W. Picard. 2005. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12, 2: 293--327. Google ScholarDigital Library
- David Boud, Rosemary Keogh, and David Walker. 2013. Reflection: Turning experience into learning. Routledge. Retrieved from https://books.google.nl/books?hl=en&lr=&id=XuBEAQAAQBAJ&oi=fnd&pg=PP1&dq=Promoting+reflection+in+learning,+in+Reflection:+Turning+experience+into+learning.+&ots=TuWs2Rrg0P&sig=KoFpLEseuZJEdzrg0P4JbEdo_JYGoogle ScholarCross Ref
- Charles S. Carver and Michael F. Scheier. 2000. Autonomy and self-regulation. Psychological Inquiry 11, 4: 284--291.Google Scholar
- Charles S. Carver and Michael F. Scheier. 2001. On the self-regulation of behavior. Cambridge University Press.Google Scholar
- Jilin Chen, Gary Hsieh, Jalal U. Mahmud, and Jeffrey Nichols. 2014. Understanding Individuals' Personal Values from Social Media Word Use. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work 8 Social Computing (CSCW '14), 405--414. Google ScholarDigital Library
- Eun Kyoung Choe, Bongshin Lee, Matthew Kay, Wanda Pratt, and Julie A. Kientz. 2015. SleepTight: low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 121--132. Retrieved from http://dl.acm.org/citation.cfm?id=2804266 Google ScholarDigital Library
- Eun Kyoung Choe, Bongshin Lee, Haining Zhu, Nathalie Henry Riche, and Dominikus Baur. 2017. Understanding Self-Reflection: How People Reflect on Personal Data through Visual Data Exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'17). ACM, New York, NY, USA. Google ScholarDigital Library
- Eun Kyoung Choe, Nicole B. Lee, Bongshin Lee, Wanda Pratt, and Julie A. Kientz. 2014. Understanding quantifiedselfers' practices in collecting and exploring personal data. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, 1143--1152. Google ScholarDigital Library
- Jan Cieciuch and Shalom H. Schwartz. 2012. The number of distinct basic values and their structure assessed by PVQ--40. Journal of personality assessment 94, 3: 321--328.Google ScholarCross Ref
- Herbert H. Clark. 1996. Using language. Cambridge university press.Google Scholar
- Sunny Consolvo, Predrag Klasnja, David W. McDonald, Daniel Avrahami, Jon Froehlich, Louis LeGrand, Ryan Libby, Keith Mosher, and James A. Landay. 2008. Flowers or a robot army?: encouraging awareness 8 activity with personal, mobile displays. In Proceedings of the 10th international conference on Ubiquitous computing, 54--63. Retrieved from http://dl.acm.org/citation.cfm?id=1409644 Google ScholarDigital Library
- Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. 2017. Calendar. help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2382--2393. Google ScholarDigital Library
- Beant Dhillon, Rafal Kocielnik, Ioannis Politis, Marc Swerts, and Dalila Szostak. 2011. Culture and facial expressions: A case study with a speech interface. In IFIP Conference on Human-Computer Interaction, 392--404. Retrieved January 10, 2017 from http://link.springer.com/chapter/10.1007/978-3-642-23771-3_29 Google ScholarDigital Library
- Carlo C. DiClemente, Angela S. Marinilli, Manu Singh, and Lori E. Bellino. 2001. The role of feedback in the process of health behavior change. American journal of health behavior 25, 3: 217--227.Google Scholar
- Mica R. Endsley. 1997. The role of situation awareness in naturalistic decision making. Naturalistic decision making 269: 284.Google Scholar
- Daniel A. Epstein, An Ping, James Fogarty, and Sean A. Munson. 2015. A lived informatics model of personal informatics. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 731--742. Retrieved February 2, 2017 from http://dl.acm.org/citation.cfm?id=2804250 Google ScholarDigital Library
- John H. Flavell. 1979. Metacognition and cognitive monitoring: A new area of cognitive--developmental inquiry. American psychologist 34, 10: 906.Google Scholar
- Rowanne Fleck and Geraldine Fitzpatrick. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction, 216--223. Retrieved January 10, 2017 from http://dl.acm.org/citation.cfm?id=1952269 Google ScholarDigital Library
- Marcus Foth, Jaz Hee-jeong Choi, and Christine Satchell. 2011. Urban informatics. In Proceedings of the ACM 2011 conference on Computer supported cooperative work, 1--8. Google ScholarDigital Library
- Michael Friedewald and Oliver Raabe. 2011. Ubiquitous computing: An overview of technology impacts. Telematics and Informatics 28, 2: 55--65. Google ScholarDigital Library
- Kentaro Fujita and H. Anna Han. 2009. Moving beyond deliberative control of impulses: The effect of construal levels on evaluative associations in self-control conflicts. Psychological Science 20, 7: 799--804.Google ScholarCross Ref
- Claudia Gama. 2001. Helping students to help themselves: a pilot experiment on the ways of increasing metacognitive awareness in problem solving. Proc. of New Technologies in Science Education.Google Scholar
- Graham Gibbs. 1988. Learning by doing: A guide to teaching and learning methods. Oxford Centre for Staff and Learning Development, Oxford Brookes University.Google Scholar
- Rúben Gouveia, Evangelos Karapanos, and Marc Hassenzahl. 2015. How do we engage with activity trackers?: a longitudinal study of Habito. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 1305--1316. Google ScholarDigital Library
- K. Gustafson and W. Bennett. 1999. Issues and difficulties in promoting learner reflection: Results from a three-year study. WWW: http://it.coe.uga.edu/~kgustafs/document/promoting.html.Google Scholar
- Lars Hallnäs and Johan Redström. 2001. Slow technology--designing for reflection. Personal and ubiquitous computing 5, 3: 201--212. Google ScholarDigital Library
- Katrin Hänsel, Natalie Wilde, Hamed Haddadi, and Akram Alomainy. 2015. Challenges with current wearable technology in monitoring health data and providing positive behavioural support. In Proceedings of the 5th EAI International Conference on Wireless Mobile Communication and Healthcare, 158--161. Google ScholarDigital Library
- Hyehyun Hong. 2009. Scale development for measuring health consciousness: Re-conceptualization. In 12th annual international public relations research conference, Holiday Inn University of Miami Coral Gables, Florida. Retrieved from http://www.instituteforpr.org/wp-content/uploads/ScaleDvlpmentMeasuring.pdfGoogle Scholar
- Kate Jolly, Amanda Lewis, Jane Beach, John Denley, Peymane Adab, Jonathan J. Deeks, Amanda Daley, and Paul Aveyard. 2011. Comparison of range of commercial or primary care led weight reduction programmes with minimal intervention control for weight loss in obesity: Lighten Up randomised controlled trial. BMJ 343: d6500.Google ScholarCross Ref
- Daniel Kahneman. 2003. Maps of bounded rationality: Psychology for behavioral economics. The American economic review 93, 5: 1449--1475.Google Scholar
- David Kember, Doris YP Leung, Alice Jones, Alice Yuen Loke, Jan McKay, Kit Sinclair, Harrison Tse, Celia Webb, Frances Kam Yuet Wong, Marian Wong, and others. 2000. Development of a questionnaire to measure the level of reflective thinking. Assessment 8 evaluation in higher education 25, 4: 381--395.Google Scholar
- Young Hoon Kim, Dan J. Kim, and Kathy Wachter. 2013. A study of mobile user engagement (MoEN): Engagement motivations, perceived value, satisfaction, and continued engagement intention. Decision Support Systems 56: 361--370.Google ScholarDigital Library
- Rafal Kocielnik, Daniel Avrahami, Jennifer Marlow, Di Lu, and Gary Hsieh. Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent. Proceedings of the 2018 Conference on Designing Interactive Systems, DIS '18: 14. Google ScholarDigital Library
- Rafal Kocielnik and Gary Hsieh. 2018. Facilitating Self-learning in Behavior Change Through Long-term Intelligent Conversational Assistance. In 23rd International Conference on Intelligent User Interfaces, 683--684. Google ScholarDigital Library
- Rafal Kocielnik and Gary Hsieh. Send Me a Different Message: Utilizing Cognitive Space to Create Engaging Message Triggers. Proceedings of the 20th ACM Conference on Computer-Supported Cooperative Work 8 Social Computing.: 2017. Google ScholarDigital Library
- Rafal Kocielnik, Fabrizio Maria Maggi, and Natalia Sidorova. 2013. Enabling self-reflection with LifelogExplorer: Generating simple views from complex data. In Pervasive Computing Technologies for Healthcare (PervasiveHealth), 2013 7th International Conference on, 184--191. Retrieved from http://ieeexplore.ieee.org/abstract/document/6563924/ Google ScholarDigital Library
- Rafal Kocielnik, Mykola Pechenizkiy, and Natalia Sidorova. 2012. Stress analytics in education. In Educational Data Mining 2012.Google Scholar
- Rafal Kocielnik and Natalia Sidorova. 2015. Personalized stress management: enabling stress monitoring with lifelogexplorer. KI-Künstliche Intelligenz 29, 2: 115--122.Google ScholarCross Ref
- Rafal Kocielnik, Natalia Sidorova, Fabrizio Maria Maggi, Martin Ouwerkerk, and Joyce HDM Westerink. 2013. Smart technologies for long-term stress monitoring at work. In Computer-Based Medical Systems (CBMS), 2013 IEEE 26th International Symposium on, 53--58.Google ScholarCross Ref
- David A. Kolb. 2014. Experiential learning: Experience as the source of learning and development. FT press. Retrieved from https://books.google.nl/books?hl=en&lr=&id=jpbeBQAAQBAJ&oi=fnd&pg=PR7&dq=Experiential+learning:+experie nce+as+the+source+of+learning+and+development&ots=Vn2SnW_XJc&sig=M3cn3_8BZgR77wpUjCmgRyMQwy8Google Scholar
- Margaret D. LeCompte. 2000. Analyzing qualitative data. Theory into practice 39, 3: 146--154.Google Scholar
- Min Kyung Lee, Junsung Kim, Jodi Forlizzi, and Sara Kiesler. 2015. Personalization revisited: a reflective approach helps people better personalize health services and motivates them to increase physical activity. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 743--754. Retrieved from http://dl.acm.org/citation.cfm?id=2807552 Google ScholarDigital Library
- Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 557--566. Retrieved from http://dl.acm.org/citation.cfm?id=1753409 Google ScholarDigital Library
- Ian Li, Anind K. Dey, and Jodi Forlizzi. 2011. Understanding my data, myself: supporting self-reflection with ubicomp technologies. In Proceedings of the 13th international conference on Ubiquitous computing, 405--414. Retrieved January 10, 2017 from http://dl.acm.org/citation.cfm?id=2030166 Google ScholarDigital Library
- Ian Li, Jodi Forlizzi, and Anind Dey. 2010. Know thyself: monitoring and reflecting on facets of one's life. In CHI'10 Extended Abstracts on Human Factors in Computing Systems, 4489--4492. Retrieved from http://dl.acm.org/citation.cfm?id=1754181 Google ScholarDigital Library
- James Lin, Lena Mamykina, Silvia Lindtner, Gregory Delajoux, and Henry Strub. 2006. Fish'n'Steps: Encouraging physical activity with an interactive computer game. UbiComp 2006: Ubiquitous Computing: 261--278. Google ScholarDigital Library
- Madelene Lindström, Anna St\a ahl, Kristina Höök, Petra Sundström, Jarmo Laaksolathi, Marco Combetto, Alex Taylor, and Roberto Bresin. 2006. Affective diary: designing for bodily expressiveness and self-reflection. In CHI'06 extended abstracts on Human factors in computing systems, 1037--1042. Retrieved from http://dl.acm.org/citation.cfm?id=1125649 Google ScholarDigital Library
- Lena Mamykina, Elizabeth Mynatt, Patricia Davidson, and Daniel Greenblatt. 2008. MAHI: investigation of social scaffolding for reflective thinking in diabetes management. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 477--486. Retrieved from http://dl.acm.org/citation.cfm?id=1357131 Google ScholarDigital Library
- Daniel McDuff, Amy Karlson, Ashish Kapoor, Asta Roseway, and Mary Czerwinski. 2012. AffectAura: an intelligent system for emotional memory. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 849--858. Retrieved from http://dl.acm.org/citation.cfm?id=2208525 Google ScholarDigital Library
- Katherine L. Milkman, Dolly Chugh, and Max H. Bazerman. 2009. How can decision making be improved? Perspectives on psychological science 4, 4: 379--383.Google Scholar
- Jennifer A. Moon. 2013. Reflection in Learning and Professional Development: Theory and Practice. Routledge.Google Scholar
- Clifford Nass, Jonathan Steuer, and Ellen R. Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems, 72--78. Retrieved from http://dl.acm.org/citation.cfm?id=191703 Google ScholarDigital Library
- Hien Nguyen and Judith Masthoff. 2008. Designing persuasive dialogue systems: Using argumentation with care. In International Conference on Persuasive Technology, 201--212. Retrieved from http://link.springer.com/chapter/10.1007/978-3-540-68504-3_18 Google ScholarDigital Library
- Afarin Pirzadeh, Li He, and Erik Stolterman. 2013. Personal Informatics and Reflection: A Critical Examination of the Nature of Reflection. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13), 1979--1988. Google ScholarDigital Library
- David B. Portnoy, Lori AJ Scott-Sheldon, Blair T. Johnson, and Michael P. Carey. 2008. Computer-delivered interventions for health promotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988--2007. Preventive medicine 47, 1: 3--16.Google Scholar
- David Premack. 2004. Is language the key to human intelligence? Science 303, 5656: 318--320.Google Scholar
- Verónica Rivera-Pelayo, Valentin Zacharias, Lars Müller, and Simone Braun. 2012. Applying quantified self approaches to support reflective learning. In Proceedings of the 2nd international conference on learning analytics and knowledge, 111--114. Retrieved February 2, 2017 from http://dl.acm.org/citation.cfm?id=2330631 Google ScholarDigital Library
- Donald A. Schon. 1984. The reflective practitioner: How professionals think in action. Basic books. Retrieved from https://books.google.nl/books?hl=en&lr=&id=ceJIWay4-jgC&oi=fnd&pg=PR7&dq=+The+reflective+practitioner:+How+professionals+think+in+action&ots=q80SNZJWqk&sig=BvJKqED7NALlofunXM3jomOp-rcGoogle Scholar
- Daniel Schulman, Timothy W. Bickmore, and Candace L. Sidner. 2011. An Intelligent Conversational Agent for Promoting Long-Term Health Behavior Change Using Motivational Interviewing. In AAAI Spring Symposium: AI and Health Communication.Google Scholar
- David W. Schumann, Richard E. Petty, and D. Scott Clemons. 1990. Predicting the Effectiveness of Different Strategies of Advertising Variation: A Test of the Repetition-Variation Hypotheses. Journal of Consumer Research 17, 2: 192--202.Google ScholarCross Ref
- Shalom H. Schwartz. 1992. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In Advances in experimental social psychology. Elsevier, 1--65.Google Scholar
- Petr Slovák, Christopher Frauenberger, and Geraldine Fitzpatrick. 2017. Reflective Practicum: A Framework of Sensitising Concepts to Design for Transformative Reflection. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 2696--2707. Google ScholarDigital Library
- L. Sobell and M. Sobell. 2008. Motivational interviewing strategies and techniques: Rationales and examples. Retrieved on April 24: 2015.Google Scholar
- Marina Sokolova and Guy Lapalme. 2009. A systematic analysis of performance measures for classification tasks. Information Processing 8 Management 45, 4: 427--437. Google ScholarDigital Library
- Yaacov Trope and Nira Liberman. 2010. Construal-level theory of psychological distance. Psychological review 117, 2: 440.Google Scholar
- Gokhan Tur and Renato De Mori. 2011. Spoken language understanding: Systems for extracting semantic information from speech. John Wiley 8 Sons.Google Scholar
- Harald Walach, Nina Buchheld, Valentin Buttenmüller, Norman Kleinknecht, and Stefan Schmidt. 2006. Measuring Mindfulness--The Freiburg Mindfulness Inventory (FMI).Google Scholar
- Ye-Yi Wang, Li Deng, and Alex Acero. 2005. Spoken language understanding. IEEE Signal Processing Magazine 22, 5: 16--31.Google ScholarCross Ref
- John R. Ward and Suzanne S. McCotter. 2004. Reflection as a visible outcome for preservice teachers. Teaching and teacher education 20, 3: 243--257.Google Scholar
- Jason D. Williams, Eslam Kamal, Mokhtar Ashour, Hani Amr, Jessica Miller, and Geoff Zweig. 2015. Fast and easy language understanding for dialog systems with Microsoft Language Understanding Intelligent Service (LUIS). In Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 159--161.Google ScholarCross Ref
- Jason D. Williams, Nobal B. Niraula, Pradeep Dasigi, Aparna Lakshmiratan, Carlos Garcia Jurado Suarez, Mouni Reddy, and Geoff Zweig. 2015. Rapidly scaling dialog systems with interactive learning. In Natural Language Dialog Systems and Intelligent Assistants. Springer, 1--13.Google Scholar
Index Terms
- Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity
Recommendations
Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent
DIS '18: Proceedings of the 2018 Designing Interactive Systems ConferenceConversational agents stand to play an important role in supporting behavior change and well-being in many domains. With users able to interact with conversational agents through both text and voice, understanding how designing for these channels ...
Combining Momentary and Retrospective Self-Reflection in a Mobile Photo-Based Journaling Application
NordiCHI '22: Nordic Human-Computer Interaction ConferenceThe concept of self-reflection is investigated in a wide range of fields, from Psychology to HCI. Different fields use different methods to trigger reflection, such as visualizing accumulated personal quantitative data, personal photos, journaling, or ...
Personal informatics and reflection: a critical examination of the nature of reflection
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsPersonal informatics systems that help people both collect and reflect on various kinds of personal information are growing rapidly. Despite the importance of journaling and the main role it has in tracking one's personal growth, a limited number of ...
Comments