skip to main content
10.1145/3546155.3546676acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article
Open Access

Combining Momentary and Retrospective Self-Reflection in a Mobile Photo-Based Journaling Application

Authors Info & Claims
Published:08 October 2022Publication History

ABSTRACT

The concept of self-reflection is investigated in a wide range of fields, from Psychology to HCI. Different fields use different methods to trigger reflection, such as visualizing accumulated personal quantitative data, personal photos, journaling, or asking reflective questions about experiences. This study combines photo-based journaling, reflective questions and data visualization for triggering momentary and retrospective self-reflection. We prototyped a photo-based journaling app and conducted a 5-week field study (N=13) to observe in-the-wild experiences. Following, we conducted an evaluation workshop (N=9) to explore strategies for motivating reflective question answering and retrospective self-reflection. Our approach encourages momentary and retrospective self-reflection, but the question-answering process could be burdensome and retrospective self-reflection should be incentivized. For that, we compiled design strategies for both kinds of self-reflection. We contribute to the HCI literature with strategies for unifying momentary and retrospective self-reflection in photo-based journaling.

References

  1. Likert, R. 1932. A technique for the measurement of attitudes. Archives of Psychology. (1932), 22 140, 55.Google ScholarGoogle Scholar
  2. Alexandra, Y. 2015. The Role of Accidental Self-Reflection in Wearable Camera Research. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. https://doi.org/10.1145/2786567Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Avrahami, D. 2020. Celebrating Everyday Success: Improving Engagement and Motivation using a System for Recording Daily Highlights. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376369Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ayobi, A. 2018. Flexible and mindful self-tracking: Design implications from paper bullet journals. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Paper 28, 1–14. https://doi.org/10.1145/3173574.3173602Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Barton, S. 1994. Chaos, Self-Organization, and Psychology. American Psychologist. 49, 1 (1994), 5–14. https://doi.org/10.1037/0003-066X.49.1.5Google ScholarGoogle ScholarCross RefCross Ref
  6. Baumer, E.P.S. 2014. Reviewing Reflection: On the Use of Reflection in Interactive System Design. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/2598510.2598598Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bentvelzen, M. 2021. The technology-mediated reflection model: Barriers and assistance in data-driven reflection. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 246, 1–12. https://doi.org/10.1145/3411764.3445505Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Braun, V. and Clarke, V. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology. 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarGoogle ScholarCross RefCross Ref
  9. Brooke, J. 2020. SUS: A “Quick and Dirty” Usability Scale. Usability Evaluation In Industry. July (2020), 207–212. https://doi.org/10.1201/9781498710411-35Google ScholarGoogle Scholar
  10. Carter, S. and Mankoff, J. 2005. When participants do the capturing: the role of media in diary studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). Association for Computing Machinery, New York, NY, USA, 899–908. https://doi.org/10.1145/1054972.1055098Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Choe, E.K. 2017. Understanding self-reflection: How people reflect on personal data through visual data exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '17). Association for Computing Machinery, New York, NY, USA, 173–182. https://doi.org/10.1145/3154862.3154881Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Clarke, M. 2004. Reflection: Journals and Reflective Questions: a Strategy for Professional Learning. Australian Journal of Teacher Education. 29, 2 (2004). https://doi.org/10.14221/ajte.2004v29n2.2Google ScholarGoogle ScholarCross RefCross Ref
  13. Consolvo, S. 2008. Flowers or a robot army? encouraging awareness & activity with personal, mobile displays. In Proceedings of the 10th international conference on Ubiquitous computing (UbiComp '08). Association for Computing Machinery, New York, NY, USA, 54–63. https://doi.org/10.1145/1409635.1409644Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Devakumar, A. 2021. A review on strategies for data collection, reflection, and communication in eating disorder apps. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 547, 1–19. https://doi.org/10.1145/3411764.3445670Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Dunlap, J.C. 2006. Using guided reflective journaling activities to capture students’ changing perceptions. TechTrends. 50, 6 (2006), 20–26. https://doi.org/10.1007/s11528-006-7614-xGoogle ScholarGoogle ScholarCross RefCross Ref
  16. Elsden, C. 2016. It's just my history, isn't it?: Understanding smart journaling practices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 2819–2831. https://doi.org/10.1145/2858036.2858103Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Epstein, D. 2014. Taming Data Complexity in Lifelogs: Exploring Visual Cuts of Personal Informatics Data. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 667–676. https://doi.org/10.1145/2598510.2598558Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Fan, C. 2012. A spark of activity: Exploring informative art as visualization for physical activity. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). Association for Computing Machinery, New York, NY, USA, 81–84. https://doi.org/10.1145/2370216.2370229Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Farnham, S.D. and Churchill, E.F. 2011. Faceted identity, faceted lives: Social and technical issues with being yourself online. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (CSCW '11). Association for Computing Machinery, New York, NY, USA, 359–368. https://doi.org/10.1145/1958824.1958880Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Fleck, R. and Fitzpatrick, G. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI '10). Association for Computing Machinery, New York, NY, USA, 216–223. https://doi.org/10.1145/1952222.1952269Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Froehlich, J. 2012. The design and evaluation of prototype eco-feedback displays for fixture-level water usage data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 2367–2376. https://doi.org/10.1145/2207676.2208397Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ghosh, S. 2020. Towards improving emotion self-report collection using self-reflection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3383019Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Gortner, E.M. 2006. Benefits of Expressive Writing in Lowering Rumination and Depressive Symptoms. Behavior Therapy. 37, 3 (2006), 292–303. https://doi.org/10.1016/j.beth.2006.01.004Google ScholarGoogle ScholarCross RefCross Ref
  24. Guilford, J.P. 1967. Creativity: Yesterday, Today and Tomorrow. The Journal of Creative Behavior. 1, 1 (Jan. 1967), 3–14. https://doi.org/10.1002/j.2162-6057.1967.tb00002.xGoogle ScholarGoogle ScholarCross RefCross Ref
  25. van House, N.A. 2011. Personal photography, digital technologies and the uses of the visual. Visual Studies. 26, 2 (2011), 125–134. https://doi.org/10.1080/1472586X.2011.571888Google ScholarGoogle ScholarCross RefCross Ref
  26. Isaacs, E. 2013. Echoes from the past: How technology mediated reflection improves well-being. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 1071–1080. https://doi.org/10.1145/2470654.2466137 .Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jung, H. 2020. In Search of Forms for Evocative and Generative Reflection: Exploratory Studies and a Design Proposal. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376231Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Karaturhan, P. 2021. Layer zero: An approach for deepening self-reflection on instagram shares. In: Meiselwitz, G. (eds) Social Computing and Social Media: Applications in Marketing, Learning, and Health. HCII 2021. Lecture Notes in Computer Science(), vol 12775. Springer, Cham. https://doi.org/10.1007/978-3-030-77685-5_27Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kim, Y.H. 2016. TimeAware: Leveraging framing effects to enhance personal productivity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 272–283. https://doi.org/10.1145/2858036.2858428Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Lange, A. 1996. Using writing assignments with families managing legacies of extreme traumas. Journal of Family Therapy. 18, 4 (1996), 375–388. https://doi.org/10.1111/j.1467-6427.1996.tb00058.xGoogle ScholarGoogle ScholarCross RefCross Ref
  31. Li, I. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 557–566. https://doi.org/10.1145/1753326.1753409Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Limueco, J.M. and Prudente, M.S. 2020. Improving Students’ Reflections in Physics Class Using Video-based Journals. In Proceedings of the 2020 11th International Conference on E-Education, E-Business, E-Management, and E-Learning (IC4E 2020). Association for Computing Machinery, New York, NY, USA, 218–222. https://doi.org/10.1145/3377571.3377591Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Lindley, S. 2008. Collocated social practices surrounding photos. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). Association for Computing Machinery, New York, NY, USA, 3921–3924. https://doi.org/10.1145/1358628.1358957Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Lu, X. 2021. How Cultural Norms Influence Persuasive Design: A Study on Chinese Food Journaling Apps. In Designing Interactive Systems Conference 2021 (DIS '21). Association for Computing Machinery, New York, NY, USA, 619–637. https://doi.org/10.1145/3461778.3462142 .Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. M. Silva, L. and A. Epstein, D. 2021. Investigating Preferred Food Description Practices in Digital Food Journaling. In Designing Interactive Systems Conference 2021 (DIS '21). Association for Computing Machinery, New York, NY, USA, 589–605. https://doi.org/10.1145/3461778.3462145Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Mair, C. 2012. Using technology for enhancing reflective writing, metacognition and learning. Journal of Further and Higher Education. 36, 2 (2012), 147–167. https://doi.org/10.1080/0309877X.2011.590583Google ScholarGoogle ScholarCross RefCross Ref
  37. McGookin, D. 2019. Reveal: Investigating proactive location-based reminiscing with personal digital photo repositories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Paper 435, 1–14. https://doi.org/10.1145/3290605.3300665Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Meston, C.M. 2013. Effects of expressive writing on sexual dysfunction, depression, and PTSD in women with a history of childhood sexual abuse: Results from a randomized clinical trial. Journal of Sexual Medicine. 10, 9 (2013), 2177–2189. https://doi.org/10.1111/jsm.12247Google ScholarGoogle ScholarCross RefCross Ref
  39. Mitchell, E.G. 2021. From reflection to action: Combining machine learning with expert knowledge for nutrition goal recommendations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 206, 1–17. https://doi.org/10.1145/3411764.3445555Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Mols, I. 2017. Balance, Cogito and Dott: Exploring Media Modalities for Everyday-life Reflection. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). Association for Computing Machinery, New York, NY, USA, 427–433. https://doi.org/10.1145/3024969.3025069Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Mols, I. 2016. Informing Design for Reflection. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). Association for Computing Machinery, New York, NY, USA, Article 21, 1–10. https://doi.org/10.1145/2971485.2971494Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Mols, I. 2014. Making memories: A cultural probe study into the remembering of everyday life. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 256–265. https://doi.org/10.1145/2639189.2639209Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Mols, I. 2016. Technologies for Everyday Life Reflection: Illustrating a Design Space. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’16). Association for Computing Machinery, New York, NY, USA, 53–61. https://doi.org/10.1145/2839462.2839466Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Moore, S.E. 2011. Social work students and self-care: A model assignment for teaching. Journal of Social Work Education. 47, 3, 545–553. https://doi.org/10.5175/JSWE.2011.201000004Google ScholarGoogle ScholarCross RefCross Ref
  45. Moussa-Inaty, J. 2015. Reflective writing through the use of guiding questions. International Journal of Teaching and Learning in Higher Education. 27, 1, 104–113.Google ScholarGoogle Scholar
  46. Oh, H. 2018. Multimodal food journaling. HealthMedia 2018 - Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care, co-located with MM 2018. 39–47. https://doi.org/10.1145/3264996.3265000Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Peesapati, S.T. 2010. Pensieve: Supporting everyday reminiscence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 2027–2036. https://doi.org/10.1145/1753326.1753635Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Petrelli, D. 2009. Making history: Intentional capture of future memories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 1723–1732. https://doi.org/10.1145/1518701.1518966Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Sellen, A.J. 2007. Do life-logging technologies support memory for the past? an experimental study using sensecam. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 81–90. https://doi.org/10.1145/1240624.1240636Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Terzimehić, N. 2021. MEMEories: Internet Memes as Means for Daily Journaling. In Proceedings of the 2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere (DIS ’21). Association for Computing Machinery, New York, NY, USA, 538–548. https://doi.org/10.1145/3461778.3462080Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Thieme, A. 2012. “we've bin watching you” - Designing for reflection and social persuasion to promote sustainable lifestyles. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 2337–2346. https://doi.org/10.1145/2207676.2208394Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Tholander, J. and Normark, M. 2020. Crafting Personal Information - Resistance, Imperfection, and Self-Creation in Bullet Journaling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376410Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Utley, A. and Garza, Y. 2011. The therapeutic use of journaling with adolescents. Journal of Creativity in Mental Health. 6, 1 (2011), 29–41. https://doi.org/10.1080/15401383.2011.557312Google ScholarGoogle ScholarCross RefCross Ref
  54. Whittaker, S. 2010. Easy on that trigger dad: A study of long term family photo retrieval. Pers Ubiquit Comput 14, 31–43. https://doi.org/10.1007/s00779-009-0218-7Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Ye, X. 2016. Assisting food journaling with automatic eating detection. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 3255–3262. https://doi.org/10.1145/2851581.2892426Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Zimmerman, J. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Combining Momentary and Retrospective Self-Reflection in a Mobile Photo-Based Journaling Application

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Article Metrics

      • Downloads (Last 12 months)342
      • Downloads (Last 6 weeks)45

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format