skip to main content
10.1145/3461778.3462145acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article
Open Access

Investigating Preferred Food Description Practices in Digital Food Journaling

Published:28 June 2021Publication History

ABSTRACT

Journaling of consumed foods through digital devices is a popular self-tracking strategy for weight loss and eating mindfulness. Research has explored modalities, like photos and open-ended text and voice descriptions, to make journaling less burdensome and more descriptive than traditional barcode and database searches. However, less is known about how people prefer to journal foods when less constrained by limitations of databases, natural language processing, and image recognition. We deployed a food journal prototype supporting varied devices and input modalities, which 15 participants used to journal 1008 food logs over two weeks. Participants had diverse strategies for indicating what and how much they ate, varying from ambiguous foods to specifying varieties and using different measurements for clarifying amount. Some strategies were interpretable by natural language food identification and image classification services, while others point to open research questions. We finally discuss opportunities for accounting for variance in food journaling.

Skip Supplemental Material Section

Supplemental Material

References

  1. 7 Best Image Recognition APIs. Retrieved 10 February, 2021 from https://nordicapis.com/7-best-image-recognition-apis/Google ScholarGoogle Scholar
  2. Sofiane Abbar, Yelena Mejova, and Ingmar Weber. (2015). You Tweet What You Eat: Studying Food Consumption Through Twitter. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2015), 3197–3206. http://doi.org/10.1145/2702123.2702153Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Deemah Alqahtani, Caroline Jay, and Markel Vigo. (2020). The Role of Uncertainty as a Facilitator to Reflection in Self-Tracking. Proceedings of the Conference on Designing Interactive Systems (DIS 2020), 1807–1818. http://doi.org/10.1145/3357236.3395448Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Amazon Rekognition. Retrieved 10 February, 2021 from https://aws.amazon.com/rekognition/Google ScholarGoogle Scholar
  5. Oliver Amft, Mathias Stäger, Paul Lukowicz, and Gerhard Tröster. (2005). Analysis of Chewing Sounds for dietary monitoring. Proceedings of the International Conference on Ubiquitous Computing (Ubicomp 2005), 56–72. http://doi.org/10.1007/11551201_4Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Adrienne H. Andrew, Gaetano Borriello, and James Fogarty. (2013). Simplifying Mobile Phone Diaries: Design and Evaluation of a Food Index-Based Nutrition Diary. Proceedings of the International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth 2013), 260–263. http://doi.org/bbkkGoogle ScholarGoogle Scholar
  7. Amid Ayobi, Paul Marshall, and Anna L. Cox. (2020). Trackly: A Customisable and Pictorial Self-Tracking App to Support Agency in Multiple Sclerosis Self-Care. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2020), 1–15. http://doi.org/10.1145/3313831.3376809Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Barcode Lookup. Retrieved 10 February, 2021 from https://www.barcodelookup.com/Google ScholarGoogle Scholar
  9. Elizabeth Barrett-Connor. (1991). Nutrition epidemiology: How do we know what they ate? American Journal of Clinical Nutrition, 182–189. http://doi.org/10.1093/ajcn/54.1.182sGoogle ScholarGoogle Scholar
  10. Eric P.S. Baumer, Sherri Jean Katz, Jill E. Freeman, Phil Adams, Amy L. Gonzales, John Pollak, Daniela Retelny, Jeff Niederdeppe, Christine M. Olson, and Geri K. Gay. (2012). Prescriptive Persuasion and Open-Ended Social Awareness: Expanding the Design Space of Mobile Health. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2012), 475–484. http://doi.org/10.1145/2145204.2145279Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Abdelkareem Bedri, Gregory Abowd, Richard Li, Malcolm Haynes, Raj Prateek Kosaraju, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, and Thad Starner. (2017). EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 1(3), 1–20. http://doi.org/10.1145/3130902Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Abdelkareem Bedri, Diana Li, Rushil Khurana, Kunal Bhuwalka, and Mayank Goel. (2020). FitByte: Automatic Diet Monitoring in Unconstrained Situations Using Multimodal Sensing on Eyeglasses. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2020), 1–12. http://doi.org/10.1145/3313831.3376869Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Oscar Beijbom, Neel Joshi, Dan Morris, Scott Saponas, and Siddharth Khullar. (2015). Menu-match: Restaurant-Specific Food Logging From Images. Proceedings of IEEE Winter Conference on Applications of Computer Vision (WACV 2015), 844–851. http://doi.org/10.1109/WACV.2015.117Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Erin Beneteau, Olivia K. Richards, Mingrui Zhang, Julie A. Kientz, Jason Yip, and Alexis Hiniker. (2019). Communication Breakdowns Between Families and Alexa. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2019), 1–13. http://doi.org/10.1145/3290605.3300473Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Johnna Blair, Yuhan Luo, Ning F. Ma, Sooyeon Lee, and Eun Kyoung Choe. (2018). OneNote Meal: A Photo-Based Diary Study for Reflective Meal Tracking. AMIA Annual Symposium proceedings (AMIA 2018), 252–261. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6371351/Google ScholarGoogle Scholar
  16. Marc Bolanos and Petia Radeva. (2016). Simultaneous Food Localization and Recognition. Proceedings of International Conference on Pattern Recognition (ICPR 2016), 0, 3140–3145. http://doi.org/10.1109/ICPR.2016.7900117Google ScholarGoogle ScholarCross RefCross Ref
  17. Virginia Braun and Victoria Clarke. (2006). Using Thematic Analysis in Psychology. Qualitative Research in Psychology, 3(2), 77–101. http://doi.org/10.1191/1478088706qp063oaGoogle ScholarGoogle ScholarCross RefCross Ref
  18. Lora E. Burke, Molly B. Conroy, Susan M. Sereika, Okan U. Elci, Mindi A. Styn, Sushama D. Acharya, Mary A. Sevick, Linda J. Ewing, and Karen Glanz. (2011). The Effect of Electronic Self-Monitoring on Weight Loss and Dietary Intake: A Randomized Behavioral Weight Loss Trial. Obesity, 19(2), 338–344. http://doi.org/10.1038/oby.2010.208Google ScholarGoogle ScholarCross RefCross Ref
  19. Micael Carvalho, Rémi Cadène, David Picard, Laure Soulier, Nicolas Thome, and Matthieu Cord. (2018). Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings. ning Semantic Text-Image Embeddings. Proceedings of The Conference on Research & Development in Information Retrieval (SIGIR 2018), 35-44. http://doi.org/10.1145/3209978.3210036Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Beenish M. Chaudhry, Christopher Schaefbauer, Ben Jelen, Katie A. Siek, and Kay Connelly. (2016). Evaluation of a Food Portion Size Estimation Interface for a Varying Literacy Population. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2016), 5645–5657. http://doi.org/10.1145/2858036.2858554Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Juliana Chen, William Berkman, Manal Bardouh, Ching Yan Kammy Ng, and Margaret Allman-Farinelli. (2019). The Use of a Food Logging App in the Naturalistic Setting Fails to Provide Accurate Measurements of Nutrients and Poses Usability Challenges. Nutrition, 57, 208–216. http://doi.org/10.1016/j.nut.2018.05.003Google ScholarGoogle ScholarCross RefCross Ref
  22. Juliana Chen, Janet E. Cade, and Margaret Allman-Farinelli. (2015). The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment. Journal of Medical Internet Research (JMIR 2015), 3(4), e104. http://doi.org/10.2196/mhealth.4334Google ScholarGoogle Scholar
  23. Eun Kyoung Choe, Saeed Abdullah, Mashfiqui Rabbi, Edison Thomaz, Daniel A. Epstein, Felicia Cordeiro, Matthew Kay, Gregory D. Abowd, Tanzeem Choudhury, James Fogarty, Bongshin Lee, Mark Matthews, and Julie A. Kientz. (2017). Semi-Automated Tracking: A Balanced Approach for Self-Monitoring Applications. IEEE Pervasive Computing, 16(1), 74–84. http://doi.org/10.1109/MPRV.2017.18Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Eun Kyoung Choe, Nicole B. Lee, Bongshin Lee, Wanda Pratt, and Julie A. Kientz. (2014). Understanding Quantified-Selfers’ Practices in Collecting and Exploring Personal Data. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014), 1143–1152. http://doi.org/10.1145/2556288.2557372Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Munmun De Choudhury, Sanket Sharma, and Emre Kiciman. (2016). Characterizing Dietary Choices, Nutrition, and Language in Food Deserts Via Social Media. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2016), 1157–1170. http://doi.org/10.1145/2818048.2819956Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Keum San Chun, Sarnab Bhattacharya, and Edison Thomaz. (2018). Detecting Eating Episodes by Tracking Jawbone Movements with a Non-Contact Wearable Sensor. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2(1), 1–21. http://doi.org/10.1145/3191736Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27]Chia-Fang Chung, Qiaosi Wang, Jessica Schroeder, Allison Cole, Jasmine Zia, James Fogarty, and Sean A. Munson. (2019). Identifying and Planning for Individualized Change. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 3(1), 1–27. http://doi.org/10.1145/3314394Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Chia Fang Chung, Elena Agapie, Jessica Schroeder, Sonali Mishra, James Fogarty, and Sean A. Munson. (2017). When Personal Tracking Becomes Social: Examining the Use of Instagram for Healthy Eating. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), 1674–1687. http://doi.org/10.1145/3025453.3025747Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Clarifai's Food Model | AI Prediction of Specific Food in Meals. Retrieved 10 February, 2021 from https://www.clarifai.com/models/foodGoogle ScholarGoogle Scholar
  30. Felicia Cordeiro, Elizabeth Bales, Erin Cherry, and James Fogarty. (2015). Rethinking the Mobile Food Journal: Exploring Opportunities for Lightweight Photo-Based Capture. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2015), 3207–3216. http://doi.org/10.1145/2702123.2702154Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Felicia Cordeiro, Daniel A. Epstein, Edison Thomaz, Elizabeth Bales, Arvind K. Jagannathan, Gregory D. Abowd, and James Fogarty. (2015). Barriers and Negative Nudges: Exploring Challenges in Food Journaling. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2015), 1159–1162. http://doi.org/10.1145/2702123.2702155Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Alaina Darby, Matthew W. Strum, Erin Holmes, and Justin Gatwood. (2016). A Review of Nutritional Tracking Mobile Applications for Diabetes Patient Use. Diabetes Technology & Therapeutics, 18(3), 200–212. http://doi.org/10.1089/dia.2015.0299Google ScholarGoogle ScholarCross RefCross Ref
  33. Tamara Denning, Adrienne Andrew, Rohit Chaudhri, Carl Hartung, Jonathan Lester, Gaetano Borriello, and Glen Duncan. (2009). BALANCE: Towards a Usable Pervasive Wellness Application With Accurate Activity Inference. Proceedings of the 10th Workshop on Mobile Computing Systems and Applications (HotMobile’09), 5. http://doi.org/10.1145/1514411.1514416Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Pooja M Desai, Elliot G Mitchell, Maria L Hwang, Matthew E Levine, David J Albers, and Lena Mamykina. (2019). Personal Health Oracle: Explorations of Personalized Predictions in Diabetes Self-Management. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2019), 1–13. http://doi.org/10.1145/3290605.3300600Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. E-health application categories used by U.S. adults 2017 | Statista. Retrieved 10 February, 2021 from https://www.statista.com/statistics/378850/top-mobile-health-application-categories-used-by-us-consumers/Google ScholarGoogle Scholar
  36. Edamam Nutrition Analysis API. Retrieved 10 February, 2021 https://developer.edamam.com/edamam-nutrition-apiGoogle ScholarGoogle Scholar
  37. Daniel A. Epstein, Felicia Cordeiro, James Fogarty, Gary Hsieh, and Sean A. Munson. (2016). Crumbs: Lightweight Daily Food Challenges to Promote Engagement and Mindfulness. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2016), 5632–5644. http://doi.org/10.1145/2858036.2858044Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Amazon says 100 million Alexa devices have been sold - The Verge. Retrieved 10 February, 2021 https://www.theverge.com/2019/1/4/18168565/amazon-alexa-devices-how-many-sold-number-100-million-dave-limpGoogle ScholarGoogle Scholar
  39. Giannina Ferrara, Jenna Kim, Shuhao Lin, Jenna Hua, and Edmund Seto. (2019). A Focused Review of Smartphone Diet-Tracking Apps: Usability, Functionality, Coherence With Behavior Change Theory, and Comparative Validity of Nutrient Intake and Energy Estimates. JMIR mHealth and uHealth, 7(5), e9232. http://doi.org/10.2196/mhealth.9232Google ScholarGoogle Scholar
  40. FoodData Central - USDA. Retrieved 10 February, 2021 from https://fdc.nal.usda.gov/api-guide.htmlGoogle ScholarGoogle Scholar
  41. Google's Cloud Vision API. Retrieved 10 February, 2021 from https://cloud.google.com/vision/docs/Google ScholarGoogle Scholar
  42. Google's “smart” Food Diary is Actually Kind of Dumb. Retrieved 10 February, 2021 from https://www.theverge.com/2015/6/2/8707851/google-calories-food-photos-im2caloriesGoogle ScholarGoogle Scholar
  43. Nanna Gorm and Irina Shklovski. (2017). Participant Driven Photo Elicitation for Understanding Activity Tracking: Benefits and Limitations. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2017), 1350–1361. http://doi.org/10.1145/2998181.2998214Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Rúben Gouveia, Evangelos Karapanos, and Marc Hassenzahl. (2018). Activity Tracking in Vivo. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2018), 1–13. http://doi.org/10.1145/3173574.3173936Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Alexandros Graikos, Vasileios Charisis, Dimitrios Iakovakis, Stelios Hadjidimitriou, and Leontios Hadjileontiadis. (2020). Single Image-Based Food Volume Estimation Using Monocular Depth-Prediction Networks. Universal Access in Human-Computer Interaction. Applications and Practice (HCII 2020), 532–543. http://doi.org/10.1007/978-3-030-49108-6_38Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Andrea Grimes, Martin Bednar, Jay David Bolter, and Rebecca E Grinter. (2008). EatWell: Sharing Nutrition-Related Memories in a Low-Income Community. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2008), 87-96. http://doi.org/10.1145/1460563.1460579Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Andrea Grimes and Richard Harper. (2008). Celebratory Technology: New Directions for Food Research in HCI. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), 467–476. http://doi.org/10.1145/1357054.1357130Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. William D. Heizer, Susannah Southern, and Susan McGovern. (2009). The Role of Diet in Symptoms of Irritable Bowel Syndrome in Adults: A Narrative Review. Journal of the American Dietetic Association, 109(7), 1204–1214. http://doi.org/10.1016/j.jada.2009.04.012Google ScholarGoogle ScholarCross RefCross Ref
  49. Uta Hinrichs and Sheelagh Carpendale. (2011). Gestures in The Wild: Studying Multi-Touch Gesture Sequences on Interactive Tabletop Exhibits. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), 3023–3032. http://doi.org/10.1145/1978942.1979391Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Jack F. Hollis, Christina M. Gullion, Victor J. Stevens, Phillip J. Brantley, Lawrence J. Appel, Jamy D. Ard, Catherine M. Champagne, Arlene Dalcin, Thomas P. Erlinger, Kristine Funk, Daniel Laferriere, Pao Hwa Lin, Catherine M. Loria, Carmen Samuel-Hodge, William M. Vollmer, and Laura P. Svetkey. (2008). Weight Loss During the Intensive Intervention Phase of the Weight-Loss Maintenance Trial. American Journal of Preventive Medicine, 35(2), 118–126. http://doi.org/10.1016/j.amepre.2008.04.013Google ScholarGoogle ScholarCross RefCross Ref
  51. Eunkyung Jo, Hyeonseok Bang, Myeonghan Ryu, Eun Jee Sung, Sungmook Leem, and Hwajung Hong. (2020). MAMAS: Supporting Parent - Child Mealtime Interactions Using Automated Tracking and Speech Recognition. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW1). http://doi.org/10.1145/3392876Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Jisu Jung, Kalina Yacef, Margaret Allman-farinelli, Judy Kay, Lyndal Wellard-Cole, Colin Cai, Irena Koprinska, and Margaret Allman-Farinelli. (2020). Foundations for Systematic Evaluation and Benchmarking of a Mobile Food Logger in a Large-scale Nutrition Study. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 4(2), 47. http://doi.org/10.1145/3397327Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Ravi Karkar, Jessica Schroeder, Daniel A. Epstein, Laura R. Pina, Jeffrey Scofield, James Fogarty, Julie A. Kientz, Sean A. Munson, Roger Vilardaga, and Jasmine Zia. (2017). TummyTrials: A Feasibility Study of Using Self-Experimentation to Detect Individualized Food Triggers. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), 2017-May, 6850–6863. http://doi.org/10.1145/3025453.3025480Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Young-Ho Kim, Jae Ho Jeon, Bongshin Lee, Eun Kyoung Choe, and Jinwook Seo. (2017). OmniTrack: A Flexible Self-Tracking Approach Leveraging Semi-Automated Tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 1(3), 1– 28. http://doi.org/10.1145/3130930Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Mandy Korpusik, Zachary Collins, and James Glass. (2017). Semantic Mapping of Natural Language Input to Database Entries Via Convolutional Neural Networks. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017), 5685–5689. http://doi.org/10.1109/ICASSP.2017.7953245Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Mandy Korpusik and James Glass. (2017). Spoken Language Understanding for a Nutrition Dialogue System. IEEE/ACM Transactions on Audio Speech and Language Processing, 25(7), 1450–1461. http://doi.org/10.1109/TASLP.2017.2694699Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Ian Li, Anind Dey, and Jodi Forlizzi. (2010). A Stage-Based Model of Personal Informatics Systems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010), 1, 557–566. http://doi.org/10.1145/1753326.1753409Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Brian Y. Lim, Xinni Chng, and Shengdong Zhao. (2017). Trade-off between Automation and Accuracy in Mobile Photo Recognition Food Logging. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), 53–59. http://doi.org/10.1145/3080631.3080640Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Lose It! - Weight Loss That Fits. Retrieved February 10, 2021 from https://www.loseit.com/Google ScholarGoogle Scholar
  60. Kai Lukoff, Taoxi Li, Yuan Zhuang, and Brian Y. Lim. (2018). TableChat: Mobile Food Journaling to Facilitate Family Support for Healthy Eating. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), 1–28. http://doi.org/10.1145/3274383Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Lena Mamykina, Matthew E. Levine, Patricia G. Davidson, Arlene M Smaldone, Noemie Elhadad, and David J Albers. (2016). Data-driven health management: reasoning about personally generated data in diabetes with information technologies. Journal of the American Medical Informatics Association, 23(3), 526–531. http://doi.org/10.1093/jamia/ocv187Google ScholarGoogle ScholarCross RefCross Ref
  62. Lena Mamykina, Elizabeth Mynatt, Patricia Davidson, and Daniel Greenblatt. (2008). MAHI: Investigation of Social Scaffolding for Reflective Thinking in Diabetes Management. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), 477. http://doi.org/10.1145/1357054.1357131Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Weiqing Min, Shuqiang Jiang, Linhu Liu, Yong Rui, and Ramesh Jain. (2019). A Survey on Food Computing. ACM Computing Surveys, 52(5), 1–36. http://doi.org/10.1145/3329168Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Jimmy Moore, Pascal Goffin, Miriah Meyer, Philip Lundrigan, Neal Patwari, Katherine Sward, and Jason Wiese. (2018). Managing In-home Environments through Sensing, Annotating, and Visualizing Air Quality Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2(3), 1–28. http://doi.org/10.1145/3264938Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Austin Myers, Nick Johnston, Vivek Rathod, Anoop Korattikara, Alex Gorban, Nathan Silberman, Sergio Guadarrama, George Papandreou, Jonathan Huang, and Kevin Murphy. (2015). Im2Calories: Towards an automated mobile vision food diary. Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1233–1241. http://doi.org/10.1109/ICCV.2015.146Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. MyFitnessPal: Calorie Counter, Diet & Exercise Journal. Retrieved February 10, 2021 from https://www.myfitnesspal.com/Google ScholarGoogle Scholar
  67. Jon Noronha, Eric Hysen, Haoqi Zhang, and Krzysztof Z Gajos. (2011). PlateMate: Crowdsourcing Nutrition Analysis from Food Photographs. Proceedings of the Annual Symposium on User Interface Software and Technology (UIST 2011), 1-12. http://doi.org/10.1145/2047196.2047198Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. NPR Study Says 118 Million Smart Speakers Owned by U.S. Adults - Voicebot.ai. Retrieved February 10, 2021 from https://voicebot.ai/2019/01/07/npr-study-says-118-million-smart-speakers-owned-by-u-s-adults/Google ScholarGoogle Scholar
  69. Nutritionix Nutrition API. Retrieved February 10, 2021 from https://www.nutritionix.com/business/apiGoogle ScholarGoogle Scholar
  70. Hyungik Oh, Jonathan Nguyen, Soundarya Soundararajan, and Ramesh Jain. (2018). Multimodal Food Journaling. Proceedings of the International Workshop on Multimedia for Personal Health and Health Care (HealthMedia 2018), 39–47. http://doi.org/10.1145/3264996.3265000Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Tauhidur Rahman, Alexander T. Adams, Mi Zhang, Erin Cherry, Bobby Zhou, Huaishu Peng, and Tanzeem Choudhury. (2014). BodyBeat: Amobile system for sensing non-speech body sounds. Proceedings of the International Conference on Mobile Systems, Applications, and Services (MobiSys 2014), 2–13. http://doi.org/10.1145/2594368.2594386Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. RapidAPI - Top Nutrition APIs. Retrieved February 10, 2021 from https://rapidapi.com/collection/nutritionGoogle ScholarGoogle Scholar
  73. Jaime Ruiz, Yang Li, and Edward Lank. (2011). User-Defined Motion Gestures for Mobile Interaction. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), 197–206. http://doi.org/10.1145/1978942.1978971Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Amaia Salvador, Michal Drozdzal, Xavier Giro-I-Nieto, and Adriana Romero. (2019). Inverse Cooking: Recipe Generation from Food Images. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR 2019), 10445–10454. http://doi.org/10.1109/CVPR.2019.01070Google ScholarGoogle ScholarCross RefCross Ref
  75. Jessica Schroeder, Jane Hoffswell, Chia Fang Chung, James Fogarty, Sean Munson, and Jasmine Zia. (2017). Supporting Patient-Provider Collaboration to Identify Individual Triggers Using Food and Symptom Journals. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW 2017), 1726–1739. http://doi.org/10.1145/2998181.2998276Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Alex Sciuto, Arnita Saini, Jodi Forlizzi, and Jason I. Hong. (2018). “Hey Alexa, what's up?”: Studies of In-Home Conversational Agent Usage. Proceedings of the Conference on Designing Interactive Systems (DIS 2018), 857–868. http://doi.org/10.1145/3196709.3196772Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Katie A. Siek, Kay H. Connelly, Yvonne Rogers, Paul Rohwer, Desiree Lambert, and Janet L. Welch. (2006). When Do We Eat? An Evaluation of Food Items Input into an Electronic Food Monitoring Application. 2006 Pervasive Health Conference and Workshops, 1–10. http://doi.org/10.1109/PCTHEALTH.2006.361684Google ScholarGoogle ScholarCross RefCross Ref
  78. Spoonacular food API. Retrieved February 10, 2021 from https://spoonacular.com/food-apiGoogle ScholarGoogle Scholar
  79. Zhida Sun, Sitong Wang, Wenjie Yang, Onur Yürüten, Chuhan Shi, and Xiaojuan Ma. (2020). “A Postcard from Your Food Journey in the Past”: Promoting Self-Refection on Social Food Posting. Proceedings of the Conference on Designing Interactive Systems (DIS 2020), 1819–1832. http://doi.org/10.1145/3357236.3395475Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Edison Thomaz, Aman Parnami, Irfan Essa, and Gregory D. Abowd. (2013). Feasibility of Identifying Eating Moments from First-Person Images Leveraging Human Computation. Proceedings of the International SenseCam & Pervasive Imaging Conference (SenseCam 2013), 26–33. http://doi.org/10.1145/2526667.2526672Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Christopher C. Tsai, Gunny Lee, Fred Raab, Gregory J. Norman, Timothy Sohn, William G. Griswold, and Kevin Patrick. (2007). Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance. Mobile Networks and Applications, 12(2–3), 173–184. http://doi.org/10.1007/s11036-007-0014-4Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Yunan Wang, Jing Jing Chen, Chong Wah Ngo, Tat Seng Chua, Wanli Zuo, and Zhaoyan Ming. (2019). Mixed dish recognition through multi-label learning. Proceedings of the 11th Workshop on Multimedia for Cooking and Eating Activities (CEA 2019), 1–8. http://doi.org/10.1145/3326458.3326929Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Donald A Williamson, ; H Raymond Allen, ; Pamela, Davis Martin, Anthony J Alfonso, Bonnie Gerald, and Alice Hunt. (2003). Comparison of Digital Photography to Weighed and Visual Estimation of Portion Sizes. Journal of American Dietetic Associattion, 103, 1139–1145. https://doi.org/10.1016/S0002-8223(03)00974-XGoogle ScholarGoogle ScholarCross RefCross Ref
  84. Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. (2009). Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2009), 1083–1092. http://doi.org/10.1145/1518701.1518866Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Hui Wu, Michele Merler, Rosario Uceda-Sosa, and John R. Smith. (2016). Learning to Make Better Mistakes: Semantics-Aware Visual Food Recognition. Proceedings of the International Conference on Multimedia (MM 2016), 172–176. http://doi.org/10.1145/2964284.2967205Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. WW (Weight Watchers): Weight Loss & Wellness Help. Retrieved February 10, 2021 from https://www.weightwatchers.comGoogle ScholarGoogle Scholar
  87. Shulin Yang, Mei Chen, Dean Pomerleau, and Rahul Sukthankar. (2010). Food Recognition Using Statistics of Pairwise Local Features. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2010), 2249–2256. http://doi.org/10.1109/CVPR.2010.5539907Google ScholarGoogle Scholar
  88. ‎YouFood Photo Food Journal on the App Store. Retrieved February 10, 2021 from https://apps.apple.com/us/app/youfood-photo-food-journal/id719841416Google ScholarGoogle Scholar
  89. Shibo Zhang, Yuqi Zhao, Dzung Tri Nguyen, Runsheng Xu, Sougata Sen, Josiah Hester, and Nabil Alshurafa. (2020). NeckSense: A Multi-Sensor Necklace for Detecting Eating Activities in Free-Living Conditions. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 4(2), 1–26. http://doi.org/10.1145/3397313Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. Jasmine K. Zia, Chia-Fang Chung, Jessica Schroeder, Sean A. Munson, Julie A. Kientz, James Fogarty, Elizabeth Bales, Jeanette M. Schenk, and Margaret M. Heitkemper. (2017). The Feasibility, Usability, and Clinical Utility of Traditional Paper Food and Symptom Journals for Patients with Irritable Bowel Syndrome. Neurogastroenterology & Motility, 29(2), e12935. http://doi.org/10.1111/nmo.12935Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference
    June 2021
    2082 pages
    ISBN:9781450384766
    DOI:10.1145/3461778

    Copyright © 2021 Owner/Author

    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 28 June 2021

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate1,158of4,684submissions,25%

    Upcoming Conference

    DIS '24
    Designing Interactive Systems Conference
    July 1 - 5, 2024
    IT University of Copenhagen , Denmark

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format