Xu Ye
ABSTRACT
In this work we study the feasibility and usability of an assistive food journaling system that sends users just-in-time reminders when unique hand gestures during food consumption are detected using a smartwatch. Our study shows that participants were able to sustain food logging throughout a 2-week period with the help of our eating detection system, as the number of reminders correlate well with the number of food logs. Despite the fact that participants were required to wear the watch on their dominant hand, it was still quite usable and did not interfere with their normal activities. Participant feedback provided additional insights to inform future work to increase detection accuracy, reduce detection delay, and allow for more dietary logging features in the app.
- O. Amft. 2010. A wearable earpad sensor for chewing monitoring. In Sensors,IEEE.Google Scholar
- O. Amft, H. Junker, and G. Troster. 2005a. Detection of eating and drinking arm gestures using inertial body-worn sensors. In Proc. Ninth IEEE International Symposium on Wearable Computers. Google ScholarDigital Library
- Oliver Amft, Mathias Stäger, Paul Lukowicz, and Gerhard Tröster. 2005b. Analysis of Chewing Sounds for Dietary Monitoring. In Proceedings of the 7th International Conference on Ubiquitous Computing (UbiComp'05). Springer-Verlag, Berlin, Heidelberg, 56-72. DOI: http://dx.doi.org/10.1007/11551201_4 Google ScholarDigital Library
- O. Amft and G. Troster. 2006. Methods for Detection and Classification of Normal Swallowing from Muscle Activation and Sound. In Pervasive Health Conference and Workshops.Google Scholar
- L. Arab, D. Estrin, D. H. Kim, J. Burke, and J. Goldman. 2011. Feasibility Testing of an Automated Image Capture Method to Aid Dietary Recall. European Journal of Clinical Nutrition 65 (2011), 1156-1162.Google ScholarCross Ref
- Felicia Cordeiro, Elizabeth Bales, Erin Cherry, and James Fogarty. 2015a. Rethinking the Mobile Food Journal: Exploring Opportunities for Lightweight Photo-Based Capture. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3207-3216. DOI: http://dx.doi.org/10.1145/2702123. Google ScholarDigital Library
- Felicia Cordeiro, Daniel A. Epstein, Edison Thomaz, Elizabeth Bales, Arvind K. Jagannathan, Gregory D. Abowd, and James Fogarty. 2015b. Barriers and Negative Nudges: Exploring Challenges in Food Journaling. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1159-1162. DOI: http://dx.doi.org/10.1145/2702123.2702155 Google ScholarDigital Library
- Y. Dong, A. Hoover, J. Scisco, and E. Muth. 2012. A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion Tracking. In Applied Psychophysiology and Biofeedback. 37:205-215.Google ScholarCross Ref
- Jack F. Hollis, Christina M. Gullion, Victor J. Stevens, Phillip J. Brantley, Lawrence J. Appel, Jamy D. Ard, Catherine M. Champagne, Arlene Dalcin, Thomas P. Erlinger, Kristine Funk, Daniel Laferriere, Pao-Hwa Lin, Catherine M. Loria, Carmen Samuel-Hodge, William M. Vollmer, and Laura P. Svetkey. 2008. Weight Loss During the Intensive Intervention Phase of the Weight-Loss Maintenance Trial. American Journal of Preventive Medicine 35 (Aug. 2008), 118-126. Issue 2.Google Scholar
- K. Hyun-Jun, M. Kim, L. Sun-Jae, and C. Young Sang. 2012 Asia-Pacific. An analysis of eating activities for automatic food type recognition. In Signal & Information Processing Association Annual Summit and Conference (APSIPA ASC).Google Scholar
- Jindong Liu, E. Johns, L. Atallah, C. Pettitt, B. Lo, G. Frost, and Guang-Zhong Yang. 2012. An Intelligent Food-Intake Monitoring System Using Wearable Sensors. In Wearable and Implantable Body Sensor Networks (BSN), 2012 Ninth International Conference on. 154-160. DOI: http://dx.doi.org/10.1109/BSN.2012.11 Google ScholarDigital Library
- S. Passler and W. Fischer. 2011. Acoustical method for objective food intake monitoring using a wearable sensor system. In Pervasive Computing Technologies for Healthcare (Pervasive Health).Google Scholar
- S. A. Rahman, C. Merck, Y. Huang, and S. Kleinberg. 2015. Unintrusive Eating Recognition using Google Glass. In Proceedings of the Pervasive Health. Google ScholarDigital Library
- Tauhidur Rahman, Alexander T. Adams, Mi Zhang, Erin Cherry, Bobby Zhou, Huaishu Peng, and Tanzeem Choudhury. 2014. BodyBeat: A Mobile System for Sensing Non-speech Body Sounds. In MobiSys. Google ScholarDigital Library
- Edison Thomaz, Irfan Essa, and Gregory D. Abowd. 2015. A Practical Approach for Recognizing Eating Moments with Wrist-mounted Inertial Sensing. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM, New York, NY, USA, 1029-1040. DOI: http://dx.doi.org/10.1145/2750858.2807545 Google ScholarDigital Library
- Edison Thomaz, Aman Parnami, Irfan Essa, and Gregory D. Abowd. 2013. Feasibility of Identifying Eating Moments from First-person Images Leveraging Human Computation. In Proceedings of the 4th International SenseCam & Pervasive Imaging Conference (SenseCam '13). ACM, New York, NY, USA, 26-33. DOI: http://dx.doi.org/10.1145/2526667.2526672 Google ScholarDigital Library
- Koji Yatani and Khai N. Truong. 2012. BodyScope: A Wearable Acoustic Sensor for Activity Recognition. In UbiComp. 341-350. Google ScholarDigital Library
- Xu Ye, Guanling Chen, and Yu Cao. 2015. Automatic Eating Detection Using Head-Mount and Wrist-Worn Accelerometers. In Proceedings of the IEEE HealthCom.Google Scholar
Index Terms
- Assisting Food Journaling with Automatic Eating Detection
Recommendations
A practical approach for recognizing eating moments with wrist-mounted inertial sensing
UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous ComputingRecognizing when eating activities take place is one of the key challenges in automated food intake monitoring. Despite progress over the years, most proposed approaches have been largely impractical for everyday usage, requiring multiple on-body ...
Multimodal Food Journaling
HealthMedia'18: Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health CareA food journal is essential for improving health and well-being. However, journaling every meal is extremely difficult because it depends on user initiative and intervention. Current approaches to food journaling are both potentially inaccurate and ...
Investigating Preferred Food Description Practices in Digital Food Journaling
DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems ConferenceJournaling of consumed foods through digital devices is a popular self-tracking strategy for weight loss and eating mindfulness. Research has explored modalities, like photos and open-ended text and voice descriptions, to make journaling less burdensome ...
Comments