Javier Hernandez
Mohammed (Ehsan) Hoque
ABSTRACT
In this study, we created and evaluated a computer vision based system that automatically encouraged, recognized and counted smiles on a college campus. During a ten-week installation, passersby were able to interact with the system at four public locations. The aggregated data was displayed in real time in various intuitive and interactive formats on a public website. We found privacy to be one of the main design constraints, and transparency to be the best strategy to gain participants' acceptance. In a survey (with 300 responses), participants reported that the system made them smile more than they expected, and it made them and others around them feel momentarily better. Quantitative analysis of the interactions revealed periodic patterns (e.g., more smiles during the weekends) and strong correlation with campus events (e.g., fewer smiles during exams, most smiles the day after graduation), reflecting the emotional responses of a large community.
- Bennett, M. P., Zeller, J. M., Rosenberg, L., and McCann, J. The effect of mirthful laughter on stress and natural killer cell activity. Journal of Alternative Therapies in Health and Medicine 9, 2 (2003), 38--45.Google Scholar
- Bradley, M. M., and Lang, P. J. Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (1994), 49--59.Google ScholarCross Ref
- Boyle, M., and Greenberg, S. The language of privacy: Learning from video media space analysis and design. Journal of Human Computer Interaction, 12, 2 (2005), 328--370. Google ScholarDigital Library
- Csikszentmihalyi, M., and Hunter, J. Happiness in everyday life: The uses of experience sampling. Journal of Happiness Studies 4, 2 (2003), 185--199.Google ScholarCross Ref
- Hayes, G. R. and Abowd, G. D. Tensions in designing capture technologies for an evidence-based care community. In Proceedings of CHI 2006, ACM (2006), 937--946. Google ScholarDigital Library
- Hoque, M. E., and Picard, R. W. Acted vs. natural frustration and delight: Many people smile in natural frustration. In Proceedings of F&G, (2011), 354--359.Google Scholar
- Hoque, M. E, McDuff, D. J., and Picard, R. W. Exploring temporal patterns in classifying frustrated and delighted smiles. Journal of IEEE Transactions on Affective Computing, PP(99), (2012), 1--13.Google Scholar
- Friedman, B., Kahn, P. H., Hagman, J., Severson R. L., and Gill B. The watcher and the watched: social judgments about privacy in a public place. Journal of Human Computer Interaction, 21, 2 (2008), 235--272. Google ScholarDigital Library
- Isomursu, M., Tahti, M., Vainamo, S., and Kuutti, K. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. International Journal of Human-Computer Studies 65, 4 (2007), 404--418. Google ScholarDigital Library
- Jancke, G., Venolia, G D., Grudin, J, Cadiz, J. J. and Gupta, A. Linking public spaces: technical and social issues. In Proc. CHI 2001, ACM (2001), 530--537. Google ScholarDigital Library
- Küblbeck, C., and Ernst, A. Face detection and tracking in video sequences using the modified census transformation. Journal of Image Vision Computing. 24, 6 (2006), 564--572. Google ScholarDigital Library
- Langheinrich, M. Privacy by design - Principles of privacy-aware ubiquitous systems. In Proceedings of Ubicomp (2001), 273--291. Google ScholarDigital Library
- Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. Coding facial expressions with gabor wavelets. In Proceedings of F&G (1998), 200--205. Google ScholarDigital Library
- MacKerron, G., and Mourato, S. Mappiness. http://www.mappiness.org.ukGoogle Scholar
- Mislove, A., Lehmann, S., Ahn, Y. Y., Onnela, J.-P., and Rosenquist, J. N. The Pulse of the Nation. http://www.ccs.neu.edu/home/amislove/twittermood/Google Scholar
- Pollak, J. P., Adams, P., and Gay, G. Pam: a photographic affect meter for frequent, in situ measurement of affect. In Proceedings of CHI 2011, ACM (2011), 725--734. Google ScholarDigital Library
- Soussignan, R. Duchenne smile, emotional experience, and autonomic reactivity: a test of the facial feedback hypothesis. Journal of Emotion 2, 1 (2002), 52--74.Google Scholar
- Strack, F., Martin, L., and Stepper, S. Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology 54, 5 (1988), 768--777.Google ScholarCross Ref
- Tsujita, H., and Rekimoto, J. Smiling makes us happier: enhancing positive mood and communication with smile-encouraging digital appliances. In Proceedings of Ubicomp 2011, ACM (2011), 1--10. Google ScholarDigital Library
- Watson, D., Clark, L. A., and Tellegen, A. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology 54, 6 (1988), 1063--1070.Google ScholarCross Ref
- Wilhelmer R., Bismarck J., and Maus B. Feel-o-meter: Stimmungsgasometer. (2008). http://www.fühlometer.deGoogle Scholar
Index Terms
- Mood meter: counting smiles in the wild
Recommendations
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...
Towards estimating computer users' mood from interaction behaviour with keyboard and mouse
The purpose of this exploratory research was to study the relationship between the mood of computer users and their use of keyboard and mouse to examine the possibility of creating a generic or individualized mood measure. To examine this, a field study ...
The vocal communication of different kinds of smile
The present study investigated the vocal communication of naturally occurring smiles. Verbal variation was controlled in the speech of 8 speakers by asking them to repeat the same sentence in response to a set sequence of 17 questions, intended to ...
Comments