ABSTRACT
Nonverbal communication is an essential part of face-to-face social interaction, conveying information about emotion and interpersonal relationships. The rigorous sensing capabilities of pervasive technologies and the subtle nature of ambient technologies make them ideal to support the production of nonverbal communication in social interactions. In this paper we present a study using an ambient technology that supports nonverbal communication, and specifically nonverbal behaviours associated with rapport. We show that an ambient display can influence a participant's nonverbal behaviour, and that participants are not aware of this change in their behaviour. We discuss these findings in terms of the design and ethical issues that it raises, and define an agenda for future work.
- Ara, K., et al., Sensible Organisations: Changing out Businesses and Work Styles through Sensor Data. J. of Information Processing 16, (2008), 1--12.Google ScholarCross Ref
- Argyle, M., Bodily Communication. Methuen, London, (1975).Google Scholar
- Barron, B., When Smart Groups Fail. J. of Learning Sciences 12, 3 (2003), 307--359.Google ScholarCross Ref
- Berdichevsky, D. and Neuenschwander, E., Towards an Ethics of Persuasive Technology. Comms. of the ACM 42, 5 (1999), 51--58. Google ScholarDigital Library
- Bernieri, F., Coordinated Movement and Rapport in Teacher-Student Interactions. J. of Nonverbal Behaviour 12, 2 (1988), 120--138.Google ScholarCross Ref
- Bernieri, F., Davis, J., Rosenthal, R., Knee, R., Interactional Synchrony and Rapport: Measuring Synchrony in Displays Devoid of Sound and Facial Expression. Personality and Social Psych. Bulletin 20, (1994), 303--311.Google ScholarCross Ref
- Bernieri, F., Gillis, J., Davis, J., GRahe, J., Dyad Rapport and the Accuracy of Its Judgement across Situations: A Lens Model Analysis. J. of Personality and Social Psych. 71, 1 (1996), 110--129.Google ScholarCross Ref
- Berzowska, J. Memory Rich Clothing: Second Skins That Communicate Phsyical Memory. In Proc. Creativity and Cognition, ACM (2005), 32--40. Google ScholarDigital Library
- Borovoy, R., Martin, F., Resnick, M., Silverman, B., Groupwear: Nametags That Tell About Relationships, In Proc. CHI ACM (1998), 329--330. Google ScholarDigital Library
- Borovoy, R., Martin, F., Vermuri, S., Resnick, M., Silverman, B., Hancock, C., Meme Tags and Community Mirrors: Moving from Conferences to Collaboration. In Proc. CSCW (1998), 159--168. Google ScholarDigital Library
- Bull, P., Posture and Gesture. Pergamon press, (1987).Google Scholar
- DiMicco, J.M., Pandolfo, A., and Bender, W. Influencing Group Participation with a Shared Display. In Proc. CSCW, ACM (2004), 614--623. Google ScholarDigital Library
- Falk, J., Björk, S., The Bubblebadge: A Wearable Public Display, In Proc. CHI 1999 ACM (1999), 318--319. Google ScholarDigital Library
- Ham, J., Midden, C., and Beute, F. Can Ambient Persuasive Technology Persuade Unconsciously? Using Sublimial Feedback to Influence Energy Consumption Ratings of Household Appliances. In Proc. Persuasive Technology, ACM (2009. Google ScholarDigital Library
- Hodgins, H. and Zuckerman, M., The Effect of Nonverbal Sensitivity on Social Interaction. J. of Nonverbal Behaviour 14, 3 (1990), 155--170.Google Scholar
- Kanis, M., Winters, N., Agamanolis, S., Gavin, A., Cullinan, C., Toward Wearable Social Networking with Iband. In Proc. CHI, ACM (2005), 1521--1524. Google ScholarDigital Library
- Kendon, A., Conducting Interaction: Patterns of Behaviour in Focused Encounters. Cambridge University Press, Cambridge, (1990).Google Scholar
- Kim, T., Chang, A., Holland, L., Pentland., Meeting Mediator: Enhancing Group Collaboration Using Sociometric Feedback. In Proc. CSCW, ACM (2008), 457--466. Google ScholarDigital Library
- Laborde, G., Influencing with Integrity: Management Skills for Communication and Negotiation. Crown House Publishing, (1998).Google Scholar
- LaFrance, M., Nonverbal Synchrony and Rapport: Analysis by the Cross-Lag Panel Technique. Social Psych. Quarterly 42, 1 (1979), 66--70.Google ScholarCross Ref
- Lakin, J., Chartland, T., and Arkin, R., Nonconscious Mimicry as an Automatic Behavioural Response to Social Exclusion. Psych. Science 19, 8 (2008), 816--822.Google ScholarCross Ref
- Lakin, J. and Chartrand, T., Using Non-Conscious Behavioural Mimicry to Creat Affiliation and Rapport. Psych. Science 14, 4 (2003), 334--339.Google ScholarCross Ref
- Lieberman, M., Intuition: A Social Cognitive Neuroscience Approach. Pysch. Bulletin 126, 1 (2000), 109--137.Google Scholar
- Mccarthy, J., McDonald, D., Soroczak, S., Ngyuyen, D., Rashid, A., Augmenting the Social Space of an Academic Conference, In Proc. CSCW, ACM (2004) 39--48. Google ScholarDigital Library
- McDonald, D.W., McCarthy, J., Soroczak, S., Nguyen, D., Rashid, D., Proactive Displays: Supporting Awareness in Fluid Social Environments. ACM Trans. Comp.-Hum. Interaction 14, 4 (2008), 1--31. Google ScholarDigital Library
- Monfries, M. and Kafer, N., Neglected and Rejected Children: A Social-Skills Model. The J. of Psych. 121, 4 (1987), 401--407.Google Scholar
- Narumi, T., Akagawa, T., Ah Seong, Y., Hirose, M., An Entertainment System Using Thermal Feedback for Increasing Communication and Social Skills. Lecture Notes in Com. Sci. 5690, (2009), 184--195. Google ScholarDigital Library
- Ngyuyen, D., T., and Canny, J. More Than Face-to-Face: Empathy Effects of Video Framing. In Proc. CHI ACM (2009), 423--432. Google ScholarDigital Library
- Olguín Olguín, D. and Pentland, A. Sensible Organizations: A Sensor Based System for Organizational Design and Engineering. In Proc. Workshop on Organizational Design and Engineering (2009.Google Scholar
- Palmer, M. and Simmons, K., Communicating Intentions through Nonverbal Behaviours: Conscious and Nonconscious Encoding of Liking. Human Comm. Research 22, 1 (1995), 128--160.Google Scholar
- Pentland, A., Honest Signals - How They Shape Our World. MIT Press, Cambridge, MA, (2008). Google ScholarDigital Library
- Reeves, B. and Nass, C., The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. CSLI Publications, California, (1996). Google ScholarDigital Library
- Rogers, Y., Hazelwood, W., Marshall, P., Dalton, N, S., Hertich, S., Ambient Influence: Can Twinkly Lights Lure and Abstract Representations Trigger Behavioral Change. In Proc. Ubicomp 2010, ACM (2010) 261--270. Google ScholarDigital Library
- Schlenker, B. and Weigold, M., Interpersonal Processes Involving Impression Regulation and Management. Annual Review of Psych. 43, (1992), 133--168.Google Scholar
- Scott, S., Shyness and Society: The Illusion of Competence. Palgrave Macmillan, (2007).Google ScholarCross Ref
- Stel, M. and Roos, V., Mimicry in Social Interaction: Benefits for Mimickers, Mimickees, and Their Interaction. Brit. J. of Psych. 101, (2010), 311--323.Google ScholarCross Ref
- 3Tickle-Degnen, L. and Rosenthal, R., The Nature of Rapport and Its Nonverbal Correlates. Psych. Inquiry 1, 4 (1990), 285--293.Google ScholarCross Ref
Index Terms
- Enhancing interactional synchrony with an ambient display
Recommendations
Acoustic-Prosodic Entrainment and Rapport in Collaborative Learning Dialogues
MLA '14: Proceedings of the 2014 ACM workshop on Multimodal Learning Analytics Workshop and Grand ChallengeIn spoken dialogue analysis, the speech signal is a rich source of information. We explore in this paper how low level features of the speech signal, such as pitch, loudness, and speaking rate, can inform a model of student interaction in collaborative ...
Enabling Embodied Conversational Agents to Respond to Nonverbal Behavior of the Communication Partner
Human-Computer Interaction. User Experience and BehaviorAbstractHumans communicate on three levels: words, paralanguage, and nonverbal. While conversational agents focus mainly on the interpretation of words that are being spoken, recently the focus has also shifted to how we say those words with our tone, ...
Ambient Rabbits Likeability of Embodied Ambient Displays
AmI '09: Proceedings of the European Conference on Ambient IntelligenceThis paper discusses the possibility of using embodied Ambient Displays for presenting information in a public setting. For embodying an Ambient Display, a Nabaztag rabbit was used, the information displayed was a weather forecast. Throughout four weeks ...
Comments