Skip to main content
Top

2022 | OriginalPaper | Chapter

The Relative Importance of Social Cues in Immersive Mediated Communication

Authors : Navya N. Sharan, Alexander Toet, Tina Mioch, Omar Niamut, Jan B. F. van Erp

Published in: Human Interaction, Emerging Technologies and Future Systems V

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Effective interpersonal communication is important to maintain relationships and build trust, empathy, and confidence. In this digital age, communication has become mediated, which filters out many of the social cues that are essential to facilitate interpersonal communication. This paper investigates the extent to which social cues influence social presence in mediated, bidirectional, multiparty interaction. Literature related to six social cues – paralinguistic cues, linguistic cues, body language, eye movements, facial expressions, and proxemic cues – was reviewed. These cues were ranked based on how relevant they are in creating a sense of social presence in mediated social communication (MSC). The most relevant cue was eye movements, followed by facial expression and linguistic cues, and lastly, body language and proxemic cues. Paralinguistic cues could not be ranked due to sparse literature in the context of MSC. Further research is required to better understand how social cues can be incorporated into MSC systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kjeldskov, J., et al.: Using cultural probes to explore mediated intimacy. Australas. J. Inf. Syst. 11, F2008 (2004) Kjeldskov, J., et al.: Using cultural probes to explore mediated intimacy. Australas. J. Inf. Syst. 11, F2008 (2004)
2.
go back to reference Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction, 7th edn. Wadsworth, CENGAGE Learning, Boston (2010) Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction, 7th edn. Wadsworth, CENGAGE Learning, Boston (2010)
3.
go back to reference Toet, A., Mioch, T., Gunkel, S.N.B., Sallaberry, C., van Erp, J.B.F., Niamut, O.: Holistic quality assessment of mediated immersive multisensory social communication. In: Bourdot, P., Interrante, V., Kopper, R., Olivier, A.H., Saito, H., Zachmann, G. (eds.) Virtual Reality and Augmented Reality. EuroVR 2020, LNCS, vol. 12499, pp. 209–215. Springer, Heidelberg (2020)CrossRef Toet, A., Mioch, T., Gunkel, S.N.B., Sallaberry, C., van Erp, J.B.F., Niamut, O.: Holistic quality assessment of mediated immersive multisensory social communication. In: Bourdot, P., Interrante, V., Kopper, R., Olivier, A.H., Saito, H., Zachmann, G. (eds.) Virtual Reality and Augmented Reality. EuroVR 2020, LNCS, vol. 12499, pp. 209–215. Springer, Heidelberg (2020)CrossRef
4.
go back to reference Short, J., Williams, E., Christie, B.: The social psychology of telecommunications. Wiley, New York (1976) Short, J., Williams, E., Christie, B.: The social psychology of telecommunications. Wiley, New York (1976)
5.
go back to reference Biocca, F., Harms, C.: Defining and measuring social presence: contribution to the Networked Minds theory and measure. In: Gouveia, F.R., Biocca, F. (eds.) Fifth Annual International Workshop on Presence, pp. 7–36 (2002) Biocca, F., Harms, C.: Defining and measuring social presence: contribution to the Networked Minds theory and measure. In: Gouveia, F.R., Biocca, F. (eds.) Fifth Annual International Workshop on Presence, pp. 7–36 (2002)
6.
go back to reference Oh, C.S., Bailenson, J.N., Welch, G.F.: A systematic review of social presence: definition, antecedents, and implications. Frontiers Rob. AI 5 (2018) Oh, C.S., Bailenson, J.N., Welch, G.F.: A systematic review of social presence: definition, antecedents, and implications. Frontiers Rob. AI 5 (2018)
7.
go back to reference Bailenson, J.N., Blascovich, J., Beall, A.C., Loomis, J.M.: Interpersonal distance in immersive virtual environments. Pers. Soc. Psychol. Bull. 29, 819–833 (2003)CrossRef Bailenson, J.N., Blascovich, J., Beall, A.C., Loomis, J.M.: Interpersonal distance in immersive virtual environments. Pers. Soc. Psychol. Bull. 29, 819–833 (2003)CrossRef
8.
go back to reference Biocca, F., Harms, C., Burgoon, J.K.: Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence Teleoperators Virtual Environ. 12, 456–480 (2003) Biocca, F., Harms, C., Burgoon, J.K.: Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence Teleoperators Virtual Environ. 12, 456–480 (2003)
9.
go back to reference Hartmann, T., Wirth, W., Vorderer, P., Klimmt, C., Schramm, H., Böcking, S.: Spatial presence theory: state of the art and challenges ahead. In: Lombard, M., Biocca, F., Freeman, J., Ijsselsteijn, W., Schaevitz, R.J. (eds.) Immersed in Media: Telepresence Theory, Measurement & Technology, pp. 115–135. Springer International Publishing, Cham (2015)CrossRef Hartmann, T., Wirth, W., Vorderer, P., Klimmt, C., Schramm, H., Böcking, S.: Spatial presence theory: state of the art and challenges ahead. In: Lombard, M., Biocca, F., Freeman, J., Ijsselsteijn, W., Schaevitz, R.J. (eds.) Immersed in Media: Telepresence Theory, Measurement & Technology, pp. 115–135. Springer International Publishing, Cham (2015)CrossRef
10.
go back to reference Mehrabian, A.: Some referents and measures of nonverbal behavior. Behav. Res. Methods Instrum. 1, 203–207 (1968)CrossRef Mehrabian, A.: Some referents and measures of nonverbal behavior. Behav. Res. Methods Instrum. 1, 203–207 (1968)CrossRef
11.
go back to reference Caspi, A., Blau, I.: Social presence in online discussion groups: testing three conceptions and their relations to perceived learning. Soc. Psychol. Educ. 11, 323–346 (2008)CrossRef Caspi, A., Blau, I.: Social presence in online discussion groups: testing three conceptions and their relations to perceived learning. Soc. Psychol. Educ. 11, 323–346 (2008)CrossRef
12.
go back to reference Vareberg, K.R., Westerman, D.: To:-) or to ☺, that is the question: a study of students’ initial impressions of instructors’ paralinguistic cues. Educ. Inf. Technol. 25, 4501–4516 (2020)CrossRef Vareberg, K.R., Westerman, D.: To:-) or to ☺, that is the question: a study of students’ initial impressions of instructors’ paralinguistic cues. Educ. Inf. Technol. 25, 4501–4516 (2020)CrossRef
13.
go back to reference Lee, K.M., Nass, C.: Designing social presence of social actors in human computer interaction. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 289–296. Association for Computing Machinery, Ft. Lauderdale (2003) Lee, K.M., Nass, C.: Designing social presence of social actors in human computer interaction. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 289–296. Association for Computing Machinery, Ft. Lauderdale (2003)
15.
go back to reference von der Pütten, A.M., Krämer, N.C., Gratch, J., Kang, S.-H.: “It doesn’t matter what you are!” Explaining social effects of agents and avatars. Comput. Hum. Behav. 26, 1641–1650 (2010)CrossRef von der Pütten, A.M., Krämer, N.C., Gratch, J., Kang, S.-H.: “It doesn’t matter what you are!” Explaining social effects of agents and avatars. Comput. Hum. Behav. 26, 1641–1650 (2010)CrossRef
16.
go back to reference Yassien, A., ElAgroudy, P., Makled, E., Abdennadher, S.: A design space for social presence in VR. In: 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, Article 8. Association for Computing Machinery, Tallinn, Estonia (2020) Yassien, A., ElAgroudy, P., Makled, E., Abdennadher, S.: A design space for social presence in VR. In: 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, Article 8. Association for Computing Machinery, Tallinn, Estonia (2020)
17.
go back to reference Yorzinski, J.L., Miller, J.: Sclera color enhances gaze perception in humans. PLOS ONE 15, e0228275 (2020) Yorzinski, J.L., Miller, J.: Sclera color enhances gaze perception in humans. PLOS ONE 15, e0228275 (2020)
18.
go back to reference Kobayashi, H., Kohshima, S.: Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye. J. Hum. Evol. 40, 419–435 (2001)CrossRef Kobayashi, H., Kohshima, S.: Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye. J. Hum. Evol. 40, 419–435 (2001)CrossRef
19.
go back to reference Bailenson, J.N., Beall, A.C., Loomis, J., Blascovich, J., Turk, M.: Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Hum. Commun. Res. 31, 511–537 (2005)CrossRef Bailenson, J.N., Beall, A.C., Loomis, J., Blascovich, J., Turk, M.: Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Hum. Commun. Res. 31, 511–537 (2005)CrossRef
20.
go back to reference Fares, M.: Towards multimodal human-like characteristics and expressive visual prosody in virtual agents. In: Proceedings of the 2020 International Conference on Multimodal Interaction, pp. 743–747. ACM, Virtual Event (2020) Fares, M.: Towards multimodal human-like characteristics and expressive visual prosody in virtual agents. In: Proceedings of the 2020 International Conference on Multimodal Interaction, pp. 743–747. ACM, Virtual Event (2020)
21.
go back to reference Pan, X., Gillies, M., Slater, M.: The impact of avatar blushing on the duration of interaction between a real and virtual person. In: Presence 2008: The 11th Annual International Workshop on Presence, pp. 100–106 (2008) Pan, X., Gillies, M., Slater, M.: The impact of avatar blushing on the duration of interaction between a real and virtual person. In: Presence 2008: The 11th Annual International Workshop on Presence, pp. 100–106 (2008)
22.
go back to reference Fiore, S., Wiltshire, T., Lobato, E., Jentsch, F., Huang, W., Axelrod, B.: Toward understanding social cues and signals in human–robot interaction: effects of robot gaze and proxemic behavior. Frontiers Psychol. 4 (2013) Fiore, S., Wiltshire, T., Lobato, E., Jentsch, F., Huang, W., Axelrod, B.: Toward understanding social cues and signals in human–robot interaction: effects of robot gaze and proxemic behavior. Frontiers Psychol. 4 (2013)
23.
go back to reference Bente, G., Rüggenberg, S., Krämer, N.C., Eschenburg, F.: Avatar-mediated networking: increasing social presence and interpersonal trust in net-based collaborations. Hum. Commun. Res. 34, 287–318 (2008)CrossRef Bente, G., Rüggenberg, S., Krämer, N.C., Eschenburg, F.: Avatar-mediated networking: increasing social presence and interpersonal trust in net-based collaborations. Hum. Commun. Res. 34, 287–318 (2008)CrossRef
Metadata
Title
The Relative Importance of Social Cues in Immersive Mediated Communication
Authors
Navya N. Sharan
Alexander Toet
Tina Mioch
Omar Niamut
Jan B. F. van Erp
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-85540-6_62

Premium Partner