Skip to main content
Top
Published in: Journal on Multimodal User Interfaces 2/2021

06-08-2020 | Original Paper

Empirical evaluation and pathway modeling of visual attention to virtual humans in an appearance fidelity continuum

Authors: Matias Volonte, Reza Ghaiumy Anaraky, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Bart P. Knijnenburg, Andrew T. Duchowski, Sabarish V. Babu

Published in: Journal on Multimodal User Interfaces | Issue 2/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this contribution we studied how different rendering styles of a virtual human impacted users’ visual attention in an interactive medical training simulator. In a mixed design experiment, 78 participants interacted with a virtual human representing a sample from the non-photorealistic (NPR) to the photorealistic (PR) rendering continuity. We presented five rendering style samples scenarios, namely All Pencil Shaded (APS), Pencil Shaded (PS), All Cartoon Shaded (ACT), Cartoon Shaded (CT), and Human-Like (HL), and compared how visual attention differed between groups of users. For this study, we employed an eye tracking system for collecting and analyzing users’ gaze during interaction with the virtual human in a failure to rescue medical training simulation. Results shows that users spent more total time in the APS and ACT conditions but users visually attended more to virtual humans in the PS, CT and HL appearance conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ayush B, Bertrand JW, Gramopadhye AK, Madathil KC, Babu SV (2018) Evaluating multiple levels of an interaction fidelity continuum on performance and learning in near-field training simulations. IEEE Trans Vis Comput Gr 24(4):1418–1427CrossRef Ayush B, Bertrand JW, Gramopadhye AK, Madathil KC, Babu SV (2018) Evaluating multiple levels of an interaction fidelity continuum on performance and learning in near-field training simulations. IEEE Trans Vis Comput Gr 24(4):1418–1427CrossRef
2.
go back to reference Brenton H, Gillies M, Ballin D, Chatting D (2005) The uncanny valley: does it exist. In: Proceedings of conference of human computer interaction, workshop on human animated character interaction Brenton H, Gillies M, Ballin D, Chatting D (2005) The uncanny valley: does it exist. In: Proceedings of conference of human computer interaction, workshop on human animated character interaction
3.
go back to reference Carter EJ, Mahler M, Hodgins JK (2013) Unpleasantness of animated characters corresponds to increased viewer attention to faces. In: Proceedings of the ACM Symposium on Applied Perception, pp. 35-40 Carter EJ, Mahler M, Hodgins JK (2013) Unpleasantness of animated characters corresponds to increased viewer attention to faces. In: Proceedings of the ACM Symposium on Applied Perception, pp. 35-40
4.
go back to reference Debevec P (2012) The light stages and their applications to photoreal digital actors. SIGGRAPH Asia 2(4):1–6 Debevec P (2012) The light stages and their applications to photoreal digital actors. SIGGRAPH Asia 2(4):1–6
5.
go back to reference Debevec P(2000) Acquiring the reflectance field of a human face. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques, pp 145–156 Debevec P(2000) Acquiring the reflectance field of a human face. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques, pp 145–156
6.
go back to reference Duchowski A (2007) Eye tracking methodology: theory and practice, vol 328, no 614. Springer, pp 2–3 Duchowski A (2007) Eye tracking methodology: theory and practice, vol 328, no 614. Springer, pp 2–3
7.
go back to reference Halper N, Mellin M, Duke D, Strothotte T (2003) Implicational rendering: drawing on latent human knowledge. ACM Trans Appl Percept Halper N, Mellin M, Duke D, Strothotte T (2003) Implicational rendering: drawing on latent human knowledge. ACM Trans Appl Percept
8.
go back to reference Halper N, Mellin M, Herrmann CS, Linneweber V, Strothotte T (2003) Psychology and non-photorealistic rendering: The beginning of a beautiful relationship. Mensch & Computer 2003. Springer, pp 277–286 Halper N, Mellin M, Herrmann CS, Linneweber V, Strothotte T (2003) Psychology and non-photorealistic rendering: The beginning of a beautiful relationship. Mensch & Computer 2003. Springer, pp 277–286
9.
go back to reference Hoffman D D (2000) Visual intelligence: how we create what we see. WW Norton and Company Hoffman D D (2000) Visual intelligence: how we create what we see. WW Norton and Company
10.
go back to reference Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J 6(1):1–55CrossRef Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J 6(1):1–55CrossRef
11.
go back to reference Gooch AA, Long J, Ji L, Estey A, Gooch BS (2003) Viewing progress in non-photorealistic rendering through Heinlein’s lens. ACM 1:165–171 Gooch AA, Long J, Ji L, Estey A, Gooch BS (2003) Viewing progress in non-photorealistic rendering through Heinlein’s lens. ACM 1:165–171
12.
go back to reference Lake A, Marshall C, Harris M, Blackstein M (2000) Stylized rendering techniques for scalable real-time 3d animation. In: Proceedings of the 1st international symposium on non-photorealistic animation and rendering, pp 13–20 Lake A, Marshall C, Harris M, Blackstein M (2000) Stylized rendering techniques for scalable real-time 3d animation. In: Proceedings of the 1st international symposium on non-photorealistic animation and rendering, pp 13–20
13.
go back to reference MacDorman KF (2006) Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: an exploration of the uncanny valley. In: ICCS/CogSci long symposium, pp 26–29 MacDorman KF (2006) Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: an exploration of the uncanny valley. In: ICCS/CogSci long symposium, pp 26–29
14.
go back to reference MacDorman KF, Green RD, Ho CC, Koch CT (2009) Too real for comfort? Uncanny responses to computer generated faces. Comput Human Behav 25(3):695–710CrossRef MacDorman KF, Green RD, Ho CC, Koch CT (2009) Too real for comfort? Uncanny responses to computer generated faces. Comput Human Behav 25(3):695–710CrossRef
15.
go back to reference Masuch M, Röber, N (2004) Game graphics beyond realism: then, now and tomorrow. In: Level UP: digital games research conference. DIGRA, Faculty of Arts, University of Utrecht Masuch M, Röber, N (2004) Game graphics beyond realism: then, now and tomorrow. In: Level UP: digital games research conference. DIGRA, Faculty of Arts, University of Utrecht
16.
go back to reference McDonnell R, Breidt M, Bulthoff HH (2012) Render me real?: investigating the effect of render style on the perception of animated virtual humans. ACM Trans Gr 31(4):91CrossRef McDonnell R, Breidt M, Bulthoff HH (2012) Render me real?: investigating the effect of render style on the perception of animated virtual humans. ACM Trans Gr 31(4):91CrossRef
17.
go back to reference McMahan RP, Bowman DA, Zielinski DJ, Brady RB (2012) Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans Vis Comput Gr 18(4):626–633CrossRef McMahan RP, Bowman DA, Zielinski DJ, Brady RB (2012) Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans Vis Comput Gr 18(4):626–633CrossRef
18.
19.
go back to reference Niles HE (1922) Correlation, causation and Wright’s theory of path coefficients. Genetics 7(3):258CrossRef Niles HE (1922) Correlation, causation and Wright’s theory of path coefficients. Genetics 7(3):258CrossRef
20.
go back to reference Nystrom M, Holmqvist K (2010) An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data. Behav Res Methods 42(1):188–204CrossRef Nystrom M, Holmqvist K (2010) An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data. Behav Res Methods 42(1):188–204CrossRef
21.
go back to reference Salvucci DD, Goldberg JH (2000) Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 symposium on Eye tracking research and applications, pp 71–78 Salvucci DD, Goldberg JH (2000) Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 symposium on Eye tracking research and applications, pp 71–78
22.
go back to reference Seyama J, Nagayama RS (2007) The uncanny valley: effect of realism on the impression of artificial human faces. Presence Teleoperators Virtual Environ 16(4):337–351CrossRef Seyama J, Nagayama RS (2007) The uncanny valley: effect of realism on the impression of artificial human faces. Presence Teleoperators Virtual Environ 16(4):337–351CrossRef
23.
go back to reference Volonte M, Anaraky RG, Knijnenburg B, Duchowski AT, Babu SV (2019) Empirical evaluation of the interplay of emotion and visual attention in human-virtual human interaction, pp 1–9 Volonte M, Anaraky RG, Knijnenburg B, Duchowski AT, Babu SV (2019) Empirical evaluation of the interplay of emotion and visual attention in human-virtual human interaction, pp 1–9
24.
go back to reference Volante M, Babu SV, Chaturvedi H, Newsome N, Ebrahimi E, Roy T, Daily SB, Fasolino T (2016) Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations. IEEE Trans Visual Comput Graphics 22(4): 1326–1335 Volante M, Babu SV, Chaturvedi H, Newsome N, Ebrahimi E, Roy T, Daily SB, Fasolino T (2016) Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations. IEEE Trans Visual Comput Graphics 22(4): 1326–1335
25.
go back to reference Zibrek K, McDonnell R (2014) Does render style affect perception of personality in virtual humans? In: Proceedings of the ACM symposium on applied perception, pp 111–115 Zibrek K, McDonnell R (2014) Does render style affect perception of personality in virtual humans? In: Proceedings of the ACM symposium on applied perception, pp 111–115
Metadata
Title
Empirical evaluation and pathway modeling of visual attention to virtual humans in an appearance fidelity continuum
Authors
Matias Volonte
Reza Ghaiumy Anaraky
Rohith Venkatakrishnan
Roshan Venkatakrishnan
Bart P. Knijnenburg
Andrew T. Duchowski
Sabarish V. Babu
Publication date
06-08-2020
Publisher
Springer International Publishing
Published in
Journal on Multimodal User Interfaces / Issue 2/2021
Print ISSN: 1783-7677
Electronic ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-020-00341-z

Other articles of this Issue 2/2021

Journal on Multimodal User Interfaces 2/2021 Go to the issue

Premium Partner