Arindam Dey
Thammathip Piumsomboon
ABSTRACT
Interfaces for collaborative tasks, such as multiplayer games can enable more effective and enjoyable collaboration. However, in these systems, the emotional states of the users are often not communicated properly due to their remoteness from one another. In this paper, we investigate the effects of showing emotional states of one collaborator to the other during an immersive Virtual Reality (VR) gameplay experience. We created two collaborative immersive VR games that display the real-time heart-rate of one player to the other. The two different games elicited different emotions, one joyous and the other scary. We tested the effects of visualizing heart-rate feedback in comparison with conditions where such a feedback was absent. The games had significant main effects on the overall emotional experience.
Supplemental Material
- A. Aron, Aron E. N., and D. Smollan. 1992. Inclusion of other in the self scale and the structure of interpersonal closeness. Journal of Personality and Social Psychology 63, 4 (1992), 596--612. Google Scholar
Cross Ref
- R. A. Calvo and S. D'Mello. 2010. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactions on Affective Computing 1, 1 (Jan 2010), 18--37. Google ScholarDigital Library
- N. De la Pena, P. Weil, E. Llobera, J. ad Giannopoulos, A. PomÖs, B. Spanlang, and M. Slater. 2010. Immersive journalism: immersive virtual reality for the first-person experience of news. Presence: Teleoperators and Virtual Environments 19, 4 (2010), 291--301.Google ScholarDigital Library
- Jang DP, Kim IY, Nam SW, Wiederhold BK, and Wiederhold MD abd Kim SI. 2002. Analysis of physiological response to two virtual environments: driving and flying simulation. Cyberpsychol Behav. 5, 1 (2002), 11 -- 18.Google ScholarCross Ref
- Wood DP, Murphy JA, Center KB, Russ C, McLay RN, Reeves D, Pyne J, Shilling R, Hagan J, and Wiederhold BK. 2008. Combat related post traumatic stress disorder: a multiple case report using virtual reality graded exposure therapy with physiological monitoring. Studies in health technology and informatics 132 (2008), 556 -- 561.Google Scholar
- Marc Fabri, David Moore, and Dave Hobbs. 2004. Mediating the expression of emotion in educational collaborative virtual environments: an experimental study. Virtual Reality 7, 2 (2004), 66--81. Google ScholarDigital Library
- Marc Fabri, David J. Moore, and Dave J. Hobbs. 1999. The Emotional Avatar: Non-verbal Communication Between Inhabitants of Collaborative Virtual Environments. Springer Berlin Heidelberg, Berlin, Heidelberg, 269--273.Google Scholar
- Anna Felnhofer, Oswald D. Kothgassner, Mareike Schmidt, Anna-Katharina Heinzle, Leon Beutl, Helmut Hlavacs, and Ilse Kryspin-Exner. 2015. Is Virtual Reality Emotionally Arousing? Investigating Five Emotion Inducing Virtual Park Scenarios. International Journal of Human-Computer Studies 82, C (Oct. 2015), 48--56. Google ScholarDigital Library
- O. Gillath, C. A. McCall, P. Shaver, and J Blascovich. 2008. Reactions to a needy virtual person: Using an immersive virtual environment to measure prosocial tendencies. Media Psychology 11 (2008), 259--282. Google ScholarCross Ref
- Tim Howe and Paul M. Sharkey. 1998. Identifying Likely Successful Users of Virtual Reality Systems. Presence: Teleoperators and Virtual Environment 7, 3 (1998), 308--316. Google ScholarDigital Library
- HTC. 2016. Vive. http://www.vive.com/anz/. (2016). Accessed: 2016-09--17.Google Scholar
- Empatica Inc. 2016. E4 Wristband. https://www.empatica.com/e4-wristband. (2016). Accessed: 2016-09--17.Google Scholar
- Michael Meehan, Brent Insko, Mary Whitton, and Frederick P. Brooks, Jr. 2002. Physiological Measures of Presence in Stressful Virtual Environments. ACM Trans. Graph. 21, 3 (July 2002), 645--652. Google ScholarDigital Library
- Chris Milk. 2015. How Virtual Reality Can Create the Ultimate Empathy Machine. http://www.ted.com/talks/chris_milk_how_virtual_ reality_can_create_the_ultimate_empathy_machine. (2015). Accessed: 2016-09--19.Google Scholar
- Leslie Moller and C Soles. 2001. Myers Briggs type preferences in distance learning education. International Journal of Educational Technology 2, 2 (2001).Google Scholar
- Ewald Moser, Birgit Derntl, Simon Robinson, Bernhard Fink, Ruben C. Gur, and Karl Grammer. 2007. Amygdala activation at 3T in response to human and avatar facial expressions of emotions. Journal of Neuroscience Methods 161, 1 (2007), 126 -- 133. Google ScholarCross Ref
- Oculus. 2016. Rift. https://www3.oculus.com/en-us/rift/. (2016). Accessed: 2016-09--17.Google Scholar
- Daniela Palomba, Alessandro Angrilli, and Alessio Mini. 1997. Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. International Journal of Psychophysiology 27, 1 (1997), 55 -- 67. Google ScholarCross Ref
- H. Prendinger and M. Ishizuka. 2005. The empathic companion: A character-based interface that addresses users' affective states. Applied Artificial Intelligence 19, 3--4 (2005), 267--285.Google ScholarCross Ref
- I. Ravenscroft. 1998. What is it like to be someone else? Simulation and empathy. Ratio 11, 2 (1998), 170--185. Google ScholarCross Ref
- G. Riva, F. Mantovani, C.S. Capideville, A. Preziosa, F. Morganti, D. Villani, A. Gaggioli, C. Botella, and M. Alcaniz. 2007. Affective interactions using virtual reality: the link between presence and emotions. CyberPsychology & Behavior 10, 1 (2007), 45--56. Google ScholarCross Ref
- Albert Rizzo, Jacquelyn Morie, Josh Williams, Jarrell Pair, and John Galen Buckwalter. 2005. Human Emotional State and its Relevance for Military VR Training. In Proceedings of the 11th International Conference on Human-Computer Interaction. Las Vegas, NV.Google Scholar
- Michael J. Roy, Michelle E. Costanzo, Tanja Jovanovic, Suzanne Leaman, Patricia Taylor, Seth D. Norrholm, and Albert A. Rizzo. 2013. Heart Rate Response to Fear Conditioning and Virtual Reality in Subthreshold PTSD. Annual Review of Cybertherapy and Telemedicine 191 (2013), 115--119.Google Scholar
- Stanley Schachter and Jerome Singer. 1962. Cognitive, social, and physiological determinants of emotional state. IEEE Transactions on Affective Computing 69, 5 (Sep 1962), 379--399. Google ScholarCross Ref
- Sensaura. 2016. . http://www.sensauratech.com/. (2016). Accessed: 2016-09--19.Google Scholar
- Pulse Sensor. 2016. Heartbeat Sensor. http://pulsesensor.com/. (2016). Accessed: 2016-09--17.Google Scholar
- R. P. Smith, J. Argod, J. L. Pepin, and P. A. Levy. 1999. Pulse transit time: an appraisal of potential clinical applications. Thorax 54, 5 (May 1999), 452--457. Google ScholarCross Ref
- Chiew Seng Sean Tan, Kris Luyten, Jan Van Den Bergh, Johannes Schöning, and Karin Coninx. 2014a. The Role of Physiological Cues During Remote Collaboration. Presence: Teleoper. Virtual Environ. 23, 1 (Feb. 2014), 90--107. Google ScholarDigital Library
- Chiew Seng Sean Tan, Johannes Schöning, Kris Luyten, and Karin Coninx. 2014b. Investigating the Effects of Using Biofeedback As Visual Stress Indicator During Video-mediated Collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 71--80.Google ScholarDigital Library
- J. C. Thomas. 1996. The long-term social implications of new information technology. Erlbaum, Hillsdale, NJ. 258 pages.Google Scholar
- David Watson, Lee A. Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 54, 6 (1988), 1063--1070. Google ScholarCross Ref
- Brenda K. Wiederhold, Dong P. Jang, Mayumi Kaneda, Irene Cabral, Yair Lurie, Todd May, In Y. Kim, Mark D. Wiederhold, and Sun I. Kim. 2001. An Investigation into Physiological Responses in Virtual Environments: An Objective Measurement of Presence. Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age. IOS, Amsterdam. 175--183 pages.Google Scholar
- Brenda K. Wiederhold, Dong P. Jang, Sun I. Kim, and Mark D. Wiederhold. 2002. Physiological Monitoring as an Objective Tool in Virtual Reality Therapy. CyberPsychology & Behavior 5, 1 (2002), 77 -- 82. Google ScholarCross Ref
- Brenda K. Wiederhold and James L. Spira Richard N. Gevirtz. 2001. Virtual Reality Exposure Therapy vs. Imagery Desensitization Therapy in the Treatment of Flying Phobia. Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age. IOS, Amsterdam. 253--270 pages.Google Scholar
- C. J. A. M. Willemse, D. K. J. Heylen, and J. B. F. van Erp. 2015. Warmth in affective mediated interaction: Exploring the effects of physical warmth on interpersonal warmth. In Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on. 28--34.Google ScholarDigital Library
Index Terms
- Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay
Recommendations
How do emotions elicited in virtual reality affect our memory? A systematic review
AbstractEmotion has been shown to have a significant influence on memory. However, most of the investigations that led to this conclusion used non-virtual reality procedures. Virtual reality, as an emotional medium, is suitable for the study ...
Highlights- Studies investigating how emotions affect memory using VR range from basic (e.g., episodic memories) to applied research.
Can Virtual Reality Increase Emotional Responses (Arousal and Valence)? A Pilot Study
Proceedings of the Third International Conference on Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments - Volume 8518Emotions in the context of UX are generally evaluated in regard to product appearance and sensorial experience. The use of virtual reality can be a way to study UX in consumer products. We want to evaluate if we could increase emotional responses using ...
Emotional Virtual Characters for Improving Motivation and Performance in VR Exergames
Motivation and high effort in exergames are still open to optimization. In reality, coaches can stimulate athletes' engagement by infecting them with their emotions. However, whether these emotion-influencing effects also occur with virtual coaches ...
Comments