Bernhard Spanlang
ABSTRACT
We describe a system that shows how to substitute a person's body in virtual reality by a virtual body (or avatar). The avatar is seen from a first person perspective, moves as the person moves and the system generates touch on the real person's body when the avatar is touched. Such replacement of the person's real body by a virtual body requires a wide field-of-view head-mounted display, real-time whole body tracking, and tactile feedback. We show how to achieve this with a variety of off-the-shelf hardware and software, and also custom systems for real-time avatar rendering and collision detection. We present an overview of the system and detail on some of its components. We provide examples of how such a system is being used in some of our current experimental studies of embodiment.
- Botvinick, M., and Cohen, J. 1998. Rubber hands 'feel' touch that eyes see. Nature 391, 6669, 756--756. 0028--0836 10.1038/35784 10.1038/35784.Google Scholar
- Carrozzino, M., Tecchia, F., Bacinelli, S., Cappelletti, C., and Bergamasco, M. 2005. Lowering the development time of multimodal interactive application: the real-life experience of the xvr project. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, 270--273. Google ScholarDigital Library
- Ehrsson, H. H. 2007. The experimental induction of out-of-body experiences. Science 317 (24.8).Google Scholar
- Ericson, C. 2005. Real-Time Collision Detection. Morgan Kaufmann.Google Scholar
- Fernando, R. 2005. Percentage-closer soft shadows. In SIGGRAPH '05: ACM SIGGRAPH 2005 Sketches, ACM, New York, NY, USA, 35. Google ScholarDigital Library
- Gillies, M., and Spanlang, B. 2010. Real-time character engines comparing and evaluating real-time character engines for virtual environments. Special Issue on Presence. Google ScholarDigital Library
- Hendrix, C., and Barfield, W. 1996. Presence within virtual environments as a function of visual display parameters. Presence: Teleoperators and Virtual Environments 5, 274--289.Google ScholarDigital Library
- Kilgard, M. 2000. Improving shadows and reflections via the stencil buffer. Tech. rep., NVIDIA.Google Scholar
- Lenggenhager, B., Tadi, T., Metzinger, T., and Blanke, O. 2007. Video ergo sum: Manipulating bodily self-consciousness. Science 317, 5841 (8), 1096--1099.Google Scholar
- Lindeman, R. W., Page, R., Yanagida, Y., and Sibert, J. L. 2004. Towards full-body haptic feedback: the design and deployment of a spatialized vibrotactile feedback system. In VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology, ACM, New York, NY, USA, 146--149. Google ScholarDigital Library
- Mohler, B. J., Creem-Regehr, S. H., Thompson, W. B., and Bulthoff, H. H. 2010. The effect of viewing a self-avatar on distance judgments in an hmd-based virtual environment. Presence: Teleoper. Virtual Environ. in Press. Google ScholarDigital Library
- Ries, B., Interrante, V., Kaeding, M., and Phillips, L. 2009. Analyzing the effect of a virtual avatar's geometric and motion fidelity on ego-centric spatial perception in immersive virtual environments. In VRST '09: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, 59--66. Google ScholarDigital Library
- Rost, R. 2006. OpenGL(R) Shading Language (2nd Edition) (OpenGL). Addison-Wesley Professional. Google ScholarDigital Library
- Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M., and Slater, M. 2010. Virtual hand illusion induced by visuomotor correlations. PLoS ONE (April).Google Scholar
- Slater, M., and Usoh, M. 1993. Presence in immersive virtual environments. In Proceedings of the IEEE Conference - Virtual Reality Annual International Symposium, 90--96.Google Scholar
- Slater, M., Daniel Pérez Marcos, H. E., and Sanchez-Vives, M. V. 2008. Towards a digital body: the virtual arm illusion. Frontiers in Human Neuroscience 2, 6, 1--8.Google ScholarCross Ref
- Slater, M., Khanna, P., Mortensen, J., and Yu, I. 2009. Visual realism enhances realistic response in an immersive virtual environment. IEEE Computer Graphics and Applications May/June.Google Scholar
- Slater, M., Spanlang, B., and Corominas, D. 2010. Simulating virtual environments within virtual environments as the basis for a psychophysics of presence. In ACM SIGGRAPH. Google ScholarDigital Library
- Slater, M., Spanlang, B., Sanchez-Vives, M. V., and Blanke, O. 2010. First person experience of body transfer in virtual reality. PLoS ONE (May).Google Scholar
- Spanlang, B., Normand, J.-M., Giannopoulos, E., and Slater, M. 2010. Gpu based detection and mapping of collisions for haptic rendering in immersive virtual reality. In IEEE International Symposium on Haptic Audio Visual Environments and Games, to appear.Google Scholar
- Sutherland, I. 1965. The ultimate display. In Proceedings of IFIP Congress, 506--508.Google Scholar
- Teschner, M., Kimmerle, S., Zachmann, G., Heidelberger, B., Raghupathi, L., Fuhrmann, A., Cani, M.-P., Faure, F., Magnetat-Thalmann, N., and Strasser, W. 2004. Collision detection for deformable objects. In Eurographics State-of-the-Art Report (EG-STAR), Eurographics Association, Eurographics Association, 119--139.Google Scholar
- A first person avatar system with haptic feedback
Recommendations
The effect of avatar realism in immersive social virtual realities
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThis paper investigates the effect of avatar realism on embodiment and social interactions in Virtual Reality (VR). We compared abstract avatar representations based on a wooden mannequin with high fidelity avatars generated from photogrammetry 3D scan ...
Haptic feedback in first person shooter video games
ECCE '22: Proceedings of the 33rd European Conference on Cognitive ErgonomicsImmersion has become an important factor for video games. This study investigates the effect that haptic feedback has on the perceived immersion of the player in two different setups; one with haptic feedback in the game controller and one with ...
A meta-analysis of recent studies on haptic feedback enhancement in immersive-augmented reality
ICVR 2018: Proceedings of the 4th International Conference on Virtual RealityIn this study, we address a research direction on haptic feedback-driven object presence in immersive Augmented Reality (AR). We reviewed 30 current studies in regard of sensory feedback in domain of Virtual Reality (VR), Augmented Virtuality (AV), AR ...
Comments