Jotaro Shigeyama
Takeru Hashimoto
Shigeo Yoshida
Takuji Narumi
ABSTRACT
Humans can estimate the shape of a wielded object through the illusory feeling of the mass properties of the object obtained using their hands. Even though the shape of hand-held objects influences immersion and realism in virtual reality (VR), it is difficult to design VR controllers for rendering desired shapes according to the perceptions derived from the illusory effects of mass properties and shape perception. We propose Transcalibur, which is a hand-held VR controller that can render a 2D shape by changing its mass properties on a 2D planar area. We built a computational perception model using a data-driven approach from the collected data pairs of mass properties and perceived shapes. This enables Transcalibur to easily and effectively provide convincing shape perception based on complex illusory effects. Our user study showed that the system succeeded in providing the perception of various desired shapes in a virtual environment.
Supplemental Material
Available for Download
zip
paper011.zip (21.7 MB)
# jpg files - supp_angle.jpg A picture of a moving angular mechanism of Transcalibur - supp_weight.jpg A picture of a moving weight shifting mechanism of Transcalibur - supp_whole.jpg A picture of entire Transcalibur working # GIF files - supp_angle.gif A footage of a moving angular mechanism of Transcalibur - supp_weight.gif A footage of a moving weight shifting mechanism of Transcalibur - supp_whole.gif A footage of entire Transcalibur working - supp_app.gif A footage of a uesr wielding Transcalibur in an actual VR experience.
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. 717-- 728. Google Scholar
Digital Library
- Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 117--119. Google ScholarDigital Library
- Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--13. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. 417-- 426. Google ScholarDigital Library
- Eisuke Fujinawa, Shigeo Yoshida, Yuki Koyama, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Computational design of hand-held VR controllers using haptic shape illusion. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology VRST '17. 1--10. Google ScholarDigital Library
- Young Min Han, Chan Jung Kim, and Seung Bok Choi. 2009. A magnetorheological fluid-based multifunctional haptic device for vehicular instrument controls. Smart Materials and Structures 18, 1 (2009).Google Scholar
- Fabian Hemmert, Susann Hamann, Matthias Löwe, Josefine Zeipelt, and Gesche Joost. 2010. Weight-shifting Mobiles: Two-dimensional Gravitational Displays in Mobile Phones. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 3087--3092. Google ScholarDigital Library
- Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. Chi 2018 (2018), 1--11. Google ScholarDigital Library
- Koichi Hirota and Michitaka Hirose. 1998. Implementation of partial surface display. Presence: Teleoperators and Virtual Environments 7, 6 (1998), 638--649. Google ScholarDigital Library
- Hiroo Iwata, Hiroaki Yano, Fumitaka Nakaizumi, and Ryo Kawamura. 2001. Project FEELEX. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques - SIGGRAPH '01. 469--476. Google ScholarDigital Library
- Seungwoo Je, Hyelip Lee, Myung Jin Kim, and Andrea Bianchi. 2018. Wind-blaster: A Wearable Propeller-based Prototype That Provides Ungrounded Force-feedback. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 23, 2 pages. Google ScholarDigital Library
- Hwan Kim, HyeonBeom Yi, Richard Chulwoo Park, and Woohun Lee. 2018. Hapcube: A Tactile Actuator Providing Tangential and Normal Pseudo-force Feedback on a Fingertip. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 9, 2 pages. Google ScholarDigital Library
- Idsart Kingma, Rolf Van De Langenberg, and Peter J. Beek. 2004. Which Mechanical Invariants Are Associated With the Perception of Length and Heaviness of a Nonvisible Handheld Rod? Testing the Inertia Tensor Hypothesis. Journal of Experimental Psychology: Human Perception and Performance 30, 2 (2004), 346--354.Google ScholarCross Ref
- Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 11--19. Google ScholarDigital Library
- Pedro Lopes, Alexandra Ion, Sijing You, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 c (2018), 1--13. Google ScholarDigital Library
- Kouta Minamizawa and Souichiro Fukamachi. 2007. Gravity grabber: wearable haptic display to present virtual mass sensation. ACM SIGGRAPH 2007 emerging technologies (2007), 8. Google ScholarDigital Library
- Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2013. Weight and Volume Changing Device with Liquid Metal Transfer. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 49--52. Google ScholarDigital Library
- Victor Adriel Oliveira, Luca Brayda, Luciana Nedel, and Anderson Maciel. 2017. Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. 453--454.Google Scholar
- Christopher C. Pagano, Paula Fitzpatrick, and M. T. Turvey. 1993. Tensorial basis to the constancy of perceived object extent over variations of dynamic touch. Perception & Psychophysics 54, 1 (1993), 43--54.Google ScholarCross Ref
- Jun Rekimoto. 2013. Traxion: A Tactile Interaction Device with Virtual Force Sensation. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). 427--431. Google ScholarDigital Library
- Tomoya Sasaki, Richard Sahala Hartanto, Kao-Hua Liu, Keitarou Tsuchiya, Atsushi Hiyama, and Masahiko Inami. 2018. Leviopole: Mid-air Haptic Interactions Using Multirotor. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). ACM, New York, NY, USA, Article 12, 2 pages. Google ScholarDigital Library
- Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems CHI '17. 3115--3119. Google ScholarDigital Library
- Jongman Seo, Sunung Mun, Jaebong Lee, and Seungmoon Choi. 2018. Substituting Motion Effects with Vibrotactile Effects for 4D Experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 428, 6 pages. Google ScholarDigital Library
- H. Yosef Solomon and M. T. Turvey. 1988. Haptically Perceiving the Distances Reachable With Hand-Held Objects. Journal of Experimental Psychology: Human Perception and Performance 14, 3 (1988), 404--427.Google ScholarCross Ref
- Evan Strasnick, Christian Holz, Eyal Ofek, Mike Sinclair, and Hrvoje Benko. 2018. Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018), 1--12. Google ScholarDigital Library
- M. T. Turvey. 1996. Dynamic Touch. American Psychologist 51, 11 (1996), 1134--1152.Google ScholarCross Ref
- M. T. Turvey, Gregory Burton, Eric L. Amazeen, Matthew Butwill, and Claudia Carello. 1998. Perceiving the Width and Height of a HandHeld Object by Dynamic Touch. Journal of Experimental Psychology: Human Perception and Performance 24, 1 (1998), 35--48.Google ScholarCross Ref
- UploadVR. 2018. This VR Controller Mod Shifts Weight To Simulate Objects. Retrieved January 3, 2018 from https://uploadvr.com/ vr-controller-mod-shifts-weight-simulate-objects/Google Scholar
- Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems CHI '18 (2018), 1--12. Google ScholarDigital Library
- Vibol Yem, Ryuta Okazaki, and Hiroyuki Kajimoto. 2016. FinGAR: Combination of Electrical and Mechanical Stimulation for High-Fidelity Tactile Presentation. In ACM SIGGRAPH 2016 Emerging Technologies on - SIGGRAPH '16. 1--2. Google ScholarDigital Library
- Andre Zenner and Antonio Kruger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1312--1321. Google ScholarDigital Library
- Yiwei Zhao, Lawrence H. Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, New York, NY, USA, 82--91. Google ScholarDigital Library
Index Terms
- Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model
Recommendations
Demonstration of Transcalibur: A VR Controller that Presents Various Shapes of Handheld Objects
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsWe demonstrate Transcalibur, which is a hand-held VR controller that can render a 2D shape by changing its mass properties on a 2D planar area. We built a computational perception model using a data-driven approach from the collected data pairs of mass ...
Transcalibur: dynamic 2D haptic shape illusion of virtual object by weight moving VR controller
SIGGRAPH '18: ACM SIGGRAPH 2018 PostersWe introduce a dynamic weight moving VR controller for 2d haptic shape rendering using a haptic shape illusion. This allows users to perceive the feeling of various shapes in virtual space with a single controller. In this paper, we describe the ...
Transcalibur: weight moving VR controller for dynamic rendering of 2D shape using haptic shape illusion
SIGGRAPH '18: ACM SIGGRAPH 2018 Emerging TechnologiesWe introduce a dynamic weight moving VR controller for 2d haptic shape rendering using a haptic shape illusion. This allows users to perceive the feeling of various shapes in virtual space with a single controller. We designed a device that drives ...
Comments