Carmine Elvezio
Steven Feiner
ABSTRACT
In many complex tasks, a remote subject-matter expert may need to assist a local user, to guide their actions on objects in the local user's environment. However, effective spatial referencing and action demonstration in a remote physical environment can be challenging. We demonstrate an approach that uses Virtual Reality (VR) or Augmented Reality (AR) for the remote expert, and AR for the local user, each wearing a stereo head-worn display (HWD). Our approach allows the remote expert to create and manipulate virtual replicas of physical objects in the local environment to refer to parts of those physical objects and to indicate actions on them. This can be especially useful for parts that are occluded or difficult to access. The remote expert can demonstrate actions in 3D by manipulating virtual replicas, supported by constraints and annotations, and point in 3D to portions of virtual replicas to annotate them.
Supplemental Material
- S. Bottecchia, J. Cieutat, and J. Jessel. 2010. T.A.C: Augmented Reality System for Collaborative Tele-assistance in the Field of Maintenance Through Internet. In Proc. ACM AH. 14:1--7. Google Scholar
Digital Library
- S. Gauglitz, B. Nuernberger, M. Turk, and T. Höllerer. 2014. World-Stabilized Annotations And Virtual Scene Navigation For Remote Collaboration. In Proc. ACM UIST. 449--459. Google ScholarDigital Library
- J. Heiser, B. Tversky, and M. Silverman. 2004. Sketches for and from Collaboration. Visual and spatial reasoning in design III 3 (2004), 69--78.Google Scholar
- S. Henderson and S. Feiner. 2011. Augmented Reality in the Psychomotor Phase of a Procedural Task. In Proc. IEEE ISMAR. 191--200. Google ScholarDigital Library
- O. Oda, C. Elvezio, M. Sukan, S. Feiner, and B. Tversky. 2015. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality. In Proc. ACM UIST. 405--415. Google ScholarDigital Library
- J.S. Pierce, B.C. Stearns, and R. Pausch. 1999. Voodoo Dolls: Seamless Interaction at Multiple Scales in Virtual Environments. In Proc. ACM i3D. 141--145. Google ScholarDigital Library
- M. Sukan, C. Elvezio, S. Feiner, and B. Tversky. 2016. Providing Assistance for Orienting 3D Objects Using Monocular Eyewear. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI '16). ACM, 89--98. Google ScholarDigital Library
- F. Tecchia, L. Alem, and W. Huang. 2012. 3D Helping Hands: A Gesture Based MR System for Remote Collaboration. In Proc. ACM VRCAI. 323--328. Google ScholarDigital Library
Index Terms
- Remote collaboration in AR and VR using virtual replicas
Recommendations
Virtual Replicas for Remote Assistance in Virtual and Augmented Reality
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyIn many complex tasks, a remote subject-matter expert may need to assist a local user to guide actions on objects in the local user's environment. However, effective spatial referencing and action demonstration in a remote physical environment can be ...
BeHere: a VR/SAR remote collaboration system based on virtual replicas sharing gesture and avatar in a procedural task
AbstractIn this paper, we focus on the significance of remote collaboration using virtual replicas, avatar, and gesture on a procedural task in industry; thus, we present a Virtual Reality (VR)/Spatial Augmented Reality (SAR) remote collaboration system, ...
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsThis demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
Comments