Thammathip Piumsomboon
Barrett Ens
Robert W. Lindeman
ABSTRACT
We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures while it transforms in size and orientation to stay within the AR user's field of view. A user study was conducted to evaluate Mini-Me in two collaborative scenarios: an asymmetric remote expert in VR assisting a local worker in AR, and a symmetric collaboration in urban planning. We found that the presence of the Mini-Me significantly improved Social Presence and the overall experience of MR collaboration.
Supplemental Material
- Hesam Alizadeh, Anna Witcraft, Anthony Tang and Ehud Sharlin. 2016. HappyFeet: Embodiments for Joint Remote Dancing. in In GI '16: Proceedings of the 2016 Graphics Interface Conference, 117--124. Google Scholar
Digital Library
- AltspaceVR. AltspaceVR. 2017. Retrieved January 1, 2018 from https://altvr.comGoogle Scholar
- Judith Amores, Xavier Benavides and Pattie Maes. 2015. Showme: A remote collaboration system that supports immersive gestural communication. in Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 1343--1348. Google ScholarDigital Library
- Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: a technique for visualizing off-screen objects. in Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 481--488. Google ScholarDigital Library
- Mark Billinghurst and Hirokazu Kato. 1999. Collaborative mixed reality. in Proceedings of the First International Symposium on Mixed Reality, 261--284.Google ScholarCross Ref
- Mark Billinghurst, Hirokazu Kato, Kiyoshi Kiyokawa, Daniel Belcher and Ivan Poupyrev. 2002. Experiments with face-to-face collaborative AR interfaces. Virtual Reality, 6 (3). 107--121.Google ScholarCross Ref
- Mark Billinghurst, Hirokazu Kato and Ivan Poupyrev. 2001. The MagicBook: a transitional AR interface. Computers & Graphics, 25 (5). 745--753.Google ScholarCross Ref
- D. Borland, T. Peck and M. Slater. 2013. An Evaluation of Self-Avatar Eye Movement for Virtual Embodiment. IEEE Transactions on Visualization and Computer Graphics, 19 (4). 591--596. Google ScholarDigital Library
- Wolfgang Broll, Irma Lindt, Jan Ohlenburg, Michael Wittkämper, Chunrong Yuan, Thomas Novotny, Chiron Mottram, A Fatah gen Schieck and A Strothman. 2004. Arthur: A collaborative augmented environment for architectural design and urban planning.Google Scholar
- Bill Buxton. 2009. Mediaspace--meaningspace-- meetingspace. Media space 20+ years of mediated life. 217--231.Google Scholar
- Andre Doucette, Carl Gutwin, Regan L Mandryk, Miguel Nacenta and Sunny Sharma. 2013. Sometimes when we touch: how arm embodiments change reaching and collaboration on digital tables. in Proceedings of the 2013 conference on Computer supported cooperative work, ACM, 193--202. Google ScholarDigital Library
- Thierry Duval, Thi Thuong Huyen Nguyen, Cédric Fleury, Alain Chauffaut, Georges Dumont and Valérie Gouranton. 2014. Improving awareness for 3D virtual collaboration by embedding the features of users' physical environments and by augmenting interaction tools with cognitive feedback cues. Journal on Multimodal User Interfaces, 8 (2). 187--197.Google ScholarCross Ref
- Barrett Ens, Eyal Ofek, Neil Bruce and Pourang Irani. 2015. Spatial constancy of surface-embedded layouts across multiple environments. in Proceedings of the 3rd ACM Symposium on Spatial User Interaction, ACM, 65--68. Google ScholarDigital Library
- Raphael Grasset, Philip Lamb and Mark Billinghurst. 2005. Evaluation of Mixed-Space Collaboration Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 90--99. Google ScholarDigital Library
- Saul Greenberg, Carl Gutwin and Mark Roseman. 1996. Semantic telepointers for groupware. in Computer-Human Interaction, 1996. Proceedings., Sixth Australian Conference on, IEEE, 54--61. Google ScholarDigital Library
- Carl Gutwin and Saul Greenberg. 1996. Workspace awareness for groupware. in Conference Companion on Human Factors in Computing Systems, ACM, 208--209. Google ScholarDigital Library
- Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence.Google Scholar
- Keita Higuchi, Yinpeng Chen, Philip A Chou, Zhengyou Zhang and Zicheng Liu. 2015. Immerseboard: Immersive telepresence experience using a digital whiteboard. in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2383--2392. Google ScholarDigital Library
- Keita Higuchi, Ryo Yonetani and Yoichi Sato. 2016. Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 5180--5190. Google ScholarDigital Library
- T. Kim, A. Kachhara and B. MacIntyre. 2016. Redirected head gaze to support AR meetings distributed over heterogeneous environments. in 2016 IEEE Virtual Reality (VR), 207--208.Google Scholar
- Kiyoshi Kiyokawa, Haruo Takemura and Naokazu Yokoya. 1999. A collaboration support technique by integrating a shared virtual reality and a shared augmented reality. in Systems, Man, and Cybernetics, 1999. IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on, IEEE, 48--53.Google Scholar
- Minoru Kobayashi and Hiroshi Ishii. 1993. ClearBoard: a novel shared drawing medium that supports gaze awareness in remote collaboration. IEICE Transactions on Communications, 76 (6). 609--617.Google Scholar
- Harry T. Lawless and Hildegarde Heymann. 2010. Preference Testing. in Sensory Evaluation of Food: Principles and Practices, Springer New York, New York, NY, 303--324.Google Scholar
- Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan and Bruno Arnaldi. 2015. The stretchable arms for collaborative remote guiding. in Proceedings of International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments. Google ScholarDigital Library
- Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan and Bruno Arnaldi. 2016. Vishnu: virtual immersive support for HelpiNg users an interaction paradigm for collaborative remote guiding in mixed reality. in Collaborative Virtual Environments (3DCVE), 2016 IEEE Third VR International Workshop on, IEEE, 9--12.Google Scholar
- Hao Li, Laura Trutoiu, Kyle Olszewski, Lingyu Wei, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls and Chongyang Ma. 2015. Facial performance sensing head-mounted display. ACM Trans. Graph., 34 (4). 1--9. Google ScholarDigital Library
- Andrew Maimone, Xubo Yang, Nate Dierk, Andrei State, Mingsong Dou and Henry Fuchs. 2013. Generalpurpose telepresence with head-worn optical seethrough displays and projector-based lighting. in Virtual Reality (VR), 2013 IEEE, IEEE, 23--26.Google Scholar
- Microsoft. 2017. Spatial Understanding.Google Scholar
- Jens Mueller, Roman Rädle and Harald Reiterer. 2017. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 6481--6486. Google ScholarDigital Library
- Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko and Andrew D Wilson. 2016. Snaptoreality: Aligning augmented reality to the real world. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 1233--1244. Google ScholarDigital Library
- Oculus. 2017. Facebook Spaces.Google Scholar
- Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner and Barbara Tversky. 2015. Virtual replicas for remote assistance in virtual and augmented reality. in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ACM, 405--415. Google ScholarDigital Library
- Ohan Oda and Steven Feiner. 2012. 3D referencing techniques for physical objects in shared augmented reality. in Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on, IEEE, 207--215. Google ScholarDigital Library
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, Tokyo, Japan, 741--754. Google ScholarDigital Library
- Kazuhiro Otsuka. 2016. MMSpace: Kineticallyaugmented telepresence for small group-to-group conversations. in Virtual Reality (VR), 2016 IEEE, IEEE, 19--28.Google ScholarCross Ref
- Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, ACM, San Francisco, California, USA, 1716--1725. Google ScholarDigital Library
- Thammathip Piumsomboon, Arindam Day, Barrett Ens, Youngho Lee, Gun Lee and Mark Billinghurst. 2017. Exploring enhancements for remote mixed reality collaboration SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, ACM, Bangkok, Thailand, 1--5. Google ScholarDigital Library
- Thammathip Piumsomboon, Youngho Lee, Gun A Lee, Arindam Dey and Mark Billinghurst. 2017. Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See. in Ubiquitous Virtual Reality (ISUVR), 2017 International Symposium on, IEEE, 3841.Google ScholarCross Ref
- Thammathip Piumsomboon, Youngho Lee, Gun Lee and Mark Billinghurst. 2017. CoVAR: a collaborative virtual and augmented reality system for remote collaboration SIGGRAPH Asia 2017 Emerging Technologies, ACM, Bangkok, Thailand, 1--2. Google ScholarDigital Library
- Simon Prince, Adrian David Cheok, Farzam Farbiz, Todd Williamson, Nik Johnson, Mark Billinghurst and Hirokazu Kato. 2002. 3-D live: real time interaction for mixed reality Proceedings of the 2002 ACM conference on Computer supported cooperative work, ACM, New Orleans, Louisiana, USA, 364--371. Google ScholarDigital Library
- Jeff Sauro and Joseph S Dumas. 2009. Comparison of three one-question, post-task usability questionnaires. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1599--1608. Google ScholarDigital Library
- Rajinder S. Sodhi, Brett R. Jones, David Forsyth, Brian P. Bailey and Giuliano Maciocci. 2013. BeThere: 3D mobile collaboration with spatial input Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, Paris, France, 179--188. Google ScholarDigital Library
- Aaron Stafford, Wayne Piekarski and Bruce H. Thomas. 2006. Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users. in 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, 165--172. Google ScholarDigital Library
- Aaron Stafford, Bruce H Thomas and Wayne Piekarski. 2008. Efficiency of techniques for mixed-space collaborative navigation. in Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 181--182. Google ScholarDigital Library
- Matthew Tait and Mark Billinghurst. 2015. The Effect of View Independence in a Collaborative AR System. Comput. Supported Coop. Work, 24 (6). 563--589. Google ScholarDigital Library
- Anthony Tang, Carman Neustaedter and Saul Greenberg. 2007. Videoarms: embodiments for mixed presence groupware. in People and Computers XX- Engage, Springer, 85--102.Google Scholar
- Anthony Tang, Michel Pahud, Kori Inkpen, Hrvoje Benko, John C Tang and Bill Buxton. 2010. Three's company: understanding communication channels in three-way distributed collaboration. in Proceedings of the 2010 ACM conference on Computer supported cooperative work, ACM, 271--280. Google ScholarDigital Library
- Franco Tecchia, Leila Alem and Weidong Huang. 2012. 3D helping hands: a gesture based MR system for remote collaboration. in Proceedings of the 11th ACM SIGGRAPH International Conference on VirtualReality Continuum and its Applications in Industry, ACM, 323--328. Google ScholarDigital Library
- Vuforia. Vuforia SDK. 2017. Retrieved January 1, 2018 from https://developer.vuforia.com/downloads/sdkGoogle Scholar
- Kevin Winata Wong. 2015. HandsOn: A Portable System for Collaboration on Virtual 3D Objects Using Binocular Optical Head-Mounted Display, Massachusetts Institute of Technology.Google Scholar
- Ferdinand Rudolf Hendrikus Zijlstra. 1993. Efficiency in work behaviour: A design approach for modern tools.Google Scholar
- Jakob Zillner, Christoph Rhemann, Shahram Izadi and Michael Haller. 2014. 3D-board: a whole-body remote collaborative whiteboard. in Proceedings of the 27th annual ACM symposium on User interface software and technology, ACM, 471--479. Google ScholarDigital Library
Index Terms
- Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
Recommendations
CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging TechnologiesWe present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...
VROOM: Virtual Robot Overlay for Online Meetings
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsTelepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online ...
Snow Dome: A Multi-Scale Interaction in Mixed Reality Remote Collaboration
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Snow Dome, a Mixed Reality (MR) remote collaboration application that supports a multi-scale interaction for a Virtual Reality (VR) user. We share a local Augmented Reality (AR) user's reconstructed space with a remote VR user who has an ...
Comments