Shunichi Kasahara
Jun Rekimoto
ABSTRACT
Remote collaboration to share abilities over the Internet is one of the ultimate goals of telepresence technology. In this paper, we present JackIn Head, a visual telepresence system with an omnidirectional wearable camera with image motion stabilization. Spherical omnidirectional video footage taken around the head of a local user is stabilized and then broadcast to others, allowing remote users to explore the scene independently of the local user's head direction. We describe the system design of JackIn Head and report the evaluation results of the system's motion decoupling. Then, through an exploratory observation study, we investigate how individuals can remotely interact, communicate with, and assist each other with our system. We report our observation and analysis of inter-personal communication, demonstrating the effectiveness of our system in augmenting remote collaboration.
Supplemental Material
- Ardouin, J., Lécuyer, A., Marchal, M., Riant, C., and Marchand, E. 2012. Flyviz: A novel display device to provide humans with 360 vision by coupling catadioptric camera with hmd. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '12, 41--44. Google Scholar
Digital Library
- Biocca, F., Harms, C., and Gregg, J. 2001. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual International Workshop on Presence, Philadelphia, PA, 1--9.Google Scholar
- Bouguet, J.-Y. 2001. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation 5.Google Scholar
- Boult, T. E. 1998. Remote reality via omni-directional imaging. In ACM SIGGRAPH 98 Conference Abstracts and Applications, ACM, New York, NY, USA, SIGGRAPH '98, 253--. Google ScholarDigital Library
- Carlon, N., and Menegatti, E. 2013. Visual gyroscope for omnidirectional cameras. In Intelligent Autonomous Systems 12. Springer, 335--344.Google Scholar
- Cheng, L.-T., and Robinson, J. 1998. Dealing with speed and robustness issues for video-based registration on a wearable computing platform. In Wearable Computers, 1998. Digest of Papers. Second International Symposium on, 84--91. Google ScholarDigital Library
- Fussell, S. R., Setlock, L. D., and Kraut, R. E. 2003. Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI 03, 513--520. Google ScholarDigital Library
- Gauglitz, S., Nuernberger, B., Turk, M., and Höllerer, T. 2014. In touch with the remote world: Remote collaboration with augmented reality drawings and virtual navigation. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '14, 197--205. Google ScholarDigital Library
- Gauglitz, S., Nuernberger, B., Turk, M., and Höllerer, T. 2014. World-stabilized annotations and virtual scene navigation for remote collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '14, 449--459. Google ScholarDigital Library
- Gluckman, J., and Nayar, S. 1998. Ego-motion and omnidirectional cameras. In Computer Vision, 1998. Sixth International Conference on, 999--1005. Google ScholarDigital Library
- Goldberg, K., Song, D., and Levandowski, A. 2003. Collaborative teleoperation using networked spatial dynamic voting. Proceedings of the IEEE 91, 3 (Mar), 430--439.Google ScholarCross Ref
- Higuchi, K., and Rekimoto, J. 2013. Flying head: A head motion synchronization mechanism for unmanned aerial vehicle control. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI EA '13, 2029--2038. Google ScholarDigital Library
- Howarth, P., and Costello, P. 1997. The occurrence of virtual simulation sickness symptoms when an hmd was used as a personal viewing system. Displays 18, 2, 107--116.Google ScholarCross Ref
- Jones, B., Witcraft, A., Bateman, S., Neustaedter, C., and Tang, A. 2015. Mechanics of camera work in mobile video collaboration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '15, 957--966. Google ScholarDigital Library
- Kasahara, S., and Rekimoto, J. 2014. Jackin: Integrating first-person view with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference, ACM, New York, NY, USA, AH '14, 46:1--46:8. Google ScholarDigital Library
- Kasahara, S., Nagai, S., and Rekimoto, J. 2015. First person omnidirectional video: System design and implications for immersive experience. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, ACM, New York, NY, USA, TVX '15, 33--42. Google ScholarDigital Library
- Kawasaki, H., Iizuka, H., Okamoto, S., Ando, H., and Maeda, T. 2010. Collaboration and skill transmission by first-person perspective view sharing system. In RO-MAN, 2010 IEEE, 125--131.Google Scholar
- Kondo, K., Mukaigawa, Y., and Yagi, Y. 2009. Wearable imaging system for capturing omnidirectional movies from a first-person perspective. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '09, 11--18. Google ScholarDigital Library
- Kurata, T., Sakata, N., Kourogi, M., Kuzuoka, H., and Billinghurst, M. 2004. Remote collaboration using a shoulder-worn active camera/laser. In Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, vol. 1, 62--69. Google ScholarDigital Library
- Kuzuoka, H. 1992. Spatial workspace collaboration: A shared-view video support system for remote collaboration capability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI 92, 533--540. Google ScholarDigital Library
- Lanir, J., Stone, R., Cohen, B., and Gurevich, P. 2013. Ownership and control of point of view in remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '13, 2243--2252. Google ScholarDigital Library
- Mann, S. 2000. Telepointer: Hands-free completely self contained wearable visual augmented reality without headwear and without any infrastructural reliance. In Proceedings of the 4th IEEE International Symposium on Wearable Computers, IEEE Computer Society, Washington, DC, USA, ISWC '00, 177--. Google ScholarDigital Library
- Misawa, K., and Rekimoto, J. 2015. Wearing another's personality: A human-surrogate system with a telepresence face. In Proceedings of the 2015 ACM International Symposium on Wearable Computers, ACM, New York, NY, USA, ISWC '15, 125--132. Google ScholarDigital Library
- Mori, H., Sekiguchi, D., Kuwashima, S., Inami, M., and Matsuno, F. 2005. Motionsphere. In ACM SIGGRAPH 2005 Emerging Technologies, ACM, New York, NY, USA, SIGGRAPH '05. Google ScholarDigital Library
- Nagai, S., Kasahara, S., and Rekimoto, J. 2015. Livesphere: Sharing the surrounding visual environment for immersive experience in remote collaboration. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, ACM, New York, NY, USA, TEI '15, 113--116. Google ScholarDigital Library
- Rae, I., Venolia, G., Tang, J. C., and Molnar, D. 2015. A framework for understanding and designing telepresence. In Proc. CSCW 2015, ACM Association for Computing Machinery. Google ScholarDigital Library
- Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006. A toolbox for easily calibrating omnidirectional cameras. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, IEEE, 5695--5701.Google Scholar
- Short, J., Williams, E., and Christie, B. 1976. The social psychology of telecommunications.Google Scholar
- Stanney, K. M., Kennedy, R. S., and Drexler, J. M. 1997. Cybersickness is not simulator sickness. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 41, SAGE Publications, 1138--1142.Google Scholar
- Tachi, S. 2015. Telexistence. Springer. Tsumaki, Y., Ono, F., and Tsukuda, T. 2012. The 20-dof miniature humanoid mh-2: A wearable communication system. In Robotics and Automation (ICRA), 2012 IEEE International Conference on, IEEE, 3930--3935.Google Scholar
Index Terms
- JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration
Recommendations
JackIn space: designing a seamless transition between first and third person view for effective telepresence collaborations
AH '17: Proceedings of the 8th Augmented Human International ConferenceTraditional telepresence systems only supported first person view and users had difficulty in recognizing the surrounding situation of their remote workspace. JackIn Space is a telepresence system that solves this problem by seamlessly integrating first ...
ShowMe: A Remote Collaboration System that Supports Immersive Gestural Communication
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsShowMe is an immersive mobile collaboration system that allows a remote user to communicate with a peer using video, audio and hand gestures. We explore the use of a Head Mounted Display and depth camera to create a system that (1) enables a remote user ...
JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera
Sharing one's own immersive experience over the Internet is one of the ultimate goals of telepresence technology. In this paper, we present JackIn Head, a visual telepresence system featuring an omnidirectional wearable camera with image motion ...
Comments