Shunichi Kasahara
Shohei Nagai
Jun Rekimoto
ABSTRACT
Fully recording and sharing an immersive experience is one of the ultimate goals of media technology. As extensive technical evolution, omnidirectional video is one of promising media to capture an immersive experience. First person omnidirectional video provides a unique experience of world through someone else's perspective. However, difficulties in wearable camera design and cybersickness induced by shaky video has been obstacle to explore applications of first person omnidirectional video. In this research, we introduce the design and implementation of "JackIn Head" a system including a wearable omnidirectional camera and image stabilization to alleviate cybersickness. Our evaluation revealed the alleviation of cybersickness. Then we report the series of workshops to explore user experience and applications in actual use cases such as virtual travel and virtual sports. We have compiled design implications about cybersickness and motion, immersive sensation, visualization and behavior data of spectators in experience with first person omnidirectional video.
Supplemental Material
- Albrecht, T., Tan, T., West, G., and Ly, T. Omnidirectional video stabilisation on a virtual camera using sensor fusion. In Control Automation Robotics Vision (ICARCV), 2010 11th International Conference on (Dec 2010), 2067--2072.Google Scholar
- Barkhuus, L., Engström, A., and Zoric, G. Watching the footwork: Second screen interaction at a dance and music performance. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 1305--1314. Google ScholarDigital Library
- Bazin, J.-C., Demonceaux, C., Vasseur, P., and Kweon, I. Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment. Int. J. Rob. Res. 31, 1 (Jan. 2012), 63--81. Google ScholarDigital Library
- Benko, H., and Wilson, A. D. Multi-point interactions with immersive omnidirectional visualizations in a dome. In ACM International Conference on Interactive Tabletops and Surfaces, ITS '10, ACM (New York, NY, USA, 2010), 19--28. Google ScholarDigital Library
- Bleumers, L., Van den Broeck, W., Lievens, B., and Pierson, J. Seeing the bigger picture: A user perspective on 360° tv. In Proceedings of the 10th European Conference on Interactive Tv and Video, EuroiTV '12, ACM (New York, NY, USA, 2012), 115--124. Google ScholarDigital Library
- Bouguet, J.-Y. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation 5 (2001).Google Scholar
- Carlon, N., and Menegatti, E. Visual gyroscope for omnidirectional cameras. In Intelligent Autonomous Systems 12. Springer, 2013, 335--344.Google Scholar
- Decock, J., Van Looy, J., Bleumers, L., and Bekaert, P. The pleasure of being (there?): an explorative study into the effects of presence and identification on the enjoyment of an interactive theatrical performance using omnidirectional video. AI & SOCIETY (2013), 1--11. Google ScholarDigital Library
- Gandhi, T., and Trivedi, M. Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera. Mach. Vision Appl. 16, 2 (Feb. 2005), 85--95. Google ScholarDigital Library
- Gluckman, J., and Nayar, S. Ego-motion and omnidirectional cameras. In Computer Vision, 1998. Sixth International Conference on (Jan 1998), 999--1005. Google ScholarDigital Library
- Howarth, P., and Costello, P. The occurrence of virtual simulation sickness symptoms when an hmd was used as a personal viewing system. Displays 18, 2 (1997), 107--116.Google ScholarCross Ref
- Jones, B. R., Benko, H., Ofek, E., and Wilson, A. D. Illumiroom: Peripheral projected illusions for interactive experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, ACM (New York, NY, USA, 2013), 869--878. Google ScholarDigital Library
- Kennedy, R. S., Drexler, J., and Kennedy, R. C. Research in visually induced motion sickness. Applied ergonomics 41, 4 (2010), 494--503.Google Scholar
- Kennedy, R. S., Lane, N. E., Berbaum, K. S., and Lilienthal, M. G. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203--220.Google Scholar
- Kondo, K., Mukaigawa, Y., and Yagi, Y. Wearable imaging system for capturing omnidirectional movies from a first-person perspective. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, VRST '09, ACM (New York, NY, USA, 2009), 11--18. Google ScholarDigital Library
- Kopf, J., Cohen, M. F., and Szeliski, R. First-person hyper-lapse videos. ACM Trans. Graph. 33, 4 (July 2014), 78:1--78:10. Google ScholarDigital Library
- Neng, L. A. R., and Chambel, T. Get around 360° hypervideo. In Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments, MindTrek '10, ACM (New York, NY, USA, 2010), 119--122. Google ScholarDigital Library
- Neumann, U., Pintaric, T., and Rizzo, A. Immersive panoramic video. In Proceedings of the Eighth ACM International Conference on Multimedia, MULTIMEDIA '00, ACM (New York, NY, USA, 2000), 493--494. Google ScholarDigital Library
- Niamut, O. A., Kochale, A., Hidalgo, J. R., Kaiser, R., Spille, J., Macq, J.-F., Kienast, G., Schreer, O., and Shirley, B. Towards a format-agnostic approach for production, delivery and rendering of immersive media. In Proceedings of the 4th ACM Multimedia Systems Conference, ACM (2013), 249--260. Google ScholarDigital Library
- Ozawa, T., Kitani, K. M., and Koike, H. Human-centric panoramic imaging stitching. In Proceedings of the 3rd Augmented Human International Conference, AH '12, ACM (New York, NY, USA, 2012), 20:1--20:6. Google ScholarDigital Library
- Rovelo Ruiz, G. A., Vanacken, D., Luyten, K., Abad, F., and Camahort, E. Multi-viewer gesture-based interaction for omni-directional video. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI '14, ACM (New York, NY, USA, 2014), 4077--4086. Google ScholarDigital Library
- Scaramuzza, D., Martinelli, A., and Siegwart, R. A toolbox for easily calibrating omnidirectional cameras. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, IEEE (2006), 5695--5701.Google ScholarCross Ref
- Shi, J., and Tomasi, C. Good features to track. In Computer Vision and Pattern Recognition, 1994. Proceedings CVPR '94., 1994 IEEE Computer Society Conference on (Jun 1994), 593--600.Google Scholar
- Stanney, K. M., Kennedy, R. S., and Drexler, J. M. Cybersickness is not simulator sickness. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 41, SAGE Publications (1997), 1138--1142.Google ScholarCross Ref
- Trumbull, D. Brainstorm, 1983.Google Scholar
- Vassallo, R. F., Santos-Victor, J., and Schneebeli, H. J. A general approach for egomotion estimation with omnidirectional images. In Proceedings of the Third Workshop on Omnidirectional Vision, OMNIVIS '02, IEEE Computer Society (Washington, DC, USA, 2002), 97--. Google ScholarDigital Library
- Zoric, G., Barkhuus, L., Engström, A., and Önnevall, E. Panoramic video: Design challenges and implications for content interaction. In Proceedings of the 11th European Conference on Interactive TV and Video, EuroITV '13, ACM (New York, NY, USA, 2013), 153--162. Google ScholarDigital Library
- Zoric, G., Engström, A., Barkhuus, L., Ruiz-Hidalgo, J., and Kochale, A. Gesture interaction with rich tv content in the social setting. In Exploring and Enhancing the User Experience for Television, Workshop of ACM SIGCHI Conference on Human Factors in Computing Systems, CHI\textquoteright13 (Paris, France, 04/2013 2013).Google Scholar
Index Terms
- First Person Omnidirectional Video: System Design and Implications for Immersive Experience
Recommendations
User Experience and Immersion of Interactive Omnidirectional Videos in CAVE Systems and Head-Mounted Displays
16th IFIP TC 13 International Conference on Human-Computer Interaction --- INTERACT 2017 - Volume 10516Omnidirectional video ODV is a medium that offers the viewer a 360-degree panoramic video view of the recorded setting. In recent years, various novel platforms for presenting such content have emerged. Many of these applications aim to offer an ...
Fixed viewport applications for omnidirectional video content: combining traditional and 360 video for immersive experiences
MMSys '20: Proceedings of the 11th ACM Multimedia Systems ConferenceWith omnidirectional videos, the viewer is able to direct her Field-of-View (FoV) to any part of the scene while watching the content. This is achieved by rendering the 360 video content on the inside of a (conceptual) sphere in which the viewer is ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Comments