Kiana Calagari
Shervin Shirmohammadi
Mohamed Hefeeda
ABSTRACT
With the recent availability of commodity Virtual Reality (VR) products, immersive video content is receiving a significant interest. However, producing high-quality VR content often requires upgrading the entire production pipeline, which is costly and time-consuming. In this work, we propose using video feeds from regular broadcasting cameras to generate immersive content. We utilize the motion of the main camera to generate a wide-angle panorama. Using various techniques, we remove the parallax and align all video feeds. We then overlay parts from each video feed on the main panorama using Poisson blending. We examined our technique on various sports including basketball, ice hockey and volleyball. Subjective studies show that most participants rated their immersive experience when viewing our generated content between Good to Excellent. In addition, most participants rated their sense of presence to be similar to ground-truth content captured using a GoPro Omni 360 camera rig.
- Aseem Agarwala, Maneesh Agrawala, Michael Cohen, David Salesin, and Richard Szeliski. 2006. Photographing Long Scenes with Multi-viewpoint Panoramas. ACM Transactions on Graphics (TOG'06) Vol. 25, 3 (2006), 853--861. Google Scholar
Digital Library
- Robert Anderson, David Gallup, Jonathan T Barron, Janne Kontkanen, Noah Snavely, Carlos Hernández, Sameer Agarwal, and Steven M Seitz. 2016. Jump: virtual reality video. ACM Transactions on Graphics (TOG'16) Vol. 35, 6 (2016), 198. Google ScholarDigital Library
- Florian Angehrn, Oliver Wang, Yaugiz Aksoy, Markus Gross, and Aljovsa Smolić. 2014. MasterCam FVV: Robust registration of multiview sports video to a static high-resolution master camera for free viewpoint video Proc. of the International Conference on Image Processing (ICIP'14). Paris, France, 3474--3478.Google Scholar
- Matthew Brown and David G Lowe. 2007. Automatic panoramic image stitching using invariant features. International journal of computer vision Vol. 74, 1 (2007), 59--73. Google ScholarDigital Library
- ITU-R BT.500-13. 2012. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Geneva, Switzerland.Google Scholar
- Kiana Calagari, Mohamed Elgharib, Piotr Didyk, Alexandre Kaspar, Wojciech Matusik, and Mohamed Hefeeda. 2015. Gradient-based 2D-to-3D Conversion for Soccer Videos Proc. of the ACM Multimedia Conference (MM'15). Brisbane, Australia, 331--340. Google ScholarDigital Library
- Peter Carr, Yaser Sheikh, and Iain Matthews. 2012. Point-less Calibration: Camera Parameters from Gradient-based Alignment to Edge Images Proc. of IEEE Workshop on the Applications of Computer Vision (WACV '12). Breckenridge, CO, 377--384. Google ScholarDigital Library
- Che-Han Chang, Yoichi Sato, and Yung-Yu Chuang. 2014. Shape-Preserving Half-Projective Warps for Image Stitching Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'14). Columbus, OH, 3254--3261. Google ScholarDigital Library
- Chun-Ming Chang, Cheng-Hsin Hsu, Chih-Fan Hsu, and Kuan-Ta Chen. 2016. Performance Measurements of Virtual Reality Systems: Quantifying the Timing and Positioning Accuracy. In Proc. of the ACM Multimedia Conference (MM '16). Amsterdam, The Netherlands, 655--659. Google ScholarDigital Library
- Tarek El-Ganainy and Mohamed Hefeeda. 2016. Streaming virtual reality content. CoRR, Vol. abs/1612.08350 (2016).Google Scholar
- Facebook. 2017. Surround 360. (2017). https://facebook360.fb.com/facebook-surround-360/Google Scholar
- Christoph Fehn, Christian Weissig, Ingo Feldmann, Markus Muller, Peter Eisert, Peter Kauff, and Hans BloB. 2006. Creation of High-Resolution Video Panoramas of Sport Events Proc. of the International Symposium on Multimedia (ISM'06). San Diego, CA, 291--298. Google ScholarDigital Library
- FIFA Women's World Cup. 2015. FIFA TV broadcast production plan for FIFA Women's World Cup Canada 2015. (2015). http://resources.fifa.com/mm/document/tournament/competition/02/59/16/21/tvproductionbackgroundpaper_en_neutral.pdfGoogle Scholar
- Martin A. Fischler and Robert C. Bolles. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM Vol. 24, 6 (1981), 381--395. Google ScholarDigital Library
- Fujii Laboratory at Nagoya University. 2017. Nagoya University Multi-view Sequences Download List. (2017). http://www.fujii.nuee.nagoya-u.ac.jp/multiview-data/Google Scholar
- Junhong Gao, Seon Joo Kim, and Michael S Brown. 2011. Constructing image panoramas using dual-homography warping Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'11). Colorado Springs, CO, 49--56. and, Vamsidhar Reddy Gaddam, Marius Tennøe, Espen Helgedagsrud, Mikkel Næss, Henrik Kjus Alstad, Carsten Griwodz, Pål Halvorsen, and Dag Johansen. 2014. Processing Panorama Video in Real-time. International Journal of Semantic Computing, Vol. 8, 2 (2014), 209--227. Google ScholarDigital Library
- Ryo Suenaga, Kazuyoshi Suzuki, Tomoyuki Tezuka, Mehrdad Panahpour Tehrani, Keita Takahashi, and Toshiaki Fujii. 2015. A practical implementation of free viewpoint video system for soccer games Proc. of the SPIE Three-Dimensional Image Processing, Measurement, and Applications. San Francisco, CA, 93930G1--93930G8.Google Scholar
- Masayuki Tanaka, Ryo Kamio, and Masatoshi Okutomi. 2012. Seamless image cloning by a closed form solution of a modified poisson problem Proc. of the ACM SIGGRAPH Asia Posters (SA'12). Singapore, 15. Google ScholarDigital Library
- Daniel Wagner, Alessandro Mulloni, Tobias Langlotz, and Dieter Schmalstieg. 2010. Real-time panoramic mapping and tracking on mobile phones Proc. of the IEEE Virtual Reality Conference (VR'10). Waltham, MA, 211--218. Google ScholarDigital Library
- Changchang Wu. 2011. VisualSFM: A Visual Structure from Motion System. http://ccwu.me/vsfm/. (2011).Google Scholar
- Julio Zaragoza, Tat-Jun Chin, Quoc-Huy Tran, Michael S Brown, and David Suter. 2014. As-Projective-As-Possible Image Stitching with Moving DLT. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI'14), Vol. 36, 7 (2014), 1285--1298. Google ScholarDigital Library
- Alireza Zare, Alireza Aminlou, Miska M. Hannuksela, and Moncef Gabbouj. 2016. HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications Proc. of the ACM Multimedia Conference (MM'16). Amsterdam, The Netherlands, 601--605. Google ScholarDigital Library
- Guofeng Zhang, Yi He, Weifeng Chen, Jiaya Jia, and Hujun Bao. 2016. Multi-Viewpoint Panorama Construction With Wide-Baseline Images. IEEE Transactions on Image Processing Vol. 25, 7 (2016), 3099--3111.Google ScholarDigital Library
Index Terms
- Sports VR Content Generation from Regular Camera Feeds
Recommendations
Testing VR headset cameras for capturing written content
AcademicMindtrek '20: Proceedings of the 23rd International Conference on Academic MindtrekVirtual reality (VR) has become an important tool for providing immersive and collaborative teleprensence experiences. The technology has the possibility of bringing people in different geographical places together in an immersive way and makes sharing ...
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyHaptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Generation Method for Immersive Bullet-Time Video Using an Omnidirectional Camera in VR Platform
AVSU'18: Proceedings of the 2018 Workshop on Audio-Visual Scene Understanding for Immersive MultimediaThis paper proposes a generation method of immersive bullet-time video that continuously switches the images captured by multi-viewpoint omnidirectional cameras arranged around the subject. In ordinary bullet-time processing, it is possible to observe a ...
Comments