Jan Brejcha
Martin Cadík
ABSTRACT
Since the advent of consumer photography, tourists and hikers have made photo records of their trips to share later. Aside from being kept as memories, photo presentations such as slideshows are also shown to others who have not visited the location to try to convey the experience.However, a slideshow alone is limited in conveying the broader spatial context, and thus the feeling of presence in beautiful natural scenery is lost. We address this by presenting the photographs as part of an immersive experience. We introduce an automated pipeline for aligning photographs with a digital terrain model. From this geographic registration, we produce immersive presentations which are viewed either passively as a video, or interactively in virtual reality. Our experimental evaluation verifies that this new mode of presentation successfully conveys the spatial context of the scene and is enjoyable to users.
Supplemental Material
- M. Balabanović , L. l. Chu, and G. J. Wolff. 2000. Storytelling with digital photographs. Proceedings of the SIGCHI conference on Human Factors in Computing Systems 2, 1 (2000), 564--571. Google Scholar
Digital Library
- B. B. Bederson and A. Boltman. 1999. Does animation help users build mental maps of spatial information?. In Information Visualization, 1999. (Info Vis '99) Proceedings. 1999 IEEE Symposium on. 28--35. Google ScholarDigital Library
- Sahil Chelaramani, Vamsidhar Muthireddy, and C. V. Jawahar. 2017. An Interactive Tour Guide for a Heritage Site. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW). 2943--2952.Google Scholar
- P. Chippendale, M. Zanin, and C. Andreatta. 2009. Collective photography. In CVMP 2009 - The 6th European Conference for Visual Media Production. 188--194. Google ScholarDigital Library
- Rustichello da Pisa and Marco Polo. c. 1300. Livres des Merveilles du Monde. (c. 1300).Google Scholar
- A. Dalvandi, B. E. Riecke, and T. Calvert. 2011. Panoramic Video Techniques for Improving Presence in Virtual Environments. In Proceedings of the 17th Eurographics Conference on Virtual Environments & Third Joint Virtual Reality (EGVE - JVRC'11). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 103--110. Google ScholarDigital Library
- G. de Haan, H. Piguillet, and F. Post. 2010. Spatial Navigation for Context-Aware Video Surveillance. IEEE Computer Graphics and Applications 30, 5 (Sept 2010), 20--31. Google ScholarDigital Library
- Kit Devine. 2007. Place and Time : Creating Contextualised Presence for Virtual Heritage. In Proc 13th Intl Conference on Virtual Systems and Multimedia. 65--72.Google Scholar
- Ruofei Du, Sujal Bista, and Amitabh Varshney. 2016. Video Fields: Fusing Multiple Surveillance Videos into a Dynamic Virtual Environment. In Proceedings of the 21st International Conference on Web3D Technology (Web3D '16). ACM, New York, NY, USA, 165--172. Google ScholarDigital Library
- Ruofei Du and Amitabh Varshney. 2016. Social Street View: Blending Immersive Street Views with Geo-tagged Social Media. In Proceedings of the 21st International Conference on Web3D Technology (Web3D '16). ACM, New York, NY, USA, 77--85. Google ScholarDigital Library
- Adrian Graham, Hector Garcia-Molina, Andreas Paepcke, and Terry Winograd. 2002. Time as essence for photo browsing through personal digital libraries. In Proceedings of the second ACM/IEEE-CS joint conference on Digital libraries - JCDL '02. 326. Google ScholarDigital Library
- Susumu Harada, Mor Naaman, Yee Jiun Song, QianYing Wang, and Andreas Paepcke. 2004. Lost in memories: interacting with photo collections on PDAs. In Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries. 325. Google ScholarDigital Library
- A. C. Haugstvedt and J. Krogstie. 2012. Mobile augmented reality for cultural heritage: A technology acceptance study. In 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 247--255. Google ScholarDigital Library
- Mahmoud Haydar, David Roussel, Madjid Maïdi, Samir Otmane, and Malik Mallem. 2011. Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint). Virtual Reality 15, 4 (01 Nov 2011), 311--327. Google ScholarDigital Library
- Otmar Hilliges, Dominikus Baur, and Andreas Butz. 2007. Photohelix: Browsing, sorting and sharing digital photo collections. In Tabletop 2007 - 2nd Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems. 87--94.Google Scholar
- W. Kabsch. 1976. A solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A 32, 5 (1976), 922--923.Google ScholarCross Ref
- Biliana Kaneva, Josef Sivic, Antonio Torralba, Shai Avidan, and William T. Freeman. 2010. Infinite images: Creating and exploring a large photorealistic virtual space. In Proceedings of the IEEE, Vol. 98. 1391--1407.Google ScholarCross Ref
- Gunhee Kim, Seungwhan Moon, and Leonid Sigal. 2015. Joint photo stream and blog post summarization and exploration. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3081--3089.Google ScholarCross Ref
- Johannes Kopf, Michael F. Cohen, and Richard Szeliski. 2014. First-person Hyper-lapse Videos. ACM Trans. Graph. 33, 4, Article 78 (July 2014), 10 pages. Google ScholarDigital Library
- Nermina Kraljic. 2008. Interactive Video Virtual Tours. In Proceedings of the Central European Seminar on Computer Graphics (CESCG).Google Scholar
- Volker Kuchelmeister and Jill Bennet. 2014. The Amnesia Atlas. An immersive SenseCam interface as memory-prosthesis. In Proceedings of the 2014 International Conference on Virtual Systems and Multimedia, VSMM 2014. 217--222.Google ScholarCross Ref
- Avanish Kushal, Ben Self, Yasutaka Furukawa, David Gallup, Carlos Hernandez, Brian Curless, and Steven M. Seitz. 2012. Photo tours. In Proceedings - 2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012. 57--64. Google ScholarDigital Library
- Neil J McCurdy, William G Griswold, and Leslie a Lenert. 2005. RealityFlythrough: enhancing situational awareness for medical response to disasters using ubiquitous video. AMIA Annual Symposium proceedings (AIMA) (2005), 510--4. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1560501Google Scholar
- P. Moulon, P. Monasse, and R. Marlet. 2013. Global Fusion of Relative Motions for Robust, Accurate and Scalable Structure from Motion. In 2013 IEEE International Conference on Computer Vision. 3248--3255. Google ScholarDigital Library
- Satoshi Oonuki and Tetsuro Ogi. 2008. VR BBS Using Immersive Virtual Environment. In 22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008). 1006--1011. Google ScholarDigital Library
- Genevieve Patterson and James Hays. 2012. SUN attribute database: Discovering, annotating, and recognizing scene attributes. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2751--2758. Google ScholarDigital Library
- Pausanias. c. 150. Graecae descriptio. (c. 150).Google Scholar
- J. C. Platt. 2000. AutoAlbum: Clustering digital photographs using probabilistic model merging. In Proceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000. 96--100. Google ScholarDigital Library
- John C. Platt, Mary Czerwinski, and Brent A. Field. 2003. PhotoTOC: Automatic clustering for browsing personal photographs. In ICICS-PCM 2003 - Proceedings of the 2003 Joint Conference of the 4th International Conference on Information, Communications and Signal Processing and 4th Pacific-Rim Conference on Multimedia, Vol. 1. 6--10.Google Scholar
- Franc cois Pomerleau, Francis Colas, Roland Siegwart, and Stéphane Magnenat. 2013. Comparing ICP Variants on Real-World Data Sets. Autonomous Robots 34, 3 (Feb. 2013), 133--148. Google ScholarDigital Library
- O. Radiano, Y. Graber, M. Mahler, L. Sigal, and A. Shamir. 2017. Story Albums: Creating Fictional Stories From Personal Photograph Sets. Computer Graphics Forum 37, 1 (2017), 19--31.Google ScholarCross Ref
- Kerry Rodden and Kenneth Wood. 2003. How do people manage their digital photographs? CHI '03: Proceedings of the SIGCHI conference on Human factors in computing systems 5, 1 (2003), 409--416. Google ScholarDigital Library
- Klaus Schoeffmann, David Ahlstrom, and Marco A. Hudelist. 2014. 3-D interfaces to improve the performance of visual known-item search. IEEE Transactions on Multimedia 16, 7 (2014), 1942--1951.Google ScholarCross Ref
- Johannes Lutz Schönberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 4104--4113.Google Scholar
- Johannes L. Schönberger, True Price, Torsten Sattler, Jan Michael Frahm, and Marc Pollefeys. 2017. A vote-and-verify strategy for fast spatial verification in image retrieval. In Computer Vision - ACCV 2016 - 13th Asian Conference on Computer Vision, Revised Selected Papers (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)), Vol. 10111 LNCS. Springer Verlag, Germany, 321--337.Google Scholar
- Ismail Oner Sebe, Jinhui Hu, Suya You, and Ulrich Neumann. 2003. 3D Video Surveillance with Augmented Virtual Environments. In First ACM SIGMM International Workshop on Video Surveillance (IWVS '03). ACM, New York, NY, USA, 107--112. Google ScholarDigital Library
- Qi Shan, Brian Curless, Yasutaka Furukawa, Carlos Hernandez, and Steven M. Seitz. 2014. Photo uncrop. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 8694 LNCS. 16--31.Google Scholar
- B. Shneiderman. 2000. Visualization methods for personal photo collections: browsing and searching in the PhotoFinder. In 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532), Vol. 3. 1539--1542.Google Scholar
- Mel Slater, Martin Usoh, and Anthony Steed. 1994. Depth of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments 3, 2 (1994), 130--144. Google ScholarDigital Library
- Scott L. Smith. 2015. Stopmotion Photowalk Animation for Spatial Immersion in a Remote Cultural Heritage Site. In Proceedings of the Conference on Electronic Visualisation and the Arts (EVA '15). BCS Learning & Development Ltd., Swindon, UK, 298--305. Google ScholarDigital Library
- Noah Snavely, Rahul Garg, Steven M. Seitz, and Richard Szeliski. 2008. Finding paths through the world's photos. ACM Transactions on Graphics 27, 3 (2008), 1. Google ScholarDigital Library
- Noah Snavely, Steven M Seitz, and Richard Szeliski. 2006. Photo tourism: Exploring Photo Collections in 3D. ACM Transactions on Graphics 25, 3 (2006), 835--846. Google ScholarDigital Library
- Noah Snavely, Steven M. Seitz, and Richard Szeliski. 2008. Modeling the world from Internet photo collections. International Journal of Computer Vision 80, 2 (2008), 189--210. Google ScholarDigital Library
- Strabo. 7. Geographica. (7).Google Scholar
- M. Claudia tom Dieck and Timothy Hyungsoo Jung. 2017. Value of augmented reality at cultural heritage sites: A stakeholder approach. Journal of Destination Marketing & Management 6, 2 (2017), 110 -- 117. Special edition on Digital Destinations.Google ScholarCross Ref
- James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, and Christian Theobalt. 2013. Video collections in panoramic contexts. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. 131--140. Google ScholarDigital Library
- Carlo Torniai, Steve Battle, and Steve Cayzer. 2007. Sharing, Discovering and Browsing Geotagged Pictures on the World Wide Web. Springer London, London, 159--170.Google Scholar
- Severi Uusitalo, Peter Eskolin, Yu You, and Petros Belimpasakis. 2010. An extensible mirror world from user-generated content. In Proceedings - IEEE Virtual Reality. 311--312. Google ScholarDigital Library
- Eduardo Veas, Alessandro Mulloni, Ernst Kruijff, Dieter Schmalstieg, Holger Regenbrecht, and Dieter Schmalstieg. 2010. Techniques for view transition in multi-camera outdoor environments. In Proceedings of Graphics Interface. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 193--200. http://dl.acm.org/citation.cfm?id=1839214.1839248 Google ScholarDigital Library
- Chun-Po Wang, Kyle Wilson, and Noah Snavely. 2013. Accurate georegistration of point clouds using geographic data. 3DTV-Conference, 2013 International Conference on (2013), 33--40. Google ScholarDigital Library
- M. Wang, J. B. Liang, S. H. Zhang, S. P. Lu, A. Shamir, and S. M. Hu. 2018. Hyper-Lapse From Multiple Spatially-Overlapping Videos. IEEE Transactions on Image Processing 27, 4 (April 2018), 1735--1747. Google ScholarDigital Library
- Y. Wang, D. Bowman, D. Krum, E. Coalho, T. Smith-Jackson, D. Bailey, S. Peck, S. Anand, T. Kennedy, and Y. Abdrazakov. 2008. Effects of Video Placement and Spatial Context Presentation on Path Reconstruction Tasks with Contextualized Videos. IEEE Transactions on Visualization and Computer Graphics 14, 6 (Nov 2008), 1755--1762. Google ScholarDigital Library
- Yi Wang, David M. Krum, Enylton M. Coelho, and Doug A. Bowman. 2007. Contextualized Videos: Combining Videos with Environment Models to Support Situational Understanding. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1568--1575. Google ScholarDigital Library
- C. Wu. 2013. Towards Linear-Time Incremental Structure from Motion. In 2013 International Conference on 3D Vision - 3DV 2013. 127--134. Google ScholarDigital Library
- C. Wu, S. Agarwal, B. Curless, and S. M. Seitz. 2011. Multicore bundle adjustment. In CVPR 2011. 3057--3064. Google ScholarDigital Library
- Fuqu Wu and Melanie Tory. 2009. PhotoScope: Visualizing Spatiotemporal Coverage of Photos for Construction Management. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1103--1112. Google ScholarDigital Library
- Chen Yang and Gé rard Medioni. 1992. Object modelling by registration of multiple range images. Image and Vision Computing 10, 3 (1992), 145--155. Google ScholarDigital Library
- Zhengyou Zhang. 1998. Determining the Epipolar Geometry and its Uncertainty: A Review. International Journal of Computer Vision 27, 2 (1998), 161--195. Google ScholarDigital Library
- Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2018. Places: A 10 million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence PP, 99 (2018), 1--1.Google Scholar
- Zhe Zhu, Hao Zhi Huang, Zhi Peng Tan, Kun Xu, and Shi Min Hu. 2016. Faithful Completion of Images of Scenic Landmarks Using Internet Images . IEEE Transactions on Visualization and Computer Graphics 22, 8 (2016), 1945--1958. Google ScholarDigital Library
Index Terms
- Immersive Trip Reports
Recommendations
Gaze-directed Immersive Visualization of Scientific Ensembles
ISS '16 Companion: Proceedings of the 2016 ACM Companion on Interactive Surfaces and SpacesThe latest advances in head-mounted displays (HMDs) for augmented reality (AR) and mixed reality (MR) have produced commercialized devices that are gradually accepted by the public. These HMDs are generally equipped with head tracking, which provides an ...
A geoscience perspective on immersive 3D gridded data visualization
We describe visualization software, Visualizer, that was developed specifically for interactive, visual exploration in immersive virtual reality (VR) environments. Visualizer uses carefully optimized algorithms and data structures to support the high ...
Immersive ParaView: A community-based, immersive, universal scientific visualization application
VR '11: Proceedings of the 2011 IEEE Virtual Reality ConferenceThe availability of low-cost virtual reality (VR) systems coupled with a growing population of researchers accustomed to newer interface styles makes this a ripe time to help domain science researchers cross the bridge to utilizing immersive interfaces. ...
Comments