Skip to main content

2018 | OriginalPaper | Buchkapitel

The Skyline as a Marker for Augmented Reality in Urban Context

verfasst von : Mehdi Ayadi, Leo Valque, Mihaela Scuturici, Serge Miguet, Chokri Ben Amar

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, augmented reality (AR) technologies have emerged as powerful tools to help visualize the future impacts of new constructions on cities. Many approaches that use costly sensors and height-end platforms to run AR in real-time have been developed. Little efforts have been made to embed AR on mobile phones. In this paper, we present a novel approach that uses the Skyline as a marker in an AR system. This lightweight feature enables real-time matching of virtual and real skyline on smartphones.
We use device’s embedded instruments to estimate the user’s pose. This approximation is used to insert a synthetic object in the live video stream. This first approach gives a very unrealistic impression of the viewed scene: the inserted objects appear to hover and float with the user’s movements. In order to address this problem, we use the live video camera feed as additional source of information which provides a redundancy to the instruments estimation. We extract the Skyline (a set of pixels that defines the boundary between the building and the sky) as main visual feature. Our proposal is to use these automatically extracted points and track them throughout the video sequence, to allow synthetic objects to anchor these visual features, making it possible to simulate a landscape from multiple viewpoints using a smartphone. We use images of the Lyon city (France) to illustrate our proposal.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Langlotz, T., Mooslechner, S., Zollmann, S., Degendorfer, C., Reitmayr, G., Schmalstieg, D.: Sketching up the world: in situ authoring for mobile augmented reality. Pers. Ubiquitous Comput. 16(6), 623–630 (2012)CrossRef Langlotz, T., Mooslechner, S., Zollmann, S., Degendorfer, C., Reitmayr, G., Schmalstieg, D.: Sketching up the world: in situ authoring for mobile augmented reality. Pers. Ubiquitous Comput. 16(6), 623–630 (2012)CrossRef
3.
4.
Zurück zum Zitat Wiggenhagen, M.: Co-registration of terrestrial laser scans and close range digital images using scale invariant features. Plastverarbeiter.De, pp. 208–212 (2010) Wiggenhagen, M.: Co-registration of terrestrial laser scans and close range digital images using scale invariant features. Plastverarbeiter.De, pp. 208–212 (2010)
5.
Zurück zum Zitat Moussa, W., Abdel-Wahab, M., Fritsch, D.: An automatic procedure for combining digital images and laser scanner data. ISPRS Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. XXXIX-B5, 229–234 (2012)CrossRef Moussa, W., Abdel-Wahab, M., Fritsch, D.: An automatic procedure for combining digital images and laser scanner data. ISPRS Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. XXXIX-B5, 229–234 (2012)CrossRef
6.
Zurück zum Zitat Taylor, Z., Nieto, J.: Automatic calibration of lidar and camera images using normalized mutual information, p. 8 (2012) Taylor, Z., Nieto, J.: Automatic calibration of lidar and camera images using normalized mutual information, p. 8 (2012)
7.
Zurück zum Zitat Taylor, Z., Nieto, J., Johnson, D.: Automatic calibration of multi-modal sensor systems using a gradient orientation measure. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1293–1300, November 2013 Taylor, Z., Nieto, J., Johnson, D.: Automatic calibration of multi-modal sensor systems using a gradient orientation measure. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1293–1300, November 2013
8.
Zurück zum Zitat Hofmann, S., Eggert, D., Brenner, C.: Skyline matching based camera orientation from images and mobile mapping point clouds. ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci. II-5, 181–188 (2014)CrossRef Hofmann, S., Eggert, D., Brenner, C.: Skyline matching based camera orientation from images and mobile mapping point clouds. ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci. II-5, 181–188 (2014)CrossRef
9.
Zurück zum Zitat Ramalingam, S., Bouaziz, S., Sturm, P., Brand, M.: Skyline2gps: localization in urban canyons using omni-skylines. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3816–3823, October 2010 Ramalingam, S., Bouaziz, S., Sturm, P., Brand, M.: Skyline2gps: localization in urban canyons using omni-skylines. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3816–3823, October 2010
10.
Zurück zum Zitat Nüchter, A., Gutev, S., Borrmann, D., Elseberg, J.: Skyline-based registration of 3d laser scans. Geo Spat. Inf. Sci. 14(2), 85 (2011)CrossRef Nüchter, A., Gutev, S., Borrmann, D., Elseberg, J.: Skyline-based registration of 3d laser scans. Geo Spat. Inf. Sci. 14(2), 85 (2011)CrossRef
11.
Zurück zum Zitat Zhu, S., Pressigout, M., Servières, M., Morin, L., Moreau, G.: Skyline matching: a robust registration method between Video and GIS. In: Conference of the European COST Action TU0801 - Semantic Enrichment of 3D City Models for Sustainable Urban Development Location: Graduate School of Architecture, Nantes, France, pp. 1–6, October 2012 Zhu, S., Pressigout, M., Servières, M., Morin, L., Moreau, G.: Skyline matching: a robust registration method between Video and GIS. In: Conference of the European COST Action TU0801 - Semantic Enrichment of 3D City Models for Sustainable Urban Development Location: Graduate School of Architecture, Nantes, France, pp. 1–6, October 2012
12.
Zurück zum Zitat Zhu, S., Morin, L., Pressigout, M., Moreau, G., Servières, M.: Video/GIS registration system based on skyline matching method. In: 2013 IEEE International Conference on Image Processing, pp. 3632–3636, September 2013 Zhu, S., Morin, L., Pressigout, M., Moreau, G., Servières, M.: Video/GIS registration system based on skyline matching method. In: 2013 IEEE International Conference on Image Processing, pp. 3632–3636, September 2013
13.
Zurück zum Zitat Guislain, M., Digne, J., Chaine, R., Monnier, G.: Fine scale image registration in large-scale urban lidar point sets. Comput. Vis. Image Underst. 157, 90–102 (2017). Large-Scale 3D Modeling of Urban Indoor or Outdoor Scenes from Images and Range Scans Guislain, M., Digne, J., Chaine, R., Monnier, G.: Fine scale image registration in large-scale urban lidar point sets. Comput. Vis. Image Underst. 157, 90–102 (2017). Large-Scale 3D Modeling of Urban Indoor or Outdoor Scenes from Images and Range Scans
14.
Zurück zum Zitat Yusoff, N.A.H., Noor, A.M., Ghazali, R.: City skyline conservation: sustaining the premier image of Kuala Lumpur. Procedia Environ. Sci. 20, 583–592 (2014)CrossRef Yusoff, N.A.H., Noor, A.M., Ghazali, R.: City skyline conservation: sustaining the premier image of Kuala Lumpur. Procedia Environ. Sci. 20, 583–592 (2014)CrossRef
16.
Zurück zum Zitat Fukuda, T., Zhang, T., Yabuki, N.: Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation. Front. Arch. Res. 3, 386–397 (2014)CrossRef Fukuda, T., Zhang, T., Yabuki, N.: Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation. Front. Arch. Res. 3, 386–397 (2014)CrossRef
17.
Zurück zum Zitat Skyline Database: \(dionysos.univ-lyon2.fr\)/\(~mayadi/ISVC^{\prime }18/skylineDatabase\) Skyline Database: \(dionysos.univ-lyon2.fr\)/\(~mayadi/ISVC^{\prime }18/skylineDatabase\)
Metadaten
Titel
The Skyline as a Marker for Augmented Reality in Urban Context
verfasst von
Mehdi Ayadi
Leo Valque
Mihaela Scuturici
Serge Miguet
Chokri Ben Amar
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-03801-4_61

Premium Partner