Skip to main content

Tipp

Weitere Kapitel dieses Buchs durch Wischen aufrufen

2022 | OriginalPaper | Buchkapitel

4. Scan Methods and Tools for Reconstruction of Built Environments as Basis for Digital Twins

Abstract

A three-dimensional digital representation, as the Digital Twin of machines and objects within production plants, is becoming increasingly important for efficient planning and documentation of production. During the acquisition of the images, the two areas of accuracy and detail are key. The accuracy describes the precision in which the digital twin represents the real objects. For example, how well the dimensions of a machine within a reconstructed model matches its counterpart in reality. Detail refers to the level of detail in the digital model. Should the door of a machine tool be distinguishable from the machine or not. Two basic technologies have been established for scanning. The photogrammetry method creates a dense point cloud based on images using a sophisticated toolchain. The laser method firstly measures an accurate model of the environment using a laser scanner. In a second step, the color information is assigned to the measured points via the evaluation of photos. For certain applications, models resulting in highest accuracy and detail are not necessary; in these cases, speed and practicability of the acquisition is the primary concern. Due to recent advancements photogrammetry these methods are best suited in the case of generating a digital twin for production facilities. An overview of the methods available as well es the underlying principles is presented. Practical considerations and examples show the feasibility and results of different photogrammetry approaches, resulting in the presentation of a photogrammetric system well suited to the task of creating a digital twin of a production facility.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Iqbal M, Hashmi MSJ (2001) Design and analysis of a virtual factory layout. J Mater Process Technol 118:403–410 CrossRef Iqbal M, Hashmi MSJ (2001) Design and analysis of a virtual factory layout. J Mater Process Technol 118:403–410 CrossRef
8.
Zurück zum Zitat Patraucean V, Armeni I, Nahangi M, Yeung J, Brilakis I, Haas C (2015) State of research in automatic as-built modelling. Adv Eng Inform 29:162–171 CrossRef Patraucean V, Armeni I, Nahangi M, Yeung J, Brilakis I, Haas C (2015) State of research in automatic as-built modelling. Adv Eng Inform 29:162–171 CrossRef
10.
Zurück zum Zitat Javaid M, Haleem A, Kumar L (2018) Current status and applications of 3D scanning in dentistry. Clinical Epidemiology and Global Health, Elsevier, a division of RELX India, Pvt. Ltd on behalf of INDIACLEN, 6 July 2018 Javaid M, Haleem A, Kumar L (2018) Current status and applications of 3D scanning in dentistry. Clinical Epidemiology and Global Health, Elsevier, a division of RELX India, Pvt. Ltd on behalf of INDIACLEN, 6 July 2018
11.
Zurück zum Zitat Moona D, Chunga S, Kwonb S, Seoc J, Shin J (2019) Comparison and utilization of point cloud generated from photogrammetry and laser scanning: 3D world model for smart heavy equipment planning. Autom Construct 98:322–331 CrossRef Moona D, Chunga S, Kwonb S, Seoc J, Shin J (2019) Comparison and utilization of point cloud generated from photogrammetry and laser scanning: 3D world model for smart heavy equipment planning. Autom Construct 98:322–331 CrossRef
13.
Zurück zum Zitat Lindskog E, Berglund J, Vallhagen J, Johansson B (2016) Layout planning and geometry analysis using 3D laser scanning in production system redesign. In: 6th CIRP Conference on Assembly Technologies and Systems (CATS) Lindskog E, Berglund J, Vallhagen J, Johansson B (2016) Layout planning and geometry analysis using 3D laser scanning in production system redesign. In: 6th CIRP Conference on Assembly Technologies and Systems (CATS)
14.
Zurück zum Zitat Bubaker-Isheil H, Hennebelle F (2019) Jean-Francois Fontaine, simple large scale 3D scanner. In: 13th CIRP conference on intelligent computation in manufacturing engineering. CIRP ICME ’19 Bubaker-Isheil H, Hennebelle F (2019) Jean-Francois Fontaine, simple large scale 3D scanner. In: 13th CIRP conference on intelligent computation in manufacturing engineering. CIRP ICME ’19
15.
Zurück zum Zitat Rebolj D, Pučko Z, Babič NČ, Bizjak M, Mongus D (2017) Point cloud quality requirements for Scan-vs-BIM based automated construction progress monitoring. Autom Construct 84:323–334 Rebolj D, Pučko Z, Babič NČ, Bizjak M, Mongus D (2017) Point cloud quality requirements for Scan-vs-BIM based automated construction progress monitoring. Autom Construct 84:323–334
16.
Zurück zum Zitat Shashi M, Jain K (2007) Use of photogrammetry in 3D modeling and visualization of buildings. ARPN J Eng Appl Sci Shashi M, Jain K (2007) Use of photogrammetry in 3D modeling and visualization of buildings. ARPN J Eng Appl Sci
17.
Zurück zum Zitat Mancini F, Salvini R (2019) Applications of photogrammetry for environmental research. ISPRS Int J Geo-Inf 8:542 CrossRef Mancini F, Salvini R (2019) Applications of photogrammetry for environmental research. ISPRS Int J Geo-Inf 8:542 CrossRef
18.
Zurück zum Zitat Emmanuel PB (1999) A comparison between photogrammetry and laser scanning. ISPRS J Photogrammetry Remote Sens 54(2–3):83–94 Emmanuel PB (1999) A comparison between photogrammetry and laser scanning. ISPRS J Photogrammetry Remote Sens 54(2–3):83–94
20.
Zurück zum Zitat Schnitzer F, Sonnenburg A, Janschek K, Willich G (2012) Bildbasierte Slam-Relativnavigation und 3drekonstruktion für das on-orbit-servicing von unbekannten und unkooperativen raumflugkörpern. Deutscher Luft- und Raumfahrtkongress Schnitzer F, Sonnenburg A, Janschek K, Willich G (2012) Bildbasierte Slam-Relativnavigation und 3drekonstruktion für das on-orbit-servicing von unbekannten und unkooperativen raumflugkörpern. Deutscher Luft- und Raumfahrtkongress
22.
Zurück zum Zitat Prasad V, Das D, Bhowmick B (2019) Epipolar geometry based learning of multi-view depth and ego-motion from monocular sequences. arXiv:​1812.​11922v3 [cs.RO] 7 Jan 2019 Prasad V, Das D, Bhowmick B (2019) Epipolar geometry based learning of multi-view depth and ego-motion from monocular sequences. arXiv:​1812.​11922v3 [cs.RO] 7 Jan 2019
23.
Zurück zum Zitat Baumann S (2011) Modulare Sensorfusion zur dynamischen Anreicherung einer SLAM-Karte fur die Verwendung auf mobilen Robotern, Universität Bielefeld, Technische Fakultät, 20. Juni 2011 Baumann S (2011) Modulare Sensorfusion zur dynamischen Anreicherung einer SLAM-Karte fur die Verwendung auf mobilen Robotern, Universität Bielefeld, Technische Fakultät, 20. Juni 2011
24.
Zurück zum Zitat Price E (2013) Evaluierung von Verfahren zum optischen Lokalisieren und Kartographieren (SLAM) mit Eignung für den Einsatz auf UAVs, Universität Stuttgart, Institut für Parallele und Verteilte Systeme, 17. Januar 2013 Price E (2013) Evaluierung von Verfahren zum optischen Lokalisieren und Kartographieren (SLAM) mit Eignung für den Einsatz auf UAVs, Universität Stuttgart, Institut für Parallele und Verteilte Systeme, 17. Januar 2013
25.
Zurück zum Zitat Lemaire T, Lacroix S (February 2007) SLAM with panoramic vision. J Field Robot 24(1–2):91–111 CrossRef Lemaire T, Lacroix S (February 2007) SLAM with panoramic vision. J Field Robot 24(1–2):91–111 CrossRef
32.
Zurück zum Zitat Hansch R, Drude I, Hellwich O (2016) Modern methods of bundle adjustment on the GPU. In: ISPRS annals of the photogrammetry, remote sensing and spatial information sciences, volume III-3, 2016 XXIII ISPRS Congress, 12–19 July 2016, Prague, Czech Republic Hansch R, Drude I, Hellwich O (2016) Modern methods of bundle adjustment on the GPU. In: ISPRS annals of the photogrammetry, remote sensing and spatial information sciences, volume III-3, 2016 XXIII ISPRS Congress, 12–19 July 2016, Prague, Czech Republic
34.
Zurück zum Zitat Yu T, Zou J-H, Song Q-B (2017) 3D reconstruction from a single still image based on monocular vision of an uncalibrated camera. ITM Web of Conferences 12, 01018 Yu T, Zou J-H, Song Q-B (2017) 3D reconstruction from a single still image based on monocular vision of an uncalibrated camera. ITM Web of Conferences 12, 01018
35.
Zurück zum Zitat Eckhof M (2015) Untersuchung der Eignung einer Handykamera fur die dreidimensionale ¨ Objektrekonstruktion. Leibniz Universität Hannover, Institut fur Photogrammetrie und Geoinformationen Eckhof M (2015) Untersuchung der Eignung einer Handykamera fur die dreidimensionale ¨ Objektrekonstruktion. Leibniz Universität Hannover, Institut fur Photogrammetrie und Geoinformationen
36.
Zurück zum Zitat Atapour-Abarghouei A, Breckon TP (2018) Real-time monocular depth estimation using synthetic data with domain adaptation via image style transfer. In: 2018 IEEE/CVF conference on computer vision and pattern recognition Atapour-Abarghouei A, Breckon TP (2018) Real-time monocular depth estimation using synthetic data with domain adaptation via image style transfer. In: 2018 IEEE/CVF conference on computer vision and pattern recognition
37.
Zurück zum Zitat Dygoduk S (2012) Entwicklung einer Android App für 3D Rekonstruktion, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012 Dygoduk S (2012) Entwicklung einer Android App für 3D Rekonstruktion, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012
38.
Zurück zum Zitat Manthe S (2014) 3D-Rekonstruktion aus monokularen Bilderserien, Universität Koblenz, September 2014 Manthe S (2014) 3D-Rekonstruktion aus monokularen Bilderserien, Universität Koblenz, September 2014
39.
Zurück zum Zitat Pollefeys M, Nist´er D, Frahm J-M, Akbarzadeh A, Mordohai P, Clipp B, Engels C, Gallup D, Kim S-J, Merrell P, Salmi C, Sinha S, Talton B, Wang L, Yang Q, Stewénius H, Yang R, Welch G, Towles H (2008) Detailed real-time urban 3D reconstruction from video. Int J Comput Vision Pollefeys M, Nist´er D, Frahm J-M, Akbarzadeh A, Mordohai P, Clipp B, Engels C, Gallup D, Kim S-J, Merrell P, Salmi C, Sinha S, Talton B, Wang L, Yang Q, Stewénius H, Yang R, Welch G, Towles H (2008) Detailed real-time urban 3D reconstruction from video. Int J Comput Vision
40.
Zurück zum Zitat Blank C (2012) Generierung von Tiefenbildern mittels Stereoskopie, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012 Blank C (2012) Generierung von Tiefenbildern mittels Stereoskopie, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012
42.
Zurück zum Zitat Chang A, Dai A, Funkhouser T, Halber M, Nießner M, Savva1 M, Song S, Zeng A, Zhang Y (2017) Matterport3D: learning from RGB-D data in indoor environments. arXiv:​1709.​06158v1 [cs.CV] 18 Sep 2017 Chang A, Dai A, Funkhouser T, Halber M, Nießner M, Savva1 M, Song S, Zeng A, Zhang Y (2017) Matterport3D: learning from RGB-D data in indoor environments. arXiv:​1709.​06158v1 [cs.CV] 18 Sep 2017
44.
Zurück zum Zitat Maier R (2019) High-quality 3D reconstruction from low-cost RGB-D sensors. Technische Universität München, Department of Informatics Maier R (2019) High-quality 3D reconstruction from low-cost RGB-D sensors. Technische Universität München, Department of Informatics
45.
Zurück zum Zitat Zhang L, Chen D, Liu W (2016) Fast plane segmentation with line primitives for RGB-D sensor. Int J Adv Robot Syst 1–8 Zhang L, Chen D, Liu W (2016) Fast plane segmentation with line primitives for RGB-D sensor. Int J Adv Robot Syst 1–8
47.
Zurück zum Zitat da Silveira TLT, Jung CR (2019) Dense 3D scene reconstruction from multiple spherical images for 3-DoF+ VR applications. In: IEEE conference on virtual reality and 3D user interfaces, Oska da Silveira TLT, Jung CR (2019) Dense 3D scene reconstruction from multiple spherical images for 3-DoF+ VR applications. In: IEEE conference on virtual reality and 3D user interfaces, Oska
49.
Zurück zum Zitat Abate D, Toschi I, Sturdy-Colls C, Remondino F (2017) A low-cost panoramic camera for the 3D documentation of contaminated crime scenes. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W8, 2017 5th international workshop lowcost 3D—sensors, algorithms, applications, 28–29 Nov 2017, Hamburg, Germany Abate D, Toschi I, Sturdy-Colls C, Remondino F (2017) A low-cost panoramic camera for the 3D documentation of contaminated crime scenes. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W8, 2017 5th international workshop lowcost 3D—sensors, algorithms, applications, 28–29 Nov 2017, Hamburg, Germany
50.
Zurück zum Zitat Bruno N, Roncella R (2019) Accuracy assessment of 3D models generated from google street view imagery. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W9, 2019 8th international workshop 3D-ARCH “3D virtual reconstruction and visualization of complex architectures, 6–8 Feb 2019, Bergamo, Italy Bruno N, Roncella R (2019) Accuracy assessment of 3D models generated from google street view imagery. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W9, 2019 8th international workshop 3D-ARCH “3D virtual reconstruction and visualization of complex architectures, 6–8 Feb 2019, Bergamo, Italy
51.
Zurück zum Zitat Perfetti L, Polari C, Fassi F (2017) Fisheye photogrammetry: tests and methodologies for the survey of narrow spaces. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W3, 2017 3D virtual reconstruction and visualization of complex architectures, 1–3 March 2017, Nafplio, Greece Perfetti L, Polari C, Fassi F (2017) Fisheye photogrammetry: tests and methodologies for the survey of narrow spaces. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W3, 2017 3D virtual reconstruction and visualization of complex architectures, 1–3 March 2017, Nafplio, Greece
52.
Zurück zum Zitat Perfetti L, Fassi F, Rossi C (2019) Fisheye Photogrammetry to generate low-cost DTMS. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W17, 2019 6th international workshop lowcost 3D—sensors, algorithms, applications, 2–3 Dec 2019, Strasbourg, France Perfetti L, Fassi F, Rossi C (2019) Fisheye Photogrammetry to generate low-cost DTMS. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W17, 2019 6th international workshop lowcost 3D—sensors, algorithms, applications, 2–3 Dec 2019, Strasbourg, France
53.
Zurück zum Zitat Caracotte J, Morbidi F, Mouaddib E (2021) Photometric stereo with Twin-Fisheye Cameras. In: 25th international conference on pattern recognition, Jan 2021, Milan, Italy, pp 5270–5277 Caracotte J, Morbidi F, Mouaddib E (2021) Photometric stereo with Twin-Fisheye Cameras. In: 25th international conference on pattern recognition, Jan 2021, Milan, Italy, pp 5270–5277
54.
Zurück zum Zitat Chiappini S, Fini A, Malinverni ES, Frontoni E, Racioppi G, Pierdicca R (2020) Cost effective spherical photogrammetry: a novel framework for the smart management of complex urban environments. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLIII-B4–2020, 2020 XXIV ISPRS Congress (2020 edition) Chiappini S, Fini A, Malinverni ES, Frontoni E, Racioppi G, Pierdicca R (2020) Cost effective spherical photogrammetry: a novel framework for the smart management of complex urban environments. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLIII-B4–2020, 2020 XXIV ISPRS Congress (2020 edition)
55.
Zurück zum Zitat Han B, Paulson C, Dapeng Wu (2011) 3D dense reconstruction from 2D video sequence via 3D geometric segmentation. J Vis Commun Image Represent 22(5):421–431 CrossRef Han B, Paulson C, Dapeng Wu (2011) 3D dense reconstruction from 2D video sequence via 3D geometric segmentation. J Vis Commun Image Represent 22(5):421–431 CrossRef
56.
Zurück zum Zitat Runceanu LS, Becker S, Haala N, Fritsch D (2017) Indoor point cloud segmentation for automatic object interpretation, 37. Wissenschaftlich-Technische Jahrestagung der DGPF in Würzburg – Publikationen der DGPF, Band 26, 2017 Runceanu LS, Becker S, Haala N, Fritsch D (2017) Indoor point cloud segmentation for automatic object interpretation, 37. Wissenschaftlich-Technische Jahrestagung der DGPF in Würzburg – Publikationen der DGPF, Band 26, 2017
57.
Zurück zum Zitat Zhang Y, Bai M, Kohli P, Izadi S, Xiao J (2017) DeepContext: context-encoding neural pathways for 3D holistic scene understanding. arXiv:​1603.​04922v4 [cs.CV] 16 Aug 2017 Zhang Y, Bai M, Kohli P, Izadi S, Xiao J (2017) DeepContext: context-encoding neural pathways for 3D holistic scene understanding. arXiv:​1603.​04922v4 [cs.CV] 16 Aug 2017
58.
Zurück zum Zitat Sedlacek M (2012) Sparse approximate inverses for preconditioning, smoothing, and regularization. TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Informatik mit Schwerpunkt Wissenschaftliches Rechnen Sedlacek M (2012) Sparse approximate inverses for preconditioning, smoothing, and regularization. TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Informatik mit Schwerpunkt Wissenschaftliches Rechnen
59.
Zurück zum Zitat Al-Nuaimi A (2016) Methods of point cloud alignment with applications to 3D indoor mapping and localization. Technische Universität München, Fakultät für Elektrotechnik und Informationstechnik Lehrstuhl für Medientechnik Al-Nuaimi A (2016) Methods of point cloud alignment with applications to 3D indoor mapping and localization. Technische Universität München, Fakultät für Elektrotechnik und Informationstechnik Lehrstuhl für Medientechnik
60.
Zurück zum Zitat Zhang X, Zhao P, Hu Q, Wang H, Ai M, Li J (2019) A 3D reconstruction pipeline of urban drainage pipes based on multiview image matching using low-cost panoramic video cameras. Water, 9 Oct 2019 Zhang X, Zhao P, Hu Q, Wang H, Ai M, Li J (2019) A 3D reconstruction pipeline of urban drainage pipes based on multiview image matching using low-cost panoramic video cameras. Water, 9 Oct 2019
Metadaten
Titel
Scan Methods and Tools for Reconstruction of Built Environments as Basis for Digital Twins
verfasst von
Markus Sommer
Klaus Seiffert
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-030-77539-1_4

Premium Partner