Skip to main content
Top

Hint

Swipe to navigate through the chapters of this book

2022 | OriginalPaper | Chapter

4. Scan Methods and Tools for Reconstruction of Built Environments as Basis for Digital Twins

Abstract

A three-dimensional digital representation, as the Digital Twin of machines and objects within production plants, is becoming increasingly important for efficient planning and documentation of production. During the acquisition of the images, the two areas of accuracy and detail are key. The accuracy describes the precision in which the digital twin represents the real objects. For example, how well the dimensions of a machine within a reconstructed model matches its counterpart in reality. Detail refers to the level of detail in the digital model. Should the door of a machine tool be distinguishable from the machine or not. Two basic technologies have been established for scanning. The photogrammetry method creates a dense point cloud based on images using a sophisticated toolchain. The laser method firstly measures an accurate model of the environment using a laser scanner. In a second step, the color information is assigned to the measured points via the evaluation of photos. For certain applications, models resulting in highest accuracy and detail are not necessary; in these cases, speed and practicability of the acquisition is the primary concern. Due to recent advancements photogrammetry these methods are best suited in the case of generating a digital twin for production facilities. An overview of the methods available as well es the underlying principles is presented. Practical considerations and examples show the feasibility and results of different photogrammetry approaches, resulting in the presentation of a photogrammetric system well suited to the task of creating a digital twin of a production facility.

To get access to this content you need the following product:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe



 


Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Literature
1.
go back to reference Iqbal M, Hashmi MSJ (2001) Design and analysis of a virtual factory layout. J Mater Process Technol 118:403–410 CrossRef Iqbal M, Hashmi MSJ (2001) Design and analysis of a virtual factory layout. J Mater Process Technol 118:403–410 CrossRef
8.
go back to reference Patraucean V, Armeni I, Nahangi M, Yeung J, Brilakis I, Haas C (2015) State of research in automatic as-built modelling. Adv Eng Inform 29:162–171 CrossRef Patraucean V, Armeni I, Nahangi M, Yeung J, Brilakis I, Haas C (2015) State of research in automatic as-built modelling. Adv Eng Inform 29:162–171 CrossRef
10.
go back to reference Javaid M, Haleem A, Kumar L (2018) Current status and applications of 3D scanning in dentistry. Clinical Epidemiology and Global Health, Elsevier, a division of RELX India, Pvt. Ltd on behalf of INDIACLEN, 6 July 2018 Javaid M, Haleem A, Kumar L (2018) Current status and applications of 3D scanning in dentistry. Clinical Epidemiology and Global Health, Elsevier, a division of RELX India, Pvt. Ltd on behalf of INDIACLEN, 6 July 2018
11.
go back to reference Moona D, Chunga S, Kwonb S, Seoc J, Shin J (2019) Comparison and utilization of point cloud generated from photogrammetry and laser scanning: 3D world model for smart heavy equipment planning. Autom Construct 98:322–331 CrossRef Moona D, Chunga S, Kwonb S, Seoc J, Shin J (2019) Comparison and utilization of point cloud generated from photogrammetry and laser scanning: 3D world model for smart heavy equipment planning. Autom Construct 98:322–331 CrossRef
13.
go back to reference Lindskog E, Berglund J, Vallhagen J, Johansson B (2016) Layout planning and geometry analysis using 3D laser scanning in production system redesign. In: 6th CIRP Conference on Assembly Technologies and Systems (CATS) Lindskog E, Berglund J, Vallhagen J, Johansson B (2016) Layout planning and geometry analysis using 3D laser scanning in production system redesign. In: 6th CIRP Conference on Assembly Technologies and Systems (CATS)
14.
go back to reference Bubaker-Isheil H, Hennebelle F (2019) Jean-Francois Fontaine, simple large scale 3D scanner. In: 13th CIRP conference on intelligent computation in manufacturing engineering. CIRP ICME ’19 Bubaker-Isheil H, Hennebelle F (2019) Jean-Francois Fontaine, simple large scale 3D scanner. In: 13th CIRP conference on intelligent computation in manufacturing engineering. CIRP ICME ’19
15.
go back to reference Rebolj D, Pučko Z, Babič NČ, Bizjak M, Mongus D (2017) Point cloud quality requirements for Scan-vs-BIM based automated construction progress monitoring. Autom Construct 84:323–334 Rebolj D, Pučko Z, Babič NČ, Bizjak M, Mongus D (2017) Point cloud quality requirements for Scan-vs-BIM based automated construction progress monitoring. Autom Construct 84:323–334
16.
go back to reference Shashi M, Jain K (2007) Use of photogrammetry in 3D modeling and visualization of buildings. ARPN J Eng Appl Sci Shashi M, Jain K (2007) Use of photogrammetry in 3D modeling and visualization of buildings. ARPN J Eng Appl Sci
17.
go back to reference Mancini F, Salvini R (2019) Applications of photogrammetry for environmental research. ISPRS Int J Geo-Inf 8:542 CrossRef Mancini F, Salvini R (2019) Applications of photogrammetry for environmental research. ISPRS Int J Geo-Inf 8:542 CrossRef
18.
go back to reference Emmanuel PB (1999) A comparison between photogrammetry and laser scanning. ISPRS J Photogrammetry Remote Sens 54(2–3):83–94 Emmanuel PB (1999) A comparison between photogrammetry and laser scanning. ISPRS J Photogrammetry Remote Sens 54(2–3):83–94
20.
go back to reference Schnitzer F, Sonnenburg A, Janschek K, Willich G (2012) Bildbasierte Slam-Relativnavigation und 3drekonstruktion für das on-orbit-servicing von unbekannten und unkooperativen raumflugkörpern. Deutscher Luft- und Raumfahrtkongress Schnitzer F, Sonnenburg A, Janschek K, Willich G (2012) Bildbasierte Slam-Relativnavigation und 3drekonstruktion für das on-orbit-servicing von unbekannten und unkooperativen raumflugkörpern. Deutscher Luft- und Raumfahrtkongress
22.
go back to reference Prasad V, Das D, Bhowmick B (2019) Epipolar geometry based learning of multi-view depth and ego-motion from monocular sequences. arXiv:​1812.​11922v3 [cs.RO] 7 Jan 2019 Prasad V, Das D, Bhowmick B (2019) Epipolar geometry based learning of multi-view depth and ego-motion from monocular sequences. arXiv:​1812.​11922v3 [cs.RO] 7 Jan 2019
23.
go back to reference Baumann S (2011) Modulare Sensorfusion zur dynamischen Anreicherung einer SLAM-Karte fur die Verwendung auf mobilen Robotern, Universität Bielefeld, Technische Fakultät, 20. Juni 2011 Baumann S (2011) Modulare Sensorfusion zur dynamischen Anreicherung einer SLAM-Karte fur die Verwendung auf mobilen Robotern, Universität Bielefeld, Technische Fakultät, 20. Juni 2011
24.
go back to reference Price E (2013) Evaluierung von Verfahren zum optischen Lokalisieren und Kartographieren (SLAM) mit Eignung für den Einsatz auf UAVs, Universität Stuttgart, Institut für Parallele und Verteilte Systeme, 17. Januar 2013 Price E (2013) Evaluierung von Verfahren zum optischen Lokalisieren und Kartographieren (SLAM) mit Eignung für den Einsatz auf UAVs, Universität Stuttgart, Institut für Parallele und Verteilte Systeme, 17. Januar 2013
25.
go back to reference Lemaire T, Lacroix S (February 2007) SLAM with panoramic vision. J Field Robot 24(1–2):91–111 CrossRef Lemaire T, Lacroix S (February 2007) SLAM with panoramic vision. J Field Robot 24(1–2):91–111 CrossRef
32.
go back to reference Hansch R, Drude I, Hellwich O (2016) Modern methods of bundle adjustment on the GPU. In: ISPRS annals of the photogrammetry, remote sensing and spatial information sciences, volume III-3, 2016 XXIII ISPRS Congress, 12–19 July 2016, Prague, Czech Republic Hansch R, Drude I, Hellwich O (2016) Modern methods of bundle adjustment on the GPU. In: ISPRS annals of the photogrammetry, remote sensing and spatial information sciences, volume III-3, 2016 XXIII ISPRS Congress, 12–19 July 2016, Prague, Czech Republic
34.
go back to reference Yu T, Zou J-H, Song Q-B (2017) 3D reconstruction from a single still image based on monocular vision of an uncalibrated camera. ITM Web of Conferences 12, 01018 Yu T, Zou J-H, Song Q-B (2017) 3D reconstruction from a single still image based on monocular vision of an uncalibrated camera. ITM Web of Conferences 12, 01018
35.
go back to reference Eckhof M (2015) Untersuchung der Eignung einer Handykamera fur die dreidimensionale ¨ Objektrekonstruktion. Leibniz Universität Hannover, Institut fur Photogrammetrie und Geoinformationen Eckhof M (2015) Untersuchung der Eignung einer Handykamera fur die dreidimensionale ¨ Objektrekonstruktion. Leibniz Universität Hannover, Institut fur Photogrammetrie und Geoinformationen
36.
go back to reference Atapour-Abarghouei A, Breckon TP (2018) Real-time monocular depth estimation using synthetic data with domain adaptation via image style transfer. In: 2018 IEEE/CVF conference on computer vision and pattern recognition Atapour-Abarghouei A, Breckon TP (2018) Real-time monocular depth estimation using synthetic data with domain adaptation via image style transfer. In: 2018 IEEE/CVF conference on computer vision and pattern recognition
37.
go back to reference Dygoduk S (2012) Entwicklung einer Android App für 3D Rekonstruktion, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012 Dygoduk S (2012) Entwicklung einer Android App für 3D Rekonstruktion, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012
38.
go back to reference Manthe S (2014) 3D-Rekonstruktion aus monokularen Bilderserien, Universität Koblenz, September 2014 Manthe S (2014) 3D-Rekonstruktion aus monokularen Bilderserien, Universität Koblenz, September 2014
39.
go back to reference Pollefeys M, Nist´er D, Frahm J-M, Akbarzadeh A, Mordohai P, Clipp B, Engels C, Gallup D, Kim S-J, Merrell P, Salmi C, Sinha S, Talton B, Wang L, Yang Q, Stewénius H, Yang R, Welch G, Towles H (2008) Detailed real-time urban 3D reconstruction from video. Int J Comput Vision Pollefeys M, Nist´er D, Frahm J-M, Akbarzadeh A, Mordohai P, Clipp B, Engels C, Gallup D, Kim S-J, Merrell P, Salmi C, Sinha S, Talton B, Wang L, Yang Q, Stewénius H, Yang R, Welch G, Towles H (2008) Detailed real-time urban 3D reconstruction from video. Int J Comput Vision
40.
go back to reference Blank C (2012) Generierung von Tiefenbildern mittels Stereoskopie, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012 Blank C (2012) Generierung von Tiefenbildern mittels Stereoskopie, Hochschule für Angewandte Wissenschaften Hamburg, Fakultät Technik und Informatik, 30 August 2012
42.
go back to reference Chang A, Dai A, Funkhouser T, Halber M, Nießner M, Savva1 M, Song S, Zeng A, Zhang Y (2017) Matterport3D: learning from RGB-D data in indoor environments. arXiv:​1709.​06158v1 [cs.CV] 18 Sep 2017 Chang A, Dai A, Funkhouser T, Halber M, Nießner M, Savva1 M, Song S, Zeng A, Zhang Y (2017) Matterport3D: learning from RGB-D data in indoor environments. arXiv:​1709.​06158v1 [cs.CV] 18 Sep 2017
44.
go back to reference Maier R (2019) High-quality 3D reconstruction from low-cost RGB-D sensors. Technische Universität München, Department of Informatics Maier R (2019) High-quality 3D reconstruction from low-cost RGB-D sensors. Technische Universität München, Department of Informatics
45.
go back to reference Zhang L, Chen D, Liu W (2016) Fast plane segmentation with line primitives for RGB-D sensor. Int J Adv Robot Syst 1–8 Zhang L, Chen D, Liu W (2016) Fast plane segmentation with line primitives for RGB-D sensor. Int J Adv Robot Syst 1–8
47.
go back to reference da Silveira TLT, Jung CR (2019) Dense 3D scene reconstruction from multiple spherical images for 3-DoF+ VR applications. In: IEEE conference on virtual reality and 3D user interfaces, Oska da Silveira TLT, Jung CR (2019) Dense 3D scene reconstruction from multiple spherical images for 3-DoF+ VR applications. In: IEEE conference on virtual reality and 3D user interfaces, Oska
49.
go back to reference Abate D, Toschi I, Sturdy-Colls C, Remondino F (2017) A low-cost panoramic camera for the 3D documentation of contaminated crime scenes. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W8, 2017 5th international workshop lowcost 3D—sensors, algorithms, applications, 28–29 Nov 2017, Hamburg, Germany Abate D, Toschi I, Sturdy-Colls C, Remondino F (2017) A low-cost panoramic camera for the 3D documentation of contaminated crime scenes. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W8, 2017 5th international workshop lowcost 3D—sensors, algorithms, applications, 28–29 Nov 2017, Hamburg, Germany
50.
go back to reference Bruno N, Roncella R (2019) Accuracy assessment of 3D models generated from google street view imagery. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W9, 2019 8th international workshop 3D-ARCH “3D virtual reconstruction and visualization of complex architectures, 6–8 Feb 2019, Bergamo, Italy Bruno N, Roncella R (2019) Accuracy assessment of 3D models generated from google street view imagery. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W9, 2019 8th international workshop 3D-ARCH “3D virtual reconstruction and visualization of complex architectures, 6–8 Feb 2019, Bergamo, Italy
51.
go back to reference Perfetti L, Polari C, Fassi F (2017) Fisheye photogrammetry: tests and methodologies for the survey of narrow spaces. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W3, 2017 3D virtual reconstruction and visualization of complex architectures, 1–3 March 2017, Nafplio, Greece Perfetti L, Polari C, Fassi F (2017) Fisheye photogrammetry: tests and methodologies for the survey of narrow spaces. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W3, 2017 3D virtual reconstruction and visualization of complex architectures, 1–3 March 2017, Nafplio, Greece
52.
go back to reference Perfetti L, Fassi F, Rossi C (2019) Fisheye Photogrammetry to generate low-cost DTMS. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W17, 2019 6th international workshop lowcost 3D—sensors, algorithms, applications, 2–3 Dec 2019, Strasbourg, France Perfetti L, Fassi F, Rossi C (2019) Fisheye Photogrammetry to generate low-cost DTMS. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLII-2/W17, 2019 6th international workshop lowcost 3D—sensors, algorithms, applications, 2–3 Dec 2019, Strasbourg, France
53.
go back to reference Caracotte J, Morbidi F, Mouaddib E (2021) Photometric stereo with Twin-Fisheye Cameras. In: 25th international conference on pattern recognition, Jan 2021, Milan, Italy, pp 5270–5277 Caracotte J, Morbidi F, Mouaddib E (2021) Photometric stereo with Twin-Fisheye Cameras. In: 25th international conference on pattern recognition, Jan 2021, Milan, Italy, pp 5270–5277
54.
go back to reference Chiappini S, Fini A, Malinverni ES, Frontoni E, Racioppi G, Pierdicca R (2020) Cost effective spherical photogrammetry: a novel framework for the smart management of complex urban environments. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLIII-B4–2020, 2020 XXIV ISPRS Congress (2020 edition) Chiappini S, Fini A, Malinverni ES, Frontoni E, Racioppi G, Pierdicca R (2020) Cost effective spherical photogrammetry: a novel framework for the smart management of complex urban environments. In: The international archives of the photogrammetry, remote sensing and spatial information sciences, volume XLIII-B4–2020, 2020 XXIV ISPRS Congress (2020 edition)
55.
go back to reference Han B, Paulson C, Dapeng Wu (2011) 3D dense reconstruction from 2D video sequence via 3D geometric segmentation. J Vis Commun Image Represent 22(5):421–431 CrossRef Han B, Paulson C, Dapeng Wu (2011) 3D dense reconstruction from 2D video sequence via 3D geometric segmentation. J Vis Commun Image Represent 22(5):421–431 CrossRef
56.
go back to reference Runceanu LS, Becker S, Haala N, Fritsch D (2017) Indoor point cloud segmentation for automatic object interpretation, 37. Wissenschaftlich-Technische Jahrestagung der DGPF in Würzburg – Publikationen der DGPF, Band 26, 2017 Runceanu LS, Becker S, Haala N, Fritsch D (2017) Indoor point cloud segmentation for automatic object interpretation, 37. Wissenschaftlich-Technische Jahrestagung der DGPF in Würzburg – Publikationen der DGPF, Band 26, 2017
57.
go back to reference Zhang Y, Bai M, Kohli P, Izadi S, Xiao J (2017) DeepContext: context-encoding neural pathways for 3D holistic scene understanding. arXiv:​1603.​04922v4 [cs.CV] 16 Aug 2017 Zhang Y, Bai M, Kohli P, Izadi S, Xiao J (2017) DeepContext: context-encoding neural pathways for 3D holistic scene understanding. arXiv:​1603.​04922v4 [cs.CV] 16 Aug 2017
58.
go back to reference Sedlacek M (2012) Sparse approximate inverses for preconditioning, smoothing, and regularization. TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Informatik mit Schwerpunkt Wissenschaftliches Rechnen Sedlacek M (2012) Sparse approximate inverses for preconditioning, smoothing, and regularization. TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Informatik mit Schwerpunkt Wissenschaftliches Rechnen
59.
go back to reference Al-Nuaimi A (2016) Methods of point cloud alignment with applications to 3D indoor mapping and localization. Technische Universität München, Fakultät für Elektrotechnik und Informationstechnik Lehrstuhl für Medientechnik Al-Nuaimi A (2016) Methods of point cloud alignment with applications to 3D indoor mapping and localization. Technische Universität München, Fakultät für Elektrotechnik und Informationstechnik Lehrstuhl für Medientechnik
60.
go back to reference Zhang X, Zhao P, Hu Q, Wang H, Ai M, Li J (2019) A 3D reconstruction pipeline of urban drainage pipes based on multiview image matching using low-cost panoramic video cameras. Water, 9 Oct 2019 Zhang X, Zhao P, Hu Q, Wang H, Ai M, Li J (2019) A 3D reconstruction pipeline of urban drainage pipes based on multiview image matching using low-cost panoramic video cameras. Water, 9 Oct 2019
Metadata
Title
Scan Methods and Tools for Reconstruction of Built Environments as Basis for Digital Twins
Authors
Markus Sommer
Klaus Seiffert
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-77539-1_4

Premium Partner