Skip to main content

2019 | OriginalPaper | Buchkapitel

26. Automatic Detection of Structural Deficiencies Using 4D Hue-Assisted Analysis of Color Point Clouds

verfasst von : Ali Khaloo, David Lattanzi

Erschienen in: Dynamics of Civil Structures, Volume 2

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recent developments in the fields of robotics and remote sensing technologies such as 3D laser scanners and photogrammetric approaches have provided an unprecedented opportunity to collect a massive amount of data from infrastructure systems in a contactless and nondestructive manner, which can potentially improve the structural health monitoring process. However, the complex nature of these geometrically accurate and high-resolution 3D models makes it inefficient and time-consuming to manually analyze and manipulate them and automating this process continue to pose a challenge. Thus, procedures that automate the data processing in order to detect a variety of damages are desired to make full use of these modern inspection technologies as a tool for infrastructure integrity assessment and asset management. The aim of this paper is to present a new algorithm to automatically identify and evaluate structural deficiencies in massive 3D point clouds of complex infrastructure systems. This approach takes advantage of both local geometry and color data properties associated with each point to improve the damage detection capabilities in a variety of scenarios. Linear and non-linear transformations from the RGB color space to non-RGB spaces were performed to increase separability between the damage and the structure and to achieve robustness to changes in illumination. Recently, a complex and large-scale gravity dam in Maryland, USA has served as a test bed for the developed methodology. In this experiment, a multi-scale photogrammetric computer vision approach was utilized to generate accurate and highly detailed 3D models of the targeted dam. In order to maximize the accessibility and to overcome geometric constraints, different multi-rotor Unmanned Aerial Vehicle (UAV) platforms with varied payload and maneuverability capabilities, each equipped with different optical sensors were used in this study. Experimental results demonstrate that the presented 4D point cloud analysis method can accurately detect and quantify a variety of anomalies from spalling to moisture infiltration in exposed concrete structures.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Phares, B.M., Washer, G.A., Rolander, D.D., Graybeal, B.A., Moore, M.: Routine highway bridge inspection condition documentation accuracy and reliability. J. Bridg. Eng. 9, 403–413 (2004)CrossRef Phares, B.M., Washer, G.A., Rolander, D.D., Graybeal, B.A., Moore, M.: Routine highway bridge inspection condition documentation accuracy and reliability. J. Bridg. Eng. 9, 403–413 (2004)CrossRef
2.
Zurück zum Zitat Chang, P.C., Flatau, A., Liu, S.C.: Review paper: health monitoring of civil infrastructure. Struct. Health Monit. 2, 257–267 (2003)CrossRef Chang, P.C., Flatau, A., Liu, S.C.: Review paper: health monitoring of civil infrastructure. Struct. Health Monit. 2, 257–267 (2003)CrossRef
3.
Zurück zum Zitat Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., Fieguth, P.: A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29, 196–210 (2015)CrossRef Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., Fieguth, P.: A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29, 196–210 (2015)CrossRef
4.
Zurück zum Zitat Lattanzi, D., Miller, G.: Review of robotic infrastructure inspection systems. J. Infrastruct. Syst. 23, 04017004 (2017)CrossRef Lattanzi, D., Miller, G.: Review of robotic infrastructure inspection systems. J. Infrastruct. Syst. 23, 04017004 (2017)CrossRef
5.
Zurück zum Zitat Khaloo, A., Lattanzi, D.: Hierarchical dense structure-from-motion reconstructions for infrastructure condition assessment. J. Comput. Civ. Eng. 31, 04016047 (2016)CrossRef Khaloo, A., Lattanzi, D.: Hierarchical dense structure-from-motion reconstructions for infrastructure condition assessment. J. Comput. Civ. Eng. 31, 04016047 (2016)CrossRef
6.
Zurück zum Zitat McGuire, B., Atadero, R., Clevenger, C., Ozbek, M.: Bridge information modeling for inspection and evaluation. J. Bridg. Eng. 21, 04015076 (2016)CrossRef McGuire, B., Atadero, R., Clevenger, C., Ozbek, M.: Bridge information modeling for inspection and evaluation. J. Bridg. Eng. 21, 04015076 (2016)CrossRef
7.
Zurück zum Zitat Khaloo, A., Lattanzi, D., Cunningham, K., Dell’Andrea, R., Riley, M.: Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling. Struct. Infrastruct. Eng. 14(1), 124–136 (2018)CrossRef Khaloo, A., Lattanzi, D., Cunningham, K., Dell’Andrea, R., Riley, M.: Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling. Struct. Infrastruct. Eng. 14(1), 124–136 (2018)CrossRef
8.
Zurück zum Zitat Fathi, H., Dai, F., Lourakis, M.: Automated as-built 3D reconstruction of civil infrastructure using computer vision: achievements, opportunities, and challenges. Adv. Eng. Inform. 29, 149–167 (2015)CrossRef Fathi, H., Dai, F., Lourakis, M.: Automated as-built 3D reconstruction of civil infrastructure using computer vision: achievements, opportunities, and challenges. Adv. Eng. Inform. 29, 149–167 (2015)CrossRef
9.
Zurück zum Zitat Jafari, B., Khaloo, A., Lattanzi, D.: Deformation tracking in 3D point clouds via statistical sampling of direct cloud-to-cloud distances. J. Nondestruct. Eval. 36, 65 (2017)CrossRef Jafari, B., Khaloo, A., Lattanzi, D.: Deformation tracking in 3D point clouds via statistical sampling of direct cloud-to-cloud distances. J. Nondestruct. Eval. 36, 65 (2017)CrossRef
10.
Zurück zum Zitat Pesci, A., Casula, G., Boschi, E.: Laser scanning the Garisenda and Asinelli towers in Bologna (Italy): detailed deformation patterns of two ancient leaning buildings. J. Cult. Herit. 12, 117–127 (2011)CrossRef Pesci, A., Casula, G., Boschi, E.: Laser scanning the Garisenda and Asinelli towers in Bologna (Italy): detailed deformation patterns of two ancient leaning buildings. J. Cult. Herit. 12, 117–127 (2011)CrossRef
11.
Zurück zum Zitat Kashani, A.G., Graettinger, A.J.: Cluster-based roof covering damage detection in ground-based lidar data. Autom. Constr. 58, 19–27 (2015)CrossRef Kashani, A.G., Graettinger, A.J.: Cluster-based roof covering damage detection in ground-based lidar data. Autom. Constr. 58, 19–27 (2015)CrossRef
12.
Zurück zum Zitat Gong, J., Maher, A.: Use of mobile lidar data to assess hurricane damage and visualize community vulnerability. Transp. Res. Rec. J. Transp. Res. Board. 2459, 119–126 (2014)CrossRef Gong, J., Maher, A.: Use of mobile lidar data to assess hurricane damage and visualize community vulnerability. Transp. Res. Rec. J. Transp. Res. Board. 2459, 119–126 (2014)CrossRef
13.
Zurück zum Zitat Riveiro, B., González-Jorge, H., Varela, M., Jauregui, D.V.: Validation of terrestrial laser scanning and photogrammetry techniques for the measurement of vertical underclearance and beam geometry in structural inspection of bridges. Measurement. 46, 784–794 (2013)CrossRef Riveiro, B., González-Jorge, H., Varela, M., Jauregui, D.V.: Validation of terrestrial laser scanning and photogrammetry techniques for the measurement of vertical underclearance and beam geometry in structural inspection of bridges. Measurement. 46, 784–794 (2013)CrossRef
14.
Zurück zum Zitat Liu, W., Chen, S., Hasuer, E.: Bridge clearance evaluation based on terrestrial LIDAR scan. J. Perform. Constr. Facil. 26, 469–477 (2012)CrossRef Liu, W., Chen, S., Hasuer, E.: Bridge clearance evaluation based on terrestrial LIDAR scan. J. Perform. Constr. Facil. 26, 469–477 (2012)CrossRef
15.
Zurück zum Zitat Tang, P., Huber, D., Akinci, B.: Characterization of laser scanners and algorithms for detecting flatness defects on concrete surfaces. J. Comput. Civ. Eng. 25, 31–42 (2010)CrossRef Tang, P., Huber, D., Akinci, B.: Characterization of laser scanners and algorithms for detecting flatness defects on concrete surfaces. J. Comput. Civ. Eng. 25, 31–42 (2010)CrossRef
16.
Zurück zum Zitat Armesto-González, J., Riveiro-Rodríguez, B., González-Aguilera, D., Rivas-Brea, M.T.: Terrestrial laser scanning intensity data applied to damage detection for historical buildings. J. Archaeol. Sci. 37, 3037–3047 (2010)CrossRef Armesto-González, J., Riveiro-Rodríguez, B., González-Aguilera, D., Rivas-Brea, M.T.: Terrestrial laser scanning intensity data applied to damage detection for historical buildings. J. Archaeol. Sci. 37, 3037–3047 (2010)CrossRef
17.
Zurück zum Zitat Hou, T.-C., Liu, J.-W., Liu, Y.-W.: Algorithmic clustering of LiDAR point cloud data for textural damage identifications of structural elements. Measurement. 108, 77–90 (2017)CrossRef Hou, T.-C., Liu, J.-W., Liu, Y.-W.: Algorithmic clustering of LiDAR point cloud data for textural damage identifications of structural elements. Measurement. 108, 77–90 (2017)CrossRef
18.
Zurück zum Zitat Jiang, C., Tsai, Y.J.: Enhanced crack segmentation algorithm using 3D pavement data. J. Comput. Civ. Eng. 30, 04015050 (2016)CrossRef Jiang, C., Tsai, Y.J.: Enhanced crack segmentation algorithm using 3D pavement data. J. Comput. Civ. Eng. 30, 04015050 (2016)CrossRef
19.
Zurück zum Zitat Conde, B., Del Pozo, S., Riveiro, B., González-Aguilera, D.: Automatic mapping of moisture affectation in exposed concrete structures by fusing different wavelength remote sensors. Struct. Control Health Monit. 23, 923–937 (2016)CrossRef Conde, B., Del Pozo, S., Riveiro, B., González-Aguilera, D.: Automatic mapping of moisture affectation in exposed concrete structures by fusing different wavelength remote sensors. Struct. Control Health Monit. 23, 923–937 (2016)CrossRef
20.
Zurück zum Zitat Besl, P.J., McKay, N.D.: Method for registration of 3-D shapes. Presented at the Robotics-DL tentative (1992) Besl, P.J., McKay, N.D.: Method for registration of 3-D shapes. Presented at the Robotics-DL tentative (1992)
21.
Zurück zum Zitat Toldo, R., Beinat, A., Crosilla, F.: Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework. In: 3DPVT 2010 Conference (2010) Toldo, R., Beinat, A., Crosilla, F.: Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework. In: 3DPVT 2010 Conference (2010)
22.
Zurück zum Zitat Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP 1. 2, 2 (2009) Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP 1. 2, 2 (2009)
23.
Zurück zum Zitat Vezhnevets, V., Sazonov, V., Andreeva, A.: A survey on pixel-based skin color detection techniques. In: Proc. Graphicon, pp. 85–92. Moscow (2003) Vezhnevets, V., Sazonov, V., Andreeva, A.: A survey on pixel-based skin color detection techniques. In: Proc. Graphicon, pp. 85–92. Moscow (2003)
24.
Zurück zum Zitat Cheng, H.-D., Jiang, X.H., Sun, Y., Wang, J.: Color image segmentation: advances and prospects. Pattern Recogn. 34, 2259–2281 (2001)CrossRef Cheng, H.-D., Jiang, X.H., Sun, Y., Wang, J.: Color image segmentation: advances and prospects. Pattern Recogn. 34, 2259–2281 (2001)CrossRef
25.
Zurück zum Zitat Son, H., Kim, C., Kim, C.: Automated color model–based concrete detection in construction-site images by using machine learning algorithms. J. Comput. Civ. Eng. 26, 421–433 (2012)CrossRef Son, H., Kim, C., Kim, C.: Automated color model–based concrete detection in construction-site images by using machine learning algorithms. J. Comput. Civ. Eng. 26, 421–433 (2012)CrossRef
26.
Zurück zum Zitat Siegel, M., Gunatilake, P.: Remote enhanced visual inspection of aircraft by a mobile robot. In: Proc. of the 1998 IEEE Workshop on Emerging Technologies, Intelligent Measurement and Virtual Systems for Instrumentation and Measurement (ETIMVIS’98), pp. 49–58 (1998) Siegel, M., Gunatilake, P.: Remote enhanced visual inspection of aircraft by a mobile robot. In: Proc. of the 1998 IEEE Workshop on Emerging Technologies, Intelligent Measurement and Virtual Systems for Instrumentation and Measurement (ETIMVIS’98), pp. 49–58 (1998)
27.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Prentice Hall, New Jersey (2008) Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Prentice Hall, New Jersey (2008)
28.
29.
Zurück zum Zitat Westland, S., Ripamonti, C., Cheung, V.: Computational Colour Science Using MATLAB. Wiley, West Sussex (2012)CrossRef Westland, S., Ripamonti, C., Cheung, V.: Computational Colour Science Using MATLAB. Wiley, West Sussex (2012)CrossRef
30.
Zurück zum Zitat Men, H., Pochiraju, K.: Hue-assisted automatic registration of color point clouds. J. Comput. Des. Eng. 1, 223–232 (2014) Men, H., Pochiraju, K.: Hue-assisted automatic registration of color point clouds. J. Comput. Des. Eng. 1, 223–232 (2014)
31.
Zurück zum Zitat Choi, K.Y., Kim, S.S.: Morphological analysis and classification of types of surface corrosion damage by digital image processing. Corros. Sci. 47, 1–15 (2005)CrossRef Choi, K.Y., Kim, S.S.: Morphological analysis and classification of types of surface corrosion damage by digital image processing. Corros. Sci. 47, 1–15 (2005)CrossRef
32.
Zurück zum Zitat Aligholi, S., Lashkaripour, G.R., Khajavi, R., Razmara, M.: Automatic mineral identification using color tracking. Pattern Recogn. 65, 164–174 (2017)CrossRef Aligholi, S., Lashkaripour, G.R., Khajavi, R., Razmara, M.: Automatic mineral identification using color tracking. Pattern Recogn. 65, 164–174 (2017)CrossRef
Metadaten
Titel
Automatic Detection of Structural Deficiencies Using 4D Hue-Assisted Analysis of Color Point Clouds
verfasst von
Ali Khaloo
David Lattanzi
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-74421-6_26

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.