Skip to main content
Erschienen in: Engineering with Computers 2/2019

18.04.2018 | Original Article

A novel method for asphalt pavement crack classification based on image processing and machine learning

verfasst von: Nhat-Duc Hoang, Quoc-Lam Nguyen

Erschienen in: Engineering with Computers | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study constructs an automatic model for detecting and classifying asphalt pavement crack. Image processing techniques including steerable filters, projective integral of image, and an enhanced method for image thresholding are employed for feature extraction. Different scenarios of feature selection have been attempted to create data sets from digital images. These data sets are then employed to train and verify the performance of machine learning algorithms including the support vector machine (SVM), the artificial neural network (ANN), and the random forest (RF). The feature set that consists of the properties derived from the projective integral and the properties of crack objects can deliver the most desirable outcome. Experimental results supported by the Wilcoxon signed-rank test show that SVM has achieved the highest classification accuracy rate (87.50%), followed by ANN (84.25%), and RF (70%). Accordingly, the proposed automatic approach can be helpful to assist transportation agencies and inspectors in the task of pavement condition assessment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li S, Cao Y, Cai H (2017) Automatic pavement-crack detection and segmentation based on steerable matched filtering and an active contour model. J Comput Civil Eng 31:04017045CrossRef Li S, Cao Y, Cai H (2017) Automatic pavement-crack detection and segmentation based on steerable matched filtering and an active contour model. J Comput Civil Eng 31:04017045CrossRef
2.
Zurück zum Zitat Cubero-Fernandez A, Rodriguez-Lozano FJ, Villatoro R, Olivares J, Palomares JM (2017) Efficient pavement crack detection and classification. EURASIP J Image Video Process 2017:39CrossRef Cubero-Fernandez A, Rodriguez-Lozano FJ, Villatoro R, Olivares J, Palomares JM (2017) Efficient pavement crack detection and classification. EURASIP J Image Video Process 2017:39CrossRef
3.
Zurück zum Zitat Liu P, Otto F, Wang D, Oeser M, Balck H (2017) Measurement and evaluation on deterioration of asphalt pavements by geophones. Measurement 109:223–232CrossRef Liu P, Otto F, Wang D, Oeser M, Balck H (2017) Measurement and evaluation on deterioration of asphalt pavements by geophones. Measurement 109:223–232CrossRef
4.
Zurück zum Zitat Gopalakrishnan K, Khaitan SK, Choudhary A, Agrawal A (2017) Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr Build Mater 157:322–330CrossRef Gopalakrishnan K, Khaitan SK, Choudhary A, Agrawal A (2017) Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr Build Mater 157:322–330CrossRef
5.
Zurück zum Zitat Gavilán M, Balcones D, Marcos O, Llorca DF, Sotelo MA, Parra I, Ocaña M, Aliseda P, Yarza P, Amírola A (2011) Adaptive road crack detection system by pavement classification. Sensors 11:9628CrossRef Gavilán M, Balcones D, Marcos O, Llorca DF, Sotelo MA, Parra I, Ocaña M, Aliseda P, Yarza P, Amírola A (2011) Adaptive road crack detection system by pavement classification. Sensors 11:9628CrossRef
6.
Zurück zum Zitat Ouma YO, Hahn M (2016) Wavelet-morphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification using circular Radon transform. Adv Eng Inform 30:481–499CrossRef Ouma YO, Hahn M (2016) Wavelet-morphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification using circular Radon transform. Adv Eng Inform 30:481–499CrossRef
7.
Zurück zum Zitat Radopoulou SC, Brilakis I (2017) Automated detection of multiple pavement defects. J Comput Civil Eng 31:04016057CrossRef Radopoulou SC, Brilakis I (2017) Automated detection of multiple pavement defects. J Comput Civil Eng 31:04016057CrossRef
8.
Zurück zum Zitat Koch C, Jog GM, Brilakis I (2013) Automated pothole distress assessment using asphalt pavement video data. J Comput Civil Eng 27:370–378CrossRef Koch C, Jog GM, Brilakis I (2013) Automated pothole distress assessment using asphalt pavement video data. J Comput Civil Eng 27:370–378CrossRef
9.
Zurück zum Zitat Tsai Y-C, Jiang C, Huang Y (2014) Multiscale crack fundamental element model for real-world pavement crack classification. J Comput Civil Eng 28:04014012CrossRef Tsai Y-C, Jiang C, Huang Y (2014) Multiscale crack fundamental element model for real-world pavement crack classification. J Comput Civil Eng 28:04014012CrossRef
10.
Zurück zum Zitat Guan H, Li J, Yu Y, Chapman M, Wang H, Wang C, Zhai R (2015) Iterative tensor voting for pavement crack extraction using mobile laser scanning data. IEEE Trans Geosci Remote Sens 53:1527–1537CrossRef Guan H, Li J, Yu Y, Chapman M, Wang H, Wang C, Zhai R (2015) Iterative tensor voting for pavement crack extraction using mobile laser scanning data. IEEE Trans Geosci Remote Sens 53:1527–1537CrossRef
11.
Zurück zum Zitat Kaseko MS, Ritchie SG (1993) A neural network-based methodology for pavement crack detection and classification. Transp Res Part C Emerg Technol 1:275–291CrossRef Kaseko MS, Ritchie SG (1993) A neural network-based methodology for pavement crack detection and classification. Transp Res Part C Emerg Technol 1:275–291CrossRef
12.
Zurück zum Zitat Bishop C (2006) Pattern recognition and machine learning. Springer Science + Business Media, SingaporeMATH Bishop C (2006) Pattern recognition and machine learning. Springer Science + Business Media, SingaporeMATH
13.
Zurück zum Zitat Cheng HD, Miyojim M (1998) Automatic pavement distress detection system. Inf Sci 108:219–240CrossRef Cheng HD, Miyojim M (1998) Automatic pavement distress detection system. Inf Sci 108:219–240CrossRef
14.
Zurück zum Zitat Cheng HD, Chen J-R, Glazier C, Hu YG (1999) Novel approach to pavement cracking detection based on fuzzy set theory. J Comput Civil Eng 13:270–280CrossRef Cheng HD, Chen J-R, Glazier C, Hu YG (1999) Novel approach to pavement cracking detection based on fuzzy set theory. J Comput Civil Eng 13:270–280CrossRef
15.
Zurück zum Zitat Lee H, Kim J (2005) Development of a crack type index, transportation research record. J Transp Res Board 1940:99–109CrossRef Lee H, Kim J (2005) Development of a crack type index, transportation research record. J Transp Res Board 1940:99–109CrossRef
16.
Zurück zum Zitat Jayaraman S, Veerakumar T, Esakkirajan S (2009) Digital image processing. Tata McGraw Hill Education, New York Jayaraman S, Veerakumar T, Esakkirajan S (2009) Digital image processing. Tata McGraw Hill Education, New York
18.
Zurück zum Zitat Kamaliardakani M, Sun L, Ardakani MK (2016) Sealed-crack detection algorithm using heuristic thresholding approach. J Comput Civil Eng 30:04014110CrossRef Kamaliardakani M, Sun L, Ardakani MK (2016) Sealed-crack detection algorithm using heuristic thresholding approach. J Comput Civil Eng 30:04014110CrossRef
19.
Zurück zum Zitat Sun L, Kamaliardakani M, Zhang Y (2016) Weighted neighborhood pixels segmentation method for automated detection of cracks on pavement surface images. J Comput Civil Eng 30:04015021CrossRef Sun L, Kamaliardakani M, Zhang Y (2016) Weighted neighborhood pixels segmentation method for automated detection of cracks on pavement surface images. J Comput Civil Eng 30:04015021CrossRef
20.
Zurück zum Zitat Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Aided Civil Infrastruct Eng 27:29–47CrossRef Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Aided Civil Infrastruct Eng 27:29–47CrossRef
21.
Zurück zum Zitat Zalama E, Gómez-García-Bermejo J, Medina R, Llamas J (2014) Road crack detection using visual features extracted by Gabor filters. Comput Aided Civil Infrastruct Eng 29:342–358CrossRef Zalama E, Gómez-García-Bermejo J, Medina R, Llamas J (2014) Road crack detection using visual features extracted by Gabor filters. Comput Aided Civil Infrastruct Eng 29:342–358CrossRef
22.
Zurück zum Zitat Jiang C, Tsai YJ (2016) Enhanced crack segmentation algorithm using 3D pavement data. J Comput Civil Eng 30:04015050CrossRef Jiang C, Tsai YJ (2016) Enhanced crack segmentation algorithm using 3D pavement data. J Comput Civil Eng 30:04015050CrossRef
23.
Zurück zum Zitat Amhaz R, Chambon S, Idier J, Baltazart V (2016) Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Trans Intell Transp Syst 17:2718–2729CrossRef Amhaz R, Chambon S, Idier J, Baltazart V (2016) Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Trans Intell Transp Syst 17:2718–2729CrossRef
25.
Zurück zum Zitat Ying L, Salari E (2010) Beamlet transform-based technique for pavement crack detection and classification. Comput Aided Civil Infrastruct Eng 25:572–580CrossRef Ying L, Salari E (2010) Beamlet transform-based technique for pavement crack detection and classification. Comput Aided Civil Infrastruct Eng 25:572–580CrossRef
26.
Zurück zum Zitat Sun L, Qian Z (2016) Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification. Measurement 86:26–40CrossRef Sun L, Qian Z (2016) Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification. Measurement 86:26–40CrossRef
27.
Zurück zum Zitat Mokhtari S, Wu L, Yun H-B (2016) Comparison of supervised classification techniques for vision-based pavement crack detection. Transp Res Rec J Transp Res Board 2595:119–127CrossRef Mokhtari S, Wu L, Yun H-B (2016) Comparison of supervised classification techniques for vision-based pavement crack detection. Transp Res Rec J Transp Res Board 2595:119–127CrossRef
28.
Zurück zum Zitat Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29:196–210CrossRef Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29:196–210CrossRef
29.
Zurück zum Zitat Zakeri H, Nejad FM, Fahimifar A (2017) Image based techniques for crack detection, classification and quantification in asphalt pavement: a review. Arch Comput Methods Eng 24:935–977CrossRefMATH Zakeri H, Nejad FM, Fahimifar A (2017) Image based techniques for crack detection, classification and quantification in asphalt pavement: a review. Arch Comput Methods Eng 24:935–977CrossRefMATH
30.
Zurück zum Zitat Coenen TBJ, Golroo A (2017) A review on automated pavement distress detection methods. Cogent Eng 4:1374822CrossRef Coenen TBJ, Golroo A (2017) A review on automated pavement distress detection methods. Cogent Eng 4:1374822CrossRef
31.
Zurück zum Zitat Adelson EH, Freeman WT (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906CrossRef Adelson EH, Freeman WT (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906CrossRef
32.
Zurück zum Zitat Perona P (1995) Deformable kernels for early vision. IEEE Trans Pattern Anal Mach Intell 17:488–499CrossRef Perona P (1995) Deformable kernels for early vision. IEEE Trans Pattern Anal Mach Intell 17:488–499CrossRef
33.
Zurück zum Zitat Freeman WT, Adelson EH (1990) Steerable filters for early vision, image analysis, and wavelet decomposition. In: Proceedings Third International Conference on Computer Vision, Osaka, Japan, IEEE, pp 406–415. https://doi.org/10.1109/ICCV Freeman WT, Adelson EH (1990) Steerable filters for early vision, image analysis, and wavelet decomposition. In: Proceedings Third International Conference on Computer Vision, Osaka, Japan, IEEE, pp 406–415. https://​doi.​org/​10.​1109/​ICCV
34.
Zurück zum Zitat Jacob M, Unser M (2004) Design of steerable filters for feature detection using canny-like criteria. IEEE Trans Pattern Anal Mach Intell 26:1007–1019CrossRef Jacob M, Unser M (2004) Design of steerable filters for feature detection using canny-like criteria. IEEE Trans Pattern Anal Mach Intell 26:1007–1019CrossRef
35.
Zurück zum Zitat Braz J, Ranchordas A, Araújo H, Jorge J (2007) Advances in computer graphics and computer vision. Springer, Berlin, HeidelbergCrossRefMATH Braz J, Ranchordas A, Araújo H, Jorge J (2007) Advances in computer graphics and computer vision. Springer, Berlin, HeidelbergCrossRefMATH
36.
Zurück zum Zitat Otsu N (1979) A threshold selection method from Gray-Level histograms. IEEE Trans Syst Man Cybern 9:62–66CrossRef Otsu N (1979) A threshold selection method from Gray-Level histograms. IEEE Trans Syst Man Cybern 9:62–66CrossRef
37.
Zurück zum Zitat Talab AMA, Huang Z, Xi F, HaiMing L (2016) Detection crack in image using Otsu method and multiple filtering in image processing techniques. Opt Int J Light Electron Opt 127:1030–1033CrossRef Talab AMA, Huang Z, Xi F, HaiMing L (2016) Detection crack in image using Otsu method and multiple filtering in image processing techniques. Opt Int J Light Electron Opt 127:1030–1033CrossRef
38.
Zurück zum Zitat Hoang N-D (2018) Detection of surface crack in building structures using image processing technique with an improved Otsu method for image thresholding. Adv Civil Eng 2018:10 Hoang N-D (2018) Detection of surface crack in building structures using image processing technique with an improved Otsu method for image thresholding. Adv Civil Eng 2018:10
40.
Zurück zum Zitat Pham BT, Tien Bui D, Prakash I, Dholakia MB (2017) Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS. CATENA 149(Part 1):52–63CrossRef Pham BT, Tien Bui D, Prakash I, Dholakia MB (2017) Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS. CATENA 149(Part 1):52–63CrossRef
42.
Zurück zum Zitat Tapas N, Lone T, Reddy D, Kuppili V (2017) Prediction of cardiac arrest recurrence using ensemble classifiers. Sādhanā 42:1135–1141 Tapas N, Lone T, Reddy D, Kuppili V (2017) Prediction of cardiac arrest recurrence using ensemble classifiers. Sādhanā 42:1135–1141
43.
Zurück zum Zitat Pham BT, Khosravi K, Prakash I (2017) Application and comparison of decision tree-based machine learning methods in landside susceptibility assessment at Pauri Garhwal Area. Environmental Processes, UttarakhandCrossRef Pham BT, Khosravi K, Prakash I (2017) Application and comparison of decision tree-based machine learning methods in landside susceptibility assessment at Pauri Garhwal Area. Environmental Processes, UttarakhandCrossRef
44.
Zurück zum Zitat Vapnik VN (1998). Statistical Learning Theory. Wiley, New York. ISBN-10: 0471030031 Vapnik VN (1998). Statistical Learning Theory. Wiley, New York. ISBN-10: 0471030031
45.
Zurück zum Zitat Hamel LH (2009) Knowledge discovery with support vector machines. Wiley, HobokenCrossRef Hamel LH (2009) Knowledge discovery with support vector machines. Wiley, HobokenCrossRef
46.
Zurück zum Zitat Hadjidemetriou GM, Vela PA, Christodoulou SE (2018) Automated pavement patch detection and quantification using support vector machines. J Comput Civil Eng 32:04017073CrossRef Hadjidemetriou GM, Vela PA, Christodoulou SE (2018) Automated pavement patch detection and quantification using support vector machines. J Comput Civil Eng 32:04017073CrossRef
47.
Zurück zum Zitat Duan K-B, Keerthi SS (2005) Which Is the Best Multiclass SVM Method? An empirical study. In: Multiple classifier systems: 6th International Workshop, MCS 2005, Seaside, CA, USA, June 13–15, 2005. Proceedings. Springer, Berlin, Heidelberg, pp 278–285 Duan K-B, Keerthi SS (2005) Which Is the Best Multiclass SVM Method? An empirical study. In: Multiple classifier systems: 6th International Workshop, MCS 2005, Seaside, CA, USA, June 13–15, 2005. Proceedings. Springer, Berlin, Heidelberg, pp 278–285
48.
Zurück zum Zitat Heaton J (2008) Introduction to neural networks for C#. Heaton Research, Inc., Washington Heaton J (2008) Introduction to neural networks for C#. Heaton Research, Inc., Washington
49.
Zurück zum Zitat Hoang N-D, Tien D, Bui (2018) Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study. Bull Eng Geol Env 9:1077–1097 Hoang N-D, Tien D, Bui (2018) Predicting earthquake-induced soil liquefaction based on a hybridization of kernel Fisher discriminant analysis and a least squares support vector machine: a multi-dataset study. Bull Eng Geol Env 9:1077–1097
50.
Zurück zum Zitat Tien Bui D, Hoang ND (2017) A Bayesian framework based on a Gaussian mixture model and radial-basis-function Fisher discriminant analysis (BayGmmKda V1.1) for spatial prediction of floods. Geosci Model Dev 10:3391–3409CrossRef Tien Bui D, Hoang ND (2017) A Bayesian framework based on a Gaussian mixture model and radial-basis-function Fisher discriminant analysis (BayGmmKda V1.1) for spatial prediction of floods. Geosci Model Dev 10:3391–3409CrossRef
Metadaten
Titel
A novel method for asphalt pavement crack classification based on image processing and machine learning
verfasst von
Nhat-Duc Hoang
Quoc-Lam Nguyen
Publikationsdatum
18.04.2018
Verlag
Springer London
Erschienen in
Engineering with Computers / Ausgabe 2/2019
Print ISSN: 0177-0667
Elektronische ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-018-0611-9

Weitere Artikel der Ausgabe 2/2019

Engineering with Computers 2/2019 Zur Ausgabe

Neuer Inhalt