Skip to main content
Erschienen in: Earth Science Informatics 4/2021

08.07.2021 | Research Article

A deep convolutional neural network for rock fracture image segmentation

verfasst von: Hoon Byun, Jineon Kim, Dongyoung Yoon, Il-Seok Kang, Jae-Joon Song

Erschienen in: Earth Science Informatics | Ausgabe 4/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Accurate recognition of rock fractures is an important problem in rock engineering because fractures greatly influence the mechanical and hydraulic properties of rock structures. However, existing image segmentation methods for identifying rock fractures tend to be limited to handling only very simple fracture images, despite many real cases containing interfering objects or features such as dark surfaces, stripes (e.g., from foliation), infilling materials, scratches, shadows, and vegetation. Here, we propose a novel deep convolutional neural network to construct the first model that is applicable in the field. After selecting U-Net, a simple and powerful network for semantic segmentation, as a baseline network, we tested network architectures by applying atrous convolutions and extra skip connections to develop an optimal network specialized for rock fracture segmentation. The rate of erroneously detecting non-fracture objects or features was reduced by using the atrous convolution module, and more skip connections were appropriately added to increase the detection rate of the actual fractures. The model's performance gradually improved as these new techniques were added to the original model. Contrast-limited adaptive histogram equalization and a fully connected conditional random field were applied before and after the network, respectively, to enhance the model’s performance. Evaluation of the proposed model using raw images of diverse site conditions shows that it can effectively distinguish rock fractures from various interfering objects and features. The source code and pre-trained model can be freely download from GitHub repository (https://​github.​com/​Montherapy/​Rock-fracture-segmentation-with-Tensorflow).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alqahtani N, Armstrong RT, Mostaghimi P (2018) Deep learning convolutional neural networks to predict porous media properties. Society of Petroleum Engineers, In SPE Asia Pacific oil and gas conference and exhibitionCrossRef Alqahtani N, Armstrong RT, Mostaghimi P (2018) Deep learning convolutional neural networks to predict porous media properties. Society of Petroleum Engineers, In SPE Asia Pacific oil and gas conference and exhibitionCrossRef
Zurück zum Zitat Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495CrossRef
Zurück zum Zitat Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
Zurück zum Zitat Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision, ECCV, pp 801–818 Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision, ECCV, pp 801–818
Zurück zum Zitat Cheng G, Guo W (2017) Rock images classification by using deep convolution neural network. IOP Conference Series: J Phys 887:012089 Cheng G, Guo W (2017) Rock images classification by using deep convolution neural network. IOP Conference Series: J Phys 887:012089
Zurück zum Zitat Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1251–1258 Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1251–1258
Zurück zum Zitat Dias LO, Bom CR, Faria EL, Valentín MB, Correia MD, Márcio P, Marcelo P, Coelho JM (2020) Automatic detection of fractures and breakouts patterns in acoustic borehole image logs using fast-region convolutional neural networks. J Petrol Sci Eng 191:107099 Dias LO, Bom CR, Faria EL, Valentín MB, Correia MD, Márcio P, Marcelo P, Coelho JM (2020) Automatic detection of fractures and breakouts patterns in acoustic borehole image logs using fast-region convolutional neural networks. J Petrol Sci Eng 191:107099
Zurück zum Zitat Ferreira A, Giraldi G (2017) Convolutional Neural Network approaches to granite tiles classification. Expert Syst Appl 84:1–11CrossRef Ferreira A, Giraldi G (2017) Convolutional Neural Network approaches to granite tiles classification. Expert Syst Appl 84:1–11CrossRef
Zurück zum Zitat Gonzalez RC, Woods RE (2002) Digital image processing, 2nd edn. Prentice Hall, New Jersey Gonzalez RC, Woods RE (2002) Digital image processing, 2nd edn. Prentice Hall, New Jersey
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015a) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef He K, Zhang X, Ren S, Sun J (2015a) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015b) Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015b) Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 1026–1034
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 770–778
Zurück zum Zitat He M, Zhang Z, Ren J, Huan J, Li G, Chen Y, Li, (2019) Deep convolutional neural network for fast determination of the rock strength parameters using drilling data. Int J Rock Mech Min Sci 123:104084CrossRef He M, Zhang Z, Ren J, Huan J, Li G, Chen Y, Li, (2019) Deep convolutional neural network for fast determination of the rock strength parameters using drilling data. Int J Rock Mech Min Sci 123:104084CrossRef
Zurück zum Zitat Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 7132–7141
Zurück zum Zitat Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 4700–4708 Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 4700–4708
Zurück zum Zitat Hummel R (1977) Image enhancement by histogram transformation. Comp Graph Image Process 6:184–195 Hummel R (1977) Image enhancement by histogram transformation. Comp Graph Image Process 6:184–195
Zurück zum Zitat Kamrava S, Tahmasebi P, Sahimi M (2019) Enhancing images of shale formations by a hybrid stochastic and deep learning algorithm. Neural Netw 118:310–320CrossRef Kamrava S, Tahmasebi P, Sahimi M (2019) Enhancing images of shale formations by a hybrid stochastic and deep learning algorithm. Neural Netw 118:310–320CrossRef
Zurück zum Zitat Karimpouli S, Tahmasebi P (2019a) Image-based velocity estimation of rock using Convolutional Neural Networks. Neural Netw 111:89–97CrossRef Karimpouli S, Tahmasebi P (2019a) Image-based velocity estimation of rock using Convolutional Neural Networks. Neural Netw 111:89–97CrossRef
Zurück zum Zitat Karimpouli S, Tahmasebi P (2019b) Segmentation of digital rock images using deep convolutional autoencoder networks. Comput Geosci 126:142–150CrossRef Karimpouli S, Tahmasebi P (2019b) Segmentation of digital rock images using deep convolutional autoencoder networks. Comput Geosci 126:142–150CrossRef
Zurück zum Zitat Karimpouli S, Tahmasebi P, Saenger EH (2020) Coal cleat/fracture segmentation using convolutional neural networks. Nat Resour Res 29(3):1675–1685CrossRef Karimpouli S, Tahmasebi P, Saenger EH (2020) Coal cleat/fracture segmentation using convolutional neural networks. Nat Resour Res 29(3):1675–1685CrossRef
Zurück zum Zitat Krähenbühl P, Koltun V (2011) Efficient inference in fully connected crfs with gaussian edge potentials. In: Advances in neural information processing systems, NIPS, pp 109–117 Krähenbühl P, Koltun V (2011) Efficient inference in fully connected crfs with gaussian edge potentials. In: Advances in neural information processing systems, NIPS, pp 109–117
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, NIPS, pp 1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, NIPS, pp 1097–1105
Zurück zum Zitat Lemy F, Hadjigeorgiou J (2003) Discontinuity trace map construction using photographs of rock exposures. Int J Rock Mech Min Sci 40(6):903–917CrossRef Lemy F, Hadjigeorgiou J (2003) Discontinuity trace map construction using photographs of rock exposures. Int J Rock Mech Min Sci 40(6):903–917CrossRef
Zurück zum Zitat Li H, Qian X, Li W (2016) Image semantic segmentation based on fully convolutional neural network and CRF. In: International conference on geo-informatics in resource management and sustainable ecosystem, GRMSE, pp 245–250 Li H, Qian X, Li W (2016) Image semantic segmentation based on fully convolutional  neural network and CRF. In: International conference on geo-informatics in resource management and sustainable ecosystem, GRMSE, pp 245–250
Zurück zum Zitat Liang Y (2016) Rock fracture skeleton tracing by image processing and quantitative analysis by geometry features. J Geophys Eng 13(3):273–284CrossRef Liang Y (2016) Rock fracture skeleton tracing by image processing and quantitative analysis by geometry features. J Geophys Eng 13(3):273–284CrossRef
Zurück zum Zitat Lin G, Milan A, Shen C, Reid I (2017) Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1925–1934 Lin G, Milan A, Shen C, Reid I (2017) Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1925–1934
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 3431–3440
Zurück zum Zitat Lu F, Fu C, Zhang G, Zhang W, Xie Y, Li Z (2020) Convolution neural network based on fusion parallel multiscale features for segmenting fractures in coal-rock images. J Electron 29(2):023008 Lu F, Fu C, Zhang G, Zhang W, Xie Y, Li Z (2020) Convolution neural network based on fusion parallel multiscale features for segmenting fractures in coal-rock images. J Electron 29(2):023008
Zurück zum Zitat McCarter MK (1976) Application of plane photogrammetry to open pit mapping. Snowbird, Society of Mining Engineers of AIME, US Symposium on Rock mechanics, pp 93–98 McCarter MK (1976) Application of plane photogrammetry to open pit mapping. Snowbird, Society of Mining Engineers of AIME, US Symposium on Rock mechanics, pp 93–98
Zurück zum Zitat Mohebbi M, Yarahmadi Bafghi AR, Fatehi Marji M, Gholamnejad J (2017) Rock mass structural data analysis using image processing techniques (Case study: Choghart iron ore mine northern slopes). J Min Environ 8(1):61–74 Mohebbi M, Yarahmadi Bafghi AR, Fatehi Marji M, Gholamnejad J (2017) Rock mass structural data analysis using image processing techniques (Case study: Choghart iron ore mine northern slopes). J Min Environ 8(1):61–74
Zurück zum Zitat Nair V, Hinton, GE (2010) Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning, ICML, pp 807–814 Nair V, Hinton, GE (2010) Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning, ICML, pp 807–814
Zurück zum Zitat Nishad PM (2013) Various colour spaces and colour space conversion. J Glob Res Comput Sci 4(1):44–48 Nishad PM (2013) Various colour spaces and colour space conversion. J Glob Res Comput Sci 4(1):44–48
Zurück zum Zitat Pascanu R, Mikolov T, Bengio Y (2013) On the difficulty of training recurrent neural networks. In: International conference on machine learning, ICML, pp 1310–1318 Pascanu R, Mikolov T, Bengio Y (2013) On the difficulty of training recurrent neural networks. In: International conference on machine learning, ICML, pp 1310–1318
Zurück zum Zitat Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, Romeny B, Zimmerman J, Zuiderveld K (1987) Adaptive histogram equalization and its variations. Comput vis Graph Image Process 39(3):355–368CrossRef Pizer SM, Amburn EP, Austin JD, Cromartie R, Geselowitz A, Greer T, Romeny B, Zimmerman J, Zuiderveld K (1987) Adaptive histogram equalization and its variations. Comput vis Graph Image Process 39(3):355–368CrossRef
Zurück zum Zitat Reid TR, Harrison JP (2000) A semi-automated methodology for discontinuity trace detection in digital images of rock mass exposures. Int J Rock Mech Min Sci 37(7):1073–1089CrossRef Reid TR, Harrison JP (2000) A semi-automated methodology for discontinuity trace detection in digital images of rock mass exposures. Int J Rock Mech Min Sci 37(7):1073–1089CrossRef
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, MICCAI, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, MICCAI, pp 234–241
Zurück zum Zitat Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput vis 115(3):211–252CrossRef Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput vis 115(3):211–252CrossRef
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1–9
Zurück zum Zitat Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 4799–4807 Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 4799–4807
Zurück zum Zitat Valentín MB, Bom CR, Coelho JM, Correia MD, Márcio P, Marcelo P, Faria EL (2019) A deep residual convolutional neural network for automatic lithological facies identification in Brazilian pre-salt oilfield wellbore image logs. J Petrol Sci Eng 179:474–503CrossRef Valentín MB, Bom CR, Coelho JM, Correia MD, Márcio P, Marcelo P, Faria EL (2019) A deep residual convolutional neural network for automatic lithological facies identification in Brazilian pre-salt oilfield wellbore image logs. J Petrol Sci Eng 179:474–503CrossRef
Zurück zum Zitat Valsecchi A, Damas S, Tubilleja C, Arechalde J (2020) Stochastic reconstruction of 3D porous media from 2D images using generative adversarial networks. Neurocomputing 399:227–236CrossRef Valsecchi A, Damas S, Tubilleja C, Arechalde J (2020) Stochastic reconstruction of 3D porous media from 2D images using generative adversarial networks. Neurocomputing 399:227–236CrossRef
Zurück zum Zitat Wang W (2005) An edge based segmentation algorithm for rock fracture tracing. In: International conference on computer graphics, imaging and visualization, CGIV, pp 43–48 Wang W (2005) An edge based segmentation algorithm for rock fracture tracing. In: International conference on computer graphics, imaging and visualization, CGIV, pp 43–48
Zurück zum Zitat Wang WX, Li WS, Yu X (2012) Fractional differential algorithms for rock fracture images. Imaging Sci J 60(2):103–111CrossRef Wang WX, Li WS, Yu X (2012) Fractional differential algorithms for rock fracture images. Imaging Sci J 60(2):103–111CrossRef
Zurück zum Zitat Wang W, Liao H, Huang Y (2007) Rock fracture tracing based on image processing and SVM. In: Third international conference on natural computation, ICNC, pp 632–635 Wang W, Liao H, Huang Y (2007) Rock fracture tracing based on image processing and SVM. In: Third international conference on natural computation, ICNC, pp 632–635
Zurück zum Zitat Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1492–1500 Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 1492–1500
Zurück zum Zitat Xie S, Tu Z (2015) Holistically-nested edge detection. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 1395–1403 Xie S, Tu Z (2015) Holistically-nested edge detection. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 1395–1403
Zurück zum Zitat Zhang W, Wu T, Li Z, Liu S, Qiu A, Li Y, Shi Y (2021) Fracture recognition in ultrasonic logging images via unsupervised segmentation network. Earth Sci Inform 14(2):955–964CrossRef Zhang W, Wu T, Li Z, Liu S, Qiu A, Li Y, Shi Y (2021) Fracture recognition in ultrasonic logging images via unsupervised segmentation network. Earth Sci Inform 14(2):955–964CrossRef
Metadaten
Titel
A deep convolutional neural network for rock fracture image segmentation
verfasst von
Hoon Byun
Jineon Kim
Dongyoung Yoon
Il-Seok Kang
Jae-Joon Song
Publikationsdatum
08.07.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Earth Science Informatics / Ausgabe 4/2021
Print ISSN: 1865-0473
Elektronische ISSN: 1865-0481
DOI
https://doi.org/10.1007/s12145-021-00650-1

Weitere Artikel der Ausgabe 4/2021

Earth Science Informatics 4/2021 Zur Ausgabe

Premium Partner