Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 3/2022

19.01.2022 | Original Article

Colon tissue image segmentation with MWSI-NET

verfasst von: Hao Cheng, Kaijie Wu, Jie Tian, Kai Ma, Chaocheng Gu, Xinping Guan

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Developments in deep learning have resulted in computer-aided diagnosis for many types of cancer. Previously, pathologists manually performed the labeling work in the analysis of colon tissues, which is both time-consuming and labor-intensive. Results are easily affected by subjective conditions. Therefore, it is beneficial to identify the cancerous regions of colon cancer with the assistance of computer-aided technology. Pathological images are often difficult to process due to their irregularity, similarity between cancerous and non-cancerous tissues and large size. We propose a multi-scale perceptual field fusion structure based on a dilated convolutional network. Using this model, a structure of dilated convolution kernels with different aspect ratios is inserted, which can process cancerous regions of different sizes and generate larger receptive fields. Thus, the model can fuse detailed information at different scales for better semantic segmentation. Two different attention mechanisms are adopted to highlight the cancerous areas. A large, open-source dataset was used to verify improved efficacy when compared to previously disclosed methods.

Graphical abstract

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Moini J, Ahangari R, Miller C et al (2020) Obesity and cancer. Global Health Complications of Obesity. pp 109–145CrossRef Moini J, Ahangari R, Miller C et al (2020) Obesity and cancer. Global Health Complications of Obesity. pp 109–145CrossRef
2.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation[J]. IEEE Trans Pattern Anal Mach Intell 39(4):640–651 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation[J]. IEEE Trans Pattern Anal Mach Intell 39(4):640–651
3.
Zurück zum Zitat Chen LC, Papandreou G, Kokkinos I et al (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen LC, Papandreou G, Kokkinos I et al (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
4.
Zurück zum Zitat Chen L C, Papandreou G, Schroff F et al (2017) Rethinking atrous convolution for semantic image segmentation[J]. arXiv preprint arXiv:1706.05587 Chen L C, Papandreou G, Schroff F et al (2017) Rethinking atrous convolution for semantic image segmentation[J]. arXiv preprint arXiv:1706.05587
5.
Zurück zum Zitat Zhao H, Shi J, Qi X et al (2016) Pyramid scene parsing network. IEEE Computer Society, New Jersey Zhao H, Shi J, Qi X et al (2016) Pyramid scene parsing network. IEEE Computer Society, New Jersey
6.
Zurück zum Zitat Peng C, Zhang X, Yu G et al (2017) Large kernel matters—improve semantic segmentation by global convolutional network[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4353–4361 Peng C, Zhang X, Yu G et al (2017) Large kernel matters—improve semantic segmentation by global convolutional network[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4353–4361
7.
Zurück zum Zitat Bing S, Zhen Z, Wang B et al (2018) Scene segmentation with DAG-recurrent neural networks[J]. IEEE Trans Pattern Anal Mach Intell 40(6):1480–1493CrossRef Bing S, Zhen Z, Wang B et al (2018) Scene segmentation with DAG-recurrent neural networks[J]. IEEE Trans Pattern Anal Mach Intell 40(6):1480–1493CrossRef
8.
Zurück zum Zitat Gers FA, Schmidhuber J et al (2000) Learning to forget: continual prediction with LSTM. Neural Comput 12:2451–2471CrossRef Gers FA, Schmidhuber J et al (2000) Learning to forget: continual prediction with LSTM. Neural Comput 12:2451–2471CrossRef
9.
Zurück zum Zitat Zhao X, Wu Y, Song G et al (2017) A deep learning model integrating FCNNs and CRFs for brain tumor segmentation[J]. Med Image Anal 43:98–111CrossRef Zhao X, Wu Y, Song G et al (2017) A deep learning model integrating FCNNs and CRFs for brain tumor segmentation[J]. Med Image Anal 43:98–111CrossRef
10.
Zurück zum Zitat Liu LC, Tsai YH, Chou YC et al (2020) Concordance analysis of intrapartum cardiotocography between physicians and artificial intelligence (AI)-based technique using modified 1D fully convolutional networks (FCN). J Chin Medic Assoc 84:158–164CrossRef Liu LC, Tsai YH, Chou YC et al (2020) Concordance analysis of intrapartum cardiotocography between physicians and artificial intelligence (AI)-based technique using modified 1D fully convolutional networks (FCN). J Chin Medic Assoc 84:158–164CrossRef
11.
Zurück zum Zitat Zhu H, Adeli E, Shi F et al (2020) FCN based label correction for multi-atlas guided organ segmentation. Neuroinformatics 18(3):319–331CrossRef Zhu H, Adeli E, Shi F et al (2020) FCN based label correction for multi-atlas guided organ segmentation. Neuroinformatics 18(3):319–331CrossRef
12.
Zurück zum Zitat Yu F, Koltun V, Funkhouser T (2017) Dilated residual networks. IEEE Computer Society, New JerseyCrossRef Yu F, Koltun V, Funkhouser T (2017) Dilated residual networks. IEEE Computer Society, New JerseyCrossRef
13.
Zurück zum Zitat Lin G, Shen C, Hengel A et al (2016) Efficient piecewise training of deep structured models for semantic segmentation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey Lin G, Shen C, Hengel A et al (2016) Efficient piecewise training of deep structured models for semantic segmentation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey
14.
Zurück zum Zitat Liu S, Qi X, Shi J et al (2016) Multi-scale patch aggregation (MPA) for simultaneous detection and segmentation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey Liu S, Qi X, Shi J et al (2016) Multi-scale patch aggregation (MPA) for simultaneous detection and segmentation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey
15.
Zurück zum Zitat Shuai B, Zuo Z, Wang G et al (2016) DAG-recurrent neural networks for scene labeling. IEEE, New JerseyCrossRef Shuai B, Zuo Z, Wang G et al (2016) DAG-recurrent neural networks for scene labeling. IEEE, New JerseyCrossRef
16.
Zurück zum Zitat Wang B, Zhiqiang C et al (2019) U-net-based blocked artifacts removal method for dynamic computed tomography. Appl Opt 58(14):3748–3753CrossRef Wang B, Zhiqiang C et al (2019) U-net-based blocked artifacts removal method for dynamic computed tomography. Appl Opt 58(14):3748–3753CrossRef
17.
Zurück zum Zitat Volodymyr M, Nicolas H, Alex G et al (2014) Recurrent models of visual attention. Advances in neural information processing systems. pp 2204–2212 Volodymyr M, Nicolas H, Alex G et al (2014) Recurrent models of visual attention. Advances in neural information processing systems. pp 2204–2212
18.
Zurück zum Zitat Lu J, Xiong C, Parikh D et al (2017) Knowing when to look: adaptive attention via a visual sentinel for image captioning. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey Lu J, Xiong C, Parikh D et al (2017) Knowing when to look: adaptive attention via a visual sentinel for image captioning. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey
19.
Zurück zum Zitat Oktay O, Schlemper J, Folgoc LL et al (2018) Attention u-net: learning where to look for the pancreas[J]. arXiv preprint arXiv:1804.03999 Oktay O, Schlemper J, Folgoc LL et al (2018) Attention u-net: learning where to look for the pancreas[J]. arXiv preprint arXiv:1804.03999
20.
Zurück zum Zitat Zhou B, Khosla A, Lapedriza A et al (2016) Learning deep features for discriminative localization. CVPR IEEE Computer Society, New JerseyCrossRef Zhou B, Khosla A, Lapedriza A et al (2016) Learning deep features for discriminative localization. CVPR IEEE Computer Society, New JerseyCrossRef
21.
Zurück zum Zitat Xu K, Ba J, Kiros R et al (2015) Show, attend and tell: neural image caption generation with visual attention. Comput Sci 2015:2048–2057 Xu K, Ba J, Kiros R et al (2015) Show, attend and tell: neural image caption generation with visual attention. Comput Sci 2015:2048–2057
22.
Zurück zum Zitat Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141
23.
Zurück zum Zitat Wang X, Girshick R, Gupta A et al (2018) Non-local neural networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey Wang X, Girshick R, Gupta A et al (2018) Non-local neural networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey
24.
Zurück zum Zitat Fu J, Liu J, Tian H et al (2020) Dual attention network for scene segmentation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey Fu J, Liu J, Tian H et al (2020) Dual attention network for scene segmentation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, New Jersey
25.
Zurück zum Zitat Li X, Ding L, Li W et al (2017) FPGA accelerates deep residual learning for image recognition. 2017 IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC). IEEE, New Jersey Li X, Ding L, Li W et al (2017) FPGA accelerates deep residual learning for image recognition. 2017 IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC). IEEE, New Jersey
26.
Zurück zum Zitat Chen L C, Collins M D, Zhu Y et al (2018) Searching for efficient multi-scale architectures for dense image prediction[J]. arXiv preprint arXiv:1809.04184 Chen L C, Collins M D, Zhu Y et al (2018) Searching for efficient multi-scale architectures for dense image prediction[J]. arXiv preprint arXiv:1809.04184
27.
Zurück zum Zitat Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. 2016 Fourth International Conference on 3D Vision (3DV). IEEE, New Jersey Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. 2016 Fourth International Conference on 3D Vision (3DV). IEEE, New Jersey
Metadaten
Titel
Colon tissue image segmentation with MWSI-NET
verfasst von
Hao Cheng
Kaijie Wu
Jie Tian
Kai Ma
Chaocheng Gu
Xinping Guan
Publikationsdatum
19.01.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 3/2022
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-022-02501-7

Weitere Artikel der Ausgabe 3/2022

Medical & Biological Engineering & Computing 3/2022 Zur Ausgabe

Premium Partner