Skip to main content

2023 | OriginalPaper | Buchkapitel

Breast Cancer Histologic Grade Identification by Graph Neural Network Embeddings

verfasst von : Salvatore Calderaro, Giosué Lo Bosco, Filippo Vella, Riccardo Rizzo

Erschienen in: Bioinformatics and Biomedical Engineering

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep neural networks are nowadays state-of-the-art methodologies for general-purpose image classification. As a consequence, such approaches are also employed in the context of histopathology biopsy image classification. This specific task is usually performed by separating the image into patches, giving them as input to the Deep Model and evaluating the single sub-part outputs. This approach has the main drawback of not considering the global structure of the input image and can lead to avoiding the discovery of relevant patterns among non-overlapping patches. Differently from this commonly adopted assumption, in this paper, we propose to face the problem by representing the input into a proper embedding resulting from a graph representation built from the tissue regions of the image. This graph representation is capable of maintaining the image structure and considering the relations among its relevant parts. The effectiveness of this representation is shown in the case of automatic tumor grading identification of breast cancer, using public available datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous distributed systems. CoRR abs/1603.04467 (2016) Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous distributed systems. CoRR abs/1603.04467 (2016)
2.
Zurück zum Zitat Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRefPubMed Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRefPubMed
4.
Zurück zum Zitat Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Fuzzy clustering of histopathological images using deep learning embeddings. In: CEUR Workshop Proceedings, vol. 3074 (2021) Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Fuzzy clustering of histopathological images using deep learning embeddings. In: CEUR Workshop Proceedings, vol. 3074 (2021)
5.
Zurück zum Zitat Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Deep metric learning for histopathological image classification. In: 2022 IEEE Eighth International Conference on Multimedia Big Data (BigMM), pp. 57–64 (2022) Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Deep metric learning for histopathological image classification. In: 2022 IEEE Eighth International Conference on Multimedia Big Data (BigMM), pp. 57–64 (2022)
6.
Zurück zum Zitat Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Deep metric learning for transparent classification of COVID-19 X-Ray images. In: 2022 16TH International Conference On Signal Image Technology & Internet Based Systems (SITIS) (2022) Calderaro, S., Lo Bosco, G., Rizzo, R., Vella, F.: Deep metric learning for transparent classification of COVID-19 X-Ray images. In: 2022 16TH International Conference On Signal Image Technology & Internet Based Systems (SITIS) (2022)
7.
Zurück zum Zitat Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
8.
Zurück zum Zitat Dimitropoulos, K., Barmpoutis, P., Zioga, C., Kamas, A., Patsiaoura, K., Grammalidis, N.: Grading of invasive breast carcinoma through Grassmannian VLAD encoding. PLoS ONE 12(9), e0185110 (2017)CrossRefPubMedPubMedCentral Dimitropoulos, K., Barmpoutis, P., Zioga, C., Kamas, A., Patsiaoura, K., Grammalidis, N.: Grading of invasive breast carcinoma through Grassmannian VLAD encoding. PLoS ONE 12(9), e0185110 (2017)CrossRefPubMedPubMedCentral
9.
Zurück zum Zitat Elston, C.W., Ellis, I.O.: Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19(5), 403–410 (1991) Elston, C.W., Ellis, I.O.: Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19(5), 403–410 (1991)
10.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
11.
Zurück zum Zitat Huang, G., Liu, Z., Weinberger, K.Q.: Densely connected convolutional networks. CoRR abs/1608.06993 (2016) Huang, G., Liu, Z., Weinberger, K.Q.: Densely connected convolutional networks. CoRR abs/1608.06993 (2016)
12.
Zurück zum Zitat Jaroensri, R., et al.: Deep learning models for histologic grading of breast cancer and association with disease prognosis. NPJ Breast Cancer 8(1), 1–12 (2022)CrossRef Jaroensri, R., et al.: Deep learning models for histologic grading of breast cancer and association with disease prognosis. NPJ Breast Cancer 8(1), 1–12 (2022)CrossRef
13.
Zurück zum Zitat Jaume, G., Pati, P., Anklin, V., Foncubierta, A., Gabrani, M.: HistoCartography: a toolkit for graph analytics in digital pathology. In: MICCAI Workshop on Computational Pathology, pp. 117–128 (2021) Jaume, G., Pati, P., Anklin, V., Foncubierta, A., Gabrani, M.: HistoCartography: a toolkit for graph analytics in digital pathology. In: MICCAI Workshop on Computational Pathology, pp. 117–128 (2021)
14.
Zurück zum Zitat Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. CoRR abs/1412.6980 (2014) Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. CoRR abs/1412.6980 (2014)
15.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks (2016) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks (2016)
16.
Zurück zum Zitat Li, L., et al.: Multi-task deep learning for fine-grained classification and grading in breast cancer histopathological images. Multimed. Tools Appl. 79(21), 14509–14528 (2020)CrossRef Li, L., et al.: Multi-task deep learning for fine-grained classification and grading in breast cancer histopathological images. Multimed. Tools Appl. 79(21), 14509–14528 (2020)CrossRef
17.
Zurück zum Zitat McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction. CoRR abs/1802.03426 (2018) McInnes, L., Healy, J., Melville, J.: UMAP: uniform manifold approximation and projection for dimension reduction. CoRR abs/1802.03426 (2018)
18.
Zurück zum Zitat Nanni, L., Maguolo, G., Lumini, A.: Exploiting Adam-like optimization algorithms to improve the performance of convolutional neural networks. CoRR abs/2103.14689 (2021) Nanni, L., Maguolo, G., Lumini, A.: Exploiting Adam-like optimization algorithms to improve the performance of convolutional neural networks. CoRR abs/2103.14689 (2021)
19.
Zurück zum Zitat Paszke, A., Gross, et al.: Pytorch: An imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems, vol. 32 (2019) Paszke, A., Gross, et al.: Pytorch: An imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
20.
Zurück zum Zitat Pati, P., et al.: Hierarchical graph representations in digital pathology. Med. Image Anal. 75, 102264 (2022)CrossRefPubMed Pati, P., et al.: Hierarchical graph representations in digital pathology. Med. Image Anal. 75, 102264 (2022)CrossRefPubMed
21.
Zurück zum Zitat Potjer, F.K.: Region adjacency graphs and connected morphological operators. In: Mathematical Morphology and its Applications to Image and Signal Processing, pp. 111–118. Computational Imaging and Vision (1996) Potjer, F.K.: Region adjacency graphs and connected morphological operators. In: Mathematical Morphology and its Applications to Image and Signal Processing, pp. 111–118. Computational Imaging and Vision (1996)
22.
Zurück zum Zitat Senousy, Z., Abdelsamea, M.M., Mohamed, M.M., Gaber, M.M.: 3E-Net: entropy-based elastic ensemble of deep convolutional neural networks for grading of invasive breast carcinoma histopathological microscopic images. Entropy 23(5), 620 (2021)CrossRefPubMedPubMedCentral Senousy, Z., Abdelsamea, M.M., Mohamed, M.M., Gaber, M.M.: 3E-Net: entropy-based elastic ensemble of deep convolutional neural networks for grading of invasive breast carcinoma histopathological microscopic images. Entropy 23(5), 620 (2021)CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Wang, M., et al.: Deep graph library: a graph-centric, highly-performant package for graph neural networks. arXiv preprint arXiv:1909.01315 (2019) Wang, M., et al.: Deep graph library: a graph-centric, highly-performant package for graph neural networks. arXiv preprint arXiv:​1909.​01315 (2019)
25.
Zurück zum Zitat Wang, Y., et al.: Improved breast cancer histological grading using deep learning. Ann. Oncol. 33(1), 89–98 (2022)CrossRefPubMed Wang, Y., et al.: Improved breast cancer histological grading using deep learning. Ann. Oncol. 33(1), 89–98 (2022)CrossRefPubMed
26.
Zurück zum Zitat Xu, K., Hu, W., Leskovec, J., Jegelka, S.: How powerful are graph neural networks? CoRR abs/1810.00826 (2018) Xu, K., Hu, W., Leskovec, J., Jegelka, S.: How powerful are graph neural networks? CoRR abs/1810.00826 (2018)
28.
Zurück zum Zitat Yan, R., Yang, Z., Li, J., Zheng, C., Zhang, F.: Divide-and-attention network for he-stained pathological image classification. Biology 11(7), 982 (2022)CrossRefPubMedPubMedCentral Yan, R., Yang, Z., Li, J., Zheng, C., Zhang, F.: Divide-and-attention network for he-stained pathological image classification. Biology 11(7), 982 (2022)CrossRefPubMedPubMedCentral
Metadaten
Titel
Breast Cancer Histologic Grade Identification by Graph Neural Network Embeddings
verfasst von
Salvatore Calderaro
Giosué Lo Bosco
Filippo Vella
Riccardo Rizzo
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-34960-7_20

Premium Partner