Skip to main content
Erschienen in: Medical & Biological Engineering & Computing 2/2024

01.11.2023 | Original Article

Nuclei detection in breast histopathology images with iterative correction

verfasst von: Ziyi Liu, Yu Cai, Qiling Tang

Erschienen in: Medical & Biological Engineering & Computing | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work presents a deep network architecture to improve nuclei detection performance and achieve the high localization accuracy of nuclei in breast cancer histopathology images. The proposed model consists of two parts, generating nuclear candidate module and refining nuclear localization module. We first design a novel patch learning method to obtain high-quality nuclear candidates, where in addition to categories, location representations are also added to the patch information to implement the multi-task learning process of nuclear classification and localization; meanwhile, the deep supervision mechanism is introduced to obtain the coherent contributions from each scale layer. In order to refine nuclear localization, we propose an iterative correction strategy to make the prediction progressively closer to the ground truth, which significantly improves the accuracy of nuclear localization and facilitates neighbor size selection in the nonmaximum suppression step. Experimental results demonstrate the superior performance of our method for nuclei detection on the H&E stained histopathological image dataset as compared to previous state-of-the-art methods, especially in multiple cluttered nuclei detection, can achieve better results than existing techniques.

Graphical Abstract

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Al-Janabi S, Huisman A, Willems SM, van Diest PJ (2012) Digital slide images for primary diagnostics in breast pathology: a feasibility study. Hum Pathol 43:2318–2325CrossRefPubMed Al-Janabi S, Huisman A, Willems SM, van Diest PJ (2012) Digital slide images for primary diagnostics in breast pathology: a feasibility study. Hum Pathol 43:2318–2325CrossRefPubMed
2.
Zurück zum Zitat Elmore JG, Longton GM, Carney PA et al (2015) Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA - J Am Med Assoc 313(11):1122–1132CrossRef Elmore JG, Longton GM, Carney PA et al (2015) Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA - J Am Med Assoc 313(11):1122–1132CrossRef
3.
Zurück zum Zitat H. Viray, K. Li, T.A. Long., P. Vasalos, et al., A prospective, multi-institutional diagnostic trial to determine pathologist accuracy in estimation of percentage of malignant cells, Arch. Pathol. Lab. Med., vol. 137, no. 11, pp. 1545–1549, 2013. H. Viray, K. Li, T.A. Long., P. Vasalos, et al., A prospective, multi-institutional diagnostic trial to determine pathologist accuracy in estimation of percentage of malignant cells, Arch. Pathol. Lab. Med., vol. 137, no. 11, pp. 1545–1549, 2013.
4.
Zurück zum Zitat Elston CW, Ellis IO (1991) Pathological prognostic factors in breast cancer I The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19(5):403–410CrossRefPubMed Elston CW, Ellis IO (1991) Pathological prognostic factors in breast cancer I The value of histological grade in breast cancer: experience from a large study with long-term follow-up. Histopathology 19(5):403–410CrossRefPubMed
5.
Zurück zum Zitat Zhang X, Liu W, Dundar M, Badve S, Zhang S (2015) Towards largescale histopathological image analysis: hashing-based image retrieval. IEEE Trans Med Imaging 34(2):496–506CrossRefPubMed Zhang X, Liu W, Dundar M, Badve S, Zhang S (2015) Towards largescale histopathological image analysis: hashing-based image retrieval. IEEE Trans Med Imaging 34(2):496–506CrossRefPubMed
6.
Zurück zum Zitat W. Lu, S. Graham, M. Bilal, N. Rajpoot, and F. Minhas, Capturing cellular topology in multi-gigapixel pathology images, in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2020, pp. 1049–1058. W. Lu, S. Graham, M. Bilal, N. Rajpoot, and F. Minhas, Capturing cellular topology in multi-gigapixel pathology images, in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2020, pp. 1049–1058.
7.
Zurück zum Zitat Irshad H, Veillard A, Roux L, Racoceanu D (2014) Methods for nuclei detection, segmentation, and classification in digital histopathology: a review—current status and future potential. IEEE Rev Biomed Eng 7:97–114CrossRefPubMed Irshad H, Veillard A, Roux L, Racoceanu D (2014) Methods for nuclei detection, segmentation, and classification in digital histopathology: a review—current status and future potential. IEEE Rev Biomed Eng 7:97–114CrossRefPubMed
8.
Zurück zum Zitat Nawaz S, Yuan Y (2016) Computational pathology: exploring the spatial dimension of tumor ecology. Cancer Lett 380(1):296–303CrossRefPubMed Nawaz S, Yuan Y (2016) Computational pathology: exploring the spatial dimension of tumor ecology. Cancer Lett 380(1):296–303CrossRefPubMed
9.
Zurück zum Zitat S Ren, K He, R Girshick, J Sun (2015) Faster R-CNN: towards realtime object detection with region proposal networks, in Proc. Adv Neural Inf Process Syst (NIPS) 1: 91-99 S Ren, K He, R Girshick, J Sun (2015) Faster R-CNN: towards realtime object detection with region proposal networks, in Proc. Adv Neural Inf Process Syst (NIPS) 1: 91-99
10.
Zurück zum Zitat S. Yousefi and Y. Nie, Transfer learning from nucleus detection to classification in histopathology images, in Proc. IEEE Int. Symp. Biomed. Imaging (ISBI), 2019, pp. 957–960. S. Yousefi and Y. Nie, Transfer learning from nucleus detection to classification in histopathology images, in Proc. IEEE Int. Symp. Biomed. Imaging (ISBI), 2019, pp. 957–960.
11.
Zurück zum Zitat T. Mahmood, M. Arsalan, M. Owais, M.B. Lee, and K.R. Park (2020) Artificial intelligence-based mitosis detection in breast cancer histopathology images using faster R-CNN and Deep CNNs. J. Clin. Med 9 3. T. Mahmood, M. Arsalan, M. Owais, M.B. Lee, and K.R. Park (2020) Artificial intelligence-based mitosis detection in breast cancer histopathology images using faster R-CNN and Deep CNNs. J. Clin. Med 9 3.
12.
Zurück zum Zitat Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A (2016) Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging 35(1):119–130CrossRefPubMed Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A (2016) Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging 35(1):119–130CrossRefPubMed
13.
Zurück zum Zitat Höfener H, Homeyer A, Weiss N, Molin J, Lundström CF, Hahn HK (2018) Deep learning nuclei detection: a simple approach can deliver state-of-the-art results. Comput Med Imag Grap 70:43–52CrossRef Höfener H, Homeyer A, Weiss N, Molin J, Lundström CF, Hahn HK (2018) Deep learning nuclei detection: a simple approach can deliver state-of-the-art results. Comput Med Imag Grap 70:43–52CrossRef
14.
Zurück zum Zitat Brieu N, Schmidt G (2017) Learning size adaptive local maxima selection for robust nuclei detection in histopathology images. In: Proc IEEE Intl Symp Biomed Imaging, pp 937–941 Brieu N, Schmidt G (2017) Learning size adaptive local maxima selection for robust nuclei detection in histopathology images. In: Proc IEEE Intl Symp Biomed Imaging, pp 937–941
15.
Zurück zum Zitat Chen T, Chefdhotel C (2014) Deep learning based automatic immune cell detection for immunohistochemistry images. In: Proc Intl Workshop Mach Learn Med Imaging, pp 17–24 Chen T, Chefdhotel C (2014) Deep learning based automatic immune cell detection for immunohistochemistry images. In: Proc Intl Workshop Mach Learn Med Imaging, pp 17–24
16.
Zurück zum Zitat Bodla N, Singh B, Chellappa R, Davis LS (2017) Soft-NMS improving object detection with one line of code. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 5562–5570 Bodla N, Singh B, Chellappa R, Davis LS (2017) Soft-NMS improving object detection with one line of code. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 5562–5570
17.
Zurück zum Zitat Tychsen-Smith L, Petersson L (2018) Improving object localization with fitness NMS and bounded IoU loss. In: Proc. IEEE Conf Comput Vis Pattern Recog (CVPR), pp 6877–6885 Tychsen-Smith L, Petersson L (2018) Improving object localization with fitness NMS and bounded IoU loss. In: Proc. IEEE Conf Comput Vis Pattern Recog (CVPR), pp 6877–6885
18.
Zurück zum Zitat Oberweger M, Wohlhart P, Lepetit V (2015) Training a feedback loop for hand pose estimation. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 3316–3324 Oberweger M, Wohlhart P, Lepetit V (2015) Training a feedback loop for hand pose estimation. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 3316–3324
19.
Zurück zum Zitat Carreira J, Agrawal P, Fragkiadaki K, Malik J (2016) Human pose estimation with iterative error feedback. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 4733–4742 Carreira J, Agrawal P, Fragkiadaki K, Malik J (2016) Human pose estimation with iterative error feedback. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 4733–4742
20.
Zurück zum Zitat Xie S, Tu Z (2017) Holistically-nested edge detection. Int J Comput Vis 125(1):3–18CrossRef Xie S, Tu Z (2017) Holistically-nested edge detection. Int J Comput Vis 125(1):3–18CrossRef
21.
Zurück zum Zitat Liu Y, Cheng M-M, Hu X, Bian J-W, Zhang L, Bai X, Tang J (2019) Richer convolutional features for edge detection. IEEE Trans Pattern Anal Mach Intell 41(8):1939–1946CrossRefPubMed Liu Y, Cheng M-M, Hu X, Bian J-W, Zhang L, Bai X, Tang J (2019) Richer convolutional features for edge detection. IEEE Trans Pattern Anal Mach Intell 41(8):1939–1946CrossRefPubMed
22.
Zurück zum Zitat Xie Y, Xing F, Kong X, Su H, Yang L (2015) Beyond classification: structured regression for robust cell detection using convolutional neural network. In: Proc Medical Image Computing and Computer-assisted Intervention (MICCAI), pp 358–365 Xie Y, Xing F, Kong X, Su H, Yang L (2015) Beyond classification: structured regression for robust cell detection using convolutional neural network. In: Proc Medical Image Computing and Computer-assisted Intervention (MICCAI), pp 358–365
23.
Zurück zum Zitat Lu C, Mandal M (2014) Toward automatic mitotic cell detection and segmentation in multispectral histopathological images. IEEE J Biomed Health Inform 18(2):594–605CrossRefPubMed Lu C, Mandal M (2014) Toward automatic mitotic cell detection and segmentation in multispectral histopathological images. IEEE J Biomed Health Inform 18(2):594–605CrossRefPubMed
24.
Zurück zum Zitat Paul A, Mukherjee DP (2015) Mitosis detection for invasive breast cancer grading in histopathological images. IEEE Trans Image Process 24(11):4041–4054CrossRefPubMed Paul A, Mukherjee DP (2015) Mitosis detection for invasive breast cancer grading in histopathological images. IEEE Trans Image Process 24(11):4041–4054CrossRefPubMed
25.
Zurück zum Zitat Sirinukunwattana K, Raza SEA, Tsang Y-W, Snead D, Cree I, Rajpoot N (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 35(5):1196–1206CrossRefPubMed Sirinukunwattana K, Raza SEA, Tsang Y-W, Snead D, Cree I, Rajpoot N (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 35(5):1196–1206CrossRefPubMed
26.
Zurück zum Zitat Ciresan DC, Giusti A, Gambardella LM, Schmidhuber J (2013) Mitosis detection in breast cancer histology images with deep neural networks. In: Proc Medical Image Computing and Computer-assisted Intervention (MICCAI), pp 411–418 Ciresan DC, Giusti A, Gambardella LM, Schmidhuber J (2013) Mitosis detection in breast cancer histology images with deep neural networks. In: Proc Medical Image Computing and Computer-assisted Intervention (MICCAI), pp 411–418
27.
Zurück zum Zitat Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRefPubMed Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRefPubMed
28.
Zurück zum Zitat Graham S, Vu QD, Raza SEA, Azam A, Tsang YW, Kwak JT, Rajpoot N (2019) Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images. Med. Image Anal 58:1–15CrossRef Graham S, Vu QD, Raza SEA, Azam A, Tsang YW, Kwak JT, Rajpoot N (2019) Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images. Med. Image Anal 58:1–15CrossRef
29.
Zurück zum Zitat Chen H, Dou Q, Wang X, Qin J, Heng PA (2016) Mitosis detection in breast cancer histology images via deep cascaded networks. In: Proc AAAI Conf Artificial Intelligence, pp 1160–1166 Chen H, Dou Q, Wang X, Qin J, Heng PA (2016) Mitosis detection in breast cancer histology images via deep cascaded networks. In: Proc AAAI Conf Artificial Intelligence, pp 1160–1166
30.
Zurück zum Zitat Zhang J, Hu H, Chen S, Huang Y, Guan Q (2016) Cancer cells detection in phase-contrast microscopy images based on faster R-CNN. In: Proc Intl Symp Computational Intelligence and Design, pp 363–367 Zhang J, Hu H, Chen S, Huang Y, Guan Q (2016) Cancer cells detection in phase-contrast microscopy images based on faster R-CNN. In: Proc Intl Symp Computational Intelligence and Design, pp 363–367
31.
Zurück zum Zitat Yi J, Wu P, Hoeppner DJ, Metaxas D (2017) Fast neural cell detection using light-weight SSD neural network. In: Proc IEEE Conf Comput Vis Pattern Recog Workshops, pp 108–112 Yi J, Wu P, Hoeppner DJ, Metaxas D (2017) Fast neural cell detection using light-weight SSD neural network. In: Proc IEEE Conf Comput Vis Pattern Recog Workshops, pp 108–112
32.
Zurück zum Zitat Sun Y, Huang X, Zhou H, Zhang Q (2021) SRPN: similarity-based region proposal networks for nuclei and cells detection in histology images. Med Image Anal 72:1–11CrossRef Sun Y, Huang X, Zhou H, Zhang Q (2021) SRPN: similarity-based region proposal networks for nuclei and cells detection in histology images. Med Image Anal 72:1–11CrossRef
34.
Zurück zum Zitat Ciresan D, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep neural networks segment neuronal membranes in electron microscopy images. In: Proc Adv Neural Inf Process Syst (NIPS), pp 2843–2851 Ciresan D, Giusti A, Gambardella LM, Schmidhuber J (2012) Deep neural networks segment neuronal membranes in electron microscopy images. In: Proc Adv Neural Inf Process Syst (NIPS), pp 2843–2851
35.
Zurück zum Zitat Woo S, Park J, Lee JY, Kweon IS (2018) CBAM: convolutional block attention module. In: Proc European Conf Computer Vision (ECCV), pp 3–19 Woo S, Park J, Lee JY, Kweon IS (2018) CBAM: convolutional block attention module. In: Proc European Conf Computer Vision (ECCV), pp 3–19
36.
Zurück zum Zitat Hu J, Shen L, Albanie S, Sun G, Wu E (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023CrossRefPubMed Hu J, Shen L, Albanie S, Sun G, Wu E (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023CrossRefPubMed
37.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: Proc IEEE Intl Conf Computer Vision (ICCV), pp 1026–1034
38.
Zurück zum Zitat Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proc Intl Conf Machine Learning (ICML), pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proc Intl Conf Machine Learning (ICML), pp 448–456
39.
Zurück zum Zitat Song G, Liu Y, Wang X (2020) Revisiting the sibling head in object detector. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 11560–11569 Song G, Liu Y, Wang X (2020) Revisiting the sibling head in object detector. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 11560–11569
40.
Zurück zum Zitat Wu Y, Chen Y, Yuan L, Liu Z, Wang L, Li H, Fu Y (2020) Rethinking classification and localization for object detection. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 10183–10192 Wu Y, Chen Y, Yuan L, Liu Z, Wang L, Li H, Fu Y (2020) Rethinking classification and localization for object detection. In: Proc IEEE Conf Comput Vis Pattern Recog (CVPR), pp 10183–10192
Metadaten
Titel
Nuclei detection in breast histopathology images with iterative correction
verfasst von
Ziyi Liu
Yu Cai
Qiling Tang
Publikationsdatum
01.11.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
Medical & Biological Engineering & Computing / Ausgabe 2/2024
Print ISSN: 0140-0118
Elektronische ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-023-02947-3

Weitere Artikel der Ausgabe 2/2024

Medical & Biological Engineering & Computing 2/2024 Zur Ausgabe

Premium Partner