Skip to main content

2019 | OriginalPaper | Buchkapitel

8. Deep Reinforcement Learning for Detecting Breast Lesions from DCE-MRI

verfasst von : Gabriel Maicas, Andrew P. Bradley, Jacinto C. Nascimento, Ian Reid, Gustavo Carneiro

Erschienen in: Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a detection model that is capable of accelerating the inference time of lesion detection from breast dynamically contrast-enhanced magnetic resonance images (DCE-MRI) at state-of-the-art accuracy. In contrast to previous methods based on computationally expensive exhaustive search strategies, our method reduces the inference time with a search approach that gradually focuses on lesions by progressively transforming a bounding volume until the lesion is detected. Such detection model is trained with reinforcement learning and is modeled by a deep Q-network (DQN) that iteratively outputs the next transformation to the current bounding volume. We evaluate our proposed approach in a breast MRI data set containing the T1-weighted and the first DCE-MRI subtraction volume from 117 patients and a total of 142 lesions. Results show that our proposed reinforcement learning based detection model reaches a true positive rate (TPR) of 0.8 at around three false positive detections and a speedup of at least 1.78 times compared to baselines methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Siegel RL, Miller KD, Jemal A (2019) Cancer statistics, 2019. CA Cancer J Clin 69(1):7–34CrossRef Siegel RL, Miller KD, Jemal A (2019) Cancer statistics, 2019. CA Cancer J Clin 69(1):7–34CrossRef
2.
Zurück zum Zitat Siegel RL, Miller KD, Jemal A (2017) Cancer statistics, 2017. CA Cancer J Clin 67(1):7–30CrossRef Siegel RL, Miller KD, Jemal A (2017) Cancer statistics, 2017. CA Cancer J Clin 67(1):7–30CrossRef
3.
Zurück zum Zitat Siegel RL, Miller KD, Jemal A (2016) Cancer statistics, 2016. CA: Cancer J Clin 66(1):7–30 Siegel RL, Miller KD, Jemal A (2016) Cancer statistics, 2016. CA: Cancer J Clin 66(1):7–30
4.
Zurück zum Zitat Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 68(6):394–424 Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 68(6):394–424
5.
Zurück zum Zitat Smith RA, DeSantis CE (2018) Breast cancer epidemiology. Breast imaging Smith RA, DeSantis CE (2018) Breast cancer epidemiology. Breast imaging
6.
Zurück zum Zitat Lauby-Secretan B, Scoccianti C, Loomis D, Benbrahim-Tallaa L, Bouvard V, Bianchini F, Straif K (2015) Breast cancer screening-viewpoint of the IARC working group. N Engl J Med 372(24):2353–2358CrossRef Lauby-Secretan B, Scoccianti C, Loomis D, Benbrahim-Tallaa L, Bouvard V, Bianchini F, Straif K (2015) Breast cancer screening-viewpoint of the IARC working group. N Engl J Med 372(24):2353–2358CrossRef
7.
Zurück zum Zitat Carter CL, Allen C, Henson DE (1989) Relation of tumor size, lymph node status, and survival in 24,740 breast cancer cases. Cancer 63(1):181–187CrossRef Carter CL, Allen C, Henson DE (1989) Relation of tumor size, lymph node status, and survival in 24,740 breast cancer cases. Cancer 63(1):181–187CrossRef
8.
Zurück zum Zitat Park JH, Anderson WF, Gail MH (2015) Improvements in US breast cancer survival and proportion explained by tumor size and estrogen-receptor status. J Clin Oncol 33(26):2870CrossRef Park JH, Anderson WF, Gail MH (2015) Improvements in US breast cancer survival and proportion explained by tumor size and estrogen-receptor status. J Clin Oncol 33(26):2870CrossRef
9.
Zurück zum Zitat Siu AL (2016) Screening for breast cancer: US preventive services task force recommendation statement. Ann Intern Med 164(4):279–296CrossRef Siu AL (2016) Screening for breast cancer: US preventive services task force recommendation statement. Ann Intern Med 164(4):279–296CrossRef
10.
Zurück zum Zitat Kuhl CK, Strobel K, Bieling H, Leutner C, Schild HH, Schrading S (2017) Supplemental breast MR imaging screening of women with average risk of breast cancer. Radiology 283(2):361–370CrossRef Kuhl CK, Strobel K, Bieling H, Leutner C, Schild HH, Schrading S (2017) Supplemental breast MR imaging screening of women with average risk of breast cancer. Radiology 283(2):361–370CrossRef
11.
Zurück zum Zitat Weigel S, Heindel W, Heidrich J, Hense HW, Heidinger O (2017) Digital mammography screening: sensitivity of the programme dependent on breast density. Eur Radiol 27(7):2744–2751CrossRef Weigel S, Heindel W, Heidrich J, Hense HW, Heidinger O (2017) Digital mammography screening: sensitivity of the programme dependent on breast density. Eur Radiol 27(7):2744–2751CrossRef
12.
Zurück zum Zitat Saslow D, Boetes C, Burke W, Harms S, Leach MO, Lehman CD, Morris E, Pisano E, Schnall M, Sener S et al (2007) American cancer society guidelines for breast screening with MRI as an adjunct to mammography. CA Cancer J Clin 57(2):75–89CrossRef Saslow D, Boetes C, Burke W, Harms S, Leach MO, Lehman CD, Morris E, Pisano E, Schnall M, Sener S et al (2007) American cancer society guidelines for breast screening with MRI as an adjunct to mammography. CA Cancer J Clin 57(2):75–89CrossRef
13.
Zurück zum Zitat Mainiero MB, Moy L, Baron P, Didwania AD, Green ED, Heller SL, Holbrook AI, Lee SJ, Lewin AA, Lourenco AP et al (2017) ACR appropriateness criteria® breast cancer screening. J Am CollE Radiol 14(11):S383–S390CrossRef Mainiero MB, Moy L, Baron P, Didwania AD, Green ED, Heller SL, Holbrook AI, Lee SJ, Lewin AA, Lourenco AP et al (2017) ACR appropriateness criteria® breast cancer screening. J Am CollE Radiol 14(11):S383–S390CrossRef
14.
Zurück zum Zitat Seely J, Alhassan T (2018) Screening for breast cancer in 2018-what should we be doing today? Curr Oncol 25(Suppl 1):S115CrossRef Seely J, Alhassan T (2018) Screening for breast cancer in 2018-what should we be doing today? Curr Oncol 25(Suppl 1):S115CrossRef
15.
Zurück zum Zitat Grimm LJ, Anderson AL, Baker JA, Johnson KS, Walsh R, Yoon SC, Ghate SV (2015) Interobserver variability between breast imagers using the fifth edition of the BI-RADS MRI lexicon. Am J Roentgenol 204(5):1120–1124CrossRef Grimm LJ, Anderson AL, Baker JA, Johnson KS, Walsh R, Yoon SC, Ghate SV (2015) Interobserver variability between breast imagers using the fifth edition of the BI-RADS MRI lexicon. Am J Roentgenol 204(5):1120–1124CrossRef
16.
Zurück zum Zitat Yamaguchi K, Schacht D, Newstead GM, Bradbury AR, Verp MS, Olopade OI, Abe H (2013) Breast cancer detected on an incident (second or subsequent) round of screening MRI: MRI features of false-negative cases. Am J Roentgenol 201(5):1155–1163CrossRef Yamaguchi K, Schacht D, Newstead GM, Bradbury AR, Verp MS, Olopade OI, Abe H (2013) Breast cancer detected on an incident (second or subsequent) round of screening MRI: MRI features of false-negative cases. Am J Roentgenol 201(5):1155–1163CrossRef
17.
Zurück zum Zitat Vreemann S, Gubern-Merida A, Lardenoije S, Bult P, Karssemeijer N, Pinker K, Mann R (2018) The frequency of missed breast cancers in women participating in a high-risk MRI screening program. Breast Cancer Res Treat 169(2):323–331CrossRef Vreemann S, Gubern-Merida A, Lardenoije S, Bult P, Karssemeijer N, Pinker K, Mann R (2018) The frequency of missed breast cancers in women participating in a high-risk MRI screening program. Breast Cancer Res Treat 169(2):323–331CrossRef
18.
Zurück zum Zitat Meeuwis C, van de Ven SM, Stapper G, Gallardo AMF, van den Bosch MA, Willem PTM, Veldhuis WB (2010) Computer-aided detection (CAD) for breast MRI: evaluation of efficacy at 3.0 T. Eur Radiol 20(3):522–528CrossRef Meeuwis C, van de Ven SM, Stapper G, Gallardo AMF, van den Bosch MA, Willem PTM, Veldhuis WB (2010) Computer-aided detection (CAD) for breast MRI: evaluation of efficacy at 3.0 T. Eur Radiol 20(3):522–528CrossRef
19.
Zurück zum Zitat Maicas G, Bradley AP, Nascimento JC, Reid I, Carneiro G (2018) Pre and post-hoc diagnosis and interpretation of malignancy from breast DCE-MRI. arXiv:1809.09404 Maicas G, Bradley AP, Nascimento JC, Reid I, Carneiro G (2018) Pre and post-hoc diagnosis and interpretation of malignancy from breast DCE-MRI. arXiv:​1809.​09404
20.
Zurück zum Zitat Vignati A, Giannini V, De Luca M, Morra L, Persano D, Carbonaro LA, Bertotto I, Martincich L, Regge D, Bert A et al (2011) Performance of a fully automatic lesion detection system for breast DCE-MRI. J Magn Reson Imaging 34(6):1341–1351CrossRef Vignati A, Giannini V, De Luca M, Morra L, Persano D, Carbonaro LA, Bertotto I, Martincich L, Regge D, Bert A et al (2011) Performance of a fully automatic lesion detection system for breast DCE-MRI. J Magn Reson Imaging 34(6):1341–1351CrossRef
21.
Zurück zum Zitat Gubern-Mérida A, Martí R, Melendez J, Hauth JL, Mann RM, Karssemeijer N, Platel B (2015) Automated localization of breast cancer in DCE-MRI. Med Image Anal 20(1):265–274CrossRef Gubern-Mérida A, Martí R, Melendez J, Hauth JL, Mann RM, Karssemeijer N, Platel B (2015) Automated localization of breast cancer in DCE-MRI. Med Image Anal 20(1):265–274CrossRef
22.
Zurück zum Zitat McClymont D, Mehnert A, Trakic A, Kennedy D, Crozier S (2014) Fully automatic lesion segmentation in breast MRI using mean-shift and graph-cuts on a region adjacency graph. J Magn Reson Imaging 39(4):795–804CrossRef McClymont D, Mehnert A, Trakic A, Kennedy D, Crozier S (2014) Fully automatic lesion segmentation in breast MRI using mean-shift and graph-cuts on a region adjacency graph. J Magn Reson Imaging 39(4):795–804CrossRef
23.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99
24.
Zurück zum Zitat Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: single shot multibox detector. In: European conference on computer vision, pp 21–37. Springer Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: single shot multibox detector. In: European conference on computer vision, pp 21–37. Springer
25.
Zurück zum Zitat Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
26.
Zurück zum Zitat Ribli D, Horváth A, Unger Z, Pollner P, Csabai I (2018) Detecting and classifying lesions in mammograms with deep learning. Sci Rep 8(1):4165CrossRef Ribli D, Horváth A, Unger Z, Pollner P, Csabai I (2018) Detecting and classifying lesions in mammograms with deep learning. Sci Rep 8(1):4165CrossRef
27.
Zurück zum Zitat Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529CrossRef Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529CrossRef
28.
Zurück zum Zitat Renz DM, Böttcher J, Diekmann F, Poellinger A, Maurer MH, Pfeil A, Streitparth F, Collettini F, Bick U, Hamm B et al (2012) Detection and classification of contrast-enhancing masses by a fully automatic computer-assisted diagnosis system for breast MRI. J Magn Reson Imaging 35(5):1077–1088CrossRef Renz DM, Böttcher J, Diekmann F, Poellinger A, Maurer MH, Pfeil A, Streitparth F, Collettini F, Bick U, Hamm B et al (2012) Detection and classification of contrast-enhancing masses by a fully automatic computer-assisted diagnosis system for breast MRI. J Magn Reson Imaging 35(5):1077–1088CrossRef
29.
Zurück zum Zitat Amit G, Hadad O, Alpert S, Tlusty T, Gur Y, Ben-Ari R, Hashoul S (2017) Hybrid mass detection in breast MRI combining unsupervised saliency analysis and deep learning. In: International conference on medical image computing and computer-assisted intervention, pp 594–602. Springer Amit G, Hadad O, Alpert S, Tlusty T, Gur Y, Ben-Ari R, Hashoul S (2017) Hybrid mass detection in breast MRI combining unsupervised saliency analysis and deep learning. In: International conference on medical image computing and computer-assisted intervention, pp 594–602. Springer
30.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
31.
Zurück zum Zitat Maicas G, Carneiro G, Bradley AP (2017) Globally optimal breast mass segmentation from DCE-MRI using deep semantic segmentation as shape prior. In: 2017 IEEE 14th international symposium on biomedical imaging (ISBI 2017), pp 305–309. IEEE Maicas G, Carneiro G, Bradley AP (2017) Globally optimal breast mass segmentation from DCE-MRI using deep semantic segmentation as shape prior. In: 2017 IEEE 14th international symposium on biomedical imaging (ISBI 2017), pp 305–309. IEEE
32.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
33.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 234–241. Springer Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 234–241. Springer
34.
Zurück zum Zitat Dalmış MU, Vreemann S, Kooi T, Mann RM, Karssemeijer N, Gubern-Mérida A (2018) Fully automated detection of breast cancer in screening MRI using convolutional neural networks. J Med Imaging 5(1):014502CrossRef Dalmış MU, Vreemann S, Kooi T, Mann RM, Karssemeijer N, Gubern-Mérida A (2018) Fully automated detection of breast cancer in screening MRI using convolutional neural networks. J Med Imaging 5(1):014502CrossRef
35.
Zurück zum Zitat Caicedo JC, Lazebnik S (2015) Active object localization with deep reinforcement learning. In: Proceedings of the IEEE international conference on computer vision, pp 2488–2496 Caicedo JC, Lazebnik S (2015) Active object localization with deep reinforcement learning. In: Proceedings of the IEEE international conference on computer vision, pp 2488–2496
36.
Zurück zum Zitat Ghesu FC, Georgescu B, Mansi T, Neumann D, Hornegger J, Comaniciu D (2016) An artificial agent for anatomical landmark detection in medical images. In: International conference on medical image computing and computer-assisted intervention, pp 229–237. Springer Ghesu FC, Georgescu B, Mansi T, Neumann D, Hornegger J, Comaniciu D (2016) An artificial agent for anatomical landmark detection in medical images. In: International conference on medical image computing and computer-assisted intervention, pp 229–237. Springer
37.
Zurück zum Zitat Mann RM, Kuhl CK, Moy L (2019) Contrast-enhanced MRI for breast cancer screening. J Magn Reson Imaging Mann RM, Kuhl CK, Moy L (2019) Contrast-enhanced MRI for breast cancer screening. J Magn Reson Imaging
38.
Zurück zum Zitat van Zelst JC, Vreemann S, Witt HJ, Gubern-Merida A, Dorrius MD, Duvivier K, Lardenoije-Broker S, Lobbes MB, Loo C, Veldhuis W et al (2018) Multireader study on the diagnostic accuracy of ultrafast breast magnetic resonance imaging for breast cancer screening. Investig Radiol 53(10):579–586CrossRef van Zelst JC, Vreemann S, Witt HJ, Gubern-Merida A, Dorrius MD, Duvivier K, Lardenoije-Broker S, Lobbes MB, Loo C, Veldhuis W et al (2018) Multireader study on the diagnostic accuracy of ultrafast breast magnetic resonance imaging for breast cancer screening. Investig Radiol 53(10):579–586CrossRef
39.
Zurück zum Zitat Sutton RS, Barto AG (1998) Introduction to reinforcement learning, vol 135. MIT press, Cambridge (1998) Sutton RS, Barto AG (1998) Introduction to reinforcement learning, vol 135. MIT press, Cambridge (1998)
40.
Zurück zum Zitat Hayton P, Brady M, Tarassenko L, Moore N (1997) Analysis of dynamic MR breast images using a model of contrast enhancement. Med Image Anal 1(3):207–224CrossRef Hayton P, Brady M, Tarassenko L, Moore N (1997) Analysis of dynamic MR breast images using a model of contrast enhancement. Med Image Anal 1(3):207–224CrossRef
41.
Zurück zum Zitat Dhungel N, Carneiro G, Bradley AP (2015) Automated mass detection in mammograms using cascaded deep learning and random forests. In: 2015 International conference on digital image computing: techniques and applications (DICTA), pp 1–8. IEEE Dhungel N, Carneiro G, Bradley AP (2015) Automated mass detection in mammograms using cascaded deep learning and random forests. In: 2015 International conference on digital image computing: techniques and applications (DICTA), pp 1–8. IEEE
42.
Zurück zum Zitat Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ (2016) Deep networks with stochastic depth. In: European conference on computer vision, pp 646–661. Springer Huang G, Sun Y, Liu Z, Sedra D, Weinberger KQ (2016) Deep networks with stochastic depth. In: European conference on computer vision, pp 646–661. Springer
Metadaten
Titel
Deep Reinforcement Learning for Detecting Breast Lesions from DCE-MRI
verfasst von
Gabriel Maicas
Andrew P. Bradley
Jacinto C. Nascimento
Ian Reid
Gustavo Carneiro
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-13969-8_8

Premium Partner