Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 2/2023

04.11.2022 | Original Article

Universal lymph node detection in T2 MRI using neural networks

verfasst von: Tejas Sudharshan Mathai, Sungwon Lee, Thomas C. Shen, Zhiyong Lu, Ronald M. Summers

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Identification of lymph nodes (LNs) that are suspicious for metastasis in T2 Magnetic Resonance Imaging (MRI) is critical for assessment of lymphadenopathy. Prior work on LN detection has been limited to specific anatomical regions of the body (pelvis, rectum). Therefore, an approach to universally detect both benign and metastatic nodes in T2 MRI studies of the body is highly desirable.

Methods

We developed a Computer Aided Detection (CAD) pipeline to universally identify LN in T2 MRI. First, we trained various neural networks for detecting LN: Faster RCNN with and without Hard Negative Example Mining (HNEM), FCOS, FoveaBox, VFNet, and Detection Transformer (DETR). Next, we show that VFNet with Adaptive Training Sample Selection (ATSS) outperformed Faster RCNN with HNEM. Finally, we ensembled models that surpassed a 45% mAP threshold.

Results

Experiments on 122 test studies revealed that VFNet achieved a 51.1% mAP and 78.7% recall at 4 false positives (FP) per volume, while the one-stage model ensemble achieved a mAP of 52.3% and sensitivity of 78.7% at 4FP. We found that VFNet and the one-stage model ensemble can be interchangeably used in the CAD pipeline.

Conclusion

Our CAD pipeline universally detected both benign and metastatic nodes in T2 MRI studies, resulting in a sensitivity improvement of \(\sim \)14% over the current LN detection approaches (sensitivity of 78.7% at 4 FP vs. 64.6% at 5 FP per volume).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amin MB, Greene FL, Edge SB, Compton CC, Gershenwald JE, Brookland RK, Meyer L, Gress DM, Byrd DR, Winchester DP (2017) The eighth edition ajcc cancer staging manual: continuing to build a bridge from a population-based to a more “personalized’’ approach to cancer staging. CA Cancer J Clin 67(2):93–99CrossRef Amin MB, Greene FL, Edge SB, Compton CC, Gershenwald JE, Brookland RK, Meyer L, Gress DM, Byrd DR, Winchester DP (2017) The eighth edition ajcc cancer staging manual: continuing to build a bridge from a population-based to a more “personalized’’ approach to cancer staging. CA Cancer J Clin 67(2):93–99CrossRef
2.
Zurück zum Zitat Taupitz M (2007) Imaging of lymph nodes - mri and ct. Springer, pp 321–329 Taupitz M (2007) Imaging of lymph nodes - mri and ct. Springer, pp 321–329
3.
Zurück zum Zitat Xingyu Z, Peiyi X, Mengmeng W, Pickhardt Perry J, Wei X, Fei X, Rui Z, Yao X, Junming J (2020) Deep learning based fully automated detection and segmentation of lymph nodes on multiparametric mri for rectal cancer: A multicentre study. EBioMedicine 56:102780CrossRef Xingyu Z, Peiyi X, Mengmeng W, Pickhardt Perry J, Wei X, Fei X, Rui Z, Yao X, Junming J (2020) Deep learning based fully automated detection and segmentation of lymph nodes on multiparametric mri for rectal cancer: A multicentre study. EBioMedicine 56:102780CrossRef
4.
Zurück zum Zitat Debats OA, Litjens GJS, Huisman HJ (2019) Lymph node detection in mr lymphography: false positive reduction using multi-view convolutional neural networks. Peer J 7:e8052CrossRef Debats OA, Litjens GJS, Huisman HJ (2019) Lymph node detection in mr lymphography: false positive reduction using multi-view convolutional neural networks. Peer J 7:e8052CrossRef
5.
Zurück zum Zitat Yun L, Qiyue Yu, Gao Y, Zhou Y, Liu G, Dong Q, Ma J, Ding L, Yao H, Zhang Z, Xiao G, An Q, Wang G, Xi J, Yuan W-T, Lian Y, Zhang D, Zhao C-G, Yao Q, Liu W, Zhou X, Liu S, Qingyao W, Wenjian X, Zhang J, Wang D, Sun Z, Gao Y, Zhang X, Jilin H, Zhang M, Wang G, Zheng X, Wang L, Zhao J, Yang S (2018) Identification of metastatic lymph nodes in mr imaging with faster region-based convolutional neural networks. Cancer Res 78 17:5135–5143 Yun L, Qiyue Yu, Gao Y, Zhou Y, Liu G, Dong Q, Ma J, Ding L, Yao H, Zhang Z, Xiao G, An Q, Wang G, Xi J, Yuan W-T, Lian Y, Zhang D, Zhao C-G, Yao Q, Liu W, Zhou X, Liu S, Qingyao W, Wenjian X, Zhang J, Wang D, Sun Z, Gao Y, Zhang X, Jilin H, Zhang M, Wang G, Zheng X, Wang L, Zhao J, Yang S (2018) Identification of metastatic lymph nodes in mr imaging with faster region-based convolutional neural networks. Cancer Res 78 17:5135–5143
6.
Zurück zum Zitat Wang S, Zhu Y, Lee S, Elton DC, Shen TC, Tang Y, Peng Y, Lu Z, Summers RM (2022) Global-Local attention network with multi-task uncertainty loss for abnormal lymph node detection in MR images. Med Image Anal 77:102345CrossRef Wang S, Zhu Y, Lee S, Elton DC, Shen TC, Tang Y, Peng Y, Lu Z, Summers RM (2022) Global-Local attention network with multi-task uncertainty loss for abnormal lymph node detection in MR images. Med Image Anal 77:102345CrossRef
7.
Zurück zum Zitat Mathai TS, Lee S, Elton DC, Shen TC, Peng Y, Zhiyong L, Summers RM (2021) Detection of lymph nodes in t2 mri using neural network ensembles. In: Lian C, Cao X, Rekik I, Xuanang X, Yan P (eds) Machine Learning in Medical Imaging. Springer International Publishing, Cham Mathai TS, Lee S, Elton DC, Shen TC, Peng Y, Zhiyong L, Summers RM (2021) Detection of lymph nodes in t2 mri using neural network ensembles. In: Lian C, Cao X, Rekik I, Xuanang X, Yan P (eds) Machine Learning in Medical Imaging. Springer International Publishing, Cham
8.
Zurück zum Zitat Mathai TS, Lee S, Elton DC, Shen TC, Peng Y, Lu Z, Summers RM (2021) Lymph node detection in t2 mri with transformers. arXiv Mathai TS, Lee S, Elton DC, Shen TC, Peng Y, Lu Z, Summers RM (2021) Lymph node detection in t2 mri with transformers. arXiv
9.
Zurück zum Zitat Zhang H, Wang Y, Dayoub F, Sünderhauf N (2021) Varifocalnet: An IoU-aware Dense Object Detector, in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 2021 pp. 8510–8519 Zhang H, Wang Y, Dayoub F, Sünderhauf N (2021) Varifocalnet: An IoU-aware Dense Object Detector, in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 2021 pp. 8510–8519
10.
Zurück zum Zitat Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Vedaldi A, Bischof H, Brox T, Frahm J-M (eds) Computer vision - ECCV 2020. ECCV 2020. Lecture Notes in Computer Science, vol 12346 Springer International Publishing, Cham Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Vedaldi A, Bischof H, Brox T, Frahm J-M (eds) Computer vision - ECCV 2020. ECCV 2020. Lecture Notes in Computer Science, vol 12346 Springer International Publishing, Cham
11.
Zurück zum Zitat Kong T, Sun F, Liu H, Jiang Y, Li L, Shi J (2020) Foveabox: beyound anchor-based object detection. IEEE Trans Image Process 29:7389–7398CrossRef Kong T, Sun F, Liu H, Jiang Y, Li L, Shi J (2020) Foveabox: beyound anchor-based object detection. IEEE Trans Image Process 29:7389–7398CrossRef
12.
Zurück zum Zitat Shaoqing R, Kaiming H, Ross G, Jian S (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence N, Lee D, Sugiyama M, Garnett R (eds) Advances in Neural Information Processing Systems. Curran Associates Inc, Red Hook Shaoqing R, Kaiming H, Ross G, Jian S (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Cortes C, Lawrence N, Lee D, Sugiyama M, Garnett R (eds) Advances in Neural Information Processing Systems. Curran Associates Inc, Red Hook
13.
Zurück zum Zitat Tang Y-B, Yan K, Tang Y-X, Liu J, Xiao J, Summers RM (2019) Uldor: a universal lesion detector for ct scans with pseudo masks and hard negative example mining. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pp 833–836 Tang Y-B, Yan K, Tang Y-X, Liu J, Xiao J, Summers RM (2019) Uldor: a universal lesion detector for ct scans with pseudo masks and hard negative example mining. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pp 833–836
14.
Zurück zum Zitat Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)
15.
Zurück zum Zitat Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 936–944 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 936–944
16.
Zurück zum Zitat Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef
17.
Zurück zum Zitat Bodla N, Singh B, Chellappa R, Davis LS (2017) Soft-NMS—improving object detection with one line of code. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) Bodla N, Singh B, Chellappa R, Davis LS (2017) Soft-NMS—improving object detection with one line of code. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV)
18.
Zurück zum Zitat Solovyev R, Wang W, Gabruseva T (2021) Weighted boxes fusion: ensembling boxes from different object detection models. Image Vis Comput 107:104117CrossRef Solovyev R, Wang W, Gabruseva T (2021) Weighted boxes fusion: ensembling boxes from different object detection models. Image Vis Comput 107:104117CrossRef
19.
Zurück zum Zitat Peng Y, Lee S, Elton DC, Shen T, Tang Y-X, Chen Q, Wang S, Zhu Y, Summers R, Lu (2020) Automatic recognition of abdominal lymph nodes from clinical text. In: Proceedings of the 3rd clinical natural language processing workshop, pp 101–110, Online, November 2020. Association for Computational Linguistics Peng Y, Lee S, Elton DC, Shen T, Tang Y-X, Chen Q, Wang S, Zhu Y, Summers R, Lu (2020) Automatic recognition of abdominal lymph nodes from clinical text. In: Proceedings of the 3rd clinical natural language processing workshop, pp 101–110, Online, November 2020. Association for Computational Linguistics
20.
Zurück zum Zitat Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, Gee JC (2010) N4itk: improved n3 bias correction. IEEE Trans Med Imaging 29(6):1310–1320CrossRef Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, Gee JC (2010) N4itk: improved n3 bias correction. IEEE Trans Med Imaging 29(6):1310–1320CrossRef
21.
Zurück zum Zitat Kociołek M, Strzelecki M, Obuchowicz R (2020) Does image normalization and intensity resolution impact texture classification? Comput Med Imaging Graph 81:101716 Kociołek M, Strzelecki M, Obuchowicz R (2020) Does image normalization and intensity resolution impact texture classification? Comput Med Imaging Graph 81:101716
22.
Zurück zum Zitat Chen K, Wang J, Pang J, Yuhang Cao Y, Xiong Xiaoxiao L, Sun S, Feng W, Liu Z, Jiarui X, Zhang Z, Cheng D, Zhu C, Cheng T, Zhao Q, Li B, Xin L, Zhu R, Yue W, Dai J, Wang J, Shi J, Ouyang W, Loy Chen C, Lin D (2019) Mmdetection: open mmlab detection toolbox and benchmark Chen K, Wang J, Pang J, Yuhang Cao Y, Xiong Xiaoxiao L, Sun S, Feng W, Liu Z, Jiarui X, Zhang Z, Cheng D, Zhu C, Cheng T, Zhao Q, Li B, Xin L, Zhu R, Yue W, Dai J, Wang J, Shi J, Ouyang W, Loy Chen C, Lin D (2019) Mmdetection: open mmlab detection toolbox and benchmark
Metadaten
Titel
Universal lymph node detection in T2 MRI using neural networks
verfasst von
Tejas Sudharshan Mathai
Sungwon Lee
Thomas C. Shen
Zhiyong Lu
Ronald M. Summers
Publikationsdatum
04.11.2022
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 2/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-022-02782-1

Weitere Artikel der Ausgabe 2/2023

International Journal of Computer Assisted Radiology and Surgery 2/2023 Zur Ausgabe

Premium Partner