Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 7/2023

22.05.2023 | Original Article

TRUSformer: improving prostate cancer detection from micro-ultrasound using attention and self-supervision

verfasst von: Mahdi Gilany, Paul Wilson, Andrea Perera-Ortega, Amoon Jamzad, Minh Nguyen Nhat To, Fahimeh Fooladgar, Brian Wodlinger, Purang Abolmaesumi, Parvin Mousavi

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 7/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

A large body of previous machine learning methods for ultrasound-based prostate cancer detection classify small regions of interest (ROIs) of ultrasound signals that lie within a larger needle trace corresponding to a prostate tissue biopsy (called biopsy core). These ROI-scale models suffer from weak labeling as histopathology results available for biopsy cores only approximate the distribution of cancer in the ROIs. ROI-scale models do not take advantage of contextual information that are normally considered by pathologists, i.e., they do not consider information about surrounding tissue and larger-scale trends when identifying cancer. We aim to improve cancer detection by taking a multi-scale, i.e., ROI-scale and biopsy core-scale, approach.

Methods

Our multi-scale approach combines (i) an “ROI-scale” model trained using self-supervised learning to extract features from small ROIs and (ii) a “core-scale” transformer model that processes a collection of extracted features from multiple ROIs in the needle trace region to predict the tissue type of the corresponding core. Attention maps, as a by-product, allow us to localize cancer at the ROI scale.

Results

We analyze this method using a dataset of micro-ultrasound acquired from 578 patients who underwent prostate biopsy, and compare our model to baseline models and other large-scale studies in the literature. Our model shows consistent and substantial performance improvements compared to ROI-scale-only models. It achieves \(80.3\%\) AUROC, a statistically significant improvement over ROI-scale classification. We also compare our method to large studies on prostate cancer detection, using other imaging modalities.

Conclusions

Taking a multi-scale approach that leverages contextual information improves prostate cancer detection compared to ROI-scale-only models. The proposed model achieves a statistically significant improvement in performance and outperforms other large-scale studies in the literature. Our code is publicly available at www.​github.​com/​med-i-lab/​TRUSFormer.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The RF is bandlimited in the axial direction such that no loss of information occurs by downsampling.
 
2
We empirically found this to be the best configuration after a manual search through: layers 1, 8, 12, 16, inner dimensions 64, 128, 256, 768, and heads 4, 8.
 
3
Performance is reported across all data centers. No statistically significant differences in performance between different data centers were observed.
 
4
Two-tailed p-value \(<0.05\)
 
Literatur
1.
Zurück zum Zitat Smeenge M, de la Rosette JJ, Wijkstra H (2012) Current status of transrectal ultrasound techniques in prostate cancer. Curr Opin Urol 22(4):297–302CrossRefPubMed Smeenge M, de la Rosette JJ, Wijkstra H (2012) Current status of transrectal ultrasound techniques in prostate cancer. Curr Opin Urol 22(4):297–302CrossRefPubMed
2.
Zurück zum Zitat Ahmed HU, Bosaily AE-S, Brown LC, Gabe R, Kaplan R, Parmar MK, Collaco-Moraes Y, Ward K, Hindley RG, Freeman A, Kirkham A, Oldroyd R, Parker C, Emberton M (2017) Diagnostic accuracy of multi-parametric mri and trus biopsy in prostate cancer (promis): a paired validating confirmatory study. Lancet 389(10071):815–822CrossRefPubMed Ahmed HU, Bosaily AE-S, Brown LC, Gabe R, Kaplan R, Parmar MK, Collaco-Moraes Y, Ward K, Hindley RG, Freeman A, Kirkham A, Oldroyd R, Parker C, Emberton M (2017) Diagnostic accuracy of multi-parametric mri and trus biopsy in prostate cancer (promis): a paired validating confirmatory study. Lancet 389(10071):815–822CrossRefPubMed
3.
Zurück zum Zitat Madej A, Wilkosz J, Różański W, Lipiński M (2012) Complication rates after prostate biopsy according to the number of sampled cores. Cent Eur J Urol 65(3):116CrossRef Madej A, Wilkosz J, Różański W, Lipiński M (2012) Complication rates after prostate biopsy according to the number of sampled cores. Cent Eur J Urol 65(3):116CrossRef
4.
Zurück zum Zitat Siddiqui MM, Rais-Bahrami S, Truong H, Stamatakis L, Vourganti S, Nix J, Hoang AN, Walton-Diaz A, Shuch B, Weintraub M, Kruecker J, Amalou H, Turkbey B, Merino M, Choyke P, Wood B, Pinto P (2013) Magnetic resonance imaging/ultrasound-fusion biopsy significantly upgrades prostate cancer versus systematic 12-core transrectal ultrasound biopsy. Eur Urol 64(5):713–719CrossRefPubMedPubMedCentral Siddiqui MM, Rais-Bahrami S, Truong H, Stamatakis L, Vourganti S, Nix J, Hoang AN, Walton-Diaz A, Shuch B, Weintraub M, Kruecker J, Amalou H, Turkbey B, Merino M, Choyke P, Wood B, Pinto P (2013) Magnetic resonance imaging/ultrasound-fusion biopsy significantly upgrades prostate cancer versus systematic 12-core transrectal ultrasound biopsy. Eur Urol 64(5):713–719CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat Salomon G, Köllerman J, Thederan I, Chun FK, Budäus L, Schlomm T, Isbarn H, Heinzer H, Huland H, Graefen M (2008) Evaluation of prostate cancer detection with ultrasound real-time elastography: a comparison with step section pathological analysis after radical prostatectomy. Eur Urol 54(6):1354–1362CrossRefPubMed Salomon G, Köllerman J, Thederan I, Chun FK, Budäus L, Schlomm T, Isbarn H, Heinzer H, Huland H, Graefen M (2008) Evaluation of prostate cancer detection with ultrasound real-time elastography: a comparison with step section pathological analysis after radical prostatectomy. Eur Urol 54(6):1354–1362CrossRefPubMed
6.
Zurück zum Zitat Oelze ML, Mamou J. Review of quantitative ultrasound: envelope statistics and backscatter coefficient imaging and contributions to diagnostic ultrasound. IEEE TUFFC Oelze ML, Mamou J. Review of quantitative ultrasound: envelope statistics and backscatter coefficient imaging and contributions to diagnostic ultrasound. IEEE TUFFC
7.
Zurück zum Zitat Kelly I, Lees W, Rickards D (1993) Prostate cancer and the role of color doppler us. Radiology 189(1):153–156CrossRefPubMed Kelly I, Lees W, Rickards D (1993) Prostate cancer and the role of color doppler us. Radiology 189(1):153–156CrossRefPubMed
8.
Zurück zum Zitat Moradi M, Abolmaesumi P, Siemens DR, Sauerbrei EE, Boag AH, Mousavi P (2008) Augmenting detection of prostate cancer in transrectal ultrasound images using svm and rf time series. IEEE Trans Biomed Eng 56(9):2214–2224CrossRefPubMed Moradi M, Abolmaesumi P, Siemens DR, Sauerbrei EE, Boag AH, Mousavi P (2008) Augmenting detection of prostate cancer in transrectal ultrasound images using svm and rf time series. IEEE Trans Biomed Eng 56(9):2214–2224CrossRefPubMed
9.
Zurück zum Zitat Ghai S, Eure G, Fradet V, Hyndman ME, McGrath T, Wodlinger B, Pavlovich CP (2016) Assessing cancer risk on novel 29 mhz micro-us images of the prostate: creation of the micro-us protocol for prostate risk identification. J Urol 196(2):562–569CrossRefPubMed Ghai S, Eure G, Fradet V, Hyndman ME, McGrath T, Wodlinger B, Pavlovich CP (2016) Assessing cancer risk on novel 29 mhz micro-us images of the prostate: creation of the micro-us protocol for prostate risk identification. J Urol 196(2):562–569CrossRefPubMed
10.
Zurück zum Zitat Mannaerts CK, Engelbrecht MR, Postema AW, van Kollenburg RA, Hoeks CM, Savci-Heijink CD, Van Sloun RJ, Wildeboer RR, De Reijke TM, Mischi M, Wijkstra H (2020) Detection of clinically significant prostate cancer in biopsy-naïve men: direct comparison of systematic biopsy, multiparametric mri-and contrast-ultrasound-dispersion imaging-targeted biopsy. BJU Int 126(4):481–493CrossRefPubMed Mannaerts CK, Engelbrecht MR, Postema AW, van Kollenburg RA, Hoeks CM, Savci-Heijink CD, Van Sloun RJ, Wildeboer RR, De Reijke TM, Mischi M, Wijkstra H (2020) Detection of clinically significant prostate cancer in biopsy-naïve men: direct comparison of systematic biopsy, multiparametric mri-and contrast-ultrasound-dispersion imaging-targeted biopsy. BJU Int 126(4):481–493CrossRefPubMed
11.
Zurück zum Zitat Rohrbach D, Wodlinger B, Wen J, Mamou J, Feleppa E (2018) High-frequency quantitative ultrasound for imaging pca using a novel micro-us scanner. Ultrasound Med Biol 44(7):1341–1354CrossRefPubMed Rohrbach D, Wodlinger B, Wen J, Mamou J, Feleppa E (2018) High-frequency quantitative ultrasound for imaging pca using a novel micro-us scanner. Ultrasound Med Biol 44(7):1341–1354CrossRefPubMed
12.
Zurück zum Zitat Secasan CC, Onchis D, Bardan R, Cumpanas A, Novacescu D, Botoca C, Dema A, Sporea I (2022) Artificial intelligence system for predicting prostate cancer lesions from shear wave elastography measurements. Curr Oncol 29(6):4212–4223CrossRefPubMedPubMedCentral Secasan CC, Onchis D, Bardan R, Cumpanas A, Novacescu D, Botoca C, Dema A, Sporea I (2022) Artificial intelligence system for predicting prostate cancer lesions from shear wave elastography measurements. Curr Oncol 29(6):4212–4223CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Fooladgar F, To MNN, Javadi G, Samadi S, Bayat S, Sojoudi S, Eshumani W, Hurtado A, Chang S, Black P, Mousavi P, Abolmaesumi P (2022) Uncertainty-aware deep ensemble model for targeted ultrasound-guided prostate biopsy. In: 2022 IEEE 19th International symposium on biomedical imaging (ISBI), pp 1–5 Fooladgar F, To MNN, Javadi G, Samadi S, Bayat S, Sojoudi S, Eshumani W, Hurtado A, Chang S, Black P, Mousavi P, Abolmaesumi P (2022) Uncertainty-aware deep ensemble model for targeted ultrasound-guided prostate biopsy. In: 2022 IEEE 19th International symposium on biomedical imaging (ISBI), pp 1–5
14.
Zurück zum Zitat Shao Y, Wang J, Wodlinger B, Salcudean SE (2020) Improving prostate cancer (pca) classification performance by using three-player minimax game to reduce data source heterogeneity. IEEE Trans Med Imaging 39(10):3148–3158CrossRefPubMed Shao Y, Wang J, Wodlinger B, Salcudean SE (2020) Improving prostate cancer (pca) classification performance by using three-player minimax game to reduce data source heterogeneity. IEEE Trans Med Imaging 39(10):3148–3158CrossRefPubMed
15.
Zurück zum Zitat Gilany M, Wilson P, Jamzad A, Fooladgar F, To MNN, Wodlinger B, Abolmaesumi P, Mousavi P (2022) Towards confident detection of pca using high resolution micro-ultrasound. In: International conference on medical image computing and computer-assisted intervention, pp 411–420 Gilany M, Wilson P, Jamzad A, Fooladgar F, To MNN, Wodlinger B, Abolmaesumi P, Mousavi P (2022) Towards confident detection of pca using high resolution micro-ultrasound. In: International conference on medical image computing and computer-assisted intervention, pp 411–420
16.
Zurück zum Zitat Wilson PF, Gilany M, Jamzad A, Fooladgar F, To MNN, Wodlinger B, Abolmaesumi P, Mousavi P (2022) Self-supervised learning with limited labeled data for prostate cancer detection in high frequency ultrasound. arXiv preprint arXiv:2211.00527 Wilson PF, Gilany M, Jamzad A, Fooladgar F, To MNN, Wodlinger B, Abolmaesumi P, Mousavi P (2022) Self-supervised learning with limited labeled data for prostate cancer detection in high frequency ultrasound. arXiv preprint arXiv:​2211.​00527
17.
Zurück zum Zitat Feng Y, Yang F, Zhou X, Guo Y, Tang F, Ren F, Guo J, Ji S (2018) A deep learning approach for targeted contrast-enhanced ultrasound based prostate cancer detection. IEEE/ACM Trans Comput Biol Bioinform 16(6):1794–1801CrossRefPubMed Feng Y, Yang F, Zhou X, Guo Y, Tang F, Ren F, Guo J, Ji S (2018) A deep learning approach for targeted contrast-enhanced ultrasound based prostate cancer detection. IEEE/ACM Trans Comput Biol Bioinform 16(6):1794–1801CrossRefPubMed
18.
Zurück zum Zitat Javadi G, Samadi S, Bayat S, Pesteie M, Jafari MH, Sojoudi S, Kesch C, Hurtado A, Chang S, Mousavi P, Black P, Abolmaesumi P (2020) Multiple instance learning combined with label invariant synthetic data for guiding systematic prostate biopsy: a feasibility study. Int J Comput Assist Radiol Surg 15(6):1023–1031CrossRefPubMed Javadi G, Samadi S, Bayat S, Pesteie M, Jafari MH, Sojoudi S, Kesch C, Hurtado A, Chang S, Mousavi P, Black P, Abolmaesumi P (2020) Multiple instance learning combined with label invariant synthetic data for guiding systematic prostate biopsy: a feasibility study. Int J Comput Assist Radiol Surg 15(6):1023–1031CrossRefPubMed
19.
Zurück zum Zitat Gordetsky J, Epstein J (2016) Grading of prostatic adenocarcinoma: current state and prognostic implications. Diagn Pathol 11(1):1–8CrossRef Gordetsky J, Epstein J (2016) Grading of prostatic adenocarcinoma: current state and prognostic implications. Diagn Pathol 11(1):1–8CrossRef
20.
Zurück zum Zitat Campanella G, Hanna MG, Geneslaw L, Miraflor A, Werneck Krauss Silva V, Busam KJ, Brogi E, Reuter VE, Klimstra DS, Fuchs TJ (2019) Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med 25(8):1301–1309CrossRefPubMedPubMedCentral Campanella G, Hanna MG, Geneslaw L, Miraflor A, Werneck Krauss Silva V, Busam KJ, Brogi E, Reuter VE, Klimstra DS, Fuchs TJ (2019) Clinical-grade computational pathology using weakly supervised deep learning on whole slide images. Nat Med 25(8):1301–1309CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process syst 30 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process syst 30
22.
Zurück zum Zitat Ilse M, Tomczak J, Welling M (2018) Attention-based deep multiple instance learning. In: International conference on machine learning. PMLR, pp 2127–2136 Ilse M, Tomczak J, Welling M (2018) Attention-based deep multiple instance learning. In: International conference on machine learning. PMLR, pp 2127–2136
23.
Zurück zum Zitat Bardes A, Ponce J, LeCun Y (2022) Vicreg: variance-invariance-covariance regularization for self-supervised learning. In: International conference on learning representations Bardes A, Ponce J, LeCun Y (2022) Vicreg: variance-invariance-covariance regularization for self-supervised learning. In: International conference on learning representations
24.
Zurück zum Zitat Chefer H, Gur S, Wolf L. Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers. In: ICCV Chefer H, Gur S, Wolf L. Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers. In: ICCV
25.
Zurück zum Zitat McInnes L, Healy J, Melville J (2018) Umap: uniform manifold approximation and projection for dimension reduction. J Open Source Softw 3(29) McInnes L, Healy J, Melville J (2018) Umap: uniform manifold approximation and projection for dimension reduction. J Open Source Softw 3(29)
Metadaten
Titel
TRUSformer: improving prostate cancer detection from micro-ultrasound using attention and self-supervision
verfasst von
Mahdi Gilany
Paul Wilson
Andrea Perera-Ortega
Amoon Jamzad
Minh Nguyen Nhat To
Fahimeh Fooladgar
Brian Wodlinger
Purang Abolmaesumi
Parvin Mousavi
Publikationsdatum
22.05.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 7/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02949-4

Weitere Artikel der Ausgabe 7/2023

International Journal of Computer Assisted Radiology and Surgery 7/2023 Zur Ausgabe

Premium Partner