Skip to main content
Erschienen in: Neural Processing Letters 9/2023

15.11.2023

Advanced Image Processing Techniques for Ultrasound Images using Multiscale Self Attention CNN

verfasst von: D. Vetriselvi, R. Thenmozhi

Erschienen in: Neural Processing Letters | Ausgabe 9/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The aim of this research is to enhance the quality of prenatal ultrasound images by addressing common artifacts such as missing or damaged areas, speckle noise, and other types of distortions that can impede accurate diagnosis. The proposed approach involves a novel preprocessing pipeline for prenatal 5th-month ultrasound scan images, which includes three main steps. First, Multiscale Self Attention convolutional neural network (CNN) is used for image inpainting and augmentation to fill missing or damaged areas and generate augmented images for training DL models. Second, Anisotropic Diffusion Filtering is used for speckle noise reduction, and the filter parameters are adapted to local noise characteristics using memory-based speckle statistics. Third, the CNN is trained to estimate local statistics of the speckle noise and adapt filtering parameters accordingly to capture local and global image features. The effectiveness of the proposed approach is evaluated on a prenatal 5th-month ultrasound scan dataset. The results demonstrate that the proposed preprocessing steps significantly improve the quality of ultrasound images and lead to better performance of DL models. The proposed preprocessing pipeline using Multiscale Self Attention CNN for image inpainting and augmentation, followed by Anisotropic Diffusion Filtering and memory-based speckle statistics for speckle noise reduction, can significantly enhance the quality of prenatal ultrasound images and enhance the accuracy of diagnostic models. The approach has potential for broader use in medical imaging applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Drukker L, Bradburn E, Rodriguez GB, Roberts NW, Impey L, Papageorghiou AT (2021) How often do we identify fetal abnormalities during routine third-trimester ultrasound? A systematic review and meta-analysis. BJOG Int J Obstetr Gynaecol 128(2):259–269CrossRef Drukker L, Bradburn E, Rodriguez GB, Roberts NW, Impey L, Papageorghiou AT (2021) How often do we identify fetal abnormalities during routine third-trimester ultrasound? A systematic review and meta-analysis. BJOG Int J Obstetr Gynaecol 128(2):259–269CrossRef
2.
Zurück zum Zitat Prieto JC, Shah H, Rosenbaum AJ, Jiang X, Musonda P, Price JT, Stringer EM, Vwalika B, Stamilio DM, Stringer JS (2021). An automated framework for image classification and segmentation of fetal ultrasound images for gestational age estimation. In: medical imaging 2021: image processing, 11596: 453–462. SPIE Prieto JC, Shah H, Rosenbaum AJ, Jiang X, Musonda P, Price JT, Stringer EM, Vwalika B, Stamilio DM, Stringer JS (2021). An automated framework for image classification and segmentation of fetal ultrasound images for gestational age estimation. In: medical imaging 2021: image processing, 11596: 453–462. SPIE
3.
Zurück zum Zitat Best RG (2022) Prenatal screening for neural tube defects and aneuploidy. In: Emery and Rimoin's principles and practice of medical genetics and genomics (pp 9–34). Academic Press Best RG (2022) Prenatal screening for neural tube defects and aneuploidy. In: Emery and Rimoin's principles and practice of medical genetics and genomics (pp 9–34). Academic Press
4.
Zurück zum Zitat D’Asta M, La Ferrera N, Gulino FA, Ettore C, Ettore G (2022) Is It possible to diagnose preoperatively a tubal ectopic hydatidiform molar pregnancy? Description of a case report and review of the literature of the last ten years. J Clin Med 11(19):5783CrossRef D’Asta M, La Ferrera N, Gulino FA, Ettore C, Ettore G (2022) Is It possible to diagnose preoperatively a tubal ectopic hydatidiform molar pregnancy? Description of a case report and review of the literature of the last ten years. J Clin Med 11(19):5783CrossRef
5.
Zurück zum Zitat Peixoto AO, Costa RM, Uzun R, Fraga ADM, Ribeiro JD, Marson FL (2021) Applicability of lung ultrasound in COVID-19 diagnosis and evaluation of the disease progression: a systematic review. Pulmonology 27(6):529–562CrossRef Peixoto AO, Costa RM, Uzun R, Fraga ADM, Ribeiro JD, Marson FL (2021) Applicability of lung ultrasound in COVID-19 diagnosis and evaluation of the disease progression: a systematic review. Pulmonology 27(6):529–562CrossRef
6.
Zurück zum Zitat Sudharson S, Kokil P (2021) Computer-aided diagnosis system for the classification of multi-class kidney abnormalities in the noisy ultrasound images. Comput Methods Programs Biomed 205:106071CrossRef Sudharson S, Kokil P (2021) Computer-aided diagnosis system for the classification of multi-class kidney abnormalities in the noisy ultrasound images. Comput Methods Programs Biomed 205:106071CrossRef
8.
Zurück zum Zitat Frenzel F, Kubale R, Massmann A, Raczeck P, Jagoda P, Schlueter C, Stroeder J, Buecker A, Minko P (2021) Artifacts in contrast-enhanced ultrasound during follow-up after endovascular aortic repair: impact on Endoleak detection in comparison with computed tomography angiography. Ultrasound Med Biol 47(3):488–498CrossRef Frenzel F, Kubale R, Massmann A, Raczeck P, Jagoda P, Schlueter C, Stroeder J, Buecker A, Minko P (2021) Artifacts in contrast-enhanced ultrasound during follow-up after endovascular aortic repair: impact on Endoleak detection in comparison with computed tomography angiography. Ultrasound Med Biol 47(3):488–498CrossRef
9.
Zurück zum Zitat Fu Z, Zhang J, Lu Y, Wang S, Mo X, He Y, Wang C, Chen H (2021) Clinical applications of superb microvascular imaging in the superficial tissues and organs: a systematic review. Acad Radiol 28(5):694–703CrossRef Fu Z, Zhang J, Lu Y, Wang S, Mo X, He Y, Wang C, Chen H (2021) Clinical applications of superb microvascular imaging in the superficial tissues and organs: a systematic review. Acad Radiol 28(5):694–703CrossRef
10.
Zurück zum Zitat Rafailidis V, Huang DY, Yusuf GT, Sidhu PS (2020) General principles and overview of vascular contrast-enhanced ultrasonography. Ultrasonography 39(1):22CrossRef Rafailidis V, Huang DY, Yusuf GT, Sidhu PS (2020) General principles and overview of vascular contrast-enhanced ultrasonography. Ultrasonography 39(1):22CrossRef
11.
Zurück zum Zitat Quer G, Arnaout R, Henne M, Arnaout R (2021) Machine learning and the future of cardiovascular care: JACC state-of-the-art review. J Am Coll Cardiol 77(3):300–313CrossRef Quer G, Arnaout R, Henne M, Arnaout R (2021) Machine learning and the future of cardiovascular care: JACC state-of-the-art review. J Am Coll Cardiol 77(3):300–313CrossRef
12.
Zurück zum Zitat Das PK, Meher S, Panda R, Abraham A (2021) An efficient blood-cell segmentation for the detection of hematological disorders. IEEE Trans Cybern 52(10):10615–10626CrossRef Das PK, Meher S, Panda R, Abraham A (2021) An efficient blood-cell segmentation for the detection of hematological disorders. IEEE Trans Cybern 52(10):10615–10626CrossRef
13.
Zurück zum Zitat Vimala BB, Srinivasan S, Mathivanan SK, Muthukumaran V, Babu JC, Herencsar N, Vilcekova L (2023) Image noise removal in ultrasound breast images based on hybrid deep learning technique. Sensors 23(3):1167CrossRef Vimala BB, Srinivasan S, Mathivanan SK, Muthukumaran V, Babu JC, Herencsar N, Vilcekova L (2023) Image noise removal in ultrasound breast images based on hybrid deep learning technique. Sensors 23(3):1167CrossRef
14.
Zurück zum Zitat Yancheng LI, Zeng X, Dong Q, Wang X (2023) RED-MAM: a residual encoder-decoder network based on multi-attention fusion for ultrasound image denoising. Biomed Signal Process Control 79:104062CrossRef Yancheng LI, Zeng X, Dong Q, Wang X (2023) RED-MAM: a residual encoder-decoder network based on multi-attention fusion for ultrasound image denoising. Biomed Signal Process Control 79:104062CrossRef
15.
Zurück zum Zitat Ilesanmi AE, Idowu OP, Chaumrattanakul U, Makhanov SS (2021) Multiscale hybrid algorithm for pre-processing of ultrasound images. Biomed Signal Process Control 66:102396CrossRef Ilesanmi AE, Idowu OP, Chaumrattanakul U, Makhanov SS (2021) Multiscale hybrid algorithm for pre-processing of ultrasound images. Biomed Signal Process Control 66:102396CrossRef
16.
Zurück zum Zitat Jain L, Singh P (2022) A novel wavelet thresholding rule for speckle reduction from ultrasound images. J King Saud Univ-Comput Inf Sci 34(7):4461–4471 Jain L, Singh P (2022) A novel wavelet thresholding rule for speckle reduction from ultrasound images. J King Saud Univ-Comput Inf Sci 34(7):4461–4471
17.
Zurück zum Zitat Karaoğlu O, Bilge HŞ, Uluer İ (2022) Removal of speckle noises from ultrasound images using five different deep learning networks. Eng Sci Technol Int J 29:101030 Karaoğlu O, Bilge HŞ, Uluer İ (2022) Removal of speckle noises from ultrasound images using five different deep learning networks. Eng Sci Technol Int J 29:101030
18.
Zurück zum Zitat Mikolaj K, Lin M, Bashir Z, Svendsen MBS, Tolsgaard M, Nymark A, Feragen A (2023) Removing confounding information from fetal ultrasound images. arXiv preprint arXiv:2303.13918. Mikolaj K, Lin M, Bashir Z, Svendsen MBS, Tolsgaard M, Nymark A, Feragen A (2023) Removing confounding information from fetal ultrasound images. arXiv preprint arXiv:​2303.​13918.
19.
Zurück zum Zitat Luo D, Wen H, Peng G, Lin Y, Liang M, Liao Y, Qin Y, Zeng Q, Dang J, Li S (2021) A prenatal ultrasound scanning approach: one-touch technique in second and third trimesters. Ultrasound Med Biol 47(8):2258–2265CrossRef Luo D, Wen H, Peng G, Lin Y, Liang M, Liao Y, Qin Y, Zeng Q, Dang J, Li S (2021) A prenatal ultrasound scanning approach: one-touch technique in second and third trimesters. Ultrasound Med Biol 47(8):2258–2265CrossRef
20.
Zurück zum Zitat Monkam P, Lu W, Jin S, Shan W, Wu J, Zhou X, Tang B, Zhao H, Zhang H, Ding X, Chen H (2023) US-Net: a lightweight network for simultaneous speckle suppression and texture enhancement in ultrasound images. Comput Biol Med 152:106385CrossRef Monkam P, Lu W, Jin S, Shan W, Wu J, Zhou X, Tang B, Zhao H, Zhang H, Ding X, Chen H (2023) US-Net: a lightweight network for simultaneous speckle suppression and texture enhancement in ultrasound images. Comput Biol Med 152:106385CrossRef
21.
Zurück zum Zitat Mousania Y, Karimi S, Farmani A (2023) Optical remote sensing, brightness preserving and contrast enhancement of medical images using histogram equalization with minimum cross-entropy-Otsu algorithm. Opt Quant Electron 55(2):1–22CrossRef Mousania Y, Karimi S, Farmani A (2023) Optical remote sensing, brightness preserving and contrast enhancement of medical images using histogram equalization with minimum cross-entropy-Otsu algorithm. Opt Quant Electron 55(2):1–22CrossRef
23.
Zurück zum Zitat Arican ME, Kara O, Bredell G, Konukoglu E (2022) Isnas-dip: Image-specific neural architecture search for deep image prior. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp 1960–1968) Arican ME, Kara O, Bredell G, Konukoglu E (2022) Isnas-dip: Image-specific neural architecture search for deep image prior. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp 1960–1968)
24.
Zurück zum Zitat Angah O, Chen AY (2020) Removal of occluding construction workers in job site image data using U-Net based context encoders. Autom Constr 119:103332CrossRef Angah O, Chen AY (2020) Removal of occluding construction workers in job site image data using U-Net based context encoders. Autom Constr 119:103332CrossRef
25.
Zurück zum Zitat Cai W, Wei Z (2020) PiiGAN: generative adversarial networks for pluralistic image inpainting. IEEE Access 8:48451–48463CrossRef Cai W, Wei Z (2020) PiiGAN: generative adversarial networks for pluralistic image inpainting. IEEE Access 8:48451–48463CrossRef
26.
Zurück zum Zitat Sinha AK, Moorthi SM, Dhar D (2022) NL-FFC: non-local fast fourier convolution for image super resolution. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp 467–476) Sinha AK, Moorthi SM, Dhar D (2022) NL-FFC: non-local fast fourier convolution for image super resolution. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp 467–476)
27.
Zurück zum Zitat Wang G, Jiao Y, Xu Q, Wang Y, Yang C (2021) Deep generative learning via schrödinger bridge. In: International conference on machine learning (pp 10794–10804). PMLR Wang G, Jiao Y, Xu Q, Wang Y, Yang C (2021) Deep generative learning via schrödinger bridge. In: International conference on machine learning (pp 10794–10804). PMLR
28.
Zurück zum Zitat Yu W, Du J, Liu R, Li Y, Zhu Y (2022) Interactive image inpainting using semantic guidance. In: 2022 26th international conference on pattern recognition (ICPR) (pp 168–174). IEEE Yu W, Du J, Liu R, Li Y, Zhu Y (2022) Interactive image inpainting using semantic guidance. In: 2022 26th international conference on pattern recognition (ICPR) (pp 168–174). IEEE
29.
Zurück zum Zitat Mingote V, Miguel A, Ribas D, Ortega A, Lleida E (2020) Knowledge distillation and random erasing data augmentation for text-dependent speaker verification. In: ICASSP 2020–2020 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp 6824–6828). IEEE Mingote V, Miguel A, Ribas D, Ortega A, Lleida E (2020) Knowledge distillation and random erasing data augmentation for text-dependent speaker verification. In: ICASSP 2020–2020 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp 6824–6828). IEEE
30.
Zurück zum Zitat Ma Y, Xu X, Li Y (2020) LungRN+ NL: An improved adventitious lung sound classification using non-local block resnet neural network with mixup data augmentation. In: Interspeech (pp 2902–2906) Ma Y, Xu X, Li Y (2020) LungRN+ NL: An improved adventitious lung sound classification using non-local block resnet neural network with mixup data augmentation. In: Interspeech (pp 2902–2906)
31.
Zurück zum Zitat Harris E, Marcu A, Painter M, Niranjan M, Prügel-Bennett A, Hare J (2020) Fmix: Enhancing mixed sample data augmentation. arXiv preprint arXiv:2002.12047. Harris E, Marcu A, Painter M, Niranjan M, Prügel-Bennett A, Hare J (2020) Fmix: Enhancing mixed sample data augmentation. arXiv preprint arXiv:​2002.​12047.
32.
Zurück zum Zitat Yang S, Xiao W, Zhang M, Guo S, Zhao J, Shen F (2022) Image data augmentation for deep learning: A survey. arXiv preprint arXiv:2204.08610. Yang S, Xiao W, Zhang M, Guo S, Zhao J, Shen F (2022) Image data augmentation for deep learning: A survey. arXiv preprint arXiv:​2204.​08610.
33.
Zurück zum Zitat Faryna K, van der Laak J, Litjens G (2021) Tailoring automated data augmentation to H&E-stained histopathology. In: Medical imaging with deep learning Faryna K, van der Laak J, Litjens G (2021) Tailoring automated data augmentation to H&E-stained histopathology. In: Medical imaging with deep learning
34.
Zurück zum Zitat Yamashita R, Long J, Banda S, Shen J, Rubin DL (2021) Learning domain-agnostic visual representation for computational pathology using medically-irrelevant style transfer augmentation. IEEE Trans Med Imaging 40(12):3945–3954CrossRef Yamashita R, Long J, Banda S, Shen J, Rubin DL (2021) Learning domain-agnostic visual representation for computational pathology using medically-irrelevant style transfer augmentation. IEEE Trans Med Imaging 40(12):3945–3954CrossRef
35.
Zurück zum Zitat Singh P, Shree R (2020) A new homomorphic and method noise thresholding based despeckling of SAR image using anisotropic diffusion. J King Saud Univ-Comput Inf Sci 32(1):137–148 Singh P, Shree R (2020) A new homomorphic and method noise thresholding based despeckling of SAR image using anisotropic diffusion. J King Saud Univ-Comput Inf Sci 32(1):137–148
37.
Zurück zum Zitat Guo F, Tang H, Liu W (2023) Non-local means de-speckling based on multi-directional local plane inclination angle. Remote Sens 15(4):1029CrossRef Guo F, Tang H, Liu W (2023) Non-local means de-speckling based on multi-directional local plane inclination angle. Remote Sens 15(4):1029CrossRef
38.
Zurück zum Zitat Khan SI, Choubey SB, Choubey A, Bhatt A, Naishadhkumar PV, Basha MM (2022) Automated glaucoma detection from fundus images using wavelet-based denoising and machine learning. Concurr Eng 30(1):103–115CrossRef Khan SI, Choubey SB, Choubey A, Bhatt A, Naishadhkumar PV, Basha MM (2022) Automated glaucoma detection from fundus images using wavelet-based denoising and machine learning. Concurr Eng 30(1):103–115CrossRef
40.
Zurück zum Zitat Tian Q, Li Z, Fan Q, Polimeni JR, Bilgic B, Salat DH, Huang SY (2022) SDnDTI: self-supervised deep learning-based denoising for diffusion tensor MRI. Neuroimage 253:119033CrossRef Tian Q, Li Z, Fan Q, Polimeni JR, Bilgic B, Salat DH, Huang SY (2022) SDnDTI: self-supervised deep learning-based denoising for diffusion tensor MRI. Neuroimage 253:119033CrossRef
Metadaten
Titel
Advanced Image Processing Techniques for Ultrasound Images using Multiscale Self Attention CNN
verfasst von
D. Vetriselvi
R. Thenmozhi
Publikationsdatum
15.11.2023
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 9/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-023-11404-z

Weitere Artikel der Ausgabe 9/2023

Neural Processing Letters 9/2023 Zur Ausgabe

Neuer Inhalt