Skip to main content
Top

2022 | OriginalPaper | Chapter

Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning

Authors : Xuanhua Xie, Huijie Fan, Zhencheng Yu, Haijun Bai, Yandong Tang

Published in: Intelligent Robotics and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Medical image segmentation plays an important role in the diagnosis and treatment of diseases. Using fully supervised deep learning methods for medical image segmentation requires large medical image datasets with pixel-level annotations, but medical image annotation is time-consuming and labor-intensive. On this basis, we study a medical image segmentation algorithm based on image-level annotation. Existing weakly supervised semantic segmentation algorithms based on image-level annotations rely on class activation maps (CAM) and saliency maps generated by preprocessing as pseudo-labels to supervise the network. However, the CAMs generated by many existing methods are often over-activated or under-activated, while most of the saliency map generated by preprocessing is also rough and cannot be updated online, which will affect the segmentation effect. In response to this situation, we study a weakly supervised medical image segmentation algorithm based on multi-task learning, which uses graph convolution to correct for improper activation, and uses similarity learning to update pseudo-labels online to improve segmentation performance. We conducted extensive experiments on ISIC2017 skin disease images to validate the proposed method and experiments show that our method achieves a Dice evaluation metric of 68.38% on this dataset, show that our approach outperforms state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation (2017) Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation (2017)
3.
go back to reference Chen, Y., Rohrbach, M., Yan, Z., Yan, S., Feng, J., Kalantidis, Y.: Graph-based global reasoning networks. IEEE (2020) Chen, Y., Rohrbach, M., Yan, Z., Yan, S., Feng, J., Kalantidis, Y.: Graph-based global reasoning networks. IEEE (2020)
4.
go back to reference Codella, N., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) (2017) Codella, N., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) (2017)
5.
go back to reference Fan, J., Zhang, Z., Song, C., Tan, T.: Learning integral objects with intra-class discriminator for weakly-supervised semantic segmentation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020) Fan, J., Zhang, Z., Song, C., Tan, T.: Learning integral objects with intra-class discriminator for weakly-supervised semantic segmentation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
6.
7.
go back to reference Huang, Z., Wang, X., Wang, J., Liu, W., Wang, J.: Weakly-supervised semantic segmentation network with deep seeded region growing. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018) Huang, Z., Wang, X., Wang, J., Liu, W., Wang, J.: Weakly-supervised semantic segmentation network with deep seeded region growing. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018)
8.
go back to reference Khoreva, A., Benenson, R., Hosang, J., Hein, M., Schiele, B.: Simple does it: weakly supervised instance and semantic segmentation. IEEE Computer Society (2016) Khoreva, A., Benenson, R., Hosang, J., Hein, M., Schiele, B.: Simple does it: weakly supervised instance and semantic segmentation. IEEE Computer Society (2016)
9.
go back to reference Lee, J., Kim, E., Lee, S., Lee, J., Yoon, S.: FickleNet: weakly and semi-supervised semantic image segmentation using stochastic inference. IEEE (2019) Lee, J., Kim, E., Lee, S., Lee, J., Yoon, S.: FickleNet: weakly and semi-supervised semantic image segmentation using stochastic inference. IEEE (2019)
10.
go back to reference Lee, S., Lee, M., Lee, J., Shim, H.: Railroad is not a train: saliency as pseudo-pixel supervision for weakly supervised semantic segmentation (2021) Lee, S., Lee, M., Lee, J., Shim, H.: Railroad is not a train: saliency as pseudo-pixel supervision for weakly supervised semantic segmentation (2021)
11.
go back to reference Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2015)
12.
go back to reference Meng, T., Perazzi, F., Djelouah, A., Ayed, I.B., Boykov, Y.: On regularized losses for weakly-supervised CNN segmentation (2018) Meng, T., Perazzi, F., Djelouah, A., Ayed, I.B., Boykov, Y.: On regularized losses for weakly-supervised CNN segmentation (2018)
13.
go back to reference Oh, S.J., Benenson, R., Khoreva, A., Akata, Z., Schiele, B.: Exploiting saliency for object segmentation from image level labels. IEEE (2017) Oh, S.J., Benenson, R., Khoreva, A., Akata, Z., Schiele, B.: Exploiting saliency for object segmentation from image level labels. IEEE (2017)
14.
go back to reference Papandreou, G., Chen, L.C., Murphy, K.P., Yuille, A.L.: Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: IEEE International Conference on Computer Vision (2016) Papandreou, G., Chen, L.C., Murphy, K.P., Yuille, A.L.: Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: IEEE International Conference on Computer Vision (2016)
15.
go back to reference Song, C., Huang, Y., Ouyang, W., Wang, L.: Box-driven class-wise region masking and filling rate guided loss for weakly supervised semantic segmentation. IEEE (2019) Song, C., Huang, Y., Ouyang, W., Wang, L.: Box-driven class-wise region masking and filling rate guided loss for weakly supervised semantic segmentation. IEEE (2019)
16.
go back to reference Vernaza, P., Chandraker, M.: Learning random-walk label propagation for weakly-supervised semantic segmentation (2018) Vernaza, P., Chandraker, M.: Learning random-walk label propagation for weakly-supervised semantic segmentation (2018)
17.
go back to reference Wang, X., You, S., Li, X., Ma, H.: Weakly-supervised semantic segmentation by iteratively mining common object features. IEEE (2018) Wang, X., You, S., Li, X., Ma, H.: Weakly-supervised semantic segmentation by iteratively mining common object features. IEEE (2018)
18.
go back to reference Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. IEEE (2017) Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. IEEE (2017)
19.
go back to reference Wei, Y., Xiao, H., Shi, H., Jie, Z., Fe Ng, J., Huang, T.S.: Revisiting dilated convolution: a simple approach for weakly- and semi- supervised semantic segmentation. IEEE (2018) Wei, Y., Xiao, H., Shi, H., Jie, Z., Fe Ng, J., Huang, T.S.: Revisiting dilated convolution: a simple approach for weakly- and semi- supervised semantic segmentation. IEEE (2018)
20.
go back to reference Wu, Z., Shen, C., Hengel, A.: Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recogn. (2016) Wu, Z., Shen, C., Hengel, A.: Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recogn. (2016)
21.
go back to reference Xiao, H., Feng, J., Wei, Y., Zhang, M.: Self-explanatory deep salient object detection (2017) Xiao, H., Feng, J., Wei, Y., Zhang, M.: Self-explanatory deep salient object detection (2017)
22.
go back to reference Yang, G.Y., Li, X.L., Martin, R.R., Hu, S.M.: Sampling equivariant self-attention networks for object detection in aerial images. arXiv e-prints (2021) Yang, G.Y., Li, X.L., Martin, R.R., Hu, S.M.: Sampling equivariant self-attention networks for object detection in aerial images. arXiv e-prints (2021)
23.
go back to reference Yao, Y., et al.: Non-salient region object mining for weakly supervised semantic segmentation (2021) Yao, Y., et al.: Non-salient region object mining for weakly supervised semantic segmentation (2021)
24.
go back to reference Zhang, B., Xiao, J., Wei, Y., Sun, M., Huang, K.: Reliability does matter: an end-to-end weakly supervised semantic segmentation approach. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 7, pp. 12765–12772 (2020) Zhang, B., Xiao, J., Wei, Y., Sun, M., Huang, K.: Reliability does matter: an end-to-end weakly supervised semantic segmentation approach. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 7, pp. 12765–12772 (2020)
25.
go back to reference Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. IEEE Computer Society (2016) Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. IEEE Computer Society (2016)
26.
go back to reference Zhao, H., et al.: PSANet: point-wise spatial attention network for scene parsing. In: European Conference on Computer Vision (2018) Zhao, H., et al.: PSANet: point-wise spatial attention network for scene parsing. In: European Conference on Computer Vision (2018)
27.
go back to reference Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. IEEE Computer Society (2016) Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. IEEE Computer Society (2016)
Metadata
Title
Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning
Authors
Xuanhua Xie
Huijie Fan
Zhencheng Yu
Haijun Bai
Yandong Tang
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-031-13822-5_35

Premium Partner