Skip to main content

2022 | OriginalPaper | Buchkapitel

Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning

verfasst von : Xuanhua Xie, Huijie Fan, Zhencheng Yu, Haijun Bai, Yandong Tang

Erschienen in: Intelligent Robotics and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Medical image segmentation plays an important role in the diagnosis and treatment of diseases. Using fully supervised deep learning methods for medical image segmentation requires large medical image datasets with pixel-level annotations, but medical image annotation is time-consuming and labor-intensive. On this basis, we study a medical image segmentation algorithm based on image-level annotation. Existing weakly supervised semantic segmentation algorithms based on image-level annotations rely on class activation maps (CAM) and saliency maps generated by preprocessing as pseudo-labels to supervise the network. However, the CAMs generated by many existing methods are often over-activated or under-activated, while most of the saliency map generated by preprocessing is also rough and cannot be updated online, which will affect the segmentation effect. In response to this situation, we study a weakly supervised medical image segmentation algorithm based on multi-task learning, which uses graph convolution to correct for improper activation, and uses similarity learning to update pseudo-labels online to improve segmentation performance. We conducted extensive experiments on ISIC2017 skin disease images to validate the proposed method and experiments show that our method achieves a Dice evaluation metric of 68.38% on this dataset, show that our approach outperforms state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation (2017) Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation (2017)
3.
Zurück zum Zitat Chen, Y., Rohrbach, M., Yan, Z., Yan, S., Feng, J., Kalantidis, Y.: Graph-based global reasoning networks. IEEE (2020) Chen, Y., Rohrbach, M., Yan, Z., Yan, S., Feng, J., Kalantidis, Y.: Graph-based global reasoning networks. IEEE (2020)
4.
Zurück zum Zitat Codella, N., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) (2017) Codella, N., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) (2017)
5.
Zurück zum Zitat Fan, J., Zhang, Z., Song, C., Tan, T.: Learning integral objects with intra-class discriminator for weakly-supervised semantic segmentation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020) Fan, J., Zhang, Z., Song, C., Tan, T.: Learning integral objects with intra-class discriminator for weakly-supervised semantic segmentation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
6.
Zurück zum Zitat Fan, R., Hou, Q., Cheng, M.-M., Yu, G., Martin, R.R., Hu, S.-M.: Associating inter-image salient instances for weakly supervised semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11213, pp. 371–388. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01240-3_23CrossRef Fan, R., Hou, Q., Cheng, M.-M., Yu, G., Martin, R.R., Hu, S.-M.: Associating inter-image salient instances for weakly supervised semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11213, pp. 371–388. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-030-01240-3_​23CrossRef
7.
Zurück zum Zitat Huang, Z., Wang, X., Wang, J., Liu, W., Wang, J.: Weakly-supervised semantic segmentation network with deep seeded region growing. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018) Huang, Z., Wang, X., Wang, J., Liu, W., Wang, J.: Weakly-supervised semantic segmentation network with deep seeded region growing. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018)
8.
Zurück zum Zitat Khoreva, A., Benenson, R., Hosang, J., Hein, M., Schiele, B.: Simple does it: weakly supervised instance and semantic segmentation. IEEE Computer Society (2016) Khoreva, A., Benenson, R., Hosang, J., Hein, M., Schiele, B.: Simple does it: weakly supervised instance and semantic segmentation. IEEE Computer Society (2016)
9.
Zurück zum Zitat Lee, J., Kim, E., Lee, S., Lee, J., Yoon, S.: FickleNet: weakly and semi-supervised semantic image segmentation using stochastic inference. IEEE (2019) Lee, J., Kim, E., Lee, S., Lee, J., Yoon, S.: FickleNet: weakly and semi-supervised semantic image segmentation using stochastic inference. IEEE (2019)
10.
Zurück zum Zitat Lee, S., Lee, M., Lee, J., Shim, H.: Railroad is not a train: saliency as pseudo-pixel supervision for weakly supervised semantic segmentation (2021) Lee, S., Lee, M., Lee, J., Shim, H.: Railroad is not a train: saliency as pseudo-pixel supervision for weakly supervised semantic segmentation (2021)
11.
Zurück zum Zitat Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2015)
12.
Zurück zum Zitat Meng, T., Perazzi, F., Djelouah, A., Ayed, I.B., Boykov, Y.: On regularized losses for weakly-supervised CNN segmentation (2018) Meng, T., Perazzi, F., Djelouah, A., Ayed, I.B., Boykov, Y.: On regularized losses for weakly-supervised CNN segmentation (2018)
13.
Zurück zum Zitat Oh, S.J., Benenson, R., Khoreva, A., Akata, Z., Schiele, B.: Exploiting saliency for object segmentation from image level labels. IEEE (2017) Oh, S.J., Benenson, R., Khoreva, A., Akata, Z., Schiele, B.: Exploiting saliency for object segmentation from image level labels. IEEE (2017)
14.
Zurück zum Zitat Papandreou, G., Chen, L.C., Murphy, K.P., Yuille, A.L.: Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: IEEE International Conference on Computer Vision (2016) Papandreou, G., Chen, L.C., Murphy, K.P., Yuille, A.L.: Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: IEEE International Conference on Computer Vision (2016)
15.
Zurück zum Zitat Song, C., Huang, Y., Ouyang, W., Wang, L.: Box-driven class-wise region masking and filling rate guided loss for weakly supervised semantic segmentation. IEEE (2019) Song, C., Huang, Y., Ouyang, W., Wang, L.: Box-driven class-wise region masking and filling rate guided loss for weakly supervised semantic segmentation. IEEE (2019)
16.
Zurück zum Zitat Vernaza, P., Chandraker, M.: Learning random-walk label propagation for weakly-supervised semantic segmentation (2018) Vernaza, P., Chandraker, M.: Learning random-walk label propagation for weakly-supervised semantic segmentation (2018)
17.
Zurück zum Zitat Wang, X., You, S., Li, X., Ma, H.: Weakly-supervised semantic segmentation by iteratively mining common object features. IEEE (2018) Wang, X., You, S., Li, X., Ma, H.: Weakly-supervised semantic segmentation by iteratively mining common object features. IEEE (2018)
18.
Zurück zum Zitat Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. IEEE (2017) Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. IEEE (2017)
19.
Zurück zum Zitat Wei, Y., Xiao, H., Shi, H., Jie, Z., Fe Ng, J., Huang, T.S.: Revisiting dilated convolution: a simple approach for weakly- and semi- supervised semantic segmentation. IEEE (2018) Wei, Y., Xiao, H., Shi, H., Jie, Z., Fe Ng, J., Huang, T.S.: Revisiting dilated convolution: a simple approach for weakly- and semi- supervised semantic segmentation. IEEE (2018)
20.
Zurück zum Zitat Wu, Z., Shen, C., Hengel, A.: Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recogn. (2016) Wu, Z., Shen, C., Hengel, A.: Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recogn. (2016)
21.
Zurück zum Zitat Xiao, H., Feng, J., Wei, Y., Zhang, M.: Self-explanatory deep salient object detection (2017) Xiao, H., Feng, J., Wei, Y., Zhang, M.: Self-explanatory deep salient object detection (2017)
22.
Zurück zum Zitat Yang, G.Y., Li, X.L., Martin, R.R., Hu, S.M.: Sampling equivariant self-attention networks for object detection in aerial images. arXiv e-prints (2021) Yang, G.Y., Li, X.L., Martin, R.R., Hu, S.M.: Sampling equivariant self-attention networks for object detection in aerial images. arXiv e-prints (2021)
23.
Zurück zum Zitat Yao, Y., et al.: Non-salient region object mining for weakly supervised semantic segmentation (2021) Yao, Y., et al.: Non-salient region object mining for weakly supervised semantic segmentation (2021)
24.
Zurück zum Zitat Zhang, B., Xiao, J., Wei, Y., Sun, M., Huang, K.: Reliability does matter: an end-to-end weakly supervised semantic segmentation approach. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 7, pp. 12765–12772 (2020) Zhang, B., Xiao, J., Wei, Y., Sun, M., Huang, K.: Reliability does matter: an end-to-end weakly supervised semantic segmentation approach. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 7, pp. 12765–12772 (2020)
25.
Zurück zum Zitat Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. IEEE Computer Society (2016) Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. IEEE Computer Society (2016)
26.
Zurück zum Zitat Zhao, H., et al.: PSANet: point-wise spatial attention network for scene parsing. In: European Conference on Computer Vision (2018) Zhao, H., et al.: PSANet: point-wise spatial attention network for scene parsing. In: European Conference on Computer Vision (2018)
27.
Zurück zum Zitat Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. IEEE Computer Society (2016) Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. IEEE Computer Society (2016)
Metadaten
Titel
Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning
verfasst von
Xuanhua Xie
Huijie Fan
Zhencheng Yu
Haijun Bai
Yandong Tang
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-031-13822-5_35

Premium Partner