Skip to main content

2021 | OriginalPaper | Buchkapitel

Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching

verfasst von : Quande Liu, Hongzheng Yang, Qi Dou, Pheng-Ann Heng

Erschienen in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2021

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Federated learning (FL) has emerged with increasing popularity to collaborate distributed medical institutions for training deep networks. However, despite existing FL algorithms only allow the supervised training setting, most hospitals in realistic usually cannot afford the intricate data labeling due to absence of budget or expertise. This paper studies a practical yet challenging FL problem, named Federated Semi-supervised Learning (FSSL), which aims to learn a federated model by jointly utilizing the data from both labeled and unlabeled clients (i.e., hospitals). We present a novel approach for this problem, which improves over traditional consistency regularization mechanism with a new inter-client relation matching scheme. The proposed learning scheme explicitly connects the learning across labeled and unlabeled clients by aligning their extracted disease relationships, thereby mitigating the deficiency of task knowledge at unlabeled clients and promoting discriminative information from unlabeled samples. We validate our method on two large-scale medical image classification datasets. The effectiveness of our method has been demonstrated with the clear improvements over state-of-the-arts as well as the thorough ablation analysis on both tasks (Code will be made available at https://​github.​com/​liuquande/​FedIRM).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Chang, Q., Qu, H., Zhang, Y., Sabuncu, M., Chen, C., Zhang, T., Metaxas, D.N.: Synthetic learning: learn from distributed asynchronized discriminator GAN without sharing medical image data. In: CVPR, pp. 13856–13866 (2020) Chang, Q., Qu, H., Zhang, Y., Sabuncu, M., Chen, C., Zhang, T., Metaxas, D.N.: Synthetic learning: learn from distributed asynchronized discriminator GAN without sharing medical image data. In: CVPR, pp. 13856–13866 (2020)
4.
Zurück zum Zitat Cheplygina, V., de Bruijne, M., Pluim, J.P.: Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in Mia. MIA 54, 280–296 (2019) Cheplygina, V., de Bruijne, M., Pluim, J.P.: Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in Mia. MIA 54, 280–296 (2019)
6.
Zurück zum Zitat Dhruva, S.S., Ross, J.S., Akar, J.G., Caldwell, B., Childers, K., et al.: Aggregating multiple real-world data sources using a patient-centered health-data-sharing platform. NPJ Digit. Med. 3(1), 1–9 (2020)CrossRef Dhruva, S.S., Ross, J.S., Akar, J.G., Caldwell, B., Childers, K., et al.: Aggregating multiple real-world data sources using a patient-centered health-data-sharing platform. NPJ Digit. Med. 3(1), 1–9 (2020)CrossRef
7.
Zurück zum Zitat Dou, Q., Liu, Q., Heng, P.A., Glocker, B.: Unpaired multi-modal segmentation via knowledge distillation. IEEE TMI 39(7), 2415–2425 (2020) Dou, Q., Liu, Q., Heng, P.A., Glocker, B.: Unpaired multi-modal segmentation via knowledge distillation. IEEE TMI 39(7), 2415–2425 (2020)
8.
Zurück zum Zitat Dou, Q., So, T.Y., Jiang, M., Liu, Q., Vardhanabhuti, V., Kaissis, G., et al.: Federated deep learning for detecting COVID-19 lung abnormalities in CT: a privacy-preserving multinational validation study. NPJ Digit. Med. 4(1), 1–11 (2021)CrossRef Dou, Q., So, T.Y., Jiang, M., Liu, Q., Vardhanabhuti, V., Kaissis, G., et al.: Federated deep learning for detecting COVID-19 lung abnormalities in CT: a privacy-preserving multinational validation study. NPJ Digit. Med. 4(1), 1–11 (2021)CrossRef
9.
Zurück zum Zitat Gal, Y., Ghahramani, Z.: Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: ICML, pp. 1050–1059. PMLR (2016) Gal, Y., Ghahramani, Z.: Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: ICML, pp. 1050–1059. PMLR (2016)
11.
Zurück zum Zitat Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: CVPR, pp. 4700–4708 (2017) Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: CVPR, pp. 4700–4708 (2017)
12.
Zurück zum Zitat Kaissis, G.A., Makowski, M.R., Rückert, D., Braren, R.F.: Secure, privacy-preserving and federated machine learning in medical imaging. Nat. Mach. Intell. 1–7 (2020) Kaissis, G.A., Makowski, M.R., Rückert, D., Braren, R.F.: Secure, privacy-preserving and federated machine learning in medical imaging. Nat. Mach. Intell. 1–7 (2020)
15.
Zurück zum Zitat Li, X., Gu, Y., Dvornek, N., Staib, L.H., Ventola, P., Duncan, J.S.: Multi-site FMRI analysis using privacy-preserving federated learning and domain adaptation: abide results. MIA 65, 101765 (2020) Li, X., Gu, Y., Dvornek, N., Staib, L.H., Ventola, P., Duncan, J.S.: Multi-site FMRI analysis using privacy-preserving federated learning and domain adaptation: abide results. MIA 65, 101765 (2020)
16.
Zurück zum Zitat Liu, Q., Chen, C., Qin, J., Dou, Q., Heng, P.A.: FedDG: federated domain generalization on medical image segmentation via episodic learning in continuous frequency space. In: CVPR (2021) Liu, Q., Chen, C., Qin, J., Dou, Q., Heng, P.A.: FedDG: federated domain generalization on medical image segmentation via episodic learning in continuous frequency space. In: CVPR (2021)
17.
Zurück zum Zitat Liu, Q., Dou, Q., Yu, L., Heng, P.A.: MS-Net: multi-site network for improving prostate segmentation with heterogeneous MRI data. IEEE Trans. Med. Imaging 39, 2713–2724 (2020)CrossRef Liu, Q., Dou, Q., Yu, L., Heng, P.A.: MS-Net: multi-site network for improving prostate segmentation with heterogeneous MRI data. IEEE Trans. Med. Imaging 39, 2713–2724 (2020)CrossRef
18.
Zurück zum Zitat Liu, Q., Yu, L., Luo, L., et al.: Semi-supervised medical image classification with relation-driven self-ensembling model. IEEE TMI 39(11), 3429–3440 (2020) Liu, Q., Yu, L., Luo, L., et al.: Semi-supervised medical image classification with relation-driven self-ensembling model. IEEE TMI 39(11), 3429–3440 (2020)
19.
Zurück zum Zitat Mathur, S., Dinakarpandian, D.: Finding disease similarity based on implicit semantic similarity. J. Biomed. Inform. 45(2), 363–371 (2012)CrossRef Mathur, S., Dinakarpandian, D.: Finding disease similarity based on implicit semantic similarity. J. Biomed. Inform. 45(2), 363–371 (2012)CrossRef
20.
Zurück zum Zitat McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282 (2017) McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282 (2017)
21.
Zurück zum Zitat Oerton, E., Roberts, I., Lewis, P.S., et al.: Understanding and predicting disease relationships through similarity fusion. Bioinformatics 35(7), 1213–1220 (2019)CrossRef Oerton, E., Roberts, I., Lewis, P.S., et al.: Understanding and predicting disease relationships through similarity fusion. Bioinformatics 35(7), 1213–1220 (2019)CrossRef
22.
Zurück zum Zitat Tschandl, P., Rosendahl, C., Kittler, H.: The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 1–9 (2018)CrossRef Tschandl, P., Rosendahl, C., Kittler, H.: The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 5, 1–9 (2018)CrossRef
24.
Zurück zum Zitat Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H.R., et al.: The future of digital health with federated learning. NPJ Digit. Med. 3(1), 1–7 (2020)CrossRef Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H.R., et al.: The future of digital health with federated learning. NPJ Digit. Med. 3(1), 1–7 (2020)CrossRef
27.
Zurück zum Zitat Sheller, M.J., Reina, G.A., Edwards, B., Martin, J., Bakas, S.: Multi-institutional deep learning modeling without sharing patient data: a feasibility study on brain tumor segmentation. In: Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M., van Walsum, T. (eds.) BrainLes 2018. LNCS, vol. 11383, pp. 92–104. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-11723-8_9CrossRef Sheller, M.J., Reina, G.A., Edwards, B., Martin, J., Bakas, S.: Multi-institutional deep learning modeling without sharing patient data: a feasibility study on brain tumor segmentation. In: Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M., van Walsum, T. (eds.) BrainLes 2018. LNCS, vol. 11383, pp. 92–104. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-11723-8_​9CrossRef
28.
Zurück zum Zitat Silva, S., Gutman, B.A., Romero, E., Thompson, P.M., Altmann, A., Lorenzi, M.: Federated learning in distributed medical databases: meta-analysis of large-scale subcortical brain data. In: ISBI, pp. 270–274. IEEE (2019) Silva, S., Gutman, B.A., Romero, E., Thompson, P.M., Altmann, A., Lorenzi, M.: Federated learning in distributed medical databases: meta-analysis of large-scale subcortical brain data. In: ISBI, pp. 270–274. IEEE (2019)
29.
Zurück zum Zitat Tarvainen A., V.H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Advances Neural Information Processing Systems (2017) Tarvainen A., V.H.: Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Advances Neural Information Processing Systems (2017)
30.
Zurück zum Zitat Wang, D., Zhang, Y., Zhang, K., Wang, L.: Focalmix: semi-supervised learning for 3D medical image detection. In: CVPR, pp. 3951–3960 (2020) Wang, D., Zhang, Y., Zhang, K., Wang, L.: Focalmix: semi-supervised learning for 3D medical image detection. In: CVPR, pp. 3951–3960 (2020)
31.
Zurück zum Zitat Yang, D., Xu, Z., Li, W., Myronenko, A., Roth, H.R., Harmon, S., et al.: Federated semi-supervised learning for COVID region segmentation in chest CT using multi-national data from China, Italy, Japan. In: MIA, p. 101992 (2021) Yang, D., Xu, Z., Li, W., Myronenko, A., Roth, H.R., Harmon, S., et al.: Federated semi-supervised learning for COVID region segmentation in chest CT using multi-national data from China, Italy, Japan. In: MIA, p. 101992 (2021)
33.
Zurück zum Zitat Zhang, Z., Yao, Z., Yang, Y., Yan, Y., Gonzalez, J.E., Mahoney, M.W.: Benchmarking semi-supervised federated learning. arXiv preprint arXiv:2008.11364 (2020) Zhang, Z., Yao, Z., Yang, Y., Yan, Y., Gonzalez, J.E., Mahoney, M.W.: Benchmarking semi-supervised federated learning. arXiv preprint arXiv:​2008.​11364 (2020)
Metadaten
Titel
Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching
verfasst von
Quande Liu
Hongzheng Yang
Qi Dou
Pheng-Ann Heng
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-87199-4_31