Skip to main content
Erschienen in: Peer-to-Peer Networking and Applications 1/2024

01.12.2023

SVFGNN: A privacy-preserving vertical federated graph neural network model training framework based on split learning

verfasst von: Yanjun Liu, Hongwei Li, Meng Hao

Erschienen in: Peer-to-Peer Networking and Applications | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph neural network(GNN) has become one of the research field in the new wave of technological revolution and industrial transformation. High-performance GNN makes full use of structural information, aggregates neighbor information through a message passing mechanism, and finally successfully updates node embeddings, which effectively overcomes the limitations of traditional neural networks. However, in practice, an adversary can use the embedding of nodes to infer information about the architecture and parameters of the GNN model, which poses a potential threat to privacy. To solve this problem, we propose a privacy-preserving vertical federated graph neural network model training framework based on split learning (SVFGNN), an efficient secure gradient computation framework for vertical federated graph neural network models, which can be extended to existing GNN models. Specifically, in the forward propagation process, in order to reduce the client to perform a large number of calculation locally, we employ split learning for device-cloud collaborative training, and apply function-hiding multi-input function encryption technology to protect the parameters uploaded during model training. This solution not only ensures the security of model data and user privacy, but also creates high-precision models and supports lossless training. At the same time, in the process of backward propagation, in order to accurately predict the classification problem of nodes, we need to safely transmit errors and respond to client requests in a timely manner. To achieve this goal, we adopt hybrid encryption technology to realize cloud ciphertext data sharing, which eliminates point-to-point communication between various parties and significantly reduces communication overhead during model training. Compared to state-of-the-art works, our communication overhead scales linearly with the number of clients. Through the optimization of this research, we can better deal with the risk of privacy leakage, and provide a feasible security guarantee for the practical application of vertical federated graph neural network, and promote the development and progress of this field.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Pan H, Liu Y, Sun G, Fan J, Liang S, Yuen C (2023) Joint power and 3d trajectory optimization for uav-enabled wireless powered communication networks with obstacles. IEEE Trans Commun 71(4):2364–2380CrossRef Pan H, Liu Y, Sun G, Fan J, Liang S, Yuen C (2023) Joint power and 3d trajectory optimization for uav-enabled wireless powered communication networks with obstacles. IEEE Trans Commun 71(4):2364–2380CrossRef
3.
5.
Zurück zum Zitat Wang B, Li A, Pang M, Li H, Chen Y (2022) Graphfl: A federated learning framework for semi-supervised node classification on graphs. In: 2022 IEEE International Conference on Data Mining (ICDM), IEEE. pp 498–507 Wang B, Li A, Pang M, Li H, Chen Y (2022) Graphfl: A federated learning framework for semi-supervised node classification on graphs. In: 2022 IEEE International Conference on Data Mining (ICDM), IEEE. pp 498–507
7.
Zurück zum Zitat Li T, Sahu AK, Talwalkar A (2020) Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50–60CrossRef Li T, Sahu AK, Talwalkar A (2020) Smith V (2020) Federated learning: Challenges, methods, and future directions. IEEE Signal Process Mag 37(3):50–60CrossRef
9.
Zurück zum Zitat Liu J, Huang J, Zhou Y, Li X, Ji S, Xiong H, Dou D (2022) From distributed machine learning to federated learning: A survey. Knowl Inf Syst 64(4):885–917CrossRef Liu J, Huang J, Zhou Y, Li X, Ji S, Xiong H, Dou D (2022) From distributed machine learning to federated learning: A survey. Knowl Inf Syst 64(4):885–917CrossRef
11.
Zurück zum Zitat He X, Jia J, Backes M, Gong NZ, Zhang Y (2021) Stealing links from graph neural networks. In: USENIX Security Symposium, pp 2669–2686 He X, Jia J, Backes M, Gong NZ, Zhang Y (2021) Stealing links from graph neural networks. In: USENIX Security Symposium, pp 2669–2686
12.
Zurück zum Zitat Liu Y, Li H, Qian X, Hao M (2023) Esa-fedgnn: Efficient secure aggregation for federated graph neural networks. Peer-to-peer Netw Appl 16(2):1257–1269CrossRefPubMed Liu Y, Li H, Qian X, Hao M (2023) Esa-fedgnn: Efficient secure aggregation for federated graph neural networks. Peer-to-peer Netw Appl 16(2):1257–1269CrossRefPubMed
13.
Zurück zum Zitat Fu X, Zhang B, Dong Y, Chen C, Li J (2022) Federated graph machine learning: A survey of concepts, techniques, and applications. ACM SIGKDD Explorations Newsl 24(2):32–47CrossRef Fu X, Zhang B, Dong Y, Chen C, Li J (2022) Federated graph machine learning: A survey of concepts, techniques, and applications. ACM SIGKDD Explorations Newsl 24(2):32–47CrossRef
15.
Zurück zum Zitat Zheng L, Zhou J, Chen C, Wu B, Wang L, Zhang B (2021) Asfgnn: Automated separated-federated graph neural network. Peer-to-Peer Netw Appl 14(3):1692–1704CrossRef Zheng L, Zhou J, Chen C, Wu B, Wang L, Zhang B (2021) Asfgnn: Automated separated-federated graph neural network. Peer-to-Peer Netw Appl 14(3):1692–1704CrossRef
18.
Zurück zum Zitat Meng C, Rambhatla S, Liu Y (2021) Cross-node federated graph neural network for spatio-temporal data modeling. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp 1202–1211 Meng C, Rambhatla S, Liu Y (2021) Cross-node federated graph neural network for spatio-temporal data modeling. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp 1202–1211
19.
Zurück zum Zitat Liu Y, Qian X, Li H, Hao M, Guo S (2022) Fast secure aggregation for privacy-preserving federated learning. In: GLOBECOM 2022-2022 IEEE Global Communications Conference, IEEE. pp 3017–3022 Liu Y, Qian X, Li H, Hao M, Guo S (2022) Fast secure aggregation for privacy-preserving federated learning. In: GLOBECOM 2022-2022 IEEE Global Communications Conference, IEEE. pp 3017–3022
20.
Zurück zum Zitat Yin L, Feng J, Xun H, Sun Z, Cheng X (2021) A privacy-preserving federated learning for multiparty data sharing in social iots. IEEE Trans Netw Sci Eng 8(3):2706–2718CrossRef Yin L, Feng J, Xun H, Sun Z, Cheng X (2021) A privacy-preserving federated learning for multiparty data sharing in social iots. IEEE Trans Netw Sci Eng 8(3):2706–2718CrossRef
22.
Zurück zum Zitat Ion M, Kreuter B, Nergiz AE, Patel S, Raykova M, Saxena S, Seth K, Shanahan D, Yung M (2019) On deploying secure computing commercially: Private intersection-sum protocols and their business applications. IACR Cryptol ePrint Arch 2019:723 Ion M, Kreuter B, Nergiz AE, Patel S, Raykova M, Saxena S, Seth K, Shanahan D, Yung M (2019) On deploying secure computing commercially: Private intersection-sum protocols and their business applications. IACR Cryptol ePrint Arch 2019:723
23.
Zurück zum Zitat Schnell R, Bachteler T, Reiher J (2011) A novel error-tolerant anonymous linking code. Available at SSRN 3549247 Schnell R, Bachteler T, Reiher J (2011) A novel error-tolerant anonymous linking code. Available at SSRN 3549247
24.
Zurück zum Zitat Xu R, Baracaldo N, Zhou Y, Anwar A, Joshi J, Ludwig H (2021) Fedv: Privacy-preserving federated learning over vertically partitioned data. In: Proceedings of the 14th ACM Workshop on Artificial Intelligence and Security, pp 181–192 Xu R, Baracaldo N, Zhou Y, Anwar A, Joshi J, Ludwig H (2021) Fedv: Privacy-preserving federated learning over vertically partitioned data. In: Proceedings of the 14th ACM Workshop on Artificial Intelligence and Security, pp 181–192
25.
Zurück zum Zitat He C, Balasubramanian K, Ceyani E, Yang C, Xie H, Sun L, He L, Yang L, Philip SY, Rong Y et al (2021) Fedgraphnn: A federated learning benchmark system for graph neural networks. In: ICLR 2021 Workshop on Distributed and Private Machine Learning (DPML) He C, Balasubramanian K, Ceyani E, Yang C, Xie H, Sun L, He L, Yang L, Philip SY, Rong Y et al (2021) Fedgraphnn: A federated learning benchmark system for graph neural networks. In: ICLR 2021 Workshop on Distributed and Private Machine Learning (DPML)
26.
Zurück zum Zitat Gilmer J, Schoenholz SS, Riley PF, Vinyals O, Dahl GE (2017) Neural message passing for quantum chemistry. In: International Conference on Machine Learning, PMLR. pp 1263–1272 Gilmer J, Schoenholz SS, Riley PF, Vinyals O, Dahl GE (2017) Neural message passing for quantum chemistry. In: International Conference on Machine Learning, PMLR. pp 1263–1272
27.
Zurück zum Zitat Boneh D, Sahai A, Waters B (2011) Functional encryption: Definitions and challenges. In: Theory of Cryptography: 8th Theory of Cryptography Conference, TCC 2011, Providence, RI, USA, March 28-30, 2011. Proceedings 8:253–273 Boneh D, Sahai A, Waters B (2011) Functional encryption: Definitions and challenges. In: Theory of Cryptography: 8th Theory of Cryptography Conference, TCC 2011, Providence, RI, USA, March 28-30, 2011. Proceedings 8:253–273
28.
Zurück zum Zitat Goldwasser S, Gordon SD, Goyal V, Jain A, Katz J, Liu F-H, Sahai A, Shi E, Zhou H-S (2014) Multi-input functional encryption. In: EUROCRYPT, vol. 8441. Springer. pp 578–602 Goldwasser S, Gordon SD, Goyal V, Jain A, Katz J, Liu F-H, Sahai A, Shi E, Zhou H-S (2014) Multi-input functional encryption. In: EUROCRYPT, vol. 8441. Springer. pp 578–602
29.
Zurück zum Zitat Abdalla M, Catalano D, Fiore D, Gay R, Ursu B (2018) Multi-input functional encryption for inner products: Function-hiding realizations and constructions without pairings. In: Advances in Cryptology–CRYPTO 2018: 38th Annual International Cryptology Conference, Santa Barbara, CA, USA, August 19–23, 2018, Proceedings, Part I 38. Springer. pp 597–627 Abdalla M, Catalano D, Fiore D, Gay R, Ursu B (2018) Multi-input functional encryption for inner products: Function-hiding realizations and constructions without pairings. In: Advances in Cryptology–CRYPTO 2018: 38th Annual International Cryptology Conference, Santa Barbara, CA, USA, August 19–23, 2018, Proceedings, Part I 38. Springer. pp 597–627
30.
Zurück zum Zitat Bonawitz K, Ivanov V, Kreuter B, Marcedone A, McMahan HB, Patel S, Ramage D, Segal A, Seth K (2017) Practical secure aggregation for privacy-preserving machine learning. In: Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, pp 1175–1191 Bonawitz K, Ivanov V, Kreuter B, Marcedone A, McMahan HB, Patel S, Ramage D, Segal A, Seth K (2017) Practical secure aggregation for privacy-preserving machine learning. In: Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, pp 1175–1191
31.
Zurück zum Zitat Xu R, Baracaldo N, Zhou Y, Anwar A, Ludwig H (2019) Hybridalpha: An efficient approach for privacy-preserving federated learning. In: Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security, pp 13–23 Xu R, Baracaldo N, Zhou Y, Anwar A, Ludwig H (2019) Hybridalpha: An efficient approach for privacy-preserving federated learning. In: Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security, pp 13–23
32.
Zurück zum Zitat Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. Adv Neural Inf Process Syst 30 Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. Adv Neural Inf Process Syst 30
33.
Zurück zum Zitat Thapa C, Arachchige PCM, Camtepe S, Sun L (2022) Splitfed: When federated learning meets split learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp 8485–8493 Thapa C, Arachchige PCM, Camtepe S, Sun L (2022) Splitfed: When federated learning meets split learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, pp 8485–8493
34.
Zurück zum Zitat Wang Q, Li W, Qin Z (2019) Proxy re-encryption in access control framework of information-centric networks. IEEE Access 7:48417–48429CrossRef Wang Q, Li W, Qin Z (2019) Proxy re-encryption in access control framework of information-centric networks. IEEE Access 7:48417–48429CrossRef
35.
Zurück zum Zitat Agrawal S, Goyal R, Tomida J (2021) Multi-party functional encryption. In: Theory of Cryptography: 19th International Conference, TCC 2021, Raleigh, NC, USA, November 8–11, 2021, Proceedings, Part II, Springer. pp 224–255 Agrawal S, Goyal R, Tomida J (2021) Multi-party functional encryption. In: Theory of Cryptography: 19th International Conference, TCC 2021, Raleigh, NC, USA, November 8–11, 2021, Proceedings, Part II, Springer. pp 224–255
Metadaten
Titel
SVFGNN: A privacy-preserving vertical federated graph neural network model training framework based on split learning
verfasst von
Yanjun Liu
Hongwei Li
Meng Hao
Publikationsdatum
01.12.2023
Verlag
Springer US
Erschienen in
Peer-to-Peer Networking and Applications / Ausgabe 1/2024
Print ISSN: 1936-6442
Elektronische ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-023-01584-9

Weitere Artikel der Ausgabe 1/2024

Peer-to-Peer Networking and Applications 1/2024 Zur Ausgabe

Premium Partner