Skip to main content
Top

2023 | OriginalPaper | Chapter

Continuous Deep Learning Based on Knowledge Transfer in Edge Computing

Authors : Wenquan Jin, Minh Quang Hoang, Luong Trung Kien, Le Anh Ngoc

Published in: Intelligent Systems and Networks

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Edge computing enables real-time intelligent services to be provided near the environment where the data is generated. However, providing intelligent services requires sufficient computing ability that is limited by edge devices. Knowledge transfer is an approach that transfers the trained model from an edge device to another edge device. In this paper, we propose a continuous deep-learning approach based on knowledge transfer to reduce the training epochs of a single-edge device without sharing the data in the edge computing environment. For training deep learning continuously in the network edge, each edge device includes a deep learning model and local dataset to fine-tune the reached model. The fine-tuning is completed, then, the updated model is transferred to the next edge device. For experimenting with the proposed approach, edge computing is comprised of multiple edge devices that are emulated by the virtual machines to operate the deep learning model and simulate the network communication. The deep learning model is developed for classification based on Convolutional Neural Network (CNN). As expected, the prediction accuracy is improved in multiple iterations of transferring in the edge computing environment.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wang, S., et al.: Adaptive federated learning in resource constrained edge computing systems. IEEE J. Sel. Areas Commun. 37(6), 1205–1221 (2019)MathSciNetCrossRef Wang, S., et al.: Adaptive federated learning in resource constrained edge computing systems. IEEE J. Sel. Areas Commun. 37(6), 1205–1221 (2019)MathSciNetCrossRef
2.
go back to reference Chatterjee, B., Cao, N., Raychowdhury, A., Sen, S.: Context-aware intelligence in resource-constrained IoT nodes: opportunities and challenges. IEEE Des. Test 36(2), 7–40 (2019)CrossRef Chatterjee, B., Cao, N., Raychowdhury, A., Sen, S.: Context-aware intelligence in resource-constrained IoT nodes: opportunities and challenges. IEEE Des. Test 36(2), 7–40 (2019)CrossRef
3.
go back to reference Jang, I., Kim, H., Lee, D., Son, Y.S., Kim, S.: Knowledge transfer for on-device deep reinforcement learning in resource constrained edge computing systems. IEEE Access 8, 146588–146597 (2020)CrossRef Jang, I., Kim, H., Lee, D., Son, Y.S., Kim, S.: Knowledge transfer for on-device deep reinforcement learning in resource constrained edge computing systems. IEEE Access 8, 146588–146597 (2020)CrossRef
4.
go back to reference Wang, F., Zhang, M., Wang, X., Ma, X., Liu, J.: Deep learning for edge computing applications: a state-of-the-art survey. IEEE Access 8, 58322–58336 (2020)CrossRef Wang, F., Zhang, M., Wang, X., Ma, X., Liu, J.: Deep learning for edge computing applications: a state-of-the-art survey. IEEE Access 8, 58322–58336 (2020)CrossRef
5.
go back to reference Xu, R., Jin, W., Hong, Y., Kim, D.H.: Intelligent optimization mechanism based on an objective function for efficient home appliances control in an embedded edge platform. Electronics 10(12), 1460 (2021)CrossRef Xu, R., Jin, W., Hong, Y., Kim, D.H.: Intelligent optimization mechanism based on an objective function for efficient home appliances control in an embedded edge platform. Electronics 10(12), 1460 (2021)CrossRef
6.
7.
go back to reference Jin, W., Xu, R., Lim, S., Park, D.H., Park, C., Kim, D.: Dynamic inference approach based on rules engine in intelligent edge computing for building environment control. Sensors 21(2), 630 (2021)CrossRef Jin, W., Xu, R., Lim, S., Park, D.H., Park, C., Kim, D.: Dynamic inference approach based on rules engine in intelligent edge computing for building environment control. Sensors 21(2), 630 (2021)CrossRef
8.
go back to reference Sharma, R., Biookaghazadeh, S., Li, B., Zhao, M.: Are existing knowledge transfer techniques effective for deep learning with edge devices?. In: 2018 IEEE International conference on edge computing (EDGE), pp. 42–49. IEEE (2018, July) Sharma, R., Biookaghazadeh, S., Li, B., Zhao, M.: Are existing knowledge transfer techniques effective for deep learning with edge devices?. In: 2018 IEEE International conference on edge computing (EDGE), pp. 42–49. IEEE (2018, July)
9.
go back to reference Li, H., Ota, K., Dong, M.: Learning IoT in edge: deep learning for the Internet of Things with edge computing. IEEE Netw. 32(1), 96–101 (2018)CrossRef Li, H., Ota, K., Dong, M.: Learning IoT in edge: deep learning for the Internet of Things with edge computing. IEEE Netw. 32(1), 96–101 (2018)CrossRef
10.
go back to reference Sufian, A., You, C., Dong, M.: A deep transfer learning-based edge computing method for home health monitoring. In: 2021 55th Annual Conference on Information Sciences and Systems (CISS), pp. 1–6. IEEE (2021, March) Sufian, A., You, C., Dong, M.: A deep transfer learning-based edge computing method for home health monitoring. In: 2021 55th Annual Conference on Information Sciences and Systems (CISS), pp. 1–6. IEEE (2021, March)
11.
go back to reference Akram, M.W., Li, G., Jin, Y., Chen, X., Zhu, C., Ahmad, A.: Automatic detection of photovoltaic module defects in infrared images with isolated and develop-model transfer deep learning. Sol. Energy 198, 175–186 (2020)CrossRef Akram, M.W., Li, G., Jin, Y., Chen, X., Zhu, C., Ahmad, A.: Automatic detection of photovoltaic module defects in infrared images with isolated and develop-model transfer deep learning. Sol. Energy 198, 175–186 (2020)CrossRef
13.
go back to reference Li, E., Zhou, Z., Chen, X.: Edge intelligence: on-demand deep learning model co-inference with device-edge synergy. In: Proceedings of the 2018 Workshop on Mobile Edge Communications, pp. 31–36 (2018, August) Li, E., Zhou, Z., Chen, X.: Edge intelligence: on-demand deep learning model co-inference with device-edge synergy. In: Proceedings of the 2018 Workshop on Mobile Edge Communications, pp. 31–36 (2018, August)
Metadata
Title
Continuous Deep Learning Based on Knowledge Transfer in Edge Computing
Authors
Wenquan Jin
Minh Quang Hoang
Luong Trung Kien
Le Anh Ngoc
Copyright Year
2023
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-4725-6_59

Premium Partner