Skip to main content
Top

31-05-2023

A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications

Authors: Shuyu Lyu, Xinfa Dai, Zhong Ma, Ying Zhou, Xing Liu, Yi Gao, Zhekun Hu

Published in: Mobile Networks and Applications

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Cloud-edge collaborative computing (CECC) is a critical way to solve the real-time problems in the Medical Internet of Things (MIoT) and Industrial IoT (IIoT) applications. However, how to efficiently schedule the real-time and non real-time tasks to the cloud or edge servers that are configured with heterogeneous computing resources such as GPUs, NPUs and FGPAs remains a critical challenge. To address this challenge, this paper first defines the capability elements of CECC architecture, and then formally describes the workflow containerized tasks and heterogeneous computing resources of CECC system. Next, it proposes a heuristic task scheduling algorithm based on the affinity between tasks and nodes (physical machines or virtual machines) by matching the task resource requests with the node resource configurations. Later, it generates the initial mapping matrix between tasks and nodes with the affinity sorting result. And finally, it optimizes the mapping results under the constraints of limited resources and task dependency, which consequently generates an efficient scheduling scheme for the real-time IoT tasks in the CECC system. Experimental results demonstrate that the proposed algorithm can effectively increases the utilization efficiency of heterogeneous resources and improves the scheduling performance of real-time IoT tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Demirel BU, Bayoumy IA, MaA F (2022) Energy-efficient real-time heart monitoring on edge-fog-cloud internet of medical things. IEEE Internet Things J 9:12472–12481CrossRef Demirel BU, Bayoumy IA, MaA F (2022) Energy-efficient real-time heart monitoring on edge-fog-cloud internet of medical things. IEEE Internet Things J 9:12472–12481CrossRef
2.
go back to reference Sánchez-Gallegos DD, Galaviz-Mosqueda A, Gonzalez-Compean JL et al (2020) On the continuous processing of health data in edge-fog-cloud computing by using micro/nanoservice composition. IEEE Access 8:120255–120281CrossRef Sánchez-Gallegos DD, Galaviz-Mosqueda A, Gonzalez-Compean JL et al (2020) On the continuous processing of health data in edge-fog-cloud computing by using micro/nanoservice composition. IEEE Access 8:120255–120281CrossRef
3.
go back to reference Kajati E, Papcun P, Liu C et al (2019) Cloud based cyber-physical systems: network evaluation study. Adv Eng Inform 42:100988CrossRef Kajati E, Papcun P, Liu C et al (2019) Cloud based cyber-physical systems: network evaluation study. Adv Eng Inform 42:100988CrossRef
4.
go back to reference Hao Y, Chen M, Gharavi H et al (2021) Deep reinforcement learning for edge service placement in softwarized industrial cyber-physical system. IEEE Trans Industr Inf 17:5552–5561CrossRef Hao Y, Chen M, Gharavi H et al (2021) Deep reinforcement learning for edge service placement in softwarized industrial cyber-physical system. IEEE Trans Industr Inf 17:5552–5561CrossRef
5.
go back to reference Lin B, Huang Y, Zhang J et al (2020) Cost-driven off-loading for DNN-based applications over cloud, edge, and end devices. IEEE Trans Industr Inf 16:5456–5466CrossRef Lin B, Huang Y, Zhang J et al (2020) Cost-driven off-loading for DNN-based applications over cloud, edge, and end devices. IEEE Trans Industr Inf 16:5456–5466CrossRef
6.
go back to reference Satyanarayanan M (2017) The emergence of edge computing. Computer 50:30–39CrossRef Satyanarayanan M (2017) The emergence of edge computing. Computer 50:30–39CrossRef
7.
go back to reference Hu M, Xie Z, Wu D et al (2020) Heterogeneous edge offloading with incomplete information: a minority game approach. IEEE Trans Parallel Distrib Syst 31:2139–2154CrossRef Hu M, Xie Z, Wu D et al (2020) Heterogeneous edge offloading with incomplete information: a minority game approach. IEEE Trans Parallel Distrib Syst 31:2139–2154CrossRef
8.
go back to reference Qiu T, Chi J, Zhou X et al (2020) Edge computing in industrial internet of things: architecture, advances and challenges. IEEE Commun Surv Tutorials 22:2462–2488CrossRef Qiu T, Chi J, Zhou X et al (2020) Edge computing in industrial internet of things: architecture, advances and challenges. IEEE Commun Surv Tutorials 22:2462–2488CrossRef
9.
go back to reference Vasconcelos FFX, Sarmento RM, Rebouças Filho PP et al (2020) Artificial intelligence techniques empowered edge-cloud architecture for brain CT image analysis. Eng Appl Artif Intell 91:103585CrossRef Vasconcelos FFX, Sarmento RM, Rebouças Filho PP et al (2020) Artificial intelligence techniques empowered edge-cloud architecture for brain CT image analysis. Eng Appl Artif Intell 91:103585CrossRef
10.
go back to reference Kaur K, Garg S, Aujla GS et al (2018) Edge computing in the industrial internet of things environment: software-defined-networks-based edge-cloud interplay. IEEE Commun Mag 56:44–51CrossRef Kaur K, Garg S, Aujla GS et al (2018) Edge computing in the industrial internet of things environment: software-defined-networks-based edge-cloud interplay. IEEE Commun Mag 56:44–51CrossRef
11.
go back to reference Xia C, Zhang Y, Wang L et al (2018) Microservice-based cloud robotics system for intelligent space. Robot Auton Syst 110:139–150CrossRef Xia C, Zhang Y, Wang L et al (2018) Microservice-based cloud robotics system for intelligent space. Robot Auton Syst 110:139–150CrossRef
12.
go back to reference Jiang Q, Leung VCM, Tang H et al (2019) Adaptive scheduling of stochastic task sequence for energy-efficient mobile cloud computing. IEEE Syst J 13:3022–3025CrossRef Jiang Q, Leung VCM, Tang H et al (2019) Adaptive scheduling of stochastic task sequence for energy-efficient mobile cloud computing. IEEE Syst J 13:3022–3025CrossRef
13.
go back to reference Yuan H, Bi J, Zhou M (2019) Spatiotemporal task scheduling for heterogeneous delay-tolerant applications in distributed green data centers. IEEE Trans Autom Sci Eng 16:1686–1697CrossRef Yuan H, Bi J, Zhou M (2019) Spatiotemporal task scheduling for heterogeneous delay-tolerant applications in distributed green data centers. IEEE Trans Autom Sci Eng 16:1686–1697CrossRef
14.
go back to reference Li K, Tang X, Li K (2014) Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans Parallel Distrib Syst 25:2867–2876CrossRef Li K, Tang X, Li K (2014) Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans Parallel Distrib Syst 25:2867–2876CrossRef
15.
go back to reference Ghodsi A, Zaharia M, Hindman B et al (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX conference on Networked systems design and implementation. USENIX Association, Boston, MA, pp 323–336 Ghodsi A, Zaharia M, Hindman B et al (2011) Dominant resource fairness: fair allocation of multiple resource types. In: Proceedings of the 8th USENIX conference on Networked systems design and implementation. USENIX Association, Boston, MA, pp 323–336
16.
go back to reference Abrishami S, Naghibzadeh M, Epema D (2013) Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds. Futur Gener Comput Syst 29:158–169CrossRef Abrishami S, Naghibzadeh M, Epema D (2013) Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds. Futur Gener Comput Syst 29:158–169CrossRef
17.
go back to reference Lakhan A, Sodhro AH, Majumdar A et al (2022) A lightweight secure adaptive approach for internet-of-medical-things healthcare applications in edge-cloud-based networks. Sensors 22 Lakhan A, Sodhro AH, Majumdar A et al (2022) A lightweight secure adaptive approach for internet-of-medical-things healthcare applications in edge-cloud-based networks. Sensors 22
18.
go back to reference Aujla GS, Kumar N, Zomaya AY et al (2018) Optimal decision making for big data processing at edge-cloud environment: an SDN perspective. IEEE Trans Industr Inf 14:778–789CrossRef Aujla GS, Kumar N, Zomaya AY et al (2018) Optimal decision making for big data processing at edge-cloud environment: an SDN perspective. IEEE Trans Industr Inf 14:778–789CrossRef
19.
go back to reference Wen Z, Garg S, Aujla GS et al (2021) Running industrial workflow applications in a software-defined multicloud environment using green energy aware scheduling algorithm. IEEE Trans Industr Inf 17:5645–5656CrossRef Wen Z, Garg S, Aujla GS et al (2021) Running industrial workflow applications in a software-defined multicloud environment using green energy aware scheduling algorithm. IEEE Trans Industr Inf 17:5645–5656CrossRef
20.
go back to reference Chekired DA, Khoukhi L, Mouftah HT (2018) Industrial IoT data scheduling based on hierarchical fog computing: a key for enabling smart factory. IEEE Trans Industr Inf 14:4590–4602CrossRef Chekired DA, Khoukhi L, Mouftah HT (2018) Industrial IoT data scheduling based on hierarchical fog computing: a key for enabling smart factory. IEEE Trans Industr Inf 14:4590–4602CrossRef
21.
go back to reference Du R, Liu C, Gao Y et al (2022) Collaborative cloud-edge-end task offloading in NOMA-enabled mobile edge computing using deep learning. J Grid Comput 20:14CrossRef Du R, Liu C, Gao Y et al (2022) Collaborative cloud-edge-end task offloading in NOMA-enabled mobile edge computing using deep learning. J Grid Comput 20:14CrossRef
22.
go back to reference Yin L, Luo J, Luo H (2018) Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans Industr Inf 14:4712–4721CrossRef Yin L, Luo J, Luo H (2018) Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans Industr Inf 14:4712–4721CrossRef
23.
go back to reference Medel V, Tolosana-Calasanz R, Bañares J et al (2018) Characterising resource management performance in Kubernetes. Comput Electr Eng 68:286–297CrossRef Medel V, Tolosana-Calasanz R, Bañares J et al (2018) Characterising resource management performance in Kubernetes. Comput Electr Eng 68:286–297CrossRef
24.
go back to reference Kaur K, Garg S, Kaddoum G et al (2020) KEIDS: kubernetes-based energy and interference driven scheduler for industrial IoT in edge-cloud ecosystem. IEEE Internet Things J 7:4228–4237CrossRef Kaur K, Garg S, Kaddoum G et al (2020) KEIDS: kubernetes-based energy and interference driven scheduler for industrial IoT in edge-cloud ecosystem. IEEE Internet Things J 7:4228–4237CrossRef
25.
go back to reference Nguyen ND, Phan LA, Park DH et al (2020) ElasticFog: elastic resource provisioning in container-based fog computing. IEEE Access 8:183879–183890CrossRef Nguyen ND, Phan LA, Park DH et al (2020) ElasticFog: elastic resource provisioning in container-based fog computing. IEEE Access 8:183879–183890CrossRef
26.
go back to reference Liu X, Zhang M, Zou C, Yang J, Yan X (2021) Edge intelligence for smart metro systems: architecture and enabling technologies. IEEE Network 36(1):136–143CrossRef Liu X, Zhang M, Zou C, Yang J, Yan X (2021) Edge intelligence for smart metro systems: architecture and enabling technologies. IEEE Network 36(1):136–143CrossRef
27.
go back to reference Filip I, Pop F, Serbanescu C et al (2018) Microservices scheduling model over heterogeneous cloud-edge environments as support for IoT applications. IEEE Internet Things J 5:2672–2681CrossRef Filip I, Pop F, Serbanescu C et al (2018) Microservices scheduling model over heterogeneous cloud-edge environments as support for IoT applications. IEEE Internet Things J 5:2672–2681CrossRef
28.
go back to reference Cao K, Li L, Cui Y et al (2021) Exploring placement of heterogeneous edge servers for response time minimization in mobile edge-cloud computing. IEEE Trans Industr Inf 17:494–503CrossRef Cao K, Li L, Cui Y et al (2021) Exploring placement of heterogeneous edge servers for response time minimization in mobile edge-cloud computing. IEEE Trans Industr Inf 17:494–503CrossRef
29.
go back to reference Gai K, Qin X, Zhu L (2021) An energy-aware high performance task allocation strategy in heterogeneous fog computing environments. IEEE Trans Comput 70:626–639CrossRefMATH Gai K, Qin X, Zhu L (2021) An energy-aware high performance task allocation strategy in heterogeneous fog computing environments. IEEE Trans Comput 70:626–639CrossRefMATH
30.
go back to reference Sadok H, Campista MEM, Costa LHMK (2021) Stateful DRF: considering the past in a multi-resource allocation. IEEE Trans Comput 70:1094–1105MathSciNetCrossRefMATH Sadok H, Campista MEM, Costa LHMK (2021) Stateful DRF: considering the past in a multi-resource allocation. IEEE Trans Comput 70:1094–1105MathSciNetCrossRefMATH
31.
go back to reference Gai K, Qiu M, Zhao H et al (2018) Resource management in sustainable cyber-physical systems using heterogeneous cloud computing. IEEE Trans Sustain Comput 3:60–72CrossRef Gai K, Qiu M, Zhao H et al (2018) Resource management in sustainable cyber-physical systems using heterogeneous cloud computing. IEEE Trans Sustain Comput 3:60–72CrossRef
Metadata
Title
A Heterogeneous Cloud-Edge Collaborative Computing Architecture with Affinity-Based Workflow Scheduling and Resource Allocation for Internet-of-Things Applications
Authors
Shuyu Lyu
Xinfa Dai
Zhong Ma
Ying Zhou
Xing Liu
Yi Gao
Zhekun Hu
Publication date
31-05-2023
Publisher
Springer US
Published in
Mobile Networks and Applications
Print ISSN: 1383-469X
Electronic ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-023-02113-x