Skip to main content
Top

2024 | OriginalPaper | Chapter

Evaluating the Performance of a Multimodal Speaker Tracking System at the Edge-to-Cloud Continuum

Authors : Alessio Orsino, Riccardo Cantini, Fabrizio Marozzo

Published in: Device-Edge-Cloud Continuum

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The edge-to-cloud compute continuum has become increasingly popular in recent years for effectively collecting and analyzing data generated by Internet of Things (IoT) devices at the network edge, ensuring low latency, high scalability, and privacy preservation. This continuum of computing resources, features, and services, which spans from the edge to the cloud, can be effectively leveraged in various application domains like smart cities, industrial IoT, and smart healthcare. However, many unexplored scenarios still exist where this technology can be successfully applied. This chapter investigates how the compute continuum can support speaker tracking in smart spaces, such as smart homes, offices, and public venues, especially focusing on multimodal systems that leverage both audio and visual data. The effectiveness of the edge-to-cloud continuum in supporting such systems was assessed through a simulation-based experimental evaluation performed with the iFogSim toolkit. Our findings reveal that edge-cloud integration improves application performance in terms of network usage and latency, compared to a centralized solution that solely relies on cloud computing.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference M.S. Alam, S.J. Jabin, A. Alam, M.I. Hossain, Comparative analysis of cloud and Fog environment based on network usage and cost of execution using iFogSim, in 2021 International Conference on Decision Aid Sciences and Application (DASA) (IEEE, Piscataway, 2021), pp. 132–137 M.S. Alam, S.J. Jabin, A. Alam, M.I. Hossain, Comparative analysis of cloud and Fog environment based on network usage and cost of execution using iFogSim, in 2021 International Conference on Decision Aid Sciences and Application (DASA) (IEEE, Piscataway, 2021), pp. 132–137
2.
go back to reference L. Belcastro, R. Cantini, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Programming big data analysis: principles and solutions. J. Big Data 9(4), 1–50 (2022) L. Belcastro, R. Cantini, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Programming big data analysis: principles and solutions. J. Big Data 9(4), 1–50 (2022)
3.
go back to reference L. Belcastro, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge-cloud continuum solutions for urban mobility prediction and planning. IEEE Access 11, 38864–38874 (2023)CrossRef L. Belcastro, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge-cloud continuum solutions for urban mobility prediction and planning. IEEE Access 11, 38864–38874 (2023)CrossRef
4.
go back to reference G. D’Angelo, S. Ferretti, V. Ghini, Simulation of the internet of things, in 2016 International Conference on High Performance Computing & Simulation (HPCS) (IEEE, Piscataway, 2016), pp. 1–8 G. D’Angelo, S. Ferretti, V. Ghini, Simulation of the internet of things, in 2016 International Conference on High Performance Computing & Simulation (HPCS) (IEEE, Piscataway, 2016), pp. 1–8
5.
go back to reference H. Gupta, A. Vahid Dastjerdi, S.K. Ghosh, R. Buyya, iFogSim: a toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Softw. Pract. Exp. 47(9), 1275–1296 (2017)CrossRef H. Gupta, A. Vahid Dastjerdi, S.K. Ghosh, R. Buyya, iFogSim: a toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Softw. Pract. Exp. 47(9), 1275–1296 (2017)CrossRef
6.
go back to reference N. Hassan, S. Gillani, E. Ahmed, I. Yaqoob, M. Imran, The role of edge computing in internet of things. IEEE Commun. Mag. 56(11), 110–115 (2018)CrossRef N. Hassan, S. Gillani, E. Ahmed, I. Yaqoob, M. Imran, The role of edge computing in internet of things. IEEE Commun. Mag. 56(11), 110–115 (2018)CrossRef
7.
go back to reference G. Kecskemeti, G. Casale, D.N. Jha, J. Lyon, R. Ranjan, Modelling and simulation challenges in internet of things. IEEE Cloud Comput. 4(1), 62–69 (2017)CrossRef G. Kecskemeti, G. Casale, D.N. Jha, J. Lyon, R. Ranjan, Modelling and simulation challenges in internet of things. IEEE Cloud Comput. 4(1), 62–69 (2017)CrossRef
8.
go back to reference V. Kılıç, M. Barnard, W. Wang, A. Hilton, J. Kittler, Mean-shift and sparse sampling-based SMC-PHD filtering for audio informed visual speaker tracking. IEEE Trans. Multimedia 18(12), 2417–2431 (2016)CrossRef V. Kılıç, M. Barnard, W. Wang, A. Hilton, J. Kittler, Mean-shift and sparse sampling-based SMC-PHD filtering for audio informed visual speaker tracking. IEEE Trans. Multimedia 18(12), 2417–2431 (2016)CrossRef
9.
go back to reference L.E. Lima, B.Y.L. Kimura, V. Rosset, Experimental environments for the internet of things: a review. IEEE Sens. J. 19(9), 3203–3211 (2019)CrossRef L.E. Lima, B.Y.L. Kimura, V. Rosset, Experimental environments for the internet of things: a review. IEEE Sens. J. 19(9), 3203–3211 (2019)CrossRef
10.
go back to reference H. Liu, Y. Li, B. Yang, 3d audio-visual speaker tracking with a two-layer particle filter, in 2019 IEEE International Conference on Image Processing (ICIP) (IEEE, Piscataway, 2019), pp. 1955–1959 H. Liu, Y. Li, B. Yang, 3d audio-visual speaker tracking with a two-layer particle filter, in 2019 IEEE International Conference on Image Processing (ICIP) (IEEE, Piscataway, 2019), pp. 1955–1959
11.
go back to reference H. Liu, Y. Sun, Y. Li, B. Yang, 3d audio-visual speaker tracking with a novel particle filter, in 2020 25th International Conference on Pattern Recognition (IEEE, Piscataway, 2021), pp. 7343–7348 H. Liu, Y. Sun, Y. Li, B. Yang, 3d audio-visual speaker tracking with a novel particle filter, in 2020 25th International Conference on Pattern Recognition (IEEE, Piscataway, 2021), pp. 7343–7348
12.
go back to reference S. Maheshwari, D. Raychaudhuri, I. Seskar, F. Bronzino, Scalability and performance evaluation of edge cloud systems for latency constrained applications, in 2018 IEEE/ACM Symposium on Edge Computing (SEC) (IEEE, Piscataway, 2018), pp. 286–299 S. Maheshwari, D. Raychaudhuri, I. Seskar, F. Bronzino, Scalability and performance evaluation of edge cloud systems for latency constrained applications, in 2018 IEEE/ACM Symposium on Edge Computing (SEC) (IEEE, Piscataway, 2018), pp. 286–299
13.
go back to reference R. Mahmud, S. Pallewatta, M. Goudarzi, R. Buyya, iFogSim2: an extended iFogSim simulator for mobility, clustering, and microservice management in edge and fog computing environments. J. Syst. Softw. 190, 111351 (2022)CrossRef R. Mahmud, S. Pallewatta, M. Goudarzi, R. Buyya, iFogSim2: an extended iFogSim simulator for mobility, clustering, and microservice management in edge and fog computing environments. J. Syst. Softw. 190, 111351 (2022)CrossRef
14.
go back to reference F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge computing solutions for distributed machine learning, in 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress (2022), pp. 1–8 F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge computing solutions for distributed machine learning, in 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress (2022), pp. 1–8
15.
go back to reference X. Qian, A. Brutti, M. Omologo, A. Cavallaro, 3d audio-visual speaker tracking with an adaptive particle filter, in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, Piscataway, 2017), pp. 2896–2900 X. Qian, A. Brutti, M. Omologo, A. Cavallaro, 3d audio-visual speaker tracking with an adaptive particle filter, in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, Piscataway, 2017), pp. 2896–2900
16.
go back to reference F.H. Rahman, T.W. Au, S. Shah Newaz, W.S. Haji Suhaili, A performance study of high-end fog and fog cluster in iFogSim, in Computational Intelligence in Information Systems: Proceedings of the Computational Intelligence in Information Systems Conference (CIIS 2018), vol. 3 (Springer, Berlin, 2019), pp. 87–96 F.H. Rahman, T.W. Au, S. Shah Newaz, W.S. Haji Suhaili, A performance study of high-end fog and fog cluster in iFogSim, in Computational Intelligence in Information Systems: Proceedings of the Computational Intelligence in Information Systems Conference (CIIS 2018), vol. 3 (Springer, Berlin, 2019), pp. 87–96
17.
go back to reference D.M.A.d. Silva, G. Asaamoning, H. Orrillo, R.C. Sofia, P.M. Mendes, An analysis of fog computing data placement algorithms, in Proceedings of the 16th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (2019), pp. 527–534 D.M.A.d. Silva, G. Asaamoning, H. Orrillo, R.C. Sofia, P.M. Mendes, An analysis of fog computing data placement algorithms, in Proceedings of the 16th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (2019), pp. 527–534
18.
go back to reference M. Sinqadu, Z.S. Shibeshi, Performance evaluation of a traffic surveillance application using iFogSim, in International Conference on Wireless Intelligent and Distributed Environment for Communication (Springer, Berlin, 2020), pp. 51–64 M. Sinqadu, Z.S. Shibeshi, Performance evaluation of a traffic surveillance application using iFogSim, in International Conference on Wireless Intelligent and Distributed Environment for Communication (Springer, Berlin, 2020), pp. 51–64
19.
go back to reference C. Sonmez, A. Ozgovde, C. Ersoy, EdgeCloudSim: an environment for performance evaluation of edge computing systems. Trans. Emerg. Telecommun. Technol. 29(11), e3493 (2018) C. Sonmez, A. Ozgovde, C. Ersoy, EdgeCloudSim: an environment for performance evaluation of edge computing systems. Trans. Emerg. Telecommun. Technol. 29(11), e3493 (2018)
20.
go back to reference X. Zeng, S.K. Garg, P. Strazdins, P.P. Jayaraman, D. Georgakopoulos, R. Ranjan, IOTSim: a simulator for analysing IoT applications. J. Syst. Archit. 72, 93–107 (2017)CrossRef X. Zeng, S.K. Garg, P. Strazdins, P.P. Jayaraman, D. Georgakopoulos, R. Ranjan, IOTSim: a simulator for analysing IoT applications. J. Syst. Archit. 72, 93–107 (2017)CrossRef
Metadata
Title
Evaluating the Performance of a Multimodal Speaker Tracking System at the Edge-to-Cloud Continuum
Authors
Alessio Orsino
Riccardo Cantini
Fabrizio Marozzo
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-42194-5_9