Skip to main content
Top

2018 | OriginalPaper | Chapter

A Case Study on Benchmarking IoT Cloud Services

Authors : Kevin Grünberg, Wolfram Schenck

Published in: Cloud Computing – CLOUD 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The Internet of Things (IoT) is on the rise, forming networks of sensors, machines, cars, household appliances, and other physical items. In the industrial area, machines in assembly lines are connected to the internet for quick date exchange and coordinated operation. Cloud services are an obvious choice for data integration and processing in the (industrial) IoT. However, manufacturing machines have to exchange data in close to real-time in many use cases, requiring small round-trip times (RTT) in the communication between device and cloud. In this study, two of the major IoT cloud services, Microsoft Azure IoT Hub and Amazon Web Services IoT, are benchmarked in the area of North Rhine-Westphalia (Germany) regarding RTT, varying factors like time of day, day of week, location, inter-message interval, and additional data processing in the cloud. The results show significant performance differences between the cloud services and a considerable impact of some of the aforementioned factors. In conclusion, as soon as (soft) real-time conditions come into play, it is highly advisable to carry out benchmarking in advance to identify an IoT cloud workflow which meets these conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Pretests did not show any significant RTT differences between different basic data types like int, float, etc.
 
Literature
1.
go back to reference Vaquero, L.M., Rodero-Merino, L., Caceres, J., Lindner, M.: A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev. 39(1), 50–55 (2008)CrossRef Vaquero, L.M., Rodero-Merino, L., Caceres, J., Lindner, M.: A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev. 39(1), 50–55 (2008)CrossRef
2.
go back to reference Jeschke, S., Brecher, C., Meisen, T., Özdemir, D., Eschert, T.: Industrial internet of things and cyber manufacturing systems. In: Jeschke, S., Brecher, C., Song, H., Rawat, D.B. (eds.) Industrial Internet of Things – Cybermanufacturing Systems. SSWT, pp. 3–19. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-42559-7_1CrossRef Jeschke, S., Brecher, C., Meisen, T., Özdemir, D., Eschert, T.: Industrial internet of things and cyber manufacturing systems. In: Jeschke, S., Brecher, C., Song, H., Rawat, D.B. (eds.) Industrial Internet of Things – Cybermanufacturing Systems. SSWT, pp. 3–19. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-42559-7_​1CrossRef
3.
go back to reference Lee, G.M., Crespi, N., Choi, J.K., Boussard, M.: Internet of things. In: Bertin, E., Crespi, N., Magedanz, T. (eds.) Evolution of Telecommunication Services: The Convergence of Telecom and Internet: Technologies and Ecosystems. LNCS, vol. 7768, pp. 257–282. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41569-2_13CrossRef Lee, G.M., Crespi, N., Choi, J.K., Boussard, M.: Internet of things. In: Bertin, E., Crespi, N., Magedanz, T. (eds.) Evolution of Telecommunication Services: The Convergence of Telecom and Internet: Technologies and Ecosystems. LNCS, vol. 7768, pp. 257–282. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-41569-2_​13CrossRef
4.
go back to reference Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M.: Internet of Things (IoT): a vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29(7), 1645–1660 (2013)CrossRef Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M.: Internet of Things (IoT): a vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29(7), 1645–1660 (2013)CrossRef
5.
go back to reference Binnig, C., Kossmann, D., Kraska, T., Loesing, S.: How is the weather tomorrow?: towards a benchmark for the cloud. In: Proceedings of the 2nd International Workshop on Testing Database Systems, DBTest 2009, pp. 9:1–9:6. ACM, New York (2009) Binnig, C., Kossmann, D., Kraska, T., Loesing, S.: How is the weather tomorrow?: towards a benchmark for the cloud. In: Proceedings of the 2nd International Workshop on Testing Database Systems, DBTest 2009, pp. 9:1–9:6. ACM, New York (2009)
6.
go back to reference Agarwal, D., Prasad, S.K.: AzureBench: benchmarking the storage services of the Azure cloud platform. In: 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops PhD Forum, pp. 1048–1057 (2012) Agarwal, D., Prasad, S.K.: AzureBench: benchmarking the storage services of the Azure cloud platform. In: 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops PhD Forum, pp. 1048–1057 (2012)
7.
go back to reference Kossmann, D., Kraska, T., Loesing, S.: An evaluation of alternative architectures for transaction processing in the cloud. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 579–590. ACM, New York (2010) Kossmann, D., Kraska, T., Loesing, S.: An evaluation of alternative architectures for transaction processing in the cloud. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 579–590. ACM, New York (2010)
8.
go back to reference Li, Z., O’Brien, L., Zhang, H.: Boosting metrics: measuring cloud services from the holistic perspective. Int. J. Cloud Comput. (IJCC) 2(4), 12–22 (2014) Li, Z., O’Brien, L., Zhang, H.: Boosting metrics: measuring cloud services from the holistic perspective. Int. J. Cloud Comput. (IJCC) 2(4), 12–22 (2014)
10.
go back to reference Gillam, L., Li, B., O’Loughlin, J., Tomar, A.P.S.: Fair benchmarking for cloud computing systems. J. Cloud Comput.: Adv. Syst. Appl. 2(1), 6 (2013)CrossRef Gillam, L., Li, B., O’Loughlin, J., Tomar, A.P.S.: Fair benchmarking for cloud computing systems. J. Cloud Comput.: Adv. Syst. Appl. 2(1), 6 (2013)CrossRef
11.
go back to reference Zant, B.E., Gagnaire, M.: Performance and price analysis for cloud service providers. In: 2015 Science and Information Conference (SAI), pp. 816–822 (2015) Zant, B.E., Gagnaire, M.: Performance and price analysis for cloud service providers. In: 2015 Science and Information Conference (SAI), pp. 816–822 (2015)
12.
go back to reference Cunha, M., Mendonca, N., Sampaio, A.: A declarative environment for automatic performance evaluation in IaaS clouds. In: 2013 IEEE Sixth International Conference on Cloud Computing, pp. 285–292 (2013) Cunha, M., Mendonca, N., Sampaio, A.: A declarative environment for automatic performance evaluation in IaaS clouds. In: 2013 IEEE Sixth International Conference on Cloud Computing, pp. 285–292 (2013)
Metadata
Title
A Case Study on Benchmarking IoT Cloud Services
Authors
Kevin Grünberg
Wolfram Schenck
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-94295-7_28

Premium Partner