Skip to main content
Erschienen in: Computing 7/2019

03.08.2018

Testing IoT systems using a hybrid simulation based testing approach

verfasst von: Stig Bosmans, Siegfried Mercelis, Joachim Denil, Peter Hellinckx

Erschienen in: Computing | Ausgabe 7/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents an extensive overview of the challenges that arise when testing large IoT applications at the system level. In order do that we start from analyzing behavior of local entities such as IoT devices or people interacting with the IoT system. The interactions of these local entities eventually leads to an emergent behavior. Both the emergent behavior and the local behavior need to be taken into account when testing IoT systems. Therefore, we present a novel hybrid simulation based testing approach that is able to effectively facilitate interactions of these local entities. Furthermore, we introduce various solutions to the challenges that arise when implementing this hybrid methodology. These challenges are mainly related to the IoT development pipeline, synchronization between real-life and simulation environment and the scalability constraints of modern simulation techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arora A, Ertin E, Ramnath R, Nesterenko M, Leal W (2006) Kansei: a high-fidelity sensing testbed. IEEE Internet Comput 10(2):35–47CrossRef Arora A, Ertin E, Ramnath R, Nesterenko M, Leal W (2006) Kansei: a high-fidelity sensing testbed. IEEE Internet Comput 10(2):35–47CrossRef
2.
Zurück zum Zitat Beizer B (1995) Black-box testing: techniques for functional testing of software and systems. Wiley, Hoboken Beizer B (1995) Black-box testing: techniques for functional testing of software and systems. Wiley, Hoboken
3.
Zurück zum Zitat Bertolino A (2007) Software testing research: achievements, challenges, dreams. In: 2007 Future of software engineering. IEEE Computer Society, pp 85–103 Bertolino A (2007) Software testing research: achievements, challenges, dreams. In: 2007 Future of software engineering. IEEE Computer Society, pp 85–103
4.
Zurück zum Zitat Bononi L, Bracuto M, D’Angelo G, Donatiello L (2006) Proximity detection in distributed simulation of wireless mobile systems. In: Proceedings of the 9th ACM international symposium on modeling analysis and simulation of wireless and mobile systems. ACM, pp 44–51 Bononi L, Bracuto M, D’Angelo G, Donatiello L (2006) Proximity detection in distributed simulation of wireless mobile systems. In: Proceedings of the 9th ACM international symposium on modeling analysis and simulation of wireless and mobile systems. ACM, pp 44–51
5.
Zurück zum Zitat Bormann C, Castellani AP, Shelby Z (2012) Coap: an application protocol for billions of tiny internet nodes. IEEE Internet Comput 16(2):62–67CrossRef Bormann C, Castellani AP, Shelby Z (2012) Coap: an application protocol for billions of tiny internet nodes. IEEE Internet Comput 16(2):62–67CrossRef
6.
Zurück zum Zitat Bosmans S, Mercelis S, Hellinckx P, Denil J (2018) Towards evaluating emergent behavior of the internet of things using large scale simulation techniques (wip). In: Proceedings of the theory of modeling and simulation symposium. Society for Computer Simulation International, p 4 Bosmans S, Mercelis S, Hellinckx P, Denil J (2018) Towards evaluating emergent behavior of the internet of things using large scale simulation techniques (wip). In: Proceedings of the theory of modeling and simulation symposium. Society for Computer Simulation International, p 4
7.
Zurück zum Zitat Carneiro G (2010) Ns-3: network simulator 3. In: UTM Lab Meeting, vol 20 Carneiro G (2010) Ns-3: network simulator 3. In: UTM Lab Meeting, vol 20
8.
Zurück zum Zitat Caughlin D, Sisti AF (1997) Summary of model abstraction techniques. Enabling Technol Simul Sci Int Soc Opt Photon 3083:2–14 Caughlin D, Sisti AF (1997) Summary of model abstraction techniques. Enabling Technol Simul Sci Int Soc Opt Photon 3083:2–14
9.
Zurück zum Zitat Crisan DA, Radoi IE, Arvind D (2013) Coap-mediated hybrid simulation and visualisation environment for specknets. In: Proceedings of the 1st ACM sigsim conference on principles of advanced discrete simulation. ACM, pp 285–294 Crisan DA, Radoi IE, Arvind D (2013) Coap-mediated hybrid simulation and visualisation environment for specknets. In: Proceedings of the 1st ACM sigsim conference on principles of advanced discrete simulation. ACM, pp 285–294
10.
Zurück zum Zitat DAngelo G (2017) The simulation model partitioning problem: an adaptive solution based on self-clustering. Simul Model Pract Theory 70:1–20CrossRef DAngelo G (2017) The simulation model partitioning problem: an adaptive solution based on self-clustering. Simul Model Pract Theory 70:1–20CrossRef
11.
Zurück zum Zitat D’Angelo G, Ferretti S, Ghini V (2016) Simulation of the internet of things. In: High performance computing & simulation (HPCS), 2016 International conference on IEEE, pp 1–8 D’Angelo G, Ferretti S, Ghini V (2016) Simulation of the internet of things. In: High performance computing & simulation (HPCS), 2016 International conference on IEEE, pp 1–8
12.
Zurück zum Zitat Dunkels A, Gronvall B, Voigt T (2004) Contiki-a lightweight and flexible operating system for tiny networked sensors. In: Local computer networks, 2004. 29th Annual IEEE international conference. IEEE, pp 455–462 Dunkels A, Gronvall B, Voigt T (2004) Contiki-a lightweight and flexible operating system for tiny networked sensors. In: Local computer networks, 2004. 29th Annual IEEE international conference. IEEE, pp 455–462
13.
Zurück zum Zitat Fortino G, Gravina R, Russo W, Savaglio C (2017) Modeling and simulating internet-of-things systems: a hybrid agent-oriented approach. Comput Sci Eng 19(5):68–76CrossRef Fortino G, Gravina R, Russo W, Savaglio C (2017) Modeling and simulating internet-of-things systems: a hybrid agent-oriented approach. Comput Sci Eng 19(5):68–76CrossRef
14.
Zurück zum Zitat Frantz FK (1995) A taxonomy of model abstraction techniques. In: Proceedings of the 27th conference on winter simulation. IEEE Computer Society, pp 1413–1420 Frantz FK (1995) A taxonomy of model abstraction techniques. In: Proceedings of the 27th conference on winter simulation. IEEE Computer Society, pp 1413–1420
15.
Zurück zum Zitat Fujimoto RM (2000) Parallel and distributed simulation systems, vol 300. Wiley, New York Fujimoto RM (2000) Parallel and distributed simulation systems, vol 300. Wiley, New York
16.
Zurück zum Zitat Gupta H, Vahid Dastjerdi A, Ghosh SK, Buyya R (2017) iFogSim: A toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Software: Pract Exp 47(9):1275–1296 Gupta H, Vahid Dastjerdi A, Ghosh SK, Buyya R (2017) iFogSim: A toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Software: Pract Exp 47(9):1275–1296
17.
Zurück zum Zitat Hunkeler U, Truong HL, Stanford-Clark A (2008) Mqtt-sa publish/subscribe protocol for wireless sensor networks. In: Communication systems software and middleware and workshops, 2008. Comsware 2008. 3rd International conference on IEEE, pp 791–798 Hunkeler U, Truong HL, Stanford-Clark A (2008) Mqtt-sa publish/subscribe protocol for wireless sensor networks. In: Communication systems software and middleware and workshops, 2008. Comsware 2008. 3rd International conference on IEEE, pp 791–798
18.
Zurück zum Zitat Latre S, Leroux P, Coenen T, Braem B, Ballon P, Demeester P (2016) City of things: an integrated and multi-technology testbed for iot smart city experiments. In: Smart cities conference (ISC2), 2016 IEEE international. IEEE, pp 1–8 Latre S, Leroux P, Coenen T, Braem B, Ballon P, Demeester P (2016) City of things: an integrated and multi-technology testbed for iot smart city experiments. In: Smart cities conference (ISC2), 2016 IEEE international. IEEE, pp 1–8
19.
Zurück zum Zitat Levis P, Lee N, Welsh M, Culler D (2003) TOSSIM: accurate and scalable simulation of entire tinyOS applications. In: Proceedings of the 1st international conference on embedded networked sensor systems. ACM, pp 126–137 Levis P, Lee N, Welsh M, Culler D (2003) TOSSIM: accurate and scalable simulation of entire tinyOS applications. In: Proceedings of the 1st international conference on embedded networked sensor systems. ACM, pp 126–137
20.
Zurück zum Zitat Marjanović M, Antonić A, Žarko IP (2018) Edge computing architecture for mobile crowdsensing. IEEE Access 6:10662–10674CrossRef Marjanović M, Antonić A, Žarko IP (2018) Edge computing architecture for mobile crowdsensing. IEEE Access 6:10662–10674CrossRef
21.
Zurück zum Zitat Mataric MJ (1993) Designing emergent behaviors: from local interactions to collective intelligence. In: Proceedings of the 2nd international conference on simulation of adaptive behavior Mataric MJ (1993) Designing emergent behaviors: from local interactions to collective intelligence. In: Proceedings of the 2nd international conference on simulation of adaptive behavior
22.
Zurück zum Zitat Murray JA, Sasani M, Shao X (2015) Hybrid simulation for system-level structural response. Eng Struct 103:228–238CrossRef Murray JA, Sasani M, Shao X (2015) Hybrid simulation for system-level structural response. Eng Struct 103:228–238CrossRef
23.
Zurück zum Zitat Nunes DS, Zhang P, Silva JS (2015) A survey on human-in-the-loop applications towards an internet of all. IEEE Commun Surv Tutor 17(2):944–965CrossRef Nunes DS, Zhang P, Silva JS (2015) A survey on human-in-the-loop applications towards an internet of all. IEEE Commun Surv Tutor 17(2):944–965CrossRef
24.
Zurück zum Zitat Roca D, Nemirovsky D, Nemirovsky M, Milito R, Valero M (2016) Emergent behaviors in the internet of things: the ultimate ultra-large-scale system. IEEE Micro 36(6):36–44CrossRef Roca D, Nemirovsky D, Nemirovsky M, Milito R, Valero M (2016) Emergent behaviors in the internet of things: the ultimate ultra-large-scale system. IEEE Micro 36(6):36–44CrossRef
25.
Zurück zum Zitat Rodriguez JD, Bauer Jr KW, Miller JO, Neher Jr RE (2008) Building prediction models of large hierarchical simulation models with artificial neural networks and other statistical techniques. In: Visual information processing XVII, vol 6978. International Society for Optics and Photonics, p 69780 Rodriguez JD, Bauer Jr KW, Miller JO, Neher Jr RE (2008) Building prediction models of large hierarchical simulation models with artificial neural networks and other statistical techniques. In: Visual information processing XVII, vol 6978. International Society for Optics and Photonics, p 69780
26.
Zurück zum Zitat Sanchez L, Muñoz L, Galache JA, Sotres P, Santana JR, Gutierrez V (2014) Smartsantander: Iot experimentation over a smart city testbed. Comput Netw 61:217–238CrossRef Sanchez L, Muñoz L, Galache JA, Sotres P, Santana JR, Gutierrez V (2014) Smartsantander: Iot experimentation over a smart city testbed. Comput Netw 61:217–238CrossRef
27.
Zurück zum Zitat Van Tendeloo Y, Vangheluwe H (2014) Activity in pythonpdevs. In: ITM Web of conferences, vol 3. EDP Sciences, p 01002 Van Tendeloo Y, Vangheluwe H (2014) Activity in pythonpdevs. In: ITM Web of conferences, vol 3. EDP Sciences, p 01002
28.
Zurück zum Zitat Varga A, Hornig R (2008) An overview of the omnet++ simulation environment. In: Proceedings of the 1st international conference on simulation tools and techniques for communications, networks and systems & workshops, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), p 60 Varga A, Hornig R (2008) An overview of the omnet++ simulation environment. In: Proceedings of the 1st international conference on simulation tools and techniques for communications, networks and systems & workshops, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), p 60
Metadaten
Titel
Testing IoT systems using a hybrid simulation based testing approach
verfasst von
Stig Bosmans
Siegfried Mercelis
Joachim Denil
Peter Hellinckx
Publikationsdatum
03.08.2018
Verlag
Springer Vienna
Erschienen in
Computing / Ausgabe 7/2019
Print ISSN: 0010-485X
Elektronische ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-018-0650-5

Weitere Artikel der Ausgabe 7/2019

Computing 7/2019 Zur Ausgabe