Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Analysis of Markov Decision Processes Under Parameter Uncertainty Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Learning-Based Testing of Cyber-Physical Systems-of-Systems: A Platooning Study

Author : Karl Meinke

Published in: Computer Performance Engineering

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Learning-based testing (LBT) is a paradigm for fully automated requirements testing that combines machine learning with model-checking techniques. LBT has been shown to be effective for unit and integration testing of safety critical components in cyber-physical systems, e.g. automotive ECU software.
We consider the challenges faced, and some initial results obtained in an effort to scale up LBT to testing co-operative open cyber-physical systems-of-systems (CO-CPS). For this we focus on a case study of testing safety and performance properties of multi-vehicle platoons.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter A New Approach to Predicting Reliable Project Runtimes via Probabilistic Model Checking
next chapter An Inspection-Based Compositional Approach to the Quantitative Evaluation of Assembly Lines
Footnotes
2
This architecture has been developed within the VINNOVA FFI project VIRTUES, http://​www.​csc.​kth.​se/​~karlm/​virtues/​.
 
3
Recall that propositional LTL extends basic propositional logic with the temporal modalities G( \(\phi \) ) (always \(\phi \)), F( \(\phi \) ) (sometime \(\phi \)) and X( \(\phi \) ) (next \(\phi \)). Other derived operators and past operators may also be included. See e.g. [12] for details.
 
4
Infinite counter-examples to LTL liveness formulas are truncated around the loop, and the weaker test verdict warning may be issued.
 
5
It seems possible to theoretically explain this observation for certain types of formulas by considering their semantics. However, this is outside the scope of our present discussion.
 
6
In practise, GPS localisation would be relied upon for greater accuracy.
 
7
For the lead vehicle, CACC is disabled and accelerator and brake pedal values are used by BBW instead. See Fig. 3.
 
8
Thus \(a_{10}\) represents 100% accelerator depression, \(a_{9}\) represents 90% depression, etc. Simultaneous depression of both pedals is handled as a brake request by the BBW component.
 
9
It is also possible to use SUT observations between the output cycles by thresholding. This can yield greater accuracy, but this approach was not taken here.
 
10
Non-homogeneous platoons could also be tested using our approach.
 
11
The actual platform used was a 4-core MacBook Pro, Mid 2014, running Yosemite OS-X 10.10.5 with 2.8 GHz Intel Core i7, 16 GB 1600 MHz DDR3 and 1 TB static disk flash storage.
 
12
Based on 1 s sampling.
 
13
Unfortunately our limited computing platform did not provide an opportunity to evaluate this result.
 
Literature
1.
Aki, M., Zheng, R., Yamabe, S., Nakano, K., Suda, Y., Suzuki, Y., Ishizaka, H., Kawashima, H., Sakuma, A.: Safety testing of an improved brake system for automatic platooning of trucks. Int. J. Intell. Transp. Syst. Res. 12(3), 98–109 (2014)
2.
3.
Bennaceur, A., Giannakopoulou, D., Hähnle, R., Meinke, K.: Machine learning for dynamic software analysis: potentials and limits (Dagstuhl seminar 16172). Dagstuhl Rep. 6(4), 161–173 (2016)
4.
Bergenhem, C., Shladover, S., Coelingh, E., Englund, C., Shladover, S., Tsugawa, S.: Overview of platooning systems. In: Proceedings of the 19th ITS World Congress, Vienna, October 2012
5.
van den Bleek, R.: Design of a hybrid adaptive cruise control stop-&-go system. Master’s thesis, Technische Universiteit Eindhoven, Department of Mechanical Engineering (2007)
6.
Cassel, S., Howar, F., Jonsson, B., Steffen, B.: Active learning for extended finite state machines. Form. Asp. Comput. 28(2), 233–263 (2016)MathSciNetCrossRefMATH
7.
Cimatti, A., et al.: NuSMV 2: an opensource tool for symbolic model checking. In: Brinksma, E., Larsen, K.G. (eds.) CAV 2002. LNCS, vol. 2404, pp. 359–364. Springer, Heidelberg (2002). doi:10.​1007/​3-540-45657-0_​29 CrossRef
8.
Colin, S., Lanoix, A., Kouchnarenko, O., Souquières, J.: Using CSP\(||\)B components: application to a platoon of vehicles. In: Cofer, D., Fantechi, A. (eds.) FMICS 2008. LNCS, vol. 5596, pp. 103–118. Springer, Heidelberg (2009). doi:10.​1007/​978-3-642-03240-0_​11 CrossRef
9.
El-Zaher, M., Contet, J., Gruer, P., Gechter, F., Koukam, A.: Compositional verification for reactive multi-agent systems applied to platoon non collision verification. Stud. Inform. Univ. 10(3), 119–141 (2012)
10.
Engelberg, S.: A Mathematical Introduction to Control Theory. Imperial College Press, London (2015)CrossRefMATH
11.
Feng, L., Lundmark, S., Meinke, K., Niu, F., Sindhu, M.A., Wong, P.Y.H.: Case studies in learning-based testing. In: Yenigün, H., Yilmaz, C., Ulrich, A. (eds.) ICTSS 2013. LNCS, vol. 8254, pp. 164–179. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-41707-8_​11 CrossRef
12.
Fisher, M.: An Introduction to Practical Formal Methods Using Temporal Logic. Wiley, Hoboken (2011)CrossRefMATH
13.
De la Higuera, C.: Grammatical Inference: Learning Automata and Grammars. Cambridge University Press, Cambridge (2010)CrossRefMATH
14.
Hossen, K., Groz, R., Oriat, C., Richier, J.: Automatic model inference of web applications for security testing. In: Seventh IEEE International Conference on Software Testing, Verification and Validation, ICST 2014 Workshops Proceedings, pp. 22–23 (2014)
15.
Howar, F., Bauer, O., Merten, M., Steffen, B., Margaria, T.: The teachers’ crowd: the impact of distributed oracles on active automata learning. In: Hähnle, R., Knoop, J., Margaria, T., Schreiner, D., Steffen, B. (eds.) ISoLA 2011. CCIS, pp. 232–247. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-34781-8_​18 CrossRef
16.
Isberner, M., Howar, F., Steffen, B.: The TTT algorithm: a redundancy-free approach to active automata learning. In: Bonakdarpour, B., Smolka, S.A. (eds.) RV 2014. LNCS, vol. 8734, pp. 307–322. Springer, Cham (2014). doi:10.​1007/​978-3-319-11164-3_​26
17.
18.
Kamali, M., Dennis, L.A., McAree, O., Fisher, M., Veres, S.M.: Formal verification of autonomous vehicle platooning. CoRR abs/1602.01718 (2016)
19.
Kearns, M., Vazirani, U.: An Introduction to Computational Learning Theory. MIT Press, Cambridge (1994)
20.
Khosrowjerdi, H., Meinke, K., Rasmusson, A.: Automated behavioral requirements testing for automotive ECU applications. In: Proceedings of the 5th International Workshop on Model Based Safety Analysis. In: IMBSA 2017. LNCS. Springer (2017, to appear)
21.
Meinke, K.: Recent progress in learning-based testing. In: Bennaceur, A., Hähnle, R., Meinke, K. (eds.) Machine Learning for Dynamic Software Analysis: Potentials and Limits: Proceedings of Dagstuhl Workshop, vol. 16172. Springer (2017, to appear)
22.
Meinke, K., Niu, F.: An incremental learning algorithm for hybrid automata (2013)
23.
24.
Meinke, K.: Automated black-box testing of functional correctness using function approximation. In: Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2004), pp. 143–153. ACM Press (2004)
25.
Meinke, K., Nycander, P.: Learning-based testing of distributed microservice architectures: correctness and fault injection. In: Bianculli, D., Calinescu, R., Rumpe, B. (eds.) SEFM 2015. LNCS, vol. 9509, pp. 3–10. Springer, Heidelberg (2015). doi:10.​1007/​978-3-662-49224-6_​1 CrossRef
26.
Meinke, K., Sindhu, M.A.: Lbtest: a learning-based testing tool for reactive systems. In: Proceedings of the 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation (ICST 2013), pp. 447–454. IEEE Computer Society (2013)
27.
Peled, D., Vardi, M.Y., Yannakakis, M.: Black box checking. In: Wu, J., Chanson, S.T., Gao, Q. (eds.) Formal Methods for Protocol Engineering and Distributed Systems. IAICT, vol. 28, pp. 225–240. Springer, Boston (1999). doi:10.​1007/​978-0-387-35578-8_​13 CrossRef
28.
29.
30.
31.
Walkinshaw, N., Bogdanov, K., Derrick, J., Paris, J.: Increasing functional coverage by inductive testing: a case study. In: Petrenko, A., Simão, A., Maldonado, J.C. (eds.) ICTSS 2010. LNCS, vol. 6435, pp. 126–141. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-16573-3_​10 CrossRef
32.
Weyuker, E.: Assessing test data adequacy through program inference. ACM Trans. Program. Lang. Syst 5(4), 641–655 (1983)CrossRefMATH
33.
Willke, T., Tientrakool, P., Maxemchuk, N.: A survey of inter-vehicle communication protocols and their applications. IEEE Commun. Surv. Tutor. 11(2), 3–20 (2009)CrossRef
34.
Özguner, U., Acarman, T., Redmill, K.: Autonomous Ground Vehicles. Artech House Publishers, Boston (2011)
Metadata
Title
Learning-Based Testing of Cyber-Physical Systems-of-Systems: A Platooning Study
Author
Karl Meinke
Copyright Year
2017
Book
Computer Performance Engineering

Print ISBN: 978-3-319-66582-5

Electronic ISBN: 978-3-319-66583-2

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-3-319-66583-2_9