Skip to main content
Top
Published in:
Cover of the book

2024 | OriginalPaper | Chapter

Providing Evidence for the Validity of the Virtual Verification of Automated Driving Systems

Authors : Birte Neurohr, Thies de Graaff, Andreas Eggers, Tom Bienmüller, Eike Möhlmann

Published in: Dependable Computing – EDCC 2024 Workshops

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the increasing complexity of automated driving systems, formal verification as well as statistical verification that solely relies on real-world testing methods, become infeasible. Virtual testing seems like a promising alternative to traditional methods, especially as part of a scenario-based verification and validation methodology. But in order to transfer the test results of a system from a simulation to the real world, we need to argue the validity of the virtual tests. Our proposed method enables this validity argumentation by comparing the virtual test traces against traces that have sufficiently similar recorded real-world traces. To reduce the amount of required real-world data, the method involves two mechanisms to generalize the validity statement of a single real-world trace to a set of virtual traces. The reduction of required data is showcased in a proof of concept that compares the needed amounts of data with a “naive” validation method and here presented enhancements in an ablation study.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference ISO 19364 - Passenger cars - Vehicle dynamic simulation and validation-Steady-state circular driving behaviour. Technical report, International Organization for Standardization ISO 19364 - Passenger cars - Vehicle dynamic simulation and validation-Steady-state circular driving behaviour. Technical report, International Organization for Standardization
2.
go back to reference The world factbook, Washington, DC 20505 (2019) The world factbook, Washington, DC 20505 (2019)
3.
go back to reference Bendale, A., Boult, T.: Towards open world recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015) Bendale, A., Boult, T.: Towards open world recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
4.
go back to reference Danquah, B., Riedmaier, S., Meral, Y., Lienkamp, M.: Statistical validation framework for automotive vehicle simulations using uncertainty learning. Appl. Sci. 11(5), 1983 (2021)CrossRef Danquah, B., Riedmaier, S., Meral, Y., Lienkamp, M.: Statistical validation framework for automotive vehicle simulations using uncertainty learning. Appl. Sci. 11(5), 1983 (2021)CrossRef
5.
go back to reference Danquah, B., Riedmaier, S., Rühm, J., Kalt, S., Lienkamp, M.: Statistical model verification and validation concept in automotive vehicle design. Procedia CIRP 91, 261–270 (2020). enhancing design through the 4th Industrial Revolution Thinking Danquah, B., Riedmaier, S., Rühm, J., Kalt, S., Lienkamp, M.: Statistical model verification and validation concept in automotive vehicle design. Procedia CIRP 91, 261–270 (2020). enhancing design through the 4th Industrial Revolution Thinking
6.
go back to reference Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: CARLA: an open urban driving simulator. In: Proceedings of the 1st Annual Conference on Robot Learning (2017) Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: CARLA: an open urban driving simulator. In: Proceedings of the 1st Annual Conference on Robot Learning (2017)
7.
go back to reference ERTRAC Working Group "Connectivity and Automated Driving": Connected automated driving roadmap (2019) ERTRAC Working Group "Connectivity and Automated Driving": Connected automated driving roadmap (2019)
8.
go back to reference Kalra, N., Paddock, S.M.: Driving to safety: how many miles of driving would it take to demonstrate autonomous vehicle reliability? (2016) Kalra, N., Paddock, S.M.: Driving to safety: how many miles of driving would it take to demonstrate autonomous vehicle reliability? (2016)
9.
go back to reference Neurohr, C., Westhofen, L., Henning, T., de Graaff, T., Möhlmann, E., Böde, E.: Fundamental considerations around scenario-based testing for automated driving. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 121–127 (2020) Neurohr, C., Westhofen, L., Henning, T., de Graaff, T., Möhlmann, E., Böde, E.: Fundamental considerations around scenario-based testing for automated driving. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 121–127 (2020)
10.
go back to reference Oberkampf, W.L., Trucano, T.G., Hirsch, C.: Verification, validation, and predictive capability in computational engineering and physics. Appl. Mech. Rev. 57(5), 345–384 (2004)CrossRef Oberkampf, W.L., Trucano, T.G., Hirsch, C.: Verification, validation, and predictive capability in computational engineering and physics. Appl. Mech. Rev. 57(5), 345–384 (2004)CrossRef
11.
go back to reference Poddey, A., Brade, T., Stellet, J.E., Branz, W.: On the validation of complex systems operating in open contexts (2019) Poddey, A., Brade, T., Stellet, J.E., Branz, W.: On the validation of complex systems operating in open contexts (2019)
12.
go back to reference Riedmaier, S., Danquah, B., Schick, B., Diermeyer, F.: Unified framework and survey for model verification, validation and uncertainty quantification. Arch. Comput. Methods Eng. 28, 2655–2688 (2021)MathSciNetCrossRef Riedmaier, S., Danquah, B., Schick, B., Diermeyer, F.: Unified framework and survey for model verification, validation and uncertainty quantification. Arch. Comput. Methods Eng. 28, 2655–2688 (2021)MathSciNetCrossRef
13.
go back to reference Riedmaier, S., Schneider, J., Danquah, B., Schick, B., Diermeyer, F.: Non-deterministic model validation methodology for simulation-based safety assessment of automated vehicles. Simul. Model. Pract. Theory 109, 102274 (2021)CrossRef Riedmaier, S., Schneider, J., Danquah, B., Schick, B., Diermeyer, F.: Non-deterministic model validation methodology for simulation-based safety assessment of automated vehicles. Simul. Model. Pract. Theory 109, 102274 (2021)CrossRef
14.
go back to reference Rosenberger, P., Schunk, G., Ikemeyer, F., Duong, Q.T.: Validation of Test Infrastructure - from cause trees to a validated system simulation Rosenberger, P., Schunk, G., Ikemeyer, F., Duong, Q.T.: Validation of Test Infrastructure - from cause trees to a validated system simulation
15.
go back to reference Rosenberger, P., et al.: Towards a generally accepted validation methodology for sensor models - challenges, metrics, and first results. In: Graz Symposium Virtual Vehicle (GSVF) (2019) Rosenberger, P., et al.: Towards a generally accepted validation methodology for sensor models - challenges, metrics, and first results. In: Graz Symposium Virtual Vehicle (GSVF) (2019)
16.
go back to reference SAE International: Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical report SAE International: Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical report
17.
go back to reference Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 2011 Winter Simulation Conference (2011) Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 2011 Winter Simulation Conference (2011)
18.
go back to reference Schaermann, A.: Systematische Bedatung und Bewertung umfelderfassender Sensormodelle. Ph.D. thesis Schaermann, A.: Systematische Bedatung und Bewertung umfelderfassender Sensormodelle. Ph.D. thesis
19.
go back to reference Schlesinger, S., et al.: Terminology for model credibility. SIMULATION 32(3), 103–104 (1979)CrossRef Schlesinger, S., et al.: Terminology for model credibility. SIMULATION 32(3), 103–104 (1979)CrossRef
20.
go back to reference Viehof, M.: Objektive Qualitätsbewertung von Fahrdynamiksimulationen durch statistische Validierung. Ph.D. thesis Viehof, M.: Objektive Qualitätsbewertung von Fahrdynamiksimulationen durch statistische Validierung. Ph.D. thesis
Metadata
Title
Providing Evidence for the Validity of the Virtual Verification of Automated Driving Systems
Authors
Birte Neurohr
Thies de Graaff
Andreas Eggers
Tom Bienmüller
Eike Möhlmann
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-56776-6_1

Premium Partner