Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Virtual Reality Collaboration Platform for Agile Software Development Read chapter Read first chapter

2024 | OriginalPaper | Chapter

A Process for Scenario Prioritization and Selection in Simulation-Based Safety Testing of Automated Driving Systems

Authors : Fauzia Khan, Hina Anwar, Dietmar Pfahl

Published in: Product-Focused Software Process Improvement

Publisher: Springer Nature Switzerland

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Simulation-based safety testing of Automated Driving Systems (ADS) is a cost-effective and safe alternative to field tests. However, it is practically impossible to test every scenario using a simulator. We propose a process for prioritizing and selecting scenarios from an existing list of scenarios. The aim is to refine the scope of tested scenarios and focus on the most representative and critical ones for evaluating ADS safety. As a proof-of-concept, we apply our process to two pre-existing scenario catalogs provided by the Land Transport Authority of Singapore and the Department of Transportation. After applying our process, we prioritized and selected six scenario groups containing 51 scenarios for testing ADS in the CARLA simulator.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Benefits and Challenges of an Internal Corporate Accelerator in a Software Company: An Action-Research Study
next chapter The Journey to Serverless Migration: An Empirical Analysis of Intentions, Strategies, and Challenges
Footnotes
Literature
1.
Abdessalem, R.B., Nejati, S., Briand, L.C., Stifter, T.: Testing vision-based control systems using learnable evolutionary algorithms. In: Proceedings of the 40th International Conference on Software Engineering, pp. 1016–1026 (2018)
2.
Chen, Z., He, F., Yin, Y., Du, Y.: Optimal design of autonomous vehicle zones in transportation networks. Transp. Res. Part B: Methodological 99, 44–61 (2017)CrossRef
3.
Chen, Z., He, F., Zhang, L., Yin, Y.: Optimal deployment of autonomous vehicle lanes with endogenous market penetration. Transp. Res. Part C: Emerging Technologies 72, 143–156 (2016)CrossRef
4.
Duarte, F., Ratti, C.: The impact of autonomous vehicles on cities: a review. J. Urban Technol. 25(4), 3–18 (2018)CrossRef
5.
6.
Iso, I.: Pas 21448-Road Vehicles-Safety of the Intended Functionality. Int, Organization for Standardization (2019)
7.
Jha, S., et al.: ML-based fault injection for autonomous vehicles: a case for Bayesian fault injection. In: 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), pp. 112–124. IEEE (2019)
8.
Jha, S., et al.: Kayotee: A fault injection-based system to assess the safety and reliability of autonomous vehicles to faults and errors (2019). arXiv preprint arXiv:​1907.​01024
9.
Karunakaran, D., Worrall, S., Nebot, E.: Efficient statistical validation with edge cases to evaluate highly automated vehicles. In: 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1–8. IEEE (2020)
10.
Kaur, P., Taghavi, S., Tian, Z., Shi, W.: A survey on simulators for testing self-driving cars. In: Fourth International Conference on Connected and Autonomous Driving (MetroCAD). IEEE (2021)
11.
Komzalov, A., Shilov, N.: Driver assistance systems: state-of-the-art and possible improvements. In: Proceedings of the 20th Conference of Open Innovations Association FRUCT, LETI University, St. Petersburg, Russland (2014)
12.
13.
Nitsche, P.: Safety-critical scenarios and virtual testing procedures for automated cars at road intersections. Ph.D. thesis, Loughborough University (2018)
14.
O’Kelly, M., Abbas, H., Gao, S., Shiraishi, S., Kato, S., Mangharam, R.: APEX: Autonomous vehicle plan verification and execution (2016)
15.
Park, S., Park, S., Jeong, H., Yun, I., So, J.: Scenario-mining for level 4 automated vehicle safety assessment from real accident situations in urban areas using a natural language process. Sensors 21(20), 6929 (2021)CrossRef
16.
Pei, K., Cao, Y., Yang, J., Jana, S.: DeepXplore: automated whitebox testing of deep learning systems. In: Proceedings of the 26th Symposium on Operating Systems Principles, pp. 1–18 (2017)
17.
Ponn, T., Gnandt, C., Diermeyer, F.: An optimization-based method to identify relevant scenarios for type approval of automated vehicles. In: Proceedings of the ESV-International Technical Conference on the Enhanced Safety of Vehicles, Eindhoven, The Netherlands, pp. 10–13 (2019)
18.
Ramanagopal, M.S., Anderson, C., Vasudevan, R., Johnson-Roberson, M.: Failing to learn: autonomously identifying perception failures for self-driving cars. IEEE Robot. Autom. Lett. 3(4), 3860–3867 (2018)CrossRef
19.
Rubaiyat, A.H.M., Qin, Y., Alemzadeh, H.: Experimental resilience assessment of an open-source driving agent. In: 2018 IEEE 23rd Pacific Rim International Symposium on Dependable Computing (PRDC), pp. 54–63. IEEE (2018)
20.
21.
Tian, Y., Pei, K., Jana, S., Ray, B.: DeepTest: automated testing of deep-neural-network-driven autonomous cars. In: Proceedings of the 40th International Conference on Software Engineering, pp. 303–314 (2018)
22.
Tuncali, C.E., Fainekos, G., Ito, H., Kapinski, J.: Simulation-based adversarial test generation for autonomous vehicles with machine learning components. In: 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 1555–1562. IEEE (2018)
23.
24.
Xinxin, Z., Fei, L., Xiangbin, W.: CSG: critical scenario generation from real traffic accidents. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 1330–1336. IEEE (2020)
25.
Yamamoto, D., Suganuma, N.: Localization for autonomous driving on urban road. In: 2015 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 452–453. IEEE (2015)
26.
Zhang, M., Zhang, Y., Zhang, L., Liu, C., Khurshid, S.: DeepRoad: GAN-based metamorphic testing and input validation framework for autonomous driving systems. In: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering, pp. 132–142 (2018)
27.
Zhou, H., et al.: DeepBillboard: systematic physical-world testing of autonomous driving systems. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering, pp. 347–358 (2020)
Metadata
Title
A Process for Scenario Prioritization and Selection in Simulation-Based Safety Testing of Automated Driving Systems
Authors
Fauzia Khan
Hina Anwar
Dietmar Pfahl
Copyright Year
2024
Book
Product-Focused Software Process Improvement

Print ISBN: 978-3-031-49265-5

Electronic ISBN: 978-3-031-49266-2

Copyright Year: 2024

DOI
https://doi.org/10.1007/978-3-031-49266-2_6

Premium Partner

    Image Credits