Skip to main content

2020 | OriginalPaper | Buchkapitel

Run-Time Assurance for Learning-Enabled Systems

verfasst von : Darren Cofer, Isaac Amundson, Ramachandra Sattigeri, Arjun Passi, Christopher Boggs, Eric Smith, Limei Gilham, Taejoon Byun, Sanjai Rayadurgam

Erschienen in: NASA Formal Methods

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There has been much publicity surrounding the use of machine learning technologies in self-driving cars and the challenges this presents for guaranteeing safety. These technologies are also being investigated for use in manned and unmanned aircraft. However, systems that include “learning-enabled components” (LECs) and their software implementations are not amenable to verification and certification using current methods. We have produced a demonstration of a run-time assurance architecture based on a neural network aircraft taxiing application that shows how several advanced technologies could be used to ensure safe operation. The demonstration system includes a safety architecture based on the ASTM F3269-17 standard for bounded behavior of complex systems, diverse run-time monitors of system safety, and formal synthesis of critical high-assurance components. The enhanced system demonstrates the ability of the run-time assurance architecture to maintain system safety in the presence of defects in the underlying LEC.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat ASTM F3269–17: Standard practice for methods to safely bound flight behavior of unmanned aircraft systems containing complex functions (2017) ASTM F3269–17: Standard practice for methods to safely bound flight behavior of unmanned aircraft systems containing complex functions (2017)
2.
Zurück zum Zitat Cofer, D., et al.: A formal approach to constructing secure air vehicle software. IEEE Comput. Mag. 51, 14–23 (2018)CrossRef Cofer, D., et al.: A formal approach to constructing secure air vehicle software. IEEE Comput. Mag. 51, 14–23 (2018)CrossRef
4.
Zurück zum Zitat Denouden, T., Salay, R., Czarnecki, K., Abdelzad, V., Phan, B., Vernekar, S.: Improving reconstruction autoencoder out-of-distribution detection with mahalanobis distance (2018). CoRR, abs/1812.02765 Denouden, T., Salay, R., Czarnecki, K., Abdelzad, V., Phan, B., Vernekar, S.: Improving reconstruction autoencoder out-of-distribution detection with mahalanobis distance (2018). CoRR, abs/1812.02765
5.
Zurück zum Zitat Gacek, A., et al.: Resolute: an assurance case language for architecture models. In: HILT 2014, pp. 19–28. ACM, New York, NY, USA (2014) Gacek, A., et al.: Resolute: an assurance case language for architecture models. In: HILT 2014, pp. 19–28. ACM, New York, NY, USA (2014)
6.
Zurück zum Zitat Feiler, P.H., Gluch, D.P.: Model-Based Engineering with AADL: An Introduction to the SAE Architecture Analysis and Design Language, 1st edn. Addison-Wesley Professional, Boston (2012) Feiler, P.H., Gluch, D.P.: Model-Based Engineering with AADL: An Introduction to the SAE Architecture Analysis and Design Language, 1st edn. Addison-Wesley Professional, Boston (2012)
9.
Zurück zum Zitat RTCA DO-178C: Software considerations in airborne systems and equipment certification (2011) RTCA DO-178C: Software considerations in airborne systems and equipment certification (2011)
10.
Zurück zum Zitat Sha, L.: Using simplicity to control complexity. IEEE Softw. 18(4), 20–28 (2001)CrossRef Sha, L.: Using simplicity to control complexity. IEEE Softw. 18(4), 20–28 (2001)CrossRef
11.
Zurück zum Zitat Whalen, M.W., Gacek, A., Cofer, D., Murugesan, A., Heimdahl, M.P., Rayadurgam, S.: Your “what” is my “how”: iteration and hierarchy in system design. IEEE Softw. 30(2), 54–60 (2013)CrossRef Whalen, M.W., Gacek, A., Cofer, D., Murugesan, A., Heimdahl, M.P., Rayadurgam, S.: Your “what” is my “how”: iteration and hierarchy in system design. IEEE Softw. 30(2), 54–60 (2013)CrossRef
Metadaten
Titel
Run-Time Assurance for Learning-Enabled Systems
verfasst von
Darren Cofer
Isaac Amundson
Ramachandra Sattigeri
Arjun Passi
Christopher Boggs
Eric Smith
Limei Gilham
Taejoon Byun
Sanjai Rayadurgam
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-55754-6_21

Premium Partner