skip to main content
10.1145/582128.582141acmconferencesArticle/Chapter ViewAbstractPublication PagesfseConference Proceedingsconference-collections
Article

Toward V&V of neural network based controllers

Published:18 November 2002Publication History

ABSTRACT

Online adaptation is a powerful means to handle unexpected slow or catastrophic changes of the system's behavior (e.g., a stuck or broken rudder of an aircraft). Therefore, adaptation is one way for realizing a self-healing system. Substantial research and development has been made to use neural networks (NN) for such tasks (e.g., integrated in various unmanned helicopters and test-flown on a modified F-15 aircraft). Despite the advantages of adaptive neural network based systems, the lack of methods to perform certification, verification, and validation (V&V) of such systems severely restricts their applicability.In this paper, we report on ongoing work to develop V&V techniques and processes for NN-based safety-critical control systems, in our case an aircraft flight control system. Although the project ultimately aims at V&V of online adaptive systems, this paper focuses on the first part of this project dealing with so-called pre-trained neural networks (PTNN). V&V techniques developed here are important pre-requisites for handling the online adaptive case. In particular, we describe highlights of a process guide which has been developed within this project and discuss important V&V issues which need to be addressed during certification.

References

  1. C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon-Press, Oxford, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. A. Calise and R. Rysdyk. Adaptive model inversion flight control for tiltrotor aircraft. In AIAA Guidance, Navigation and Control Conference 1997, number AIAA-97-3758. AIAA, 1997.Google ScholarGoogle Scholar
  3. J. E. Dennis and R. B. Schnabel. Numerical Methods for Unconstrained Optimization and Nonlinear Equations, volume 16 of Classics in Applied Mathematics. SIAM, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. DO-178B: Software considerations in airborne systems and equipment certification. URL: http://www.rtca.org, 1992.Google ScholarGoogle Scholar
  5. S. S. Ge, T. Lee, and C. J. Harris. Adaptive Neural Network Control of Robotic Manipulators, volume 19 of World Scientific Series in Robotics and Intelligent Systems. World Scientific, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. P. Gill, W. Murray, and M. Wright. Practical Optimization. Academic Press, 1981.Google ScholarGoogle Scholar
  7. M. Idan, M. Johnson, and A. Calise. A hierarchical approach to adaptive control for improved flight safety. In AIAA Guidance, Navigation and Control Conference 2001, number AIAA-2001-4209. AIAA, 2001.Google ScholarGoogle Scholar
  8. IEEE standards 12207.0, 12207.1, 12207.2. URL: http://ieeexplore.ieee.org, 1997.Google ScholarGoogle Scholar
  9. C. Jorgensen. Direct adaptive aircraft control using neural networks. Technical Report TM-47136, NASA, 1997.Google ScholarGoogle Scholar
  10. J. Kaneshige and K. Gundy-Burlet. Integrated neural flight and propulsion control system. In AIAA Guidance, Navigation and Control Conference 2001, number AIAA-2001-4386. AIAA, 2001.Google ScholarGoogle Scholar
  11. A. Kelkar. Neural networks for modeling and control of dynamic systems. Presentation at NASA Ames, Code IC, 2001.Google ScholarGoogle Scholar
  12. D. Mackall, S. Nelson, and J. Schumann. Verification and Validation of Neural Networks of Aerospace Applications. Technical Report CR-211409, NASA, 2002.Google ScholarGoogle Scholar
  13. NASA guidebook for safety critical software. Technical Report NASA-GB-1740.13-96, NASA, 1996.Google ScholarGoogle Scholar
  14. NASA procedures and guidelines NPG: 2820.draft, NASA software guidelines and requirements as of 3/19/01. NASA Ames Research Center, Moffett Field, California, USA, 2001. (Responsible Office: Code AE/Office of the Chief Engineer).Google ScholarGoogle Scholar
  15. M. Norgaard, O. Ravn, N. Poulsen, and L. K. Hansen. Neural Networks for Modeling and Control of Dynamic Systems. Springer, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. A. Sastry and M. Bodson. Adaptive Control: Stability, Convergence and Robustness. Prentice Hall, 1994. http://www.ece.utah.edu/~bodson/acscr. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. J. Schumann. Vericonn: Verification of controllers based on adaptive neural networks --- white paper---. Technical report, NASA Ames, Automated Software Engineering, 2001.Google ScholarGoogle Scholar
  18. J. Schumann. V&V issues for neural networks. Technical Report RIACS-TR-XX-02, RIACS, 2002.Google ScholarGoogle Scholar
  19. D. Soloway and P. Haley. Reconfigurable flight control using neural generalized predictive control. In AIAA Space 2000 Conference, number AIAA-2000-5328. AIAA, 2000.Google ScholarGoogle ScholarCross RefCross Ref
  20. J. Totah. Adaptive flight control and on-line learning. In AIAA Guidance, Navigation and Control Conference 1997, number AIAA-97-3537. AIAA, 1997.Google ScholarGoogle Scholar
  1. Toward V&V of neural network based controllers

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      WOSS '02: Proceedings of the first workshop on Self-healing systems
      November 2002
      120 pages
      ISBN:1581136099
      DOI:10.1145/582128

      Copyright © 2002 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 18 November 2002

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Upcoming Conference

      FSE '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader