Skip to main content
Top

2017 | OriginalPaper | Chapter

5. Verification Challenges for Autonomous Systems

Authors : Signe A. Redfield, Mae L. Seto

Published in: Autonomy and Artificial Intelligence: A Threat or Savior?

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this chapter, some research challenges in the verification of autonomous systems are outlined. The objective was to identify existing available verification tools and their associated gaps, additional challenges for which there are no tools, and to make suggestions for directions in which progress may profitably be made. The chapter briefly touches on existing research to begin addressing these problems but there are more unexplored research challenges than there are programs underway to explore them. This chapter concludes with an enumeration of the unexplored challenges.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Immobot—a robot that is not capable of moving from one location to another within its environment but is capable of modifying its environment in some way, e.g. a smart house.
 
Literature
go back to reference IEEE Standard Ontologies for Robotics and Automation (2015a), IEEE Std 1872-2015, 60 pages. IEEE Standard Ontologies for Robotics and Automation (2015a), IEEE Std 1872-2015, 60 pages.
go back to reference IEEE Standard Ontologies for Robotics and Automation (2015b), P1872/D3, 55 pages. IEEE Standard Ontologies for Robotics and Automation (2015b), P1872/D3, 55 pages.
go back to reference Albus, J., Huang, H. M., Messina, E., Murphy, K., Juberts, M., Lacaze, A., et al. (2000). 4D/RCS: A reference model architecture for unmanned vehicle systems version 2.0. Albus, J., Huang, H. M., Messina, E., Murphy, K., Juberts, M., Lacaze, A., et al. (2000). 4D/RCS: A reference model architecture for unmanned vehicle systems version 2.0.
go back to reference Barltrop, K. J., Friberg, K. H., & Horvath, G. A. (2008). Automated generation and assessment of autonomous systems test cases. Aerospace Conference (pp. 1–10). IEEE. Barltrop, K. J., Friberg, K. H., & Horvath, G. A. (2008). Automated generation and assessment of autonomous systems test cases. Aerospace Conference (pp. 1–10). IEEE.
go back to reference Billman, L., & Steinberg, M. (2007). Human system performance metrics for evaluation of mixed-initiative hterogeneous autonomys systems. Proceedings of 2007 Workshop on Performance Metrics for Intelligent Systems (pp. 120–126). ACM. Billman, L., & Steinberg, M. (2007). Human system performance metrics for evaluation of mixed-initiative hterogeneous autonomys systems. Proceedings of 2007 Workshop on Performance Metrics for Intelligent Systems (pp. 120–126). ACM.
go back to reference Castillo-Effen, M., & Visnevski, N. A. (2009). Analysis of autonomous deconfliction in unmanned aircraft systems for testing and evaluation. Aerospace Conference (pp. 1–12). IEEE. Castillo-Effen, M., & Visnevski, N. A. (2009). Analysis of autonomous deconfliction in unmanned aircraft systems for testing and evaluation. Aerospace Conference (pp. 1–12). IEEE.
go back to reference Chaki, S., & Giampapa, J. A. (2013). Probabilistic verification of coordinated multi-robot missions. In Model Checking Software (pp. 135–153). Springer. Chaki, S., & Giampapa, J. A. (2013). Probabilistic verification of coordinated multi-robot missions. In Model Checking Software (pp. 135–153). Springer.
go back to reference Cleary, M. E., Abramsom, M., Adams, M. B., & Kolitz, S. (2001). Metrics for embedded collaborative intelligent systems. NIST Special Publication. Cleary, M. E., Abramsom, M., Adams, M. B., & Kolitz, S. (2001). Metrics for embedded collaborative intelligent systems. NIST Special Publication.
go back to reference Dunbabin, M., & Marques, L. (2012, March). Robots for environmental monitoring: Significant advancements and applications. IEEE Robotics and Automation Magazine, 19(1), pp. 24–39. Dunbabin, M., & Marques, L. (2012, March). Robots for environmental monitoring: Significant advancements and applications. IEEE Robotics and Automation Magazine, 19(1), pp. 24–39.
go back to reference Durst, P. J., Gray, W., Nikitenko, A., Caetano, J., Trentini, M., & King, R. (2014). A framework for predicting the mission-specific performance of autonomous unmanned systems. IEEE/RSM International Conference on Intelligent Robots and Systems, (pp. 1962–1969). Durst, P. J., Gray, W., Nikitenko, A., Caetano, J., Trentini, M., & King, R. (2014). A framework for predicting the mission-specific performance of autonomous unmanned systems. IEEE/RSM International Conference on Intelligent Robots and Systems, (pp. 1962–1969).
go back to reference Engelberger, J. (1974). Three million hours of robot field experience. Industrial Robot: An International Journal, 164–168. Engelberger, J. (1974). Three million hours of robot field experience. Industrial Robot: An International Journal, 164–168.
go back to reference Ferri, G., Ferreira, F., Djapic, V., Petillot, Y., Palau, M., & Winfield, A. (2016). The eurathlon 2015 grand challenge: The first outdoor multi-domain search and rescue robotics competition - a marine perspective. Marine Technology Science Journal, 81–97(17). Ferri, G., Ferreira, F., Djapic, V., Petillot, Y., Palau, M., & Winfield, A. (2016). The eurathlon 2015 grand challenge: The first outdoor multi-domain search and rescue robotics competition - a marine perspective. Marine Technology Science Journal, 81–97(17).
go back to reference Gehr, J. D. (2009). Evaluating situation awareness of autonomous systems. In Performance Evaluation and Benchmarking of Intelligent Systems (pp. 93–111). Springer. Gehr, J. D. (2009). Evaluating situation awareness of autonomous systems. In Performance Evaluation and Benchmarking of Intelligent Systems (pp. 93–111). Springer.
go back to reference Huang, H. M., Albus, J. S., Messina, R. L., Wade, R. L., & English, R. (2004). Specifying autonomy levels for unmanned systems: Interim report. Defence and Security (pp. 386–397). International Society for Optics and Photonics. Huang, H. M., Albus, J. S., Messina, R. L., Wade, R. L., & English, R. (2004). Specifying autonomy levels for unmanned systems: Interim report. Defence and Security (pp. 386–397). International Society for Optics and Photonics.
go back to reference Huang, H. M., Pavek, K., Novak, B., Albus, J., & Messina, E. (2005). A framework for autonomous levels for unmanned Systems (ALFUS). Proceedings of the AUVSI's Unmanned Systems North America. Huang, H. M., Pavek, K., Novak, B., Albus, J., & Messina, E. (2005). A framework for autonomous levels for unmanned Systems (ALFUS). Proceedings of the AUVSI's Unmanned Systems North America.
go back to reference Jacoff, A., Huang, H. M., Messina, E., Virts, A., & Downs, A. (2010). Comprehensive standard test suites for the performance evaluation of mobile robots. Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop. ACM. Jacoff, A., Huang, H. M., Messina, E., Virts, A., & Downs, A. (2010). Comprehensive standard test suites for the performance evaluation of mobile robots. Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop. ACM.
go back to reference Kress-Gazit, H., Wongpiromsarn, T., & Topcu, U. (1989). Correct, reactive, high-level robot control. Robotics and Automation Magazine, 18(3), pp. 65–74. Kress-Gazit, H., Wongpiromsarn, T., & Topcu, U. (1989). Correct, reactive, high-level robot control. Robotics and Automation Magazine, 18(3), pp. 65–74.
go back to reference McWilliams, G. T., Brown, M. A., Lamm, R. D., Guerra, C. J., Avery, P. A., Kozak, K. C., et al. (2007). Evaluation of autonomy in recent ground vehicles using the autonomy levelos for unmanned systems (alfus) framework. Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems (pp. 54–61). ACM. McWilliams, G. T., Brown, M. A., Lamm, R. D., Guerra, C. J., Avery, P. A., Kozak, K. C., et al. (2007). Evaluation of autonomy in recent ground vehicles using the autonomy levelos for unmanned systems (alfus) framework. Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems (pp. 54–61). ACM.
go back to reference Miller, S., van den Berg, J., Fritz, M., Darrell, T., Goldberg, K., & Abbeel, P. (2011). A geometric approach to robotic laundry folding. International Journal of Robotics Research, 31(2), 249–267. Miller, S., van den Berg, J., Fritz, M., Darrell, T., Goldberg, K., & Abbeel, P. (2011). A geometric approach to robotic laundry folding. International Journal of Robotics Research, 31(2), 249–267.
go back to reference Murphy, R. & Shields, J. (2012). Task Force Report: The Role of Autonomy in DoD Systems. Department of Defense, Defense Science Board. Murphy, R. & Shields, J. (2012). Task Force Report: The Role of Autonomy in DoD Systems. Department of Defense, Defense Science Board.
go back to reference Paull, L., Severac, G., Raffo, G. V., Angel, J. M., Boley, H., Durst, P. J., et al. (2012). Towards an ontology for autonomous robots. IEEE/RSJ International Conference on Intelligent Robots and Systems, (pp. 1359–1364). Paull, L., Severac, G., Raffo, G. V., Angel, J. M., Boley, H., Durst, P. J., et al. (2012). Towards an ontology for autonomous robots. IEEE/RSJ International Conference on Intelligent Robots and Systems, (pp. 1359–1364).
go back to reference Pecheur, C. (2000). Validation and verification of autonomy software at NASA. National Aeronautics and Space Administration. Pecheur, C. (2000). Validation and verification of autonomy software at NASA. National Aeronautics and Space Administration.
go back to reference Schultz, A. C., Grefenstett, J. J., & De Jong, K. A. (1993, October). Test and evaluation by genetic algorithms. IEEE Expert, 8(5), 9–14. Schultz, A. C., Grefenstett, J. J., & De Jong, K. A. (1993, October). Test and evaluation by genetic algorithms. IEEE Expert, 8(5), 9–14.
go back to reference Sholes, E. (2007). Evolution of a uav autonomy classification taxonomy. Aerospace Conference (pp. 1–16). IEEE. Sholes, E. (2007). Evolution of a uav autonomy classification taxonomy. Aerospace Conference (pp. 1–16). IEEE.
go back to reference Smith, B., Millar, W., Dunphy, J., Tung, Y. W., Nayak, P., Gamble, E., et al. (1999). Validation and verification of the remote agent for spacecraft autonomy. Aerospace Conference. 1, pp. 449–468. IEEE. Smith, B., Millar, W., Dunphy, J., Tung, Y. W., Nayak, P., Gamble, E., et al. (1999). Validation and verification of the remote agent for spacecraft autonomy. Aerospace Conference. 1, pp. 449–468. IEEE.
go back to reference Smithers, T. (1995). On quantitative performance measures of robot behavior. In The Biology and Technology of Intelligent autonomous Agends (pp. 21–52). Springer. Smithers, T. (1995). On quantitative performance measures of robot behavior. In The Biology and Technology of Intelligent autonomous Agends (pp. 21–52). Springer.
go back to reference Steinberg, M. (2006). Intelligent autonomy for unmanned naval systems. Defense and Security Symposiukm (pp. 623013–623013). International Society for Optics and Photonics. Steinberg, M. (2006). Intelligent autonomy for unmanned naval systems. Defense and Security Symposiukm (pp. 623013–623013). International Society for Optics and Photonics.
go back to reference Vassev, E., & Hinchey, M. (2013). On the autonomy requirements for space missions. IEEE 16th International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing, (pp. 1–10). Vassev, E., & Hinchey, M. (2013). On the autonomy requirements for space missions. IEEE 16th International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing, (pp. 1–10).
Metadata
Title
Verification Challenges for Autonomous Systems
Authors
Signe A. Redfield
Mae L. Seto
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-59719-5_5

Premium Partner