Skip to main content

2024 | OriginalPaper | Buchkapitel

Verification Complexity: An Initial Look at Verification Artifacts

verfasst von : Sukhwan Jung, Alejandro Salado

Erschienen in: The Proceedings of the 2023 Conference on Systems Engineering Research

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There has been increasing interest in developing numerical methods to inform the design of verification strategies in recent years. Existing work has been applied to toy problems that significantly simplify the complexity of verification in real-life applications, both in terms of the size of the problem and the interdependencies between the different elements of a verification strategy. To our knowledge, there is no publicly available evidence of the complexity of the verification “problem” in terms of requirements that need to be verified, verification activities that are conducted, and their interrelationships. In this chapter, we use knowledge graphs to visualize the size of the verification problem for two industrial projects, as captured in their verification artifacts, which include requirements traceability matrices and verification matrices.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat P.D. Collopy, A research agenda for the coming renaissance in systems engineering, in 50th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition, (2012) P.D. Collopy, A research agenda for the coming renaissance in systems engineering, in 50th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition, (2012)
2.
Zurück zum Zitat P.D. Collopy, Report on the science of systems engineering workshop, in 53rd AIAA Aerospace Sciences Meeting, (American Institute of Aeronautics and Astronautics, 2015) P.D. Collopy, Report on the science of systems engineering workshop, in 53rd AIAA Aerospace Sciences Meeting, (American Institute of Aeronautics and Astronautics, 2015)
3.
Zurück zum Zitat P.D. Collopy, Systems engineering theory: What needs to be done, in Systems Conference (SysCon), 2015 9th Annual IEEE International, (2015) P.D. Collopy, Systems engineering theory: What needs to be done, in Systems Conference (SysCon), 2015 9th Annual IEEE International, (2015)
4.
Zurück zum Zitat A. Salado, R. Nilchiani, D. Verma, A contribution to the scientific foundations of systems engineering: Solution spaces and requirements. J. Syst. Sci. Syst. Eng. 26(5), 549–589 (2017)CrossRef A. Salado, R. Nilchiani, D. Verma, A contribution to the scientific foundations of systems engineering: Solution spaces and requirements. J. Syst. Sci. Syst. Eng. 26(5), 549–589 (2017)CrossRef
5.
Zurück zum Zitat A. Salado, R. Nilchiani, On the evolution of solution spaces triggered by emerging technologies. Procedia Comput. Sci. 44, 155–163 (2015)CrossRef A. Salado, R. Nilchiani, On the evolution of solution spaces triggered by emerging technologies. Procedia Comput. Sci. 44, 155–163 (2015)CrossRef
6.
Zurück zum Zitat A. Salado, R. Nilchiani, The concept of order of conflict in requirements engineering. IEEE Syst. J. 10(1), 25–35 (2016)CrossRef A. Salado, R. Nilchiani, The concept of order of conflict in requirements engineering. IEEE Syst. J. 10(1), 25–35 (2016)CrossRef
7.
Zurück zum Zitat P.D. Collopy, P.M. Hollingsworth, Value-driven design. J. Aircr. 48(3), 749–759 (2011)CrossRef P.D. Collopy, P.M. Hollingsworth, Value-driven design. J. Aircr. 48(3), 749–759 (2011)CrossRef
8.
Zurück zum Zitat B.D. Lee, C.J.J. Paredis, A conceptual framework for value-driven design and systems engineering. Procedia CIRP 21, 10–17 (2014)CrossRef B.D. Lee, C.J.J. Paredis, A conceptual framework for value-driven design and systems engineering. Procedia CIRP 21, 10–17 (2014)CrossRef
9.
Zurück zum Zitat A.W. Wymore, Model-Based Systems Engineering (CRC Press, Boca Raton, 1993) A.W. Wymore, Model-Based Systems Engineering (CRC Press, Boca Raton, 1993)
10.
Zurück zum Zitat INCOSE, Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 4.0 ed (Wiley, Hoboken, 2015) INCOSE, Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 4.0 ed (Wiley, Hoboken, 2015)
11.
Zurück zum Zitat D.M. Buede, W.D. Miller (eds.), The Engineering Design of Systems: Models and Methods, 3rd edn. (Wiley, Hoboken, 2016) D.M. Buede, W.D. Miller (eds.), The Engineering Design of Systems: Models and Methods, 3rd edn. (Wiley, Hoboken, 2016)
12.
Zurück zum Zitat A. Engel, in Verification, Validation, and Testing of Engineered Systems, Wiley Series on Systems Engineering and Management, ed. by A.P. Sage, (Wiley, Hoboken, 2010)CrossRef A. Engel, in Verification, Validation, and Testing of Engineered Systems, Wiley Series on Systems Engineering and Management, ed. by A.P. Sage, (Wiley, Hoboken, 2010)CrossRef
13.
Zurück zum Zitat A. Salado, H. Kannan, Elemental patterns of verification strategies. Syst. Eng. 5, 370–388 (2019)CrossRef A. Salado, H. Kannan, Elemental patterns of verification strategies. Syst. Eng. 5, 370–388 (2019)CrossRef
14.
Zurück zum Zitat A. Salado, H. Kannan, A mathematical model of verification strategies. Syst. Eng. 21, 583–608 (2018)CrossRef A. Salado, H. Kannan, A mathematical model of verification strategies. Syst. Eng. 21, 583–608 (2018)CrossRef
15.
Zurück zum Zitat G.A. Hazelrigg, A framework for decision-based engineering design. J. Mech. Des. 120(4), 653–658 (1998)CrossRef G.A. Hazelrigg, A framework for decision-based engineering design. J. Mech. Des. 120(4), 653–658 (1998)CrossRef
16.
Zurück zum Zitat G.A. Hazelrigg, An axiomatic framework for engineering design. J. Mech. Des. 121(3), 342–347 (1999)CrossRef G.A. Hazelrigg, An axiomatic framework for engineering design. J. Mech. Des. 121(3), 342–347 (1999)CrossRef
17.
Zurück zum Zitat D.M. Buede, The Engineering Design of Systems: Models and Methods (Wiley, 2009)CrossRef D.M. Buede, The Engineering Design of Systems: Models and Methods (Wiley, 2009)CrossRef
18.
Zurück zum Zitat M. Tribus, Rational Descriptions, Decisions and Designs (Pergamon Press Inc, Oxford, 1969) M. Tribus, Rational Descriptions, Decisions and Designs (Pergamon Press Inc, Oxford, 1969)
19.
Zurück zum Zitat S.C. Thompson, C.J.J. Paredis, An investigation into the decision analysis of design process decisions. J. Mech. Des. 132(12), 121009–121009-9 (2010)CrossRef S.C. Thompson, C.J.J. Paredis, An investigation into the decision analysis of design process decisions. J. Mech. Des. 132(12), 121009–121009-9 (2010)CrossRef
20.
Zurück zum Zitat J.M. Aughenbaugh, C.J. Paredis, The value of using imprecise probabilities in engineering design. J. Mech. Des. 128(4), 969–979 (2005)CrossRef J.M. Aughenbaugh, C.J. Paredis, The value of using imprecise probabilities in engineering design. J. Mech. Des. 128(4), 969–979 (2005)CrossRef
21.
Zurück zum Zitat A. Salado, H. Kannan, Properties of the utility of verification, in IEEE International Symposium in Systems Engineering, (Rome, Italy, 2018) A. Salado, H. Kannan, Properties of the utility of verification, in IEEE International Symposium in Systems Engineering, (Rome, Italy, 2018)
22.
Zurück zum Zitat ECSS, Space Engineering – Verification (European Cooperation for Space Standardization, Noordwijk, 2009) ECSS, Space Engineering – Verification (European Cooperation for Space Standardization, Noordwijk, 2009)
23.
Zurück zum Zitat ECSS, Space Engineering – Testing (European Cooperation for Space Standardization, Noordwijk, 2012) ECSS, Space Engineering – Testing (European Cooperation for Space Standardization, Noordwijk, 2012)
24.
25.
Zurück zum Zitat V.K. Smith, D.H. Taylor, F.A. Sloan, Longevity expectations and death: Can people predict their own demise? Am. Econ. Rev. 91(4), 1126–1134 (2001)CrossRef V.K. Smith, D.H. Taylor, F.A. Sloan, Longevity expectations and death: Can people predict their own demise? Am. Econ. Rev. 91(4), 1126–1134 (2001)CrossRef
26.
Zurück zum Zitat M. Hoppe, A. Engel, S. Shachar, SysTest: Improving the verification, validation, and testing process – Assessing six industrial pilot projects. Syst. Eng. 10(4), 323–347 (2007)CrossRef M. Hoppe, A. Engel, S. Shachar, SysTest: Improving the verification, validation, and testing process – Assessing six industrial pilot projects. Syst. Eng. 10(4), 323–347 (2007)CrossRef
27.
Zurück zum Zitat M. Barad, A. Engel, Optimizing VVT strategies: A decomposition approach. J. Oper. Res. Soc. 57(8), 965–974 (2005)CrossRef M. Barad, A. Engel, Optimizing VVT strategies: A decomposition approach. J. Oper. Res. Soc. 57(8), 965–974 (2005)CrossRef
28.
Zurück zum Zitat P. Xu, A. Salado, A mathematical approach to design verification strategies that incorporate corrective activities as dedicated decisions. IEEE Open J. Syst. Eng. 1, 1–10 (2022)CrossRef P. Xu, A. Salado, A mathematical approach to design verification strategies that incorporate corrective activities as dedicated decisions. IEEE Open J. Syst. Eng. 1, 1–10 (2022)CrossRef
29.
Zurück zum Zitat A.U. Kulkarni et al., An evaluation of the optimality of frequent verification for vertically integrated systems. Syst. Eng. 24(1), 17–33 (2021)CrossRef A.U. Kulkarni et al., An evaluation of the optimality of frequent verification for vertically integrated systems. Syst. Eng. 24(1), 17–33 (2021)CrossRef
30.
Zurück zum Zitat M. Messer et al., Model selection under limited information using a value-of-information-based indicator. J. Mech. Des. 132(12), 121008 (2010)CrossRef M. Messer et al., Model selection under limited information using a value-of-information-based indicator. J. Mech. Des. 132(12), 121008 (2010)CrossRef
31.
Zurück zum Zitat A. Engel, S. Shachar, Measuring and optimizing systems’ quality costs and project duration. Syst. Eng. 9(3), 259–280 (2006)CrossRef A. Engel, S. Shachar, Measuring and optimizing systems’ quality costs and project duration. Syst. Eng. 9(3), 259–280 (2006)CrossRef
32.
Zurück zum Zitat A. Salado, H. Kannan, F. Farkhondehmaal, Capturing the Information Dependencies of Verification Activities with Bayesian Networks (Springer, Cham, 2019)CrossRef A. Salado, H. Kannan, F. Farkhondehmaal, Capturing the Information Dependencies of Verification Activities with Bayesian Networks (Springer, Cham, 2019)CrossRef
33.
Zurück zum Zitat F. Farkhondehmaal, A. Salado, Efficient population of the verification tradespace using Bayesian inference. IEEE Syst. J. 14(3), 3225–3232 (2020)CrossRef F. Farkhondehmaal, A. Salado, Efficient population of the verification tradespace using Bayesian inference. IEEE Syst. J. 14(3), 3225–3232 (2020)CrossRef
34.
Zurück zum Zitat A.U. Kulkarni et al., Is verifying frequently an optimal strategy? A belief-based model of verification, in ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, (2020) A.U. Kulkarni et al., Is verifying frequently an optimal strategy? A belief-based model of verification, in ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, (2020)
35.
Zurück zum Zitat A.U. Kulkarni, C. Wernz, A. Salado, Coordination of verification activities with incentives: A two-firm model. Res. Eng. Des. 32, 31–47 (2021)CrossRef A.U. Kulkarni, C. Wernz, A. Salado, Coordination of verification activities with incentives: A two-firm model. Res. Eng. Des. 32, 31–47 (2021)CrossRef
36.
Zurück zum Zitat P. Xu, A. Salado, A concept for set-based design of verification strategies, in INCOSE International Symposium, (Orlando, FL, USA, 2019) P. Xu, A. Salado, A concept for set-based design of verification strategies, in INCOSE International Symposium, (Orlando, FL, USA, 2019)
37.
Zurück zum Zitat P. Xu, A. Salado, G. Xie, A reinforcement learning approach to design verification strategies of engineered systems, in IEEE International Conference on Systems, Man, and Cybernetics, (Toronto, Canada, 2020) P. Xu, A. Salado, G. Xie, A reinforcement learning approach to design verification strategies of engineered systems, in IEEE International Conference on Systems, Man, and Cybernetics, (Toronto, Canada, 2020)
38.
Zurück zum Zitat P. Xu, A. Salado, X. Deng, A parallel tempering approach for efficient exploration of the verification tradespace in engineered systems. IEEE Trans. Syst. Man Cybern. Syst. 2022, 1–13 (2022) P. Xu, A. Salado, X. Deng, A parallel tempering approach for efficient exploration of the verification tradespace in engineered systems. IEEE Trans. Syst. Man Cybern. Syst. 2022, 1–13 (2022)
Metadaten
Titel
Verification Complexity: An Initial Look at Verification Artifacts
verfasst von
Sukhwan Jung
Alejandro Salado
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-49179-5_14

Neuer Inhalt