Findings
Background and hypothesis
Methods and approach
Results
-
System-Level and Model-Level Checklists: These practitioner aides were simplified in wording and number of line items. The supporting text was significantly revised and expanded to more clearly communicate intent and recommended process for use of this checklist.
-
TML assessment guide: This practitioner aide was revised by adding numerous supporting comments in the Excel™ comment tabs, adjusting some of the category headers based on feedback, and by adding some line items in the category boxes for selected TML levels.
-
Recommended Best Practice for ICME V&V: The two recommended process flow charts were revised. The simplified (‘3-step’) process flow chart was updated to illustrate the iterative and interactive nature recommended for key steps in the V&V planning process. The detailed process flow chart was revised to improve flow and reflect the expected actual sequence of activities in a V&V planning process. In addition, the step-by-step instructions were updated and recommended activities clarified.
-
Use of Phenomena Identification and Ranking Technique (PIRT) (note that often ‘Table’ is used instead of ‘Technique’ in this acronym): Instructions and an ICME-relevant example for the use of this technique provided by Southwest Research Institute (SwRI) were included in the guidelines and recommended best practice. Use of PIRT is a flexible approach to outline and describe model hierarchy and parameters, assess their relative importance, and communicate or illustrate this to the project team or reviewers and is now included as a recommended tool for use.
-
Development of a ‘Dashboard’ chart: A simple, one-page chart in presentation format was developed, suitable for succinctly summarizing the status of ICME V&V planning and execution for a specific project. The ‘Dashboard’ reflects the status of checklist items, TML, and any risk mitigation items in a format suitable for reporting and presentation.
-
Application examples were expanded and improved: A more detailed example of use of the ‘Risk vs. Consequences’ approach for prediction of forging residual stress predictions was included. A detailed example of uncertainty assessment for an ICME computational model for aluminum was expanded from the prior version and related to the TML assessment guide.
-
Alignment of the guidelines and recommended best practice with current gated processes: Background and supporting text was revised, and figures showing alignment of the recommended best practice with TRL, MRL, IPD, and the Department of Defense (DoD) Acquisition Guide were revised and improved.