Robert G. Sargent
ABSTRACT
We give a general introduction to verification and validation of simulation models, define the various validation techniques, and present a recommended model validation procedure in this overview paper.
- Anderson, H.A. and R.G. Sargent (1974). An Investigation into Schedu2ing for an Interactive Cornputer System, 1BM Journal of Research and Development, 18, 2, pp. 125-137.Google Scholar
- Balci, O. (1987). Credibility Assessment of Simulation Results: The State of the Art, Methodology and Validation, Simulation Series, Vol. 19, No. l, The Society for Computer Simulation, pp. 19-25.Google Scholar
- Balci, (3. and R.G. Sargent (1981). A Methodology for Cost-Risk Analysis in the Statistical Validation ol Simulation Models, Communications of the ACM, 24, 4, pp. 190-197. Google ScholarDigital Library
- Balci, O. and R.G. Sargent (1982a). Validation of Multivariate Respon~'~e Simulation Models by Using {-lotelling's Two-Sample T2 Test, Simulation, Vol. 39, No. 6, pp. 185-192.Google ScholarCross Ref
- Balci, O. and R.G. Sargent (1982b). Some Examples of Simulation Model Validation Using Hypothesis Testing, Proceedings of the 1982 Winter Simulation Conference, edited by Highland, Chat, and Madrig~, pp. 620-629. Google ScholarDigital Library
- Balci, O. and R.G. Sargent (1983). Validation of Multivariate Response Trace-Driven Simulation Models, Per.{ormance 83, edited by Agrawada and Tripathi, North Holland, pp. 309-323. Google ScholarDigital Library
- Balci, O. and R.G. Sargent (I984a). A Bibliography on the Credibility, Assessment and Validation of Simulation and Mathematical Models, Simuletter, Vol. 15, No. 3, pp. 15-27,Google Scholar
- Balci, O. and R.G. Sargent (1984b). Validation of Simulation Models via Simultaneous Confidence Intervals, American Journal of Mathematical and Management Science, Vol. 4, No. 3 and 4, pp. 375- 406.Google Scholar
- Banks, J. and J.S. Carson II (1984). Discrete-Event System Simulation, Prentice-Hall, New Jersey.Google Scholar
- Banks, 5., D. Gerstein, and S.P. Searles (1987). Modeling Processes, Validation, and Verification of Complex Simulations: A Survey, Methodology and Validation, Simulation Series, Vol. 19, No. 1. The Society for Computer Simulation, pp. 13-18.Google Scholar
- Chattergy, R. and V.W. Pooch (I977). Integrated Design and Verification of Simulation Programs, Computer, Vol. 10, No. 4, pp. 40-46. Google ScholarDigital Library
- Chen, B. and R.G. Sargent (1987). Using Standardized Time Series to Estimate the Difference Between Two Stationary Time Series, Operations Research, Vol. 35, No. 3. Google ScholarDigital Library
- Davis, E.A. (1986). Use of Seminar Gaming to Specify and Validate Simulation Models, Proceedings of the 1986 Winter Simulation Conference, edited by Wilson, Henfiksen, and Roberts, Washington, D.C., pp. 242-247. Google ScholarDigital Library
- Fairley, R.E, (1976). Dynamic Testing of Simulation Software, Proceedings of the 1976 Summer Computer Simulation Conference, Washington, D.C., pp. 40-46.Google Scholar
- Gass, S.I. and B.W. Thompson (1980). Guidelines for Model Evaluation: An Abridged Version of the U.S. General Accounting Office Exposure Draft, Operations Research, 28, 2, pp. 431-479.Google ScholarDigital Library
- Gass, S.I. (1983). Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis, Operations Research, 31, 4, pp. 601-663.Google ScholarDigital Library
- Kleijnen, J.P.C. (1975). Statistical Techniques in Simulation, Part II, Marcel Dekker, New York. Google ScholarDigital Library
- Kleijnen, J.P.C. (1982). Experimentation with Models: Statistical Design and Analysis Techniques, Progress in Modelling and Simulation, F.E. Cellier, Editor, Academic Press, London.Google Scholar
- Law, A.M. (1983). Statistical Analysis of Simulation Output Data, Operations Research, Vol. 31, No. 6, pp. 983-1029.Google ScholarDigital Library
- Law, A.M. and W.D. Kelton (1982). Simulation Modeling Analysis, McGraw-Hill Book Company. Google ScholarDigital Library
- Miller, I. and J.E. Feund (1985). Probability and Statistics for Engineers, Prentice-Hall, Englewood Cliffs, New Jersey.Google Scholar
- Naylor, T.H. and J.M. Finger (1967). Verification of Computer Simulation Models, Management Science, 14, 2, pp. B92-B 101.Google ScholarDigital Library
- Oren, T. (198I). Concepts and Criteria to Assess Acceptability of Simulation Studies: A Frame of Reference, Communications of the ACM, 24, 4, pp. 180-189. Google ScholarDigital Library
- Sargent, R.G. (1979). Validation of Simulation Models, Proceedings of the 1979 Winter Simulation Conference, edited by Highland, H.J., et al., San Diego, California, pp. 497-503. Google ScholarDigital Library
- Sargent, R.G. (1981). An Assessment Procedure and a Set of Criteria for Use in the Evaluation of Computerized Models and Computer-Based Modelling Tools, Final Technical Report RADC-TR-80-409.Google ScholarCross Ref
- Sargent, R.G. (1982). Verification and Validation of Simulation Models, Chapter IX in Progress in Modelling and Simulation, edited by F.E. Cellier, Academic Press, London, pp. 159-169.Google Scholar
- Sargent, R.G. (1984). Simulation Model Validation, Simulat'.t.on and Model-Based Methodologies: A n integrative View, edited by Oven, et al., Springer-Verlag.Google Scholar
- Sargent, R.G. (1985). An Expository on Verification and Validation of Simulation Models, Proceedings of the 1985 Winter Simulation Conference, edited by Gantz, Blais, and Solomon, Dallas, Texas, pp. 15-22. Google ScholarDigital Library
- Sargent, R.G. (I986). The Use of Graphic Models in Model Validation, Proceedings of the 1986 Winter Simulation Conference, edited by Wilson, Henriksen, and Roberts, Washington, D.C., pp. 237- 24I. Google ScholarDigital Library
- Schlesinger, et al. (1979). Terminology for Model Credibility, Simulation, 32, 3, pp. 103-104.Google ScholarCross Ref
- Schruben, L.W. (1980). Establishing the Credibility of Simulations, Simulation, 34, 3, pp. 101-105.Google ScholarCross Ref
- Shannon, R.B. (1975). Systems Simulation: The Art and the Science, Prentice-Hall.Google Scholar
- Shannon, R.E. (1981). Tests for the Verification and Validation of Computer Simulation M. oriels, Proceedings of the Winter Simulation Conference, edited by Oren, Delfosse, and Shub, pp. 573-577. Google ScholarDigital Library
- Smith, D.E. and C.A. Mauro (1982). Factor Screening in Computer Simulation, Simulan'on, Vol. 38, No. 2, pp. 49-54.Google ScholarCross Ref
- Wood, D.O. (1986). MIT Model Analysis Program: What We Have Learned About Policy Model Review, Proceedings of the 1986 Winter Simulation Conference, edited by Wilson, Henriksen, and Roberts, Washington, D.C., pp. 248-252. Google ScholarDigital Library
- Zeigler, B.P. (1976). Theory of Modelling and Simulation, John Wiley and Sons, Inc., New York. Google ScholarDigital Library
Index Terms
- An overview of verification and validation of simulation models
Recommendations
Validation and verification of simulation models
WSC '04: Proceedings of the 36th conference on Winter simulationIn this paper we discuss validation and verfication of simulation models. Four different approaches to deciding model validity are described; two different paradigms that relate validation and verification to the model development process are presented; ...
Verification and validation of simulation models
WSC '03: Proceedings of the 35th conference on Winter simulation: driving innovationIn this paper we discuss verification and validation of simulation models. Four different approaches to deciding model validity are described; two different paradigms that relate verification and validation to the model development process are presented;...
Verification and validation of simulation models
WSC '11: Proceedings of the Winter Simulation ConferenceIn this paper we discuss verification and validation of simulation models. Four different approaches to deciding model validity are described, a graphical paradigm that relates verification and validation to the model development process is presented, ...
Comments