Article

Free access

A tutorial on design and analysis of simulation experiments

Author:

W. David KeltonAuthors Info & Claims

WSC '95: Proceedings of the 27th conference on Winter simulation

Pages 24 - 31

https://doi.org/10.1145/224401.224412

Published: 01 December 1995 Publication History

Abstract

This paper describes, in general terms, methods to help design the runs for simulation models and interpret their output. Statistical methods are described for several different purposes, and related problems like comparison, variance reduction, sensitivity estimation, metamodeling and optimization are mentioned. The main point is to call attention to the challenges and opportunities in using simulation models carefully and effectively.

References

[1]

Alexopoulos, C. 1993. Advanced simulation output analysis for a single system. In Proceedings of the 1993 Winter Simulation Conference, ed. G.W. Evans, M. Mollaghasemi, E.C. Russell, and W.E. B iles, 89-96. WSC Board of Directors.

Digital Library

[2]

Alexopoulos, C. 1994. A review of advanced methods for simulation output analysis. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.F. Seila, 133-140. WSC Board of Directors.

Digital Library

[3]

Azadivar, F. 1992. A tutorial on simulation optimization. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 198-204. WSC Board of Directors.

Digital Library

[4]

Banks, J. and J.S. Carson, II. 1984. Discrete-event system simulation. Englewood Cliffs, New Jersey: Prentice- Hall.

[5]

Barton. R.R. 1992. Metamodels for Simulation Input- Output Relations. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 289-299. WSC Board of Directors.

Digital Library

[6]

Bratley, P., B.L. Fox, and L.E. Schrage. 1987. A guide to simulation. 2nd ed. New York: Springer-Verlag.

Digital Library

[7]

Charnes, J.M. 1991. Multivariate simulation output analysis. In Proceedings of the 1991 Winter Simulation Conference, ed. B.L. Nelson, W.D. Kelton, and G.M. Clark, 187-193. WSC Board of Directors.

Digital Library

[8]

Charnes, J.M. 1993. Statistical analysis of output processes. In Proceedings of the 1993 Winter Simulation Conference, ed. G.W. Evans, M. Mollaghasemi, E.C. Russell, and W.E. Biles, 41-49. WSC Board of Directors.

Digital Library

[9]

Cook, L.S. 1992. Factor screening of multiple responses. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 174-180. WSC Board of Directors.

Digital Library

[10]

Fishman, G.S. 1978. Principles of discrete event simulation. New York: John Wiley & Sons.

Digital Library

[11]

Fu, M.C. 1994. A tutorial review of techniques for simulation optimization. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.F. Seila, 149-156. WSC Board of Directors.

Digital Library

[12]

Glasserman, P. and P.W. Glynn. 1992. Gradient estimation for regenerative processes. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 280-288. WSC Board of Directors.

Digital Library

[13]

Goldsman, D. 1992. Simulation output analysis. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 97-103. WSC Board of Directors.

Digital Library

[14]

Goldsman, D. and B.L. Nelson. 1994. Ranking, selection and multiple comparisons in computer simulation. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.F. Seila, 192-199. WSC Board of Directors.

Digital Library

[15]

Goldsman, D., B.L Nelson, and B. Schmeiser. 1991. Methods for selecting the best system. In Proceedings of the 1991 Winter Simulation Conference, ed. B.L. Nelson, W.D. Kelton, and G.M. Clark, 177-186. WSC Board of Directors.

Digital Library

[16]

Grier, D.A. 1992. Graphical techniques for output analysis. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 314-319. WSC Board of Directors.

Digital Library

[17]

Ho, Y.-C. 1992. Perturbation analysis: concepts and algorithms, in Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 231-240. WSC Board of Directors.

Digital Library

[18]

Hood, S.J. and P.D. Welch. 1992. Experimental design issues in simulation with examples from semiconductor manufacturing. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 255-263. WSC Board of Directors.

Digital Library

[19]

Hood, S.J. and P.D. Welch. 1993. Response surface methodology and its application in simulation. In Proceedings of the 1993 Winter Simulation Conference, ed. G.W. Evans, M. Mollaghasemi, E.C. Russell, and W.E. Biles, 115-122. WSC Board of Directors.

Digital Library

[20]

Kelton, W.D. 1994. Analysis of output data. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.F. Seila, 62-68. WSC Board of Directors.

Digital Library

[21]

Khoshnevis, B. 1994. Discrete systems simulation. New York: McGraw-Hill.

[22]

Kleijnen, J.P.C. 1987. Statistical tools for simulation practitioners. New York: Marcel Dekker, Inc.

Digital Library

[23]

Law, A.M. and W.D. Kelton. 1991. Simulation modeling and analysis. 2nd ed. New York: McGraw-Hill.

Digital Library

[24]

L'Ecuyer, P. 1991. An overview of derivative estimation. In Proceedings of the 1991 Winter Simulation Conference, ed. B.L. Nelson, W.D. Kelton, and G.M. Clark, 28-36. WSC Board of Directors.

Digital Library

[25]

L'Ecuyer, P. 1994. Efficiency improvement and variance reduction. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.E Seila, 122-132. WSC Board of Directors.

Digital Library

[26]

Lewis, P.A.W. and E.J. Orav. 1989. Simulation methodology for statisticians, operations analysts, and engineers, volume I. Belmont, California: Wadsworth, inc.

Digital Library

[27]

Morgan, B.J.T. 1984. Elements of simulation. London: Chapman and Hall.

Digital Library

[28]

Nelson, B.L. 1992. Designing efficient simulation experiments. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 126-132. WSC Board of Directors.

Digital Library

[29]

Ramberg, J.S., S.M. Sanchez, P.J. Sanchez, and L.J. Hollick. 1991. Designing simulation experiments: Taguchi methods and response surface metamodels. In Proceedings of the 1991 Winter Simulation Conference, ed. B.L. Nelson, W.D. Kelton, and G.M. Clark, 167-176. WSC Board of Directors.

Digital Library

[30]

Ripley, B.D. 1987. Stochastic simulation. New York: John Wiley & Sons.

Digital Library

[31]

Seila, A.F. 1991. Output analysis for simulation. In Proceedings of the 1991 Winter Simulation Conference, ed. B.L. Nelson, W.D. Kelton, and G.M. Clark, 28-36. WSC Board of Directors.

Digital Library

[32]

Seila, A.F. 1992. Advanced output analysis for simulation. In Proceedings of the 1992 Winter Simulation Conference, ed. J.J. Swain, D. Goldsman, R.C. Crain, and J.R. Wilson, 190-197. WSC Board of Directors.

Digital Library

[33]

Strickland, S.G. 1993. Gradient/sensitivity estimation in discrete-event simulation. In Proceedings of the 1993 Winter Simulation Conference, ed. G.W. Evans, M. Mollaghasemi, E.C. Russell, and W.E. Biles, 97-105. WSC Board of Directors.

Digital Library

[34]

Swain, J.J. and P.A. Farrington. 1994. Designing simulation Cxl~rimcnt,s for evaluating manufacturing systems. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.E Seila, 69-76. WSC Board of Directors.

Digital Library

[35]

Sanchez, S.M. 1994. A robust design tutorial. In Proceedings of the 1994 Winter Simulation Conference, ed. J.D. Tew, M.S. Manivannan, D.A. Sadowski, and A.E Seila, 106- I 13. WSC Board of Directors.

Digital Library

[36]

Thesen, A. and L.E. Travis. 1992. Simulation for decision making. St. Paul, Minnesota: West Publishing Company.

Digital Library

Cited By

Al‐Aomar RWilliams EÜlgen O(2015)Simulation Output AnalysisProcess Simulation Using WITNESS®10.1002/9781119019770.ch8(253-304)Online publication date: 21-Aug-2015
https://doi.org/10.1002/9781119019770.ch8
Saayman SBekker J(1999)Drawing conclusions from deterministic logistic simulation modelsLogistics Information Management10.1108/0957605991029903612:6(460-466)Online publication date: 1-Dec-1999
https://doi.org/10.1108/09576059910299036
Shannon R(1998)Introduction to the art and science of simulationProceedings of the 30th conference on Winter simulation10.5555/293172.293175(7-14)Online publication date: 1-Dec-1998
https://dl.acm.org/doi/10.5555/293172.293175
Show More Cited By

Index Terms

A tutorial on design and analysis of simulation experiments
1. Computing methodologies
  1. Modeling and simulation

Recommendations

Design and Analysis of Simulation Experiments
Bootstrap methods in computer simulation experiments
WSC '95: Proceedings of the 27th conference on Winter simulation

We critically review the work that has been done in applying basic, smoothed and parametric bootstrap methods to simulation experiments. We develop a framework to classify bootstrap methods in this context and use it to compare various bootstrap ...
ALPHA/SIM simulation software tutorial
WSC '96: Proceedings of the 28th conference on Winter simulation

ALPHA/Sim is a general-purpose, discrete-event simulation tool. ALPHA/Sim allows a user to graphically build a simulation model, enter input data via integrated forms, execute the simulation model, and view the simulation results, within a single ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSC '95: Proceedings of the 27th conference on Winter simulation

December 1995

1493 pages

ISBN:0780330188

Chairmen:
William R. Lilegdon
Pritsker Corp., West Lafayette, IN
,
David Goldsman
Georgia Institute of Technology, Atlanta
,
Editors:
Christos Alexopoulos
Georgia Institute of Technology, Atlanta
,
Keebom Kang
Naval Postgraduate School, Monterey, CA

Sponsors

IIE: Institute of Industrial Engineers
IEEE-SMCS: Systems, Man & Cybernetics Society
INFORMS/CS: Computer Science TC
ASA: American Statistical Association
ACM: Association for Computing Machinery
SCS: Society for Computer Simulation
SIGSIM: ACM Special Interest Group on Simulation and Modeling
IEEE-CS: Computer Society
NIST: National Institute of Standards & Technology

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 December 1995

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

WSC95

Sponsor:

IIE
IEEE-SMCS
INFORMS/CS
ASA
ACM
SCS
SIGSIM
IEEE-CS
NIST

WSC95: 1995 Winter Simulation Conference

December 3 - 6, 1995

Virginia, Arlington, USA

Acceptance Rates

WSC '95 Paper Acceptance Rate 122 of 183 submissions, 67%;

Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
771
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Al‐Aomar RWilliams EÜlgen O(2015)Simulation Output AnalysisProcess Simulation Using WITNESS®10.1002/9781119019770.ch8(253-304)Online publication date: 21-Aug-2015
https://doi.org/10.1002/9781119019770.ch8
Saayman SBekker J(1999)Drawing conclusions from deterministic logistic simulation modelsLogistics Information Management10.1108/0957605991029903612:6(460-466)Online publication date: 1-Dec-1999
https://doi.org/10.1108/09576059910299036
Shannon R(1998)Introduction to the art and science of simulationProceedings of the 30th conference on Winter simulation10.5555/293172.293175(7-14)Online publication date: 1-Dec-1998
https://dl.acm.org/doi/10.5555/293172.293175
Kelton W(1997)Statistical analysis of simulation outputProceedings of the 29th conference on Winter simulation10.1145/268437.268443(23-30)Online publication date: 1-Dec-1997
https://dl.acm.org/doi/10.1145/268437.268443
Carson J(1996)So you want to be a simulation consultantProceedings of the 28th conference on Winter simulation10.1145/256562.256585(111-113)Online publication date: 8-Nov-1996
https://dl.acm.org/doi/10.1145/256562.256585
Kelton W(1996)Statistical issues in simulationProceedings of the 28th conference on Winter simulation10.1145/256562.256570(47-54)Online publication date: 8-Nov-1996
https://dl.acm.org/doi/10.1145/256562.256570

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents