Article

Free access

Analyzing multivariate output

Author:

John M. CharnesAuthors Info & Claims

WSC '95: Proceedings of the 27th conference on Winter simulation

Pages 201 - 208

https://doi.org/10.1145/224401.224463

Published: 01 December 1995 Publication History

Abstract

This paper gives an overview of multivariate statistical techniques that can be useful for analyzing discrete-event simulation output, and describes some of the latest directions in research on multivariate output analysis. A general discussion is given of constructing joint confidence regions on the mean vector of multivariate output from independent replications of terminating models. The multivariate batch means method of simultaneous estimation of means from one long run of steady-state simulation models is described. References are also given for autoregressive, spectral analysis and regenerative methods of inference, as well as variance-reduction and sequential techniques.

References

[1]

Anderson, T. W. 1978. Repeated measurements on autoregressive processes, Journal of The American Statistical Association, 73: 371-378.

[2]

Anderson, T.W. 1984. An Introduction to Multzvamate Statist,cal Analys,s, Second Edition. New York: John Wiley.

[3]

Bratley, P., B. L. Fox, and L. E. Schrage. 1987. A Guide to S, mulation, Second Edition. New York: Springer-Verlag.

Digital Library

[4]

Charnes, j.M. 1990. Power comparisons for the multivariate batch-means method, In Proceedings of the 1990 Winter Simulation Conference, eds. O. Balci, R.P. Sadowski, R.E. Nance, 281-287. Institute of Electrical and Electronics Engineers, New Orleans, Lousiana.

Digital Library

[5]

Charnes, J.M. 1991. Multivariate simulation output analysis, In Proceedings of the 1991 Winter Simulation Conference, eds. B. L. Nelson, W. D. Kelton, G. M. Clark, 187-193. Institute of Electrical and Electronics Engineers, Phoenix, Arizona.

Digital Library

[6]

Charnes, J.M. and W.D. Kelton. 1988. A comparison of confidence region estimators for multivariate simulation output, In Proceedings of the 1988 Winler Simulation Conference, eds. M. Abrams, P. IIaigh, J.C. Comfort, 458-465. Institute of Electrical and Electronics Engineers, San Diego, Califor- Ilia.

Digital Library

[7]

Charnes, J. M. and Kelton, W. D. 1993. Multivariate autoregressive techniques for constructing confidence regions on the mean vector, Management Science, 39: 1112-1129.

Digital Library

[8]

Chen, D.R. and Chen, W.P. 1988. Multivariate inference in stationary simulation using batch means, In Proceedings of the 1989 Wznter S~mulatzon Conference, E.A. MacNair, K.J. Musselman, and P. Heidelberger, Eds. Institute of Electrical and Electronics Engineers, Piscataway, NJ, 524-533.

Digital Library

[9]

Chen, D.R. and Cheng, W.J. 1989. Multivariate statistical analysis for regenerative simulation, Journal of Management Science, 6: 43-56.

[10]

Chen, D.R. 1991. The relationship between multivari~te correlaticm and coverage rate, presentation at TIMS XXX~SOBRAPO XXIII Joint International Meeting.

[11]

Chen, D.R. and A.F. Seila. 1987. Multivariate inference in stationary simulation using batch means, In Proceedzngs of the 1987 Winter Simulation Conference, eds. A. Thesen, H. Grant, W.D. Kelton, 302-304. Institute of Electrical and Electronics Engineers, Atlanta, Georgia.

Digital Library

[12]

Gallagher, M. A., Bauer, K. W., and Maybeck, P. S. 1994. Initial data truncation for multivariate output of discrete-event simulations using the Kalman filter. In Annals of Operatzons Research, ed. O. Balci, 53: 419.

[13]

Johnson, R.A. and D.W. Wichern 1988. Applied Multivariate Statzstical Analysis, Second Edition. Englewood Cliffs, New Jersey: Prentice Hall.

Digital Library

[14]

Kabaila, P. and G. Nelson. 1985. On confidence regions for the mean of a multivariate time series, Communications in Statistics--Theory and Methods, 14: 735-753.

[15]

Law, A.M. and W.D. Kelton. 1991. Szmulation Modelling and Analysis, Second Edition. New York: McGraw-Hill.

Digital Library

[16]

Miller, R. G. Jr. 1981. Simultaneous StatzsticalInference, Second Edition. New York: Springer-Verlag.

[17]

Morrison, D.F. 1976. Multivariate Statistical Methods, New York: McGraw-Hill. Munoz, D. F. 1991. Cancellation methods in the analysis of simulation output (confidence intervals). Ph.D. thesis, Department of Operations Research, Stanford University.

[18]

Raatikainen, K. E. E. 1993. A sequential procedure for simultaneous estimation of several means, A CM Transactions on Modeling and Computer Simulation, 3: 108-133.

Digital Library

[19]

Rao, C.R. 1951. An asymptotic expansion of the distribution of Wilk's criterion. Bulletin of the International Slatist~cal Institute, 33: 177-180.

[20]

Schmeiser, B. 1982. Batch size effects in the analysis of simulation output. Operations Research, 30: 556-568.

Digital Library

[21]

Schruben, L.W. 1981. Control of initialization bias in multivariate simulation response. Communications of the A CM, 24: 246-252.

Digital Library

[22]

Seila, A. F. 1982. Multivariate estimation in regenerative simulation, Operatzons Research Letters, 1: 153-156.

Digital Library

[23]

Seila, A. F. 1982. Multivariate e~tirnation in simulation, Proceedings of the 1983 Winter Simulation Conference, 693-696. Institute of Electrical and Electronics Engineers.

Digital Library

[24]

Seila, A. F. 1984. Multivariate simulation output analysis, A memcan Journal of Mathematical and Management Sciences, 4: 313-334.

[25]

Seila, A.F. 1990. Multivariate Estimation of Conditional Performance Measures in Regenerative Sireulation. American Journal of Mathematical and Management Sciences 10: 17-50.

[26]

Yang, W.-N. and B.L. Nelson. 1988. Multivariate estimation and variance reduction in terminating and steady-state simulation, In Proceedzngs of the I988 Wznter Simulatzon Conference, eds. M. Abrams, P.

Digital Library

[27]

Haigh, J.C. Comfort, 466-472. Institute of Electrical and Electronics Engineers, San Diego, California.

[28]

Yang, W.-N. and B.L. Nelson. 1992. Multivariate batch means and control variates, Management Science, 38: 1415-1431.

Digital Library

Cited By

Al-tekreeti MNaik KAbdrabou AZaman MSrivastava P(2019)A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming ApplicationsModel-Driven Engineering and Software Development10.1007/978-3-030-11030-7_18(406-429)Online publication date: 1-Feb-2019
https://doi.org/10.1007/978-3-030-11030-7_18
Al‐tekreeti MAbdrabou ANaik K(2019)An end‐user‐centric test generation methodology for performance evaluation of mobile networked applicationsSoftware Testing, Verification and Reliability10.1002/stvr.171329:6-7Online publication date: 7-Oct-2019
https://doi.org/10.1002/stvr.1713
Nelson B(2011)Thirty years of "batch size effects"Proceedings of the Winter Simulation Conference10.5555/2431518.2431561(393-400)Online publication date: 11-Dec-2011
https://dl.acm.org/doi/10.5555/2431518.2431561
Show More Cited By

Index Terms

Analyzing multivariate output
1. Computing methodologies
  1. Modeling and simulation
2. Mathematics of computing
  1. Mathematical analysis
    1. Numerical analysis
      1. Interval arithmetic
      2. Numerical differentiation
  2. Probability and statistics
    1. Statistical paradigms
      1. Statistical graphics

Recommendations

Multivariate U-statistics: a tutorial with applications

U-statistics represent an important class of statistics arising from modeling quantities of interest defined by multi-subject responses such as the classic Mann-Whitney-Wilcoxon rank tests. However, classic applications of U-statistics are largely ...
Multivariate Input Uncertainty in Output Analysis for Stochastic Simulation

When we use simulations to estimate the performance of stochastic systems, the simulation is often driven by input models estimated from finite real-world data. A complete statistical characterization of system performance estimates requires quantifying ...
Multivariate Standardized Time Series for Steady-State Simulation Output Analysis

<P>The theory of standardized time series, initially proposed to estimate a single steady-state mean from the output of a simulation, is extended to the case where more than one steady-state mean is to be estimated simultaneously. Under mild assumptions ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSC '95: Proceedings of the 27th conference on Winter simulation

December 1995

1493 pages

ISBN:0780330188

Chairmen:
William R. Lilegdon
Pritsker Corp., West Lafayette, IN
,
David Goldsman
Georgia Institute of Technology, Atlanta
,
Editors:
Christos Alexopoulos
Georgia Institute of Technology, Atlanta
,
Keebom Kang
Naval Postgraduate School, Monterey, CA

Sponsors

IIE: Institute of Industrial Engineers
IEEE-SMCS: Systems, Man & Cybernetics Society
INFORMS/CS: Computer Science TC
ASA: American Statistical Association
ACM: Association for Computing Machinery
SCS: Society for Computer Simulation
SIGSIM: ACM Special Interest Group on Simulation and Modeling
IEEE-CS: Computer Society
NIST: National Institute of Standards & Technology

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 December 1995

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

WSC95

Sponsor:

IIE
IEEE-SMCS
INFORMS/CS
ASA
ACM
SCS
SIGSIM
IEEE-CS
NIST

WSC95: 1995 Winter Simulation Conference

December 3 - 6, 1995

Virginia, Arlington, USA

Acceptance Rates

WSC '95 Paper Acceptance Rate 122 of 183 submissions, 67%;

Overall Acceptance Rate 3,413 of 5,075 submissions, 67%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
334
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)12

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Al-tekreeti MNaik KAbdrabou AZaman MSrivastava P(2019)A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming ApplicationsModel-Driven Engineering and Software Development10.1007/978-3-030-11030-7_18(406-429)Online publication date: 1-Feb-2019
https://doi.org/10.1007/978-3-030-11030-7_18
Al‐tekreeti MAbdrabou ANaik K(2019)An end‐user‐centric test generation methodology for performance evaluation of mobile networked applicationsSoftware Testing, Verification and Reliability10.1002/stvr.171329:6-7Online publication date: 7-Oct-2019
https://doi.org/10.1002/stvr.1713
Nelson B(2011)Thirty years of "batch size effects"Proceedings of the Winter Simulation Conference10.5555/2431518.2431561(393-400)Online publication date: 11-Dec-2011
https://dl.acm.org/doi/10.5555/2431518.2431561
Sanchez SRohrer MMedeiros DGrabau M(2001)Output modelingProceedings of the 33nd conference on Winter simulation10.5555/564124.564131(30-38)Online publication date: 9-Dec-2001
https://dl.acm.org/doi/10.5555/564124.564131

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents