Abstract
We develop two sequential procedures to compare a finite number of designs with respect to a single standard. The goal is to identify a good design, and ensure that the standard is chosen when other alternatives are not better than the standard. We give preference to the standard since there are costs and time involved when replacing the standard. These procedures can be used when the expected performance of the standard is known or unknown, when variances across designs are unequal, and with the variance reduction technique of common random numbers. An experimental performance evaluation demonstrates the validity and efficiency of these sequential procedures.
Similar content being viewed by others
References
Banks J, (1998). Handbook of Simulation. Wiley, New York.
Bechhofer RE, Santner TJ, and Goldsman DM (1995). Design and Analysis of Experiments for Statistical Selection, Screening and Multiple Comparisons. Wiley, New York.
Chen EJ (2004). Using ordinal optimization approach to improve efficiency of selection procedures. Journal of Discrete Event Dynamic Systems 14(2): 153–170.
Chen EJ (2005). Using parallel and distributed computing to increase the capability of selection procedures. Proceedings of the 2005 Winter Simulation Conference. Institute of Electrical and Electronics Engineers, Piscataway, New Jersey, pp. 723–731.
Chen EJ, Kelton WD (2003). Inferences from indifference-zone selection procedures. Proceedings of the 2003 Winter Simulation Conference, Institute of Electrical and Electronic Engineers, Piscataway, New Jersey, pp. 456–464.
Chen EJ, Kelton WD (2005). Sequential selection procedures: Using sample means to improve efficiency. European Journal of Operational Research 166(1):133–153.
Chen CH, Lin J, Yücesan E, Chick SE (2000). Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Journal of Discrete Event Dynamic Systems 10(3):251–270.
Chick SE, Inoue K (2001). New two-stage and sequential procedures for selecting the best system. Operations Research 49:732–743.
Edwards DG, Hsu JC (1983). Multiple comparisons with the best treatment. Journal of the American Statistical Association 78:965–971.
Hastings C Jr (1955). Approximations for Digital Computers. Princeton University Press, Princeton, New Jersey.
Ho YC, Sreenivas RS, Vakili P (1992). Ordinal optimization of DEDS. Journal of Discrete Event Dynamic Systems 2:61–68.
Kim S-H (2005). Comparison with a standard via fully sequential procedures. ACM Transactions on Modeling and Computer Simulation 15:155–174.
Kim S-H, Nelson BL (2001). A fully sequential procedure for indifference-zone selection in simulation. ACM Transactions on Modeling and Computer Simulation 11:251–273.
Law AM, Kelton WD (2000). Simulation Modeling and Analysis. 3rd edn. McGraw-Hill, New York
Nakayama MK (1997). Multiple-comparison procedures for steady-state simulations. Annals of Statistics 25:2433–2450.
Nelson BL, Goldsman D (2001). Comparisons with a standard in simulation experiments. Management Science 47:449–463.
Nelson BL, Matejcik FJ (1995). Using common random numbers for indifference-zone selection and multiple comparisons in simulation. Management Science 41:1935–1945.
Press WH, Flannery BP, Teukolsky SA, Vetterling WT (1992). Numerical Recipes in C: The Art of Scientific Computing. 2nd edn. Cambridge University Press, Cambridge, England.
Rice JA (1995). Mathematical Statistics and Data Analysis. 2nd edn. Duxbury, Belmont, California.
Rinott Y (1978). On two-stage selection procedures and related probability inequalities. Communications in Statistics A7:799–811.
Swisher JR, Jacobson SH, and Yücesan E (2003). Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey. ACM Transactions on Modeling and Computer Simulation 13(2):134–154.
Tong YL (1980). Probability Inequalities in Multivariate Distributions. Academic, New York.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, E.J. Comparison with a Standard via All-Pairwise Comparisons. Discrete Event Dyn Syst 16, 385–403 (2006). https://doi.org/10.1007/s10626-006-9328-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10626-006-9328-9