Abstract
Complex simulations are increasingly important in systems analysis and design. In some cases simulations can be exhaustively validated against experiment and taken to be implicitly accurate. However, in domains where only limited validation of the simulations can be performed, implications of simulation studies have historically been qualitative. Validation is notably difficult in cases where experiments are expensive or otherwise prohibitive, where experimental effects are difficult to measure, and where models are thought to have unaccounted systematic error. This paper describes an approach to integrate simulation experiments with empirical data that has been applied successfully in a number of domains. This methodology generates coherent estimates of confidence in model predictions, model parameters, and estimates, i.e. calibrations, for unobserved variables. Extensions are described to integrate the results of separate experiments into a single estimate for simulation parameters, which demonstrates a new approach to model-based data fusion.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Los Alamos Science special issue on Science-Based Prediction for Complex Systems 29 (2005)
Gattiker, J.: Using the Gaussian Process Model for Simulation Analysis Code. Los Alamos technical report LA-UR-05-5215 (2005)
Christie, G., Grove, H., Sharp, S.: Error Analysis in Simulation of Complex Phenomena. Los Alamos Science special issue on Science-Based Prediction for Complex Systems 29, 6–25 (2005)
Chib, S., Greenberg, E.: Understanding the Metropolis-Hastings Algorithm. The American Statistician 49(4), 327 (1995)
Fugate, M., Williams, B., Higdon, D., Hanson, K., Gattiker, J., Chen, S., Unal, C.: Hierarchical Bayesian Analysis and the Preston-Tonks-Wallace Model, Los Alamos Technical Report, LA-UR-05-3935 (2005)
Kennedy, M., O’Hagan, A.: Bayesian Calibration of Computer Models (with discussion). Journal of the Royal Statistical Society B 68, 426–464
Jones, D., Schonlau, M., Welch, W.: Efficient Global Optimization of Expensive Black-Box Functions. Journal of Global Optimization 13, 455–492 (1998)
Higdon, D., Kennedy, M., Cavendish, J., Cafeo, J., Ryne, R.: Combining field Observations and Simulations for Calibration and Prediction. SIAM Journal of Scientific Computing 26, 448–466
Nakhleh, C., Higdon, D., Allen, C., Kumar, V.: Bayesian Reconstruction of Particle Beam Phase Space from Low Dimensional Data, Los Alamos technical report LA-UR-05-5897
Higdon, D., Gattiker, J., Williams, B., Rightley, M.: Computer Model Calibration using High Dimensional Output, Los Alamos Technical report LAUR-05-6410, submitted to the Journal of the American Statistical Association
Williams, B., Higdon, D., Gattiker, J.: Uncertainty Quantification for Combining Experimental Data and Computer Simulations, Los Alamos Technical Report LA-UR-05-7812
Jones, D.R., Schonlau, M., Welch, W.: Efficient Global Optimization of Expensive Balck-Box Functions. Journal of Global Optimization 13, 455–492 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gattiker, J.R., Lawrence, E., Higdon, D. (2006). Analysis of Multi-domain Complex Simulation Studies. In: Gavrilova, M., et al. Computational Science and Its Applications - ICCSA 2006. ICCSA 2006. Lecture Notes in Computer Science, vol 3982. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11751595_121
Download citation
DOI: https://doi.org/10.1007/11751595_121
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34075-1
Online ISBN: 978-3-540-34076-8
eBook Packages: Computer ScienceComputer Science (R0)