Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Generalized Integrated Brownian Fields for Simulation Metamodeling

Published: 01 May 2019 Publication History

Abstract

In operations research, stochastic simulations are often used to model complex systems. Simulation runs can be time-consuming to execute, especially when there are many scenarios that need to be evaluated, or the scenarios to be evaluated cannot be anticipated in advance of when the results are needed. Simulation metamodels are statistical models built using the simulation output at a small set of scenarios and can be used to predict the value of the response surface for any scenario, simulated or not. Thus, simulation metamodels can provide support for real-time decision making and sensitivity analysis. Gaussian process (GP) regression is a popular technique for metamodeling; GP regression represents the unknown response surface as the realization of a Gaussian random field (GRF). Specifying the proper GRF is crucial for effective metamodeling. In “Generalized Integrated Brownian Fields for Simulation Metamodeling”, Salemi, Staum, and Nelson propose a novel class of GRFs called generalized integrated Brownian fields. These GRFs have several desirable properties, including differentiability that can be customized in each coordinate direction, no mean reversion, and the Markov property. These properties are shown to lead to better metamodels than those obtained from standard choices for the GRF.

Abstract

We introduce a novel class of Gaussian random fields (GRFs), called generalized integrated Brownian fields (GIBFs), focusing on the use of GIBFs for Gaussian process regression in deterministic and stochastic simulation metamodeling. We build GIBFs from the well-known Brownian motion and discuss several of their properties, including differentiability that can differ in each coordinate, no mean reversion, and the Markov property. We explain why we desire to use GRFs with these properties and provide formal definitions of mean reversion and the Markov property for real-valued, differentiable random fields. We show how to use GIBFs with stochastic kriging, covering trend modeling and parameter fitting, discuss their approximation capability, and show that the resulting metamodel also has differentiability that can differ in each coordinate. Last, we use several examples to demonstrate superior prediction capability as compared with the GRFs corresponding to the Gaussian and Matérn covariance functions.
The e-companion is available at https://doi.org/10.1287/opre.2018.1804.

References

[1]
Ankenman B, Nelson BL, Staum J (2010) Stochastic kriging for simulation metamodeling. Oper. Res. 58(2):371–382.
[2]
Aydin G, Porteus EL (2008) Joint inventory and pricing decisions for an assortment. Oper. Res. 56(5):1247–1255.
[3]
Berlinet A, Thomas-Agnan C (2004) Reproducing Kernel Hilbert Spaces in Probability and Statistics (Kluwer Academic Publishers, New York).
[4]
Binois M, Gramacy RB, Ludkovski M (2018) Practical heteroskedastic Gaussian process modeling for large simulation experiments. J. Comput. Graphical Statist. 27(4):808–821.
[5]
Chen X, Ankenman B, Nelson BL (2012) The effects of common random numbers of stochastic kriging metamodels. ACM Trans. Modeling Comput. Simulation 22(2):1–20.
[6]
Chen X, Ankenman B, Nelson BL (2013) Enhancing stochastic kriging metamodels with gradient estimators. Oper. Res. 61(2):512–528.
[7]
Fill JA, Torcaso F (2004) Asymptotic analysis via Mellin transforms for small deviations in l2-norm of integrated Brownian sheets. Probab. Theory Related Fields 130(2):259–288.
[8]
Glasserman P, Kang W, Shahabuddin P (2008) Fast simulation of multifactor portfolio credit risk. Oper. Res. 56(5):1200–1217.
[9]
Holden H, Øksendal B, Ubøe J, Zhang T (2010) Stochastic Partial Differential Equations: A Modeling, White Noise Functional Approach, 2nd ed., Universitext (Springer Science and Business Media, New York).
[10]
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4):455–492.
[11]
Joseph VR (2006) Limit kriging. Technometrics 48(4):458–466.
[12]
Joseph VR, Hung Y, Sudjianto A (2008) Blind kriging. J. Mech. Design 130(3):031102-1–031102-8.
[13]
Kleijnen J, van Beers W (2005) Robustness of kriging when interpolating in random simulation with heterogeneous variance: Some experiments. Eur. J. Oper. Res. 165(3):826–834.
[14]
Krige DG (1951) A statistical approach to some mine valuations and allied problems at the Witwatersrand. Master’s thesis, University of Witwatersrand, Johannesburg, South Africa.
[15]
Li R, Sudjianto A (2005) Analysis of computer experiments using penalized likelihood in Gaussian kriging models. Technometrics 47(2):111–120.
[16]
Liu M, Staum J (2010) Stochastic kriging for efficient nested simulation of expected shortfall. J. Risk 12(3):3–27.
[17]
Mitchell TJ, Morris MD (1992) The spatial correlation function approach to response surface estimation. Proc. 1992 Winter Simulation Conf. (IEEE, Piscataway, NJ), 565–571.
[18]
Paciorek CJ, Schervish MJ (2004) Nonstationary covariance functions for Gaussian process regression. Proc. Conf. Neural Inform. Processing Systems (MIT Press, Cambridge, MA).
[19]
Pitt LD (1971) A Markov property for Gaussian processes with a multidimensional parameter. Archive Ration. Mech. Anal. 43(5):367–391.
[20]
Powell WB, Ryzhov IO (2012) Optimal Learning (John Wiley and Sons, Hoboken, NJ).
[21]
Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Statist. Sci. 4(4):409–423.
[22]
Salemi P, Staum J, Nelson BL (2013) Generalized integrated Brownian fields for simulation metamodeling. Proc. 2013 Winter Simulation Conf. (IEEE, Piscataway, NJ).
[23]
Santner TJ, Williams BJ, Notz WI (2010) The Design and Analysis of Computer Experiments (Springer, New York).
[24]
Shao J (2010) Mathematical Statistics (Springer Texts in Statistics, New York).
[25]
Sun L, Hong LJ, Hu Z (2014) Balancing exploitation and exploration in discrete optimization via simulation through a Gaussian process-based search. Oper. Res. 62(6):1416–1438.
[26]
van Beers W, Kleijnen J (2003) Kriging for interpolation in random simulation. J. Oper. Res. Soc. 54(3):255–262.
[27]
Xie W, Nelson BL, Staum J (2010) The influence of correlation functions on stochastic kriging metamodels. Proc. 2010 Winter Simulation Conf. (IEEE, Piscataway, NJ).
[28]
Yin J, Ng SH, Ng KM (2011) Kriging metamodel with modified nugget-effect: The heteroscedastic variance case. Comput. Indust. Engrg. 61(3):760–777.
[29]
Zhang N, Apley DW (2014) Fractional Brownian fields for response surface metamodeling. J. Quality Tech. 46(4):285–301.
[30]
Zhang N, Apley DW (2016) Brownian integrated covariance functions for Gaussian process modeling: Sigmoidal versus localized basis functions. J. Amer. Statist. Assoc. 111(515):1182–1195.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Operations Research
Operations Research  Volume 67, Issue 3
May-June 2019
309 pages
ISSN:0030-364X
DOI:10.1287/opre.2019.67.issue-3
Issue’s Table of Contents

Publisher

INFORMS

Linthicum, MD, United States

Publication History

Published: 01 May 2019
Accepted: 12 July 2018
Received: 30 June 2017

Author Tags

  1. simulation metamodeling
  2. Gaussian random fields
  3. kriging
  4. stochastic kriging
  5. Gaussian process regression
  6. mean reversion
  7. Markov property

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Sample and Computationally Efficient Stochastic Kriging in High DimensionsOperations Research10.1287/opre.2022.236772:2(660-683)Online publication date: 1-Mar-2024
  • (2023)Causal Dynamic Bayesian Networks for Simulation MetamodelingProceedings of the Winter Simulation Conference10.5555/3643142.3643204(746-757)Online publication date: 10-Dec-2023
  • (2022)Plausible Screening Using Functional Properties for Simulations with Large Solution SpacesOperations Research10.1287/opre.2021.220670:6(3473-3489)Online publication date: 1-Nov-2022
  • (2021)Statistical Tests for Cross-Validation of Kriging ModelsINFORMS Journal on Computing10.1287/ijoc.2021.107234:1(607-621)Online publication date: 31-Aug-2021

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media