Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Generalized Probabilistic Bisection for Stochastic Root Finding

Published: 05 February 2020 Publication History

Abstract

We consider numerical schemes for root finding of noisy responses through generalizing the Probabilistic Bisection Algorithm (PBA) to the more practical context where the sampling distribution is unknown and location dependent. As in standard PBA, we rely on a knowledge state for the approximate posterior of the root location. To implement the corresponding Bayesian updating, we also carry out inference of oracle accuracy, namely learning the probability of the correct response. To this end we utilize batched querying in combination with a variety of frequentist and Bayesian estimators based on majority vote, as well as the underlying functional responses, if available. For guiding sampling selection we investigate both entropy-directed sampling and quantile sampling. Our numerical experiments show that these strategies perform quite differently; in particular, we demonstrate the efficiency of randomized quantile sampling, which is reminiscent of Thompson sampling. Our work is motivated by the root-finding subroutine in pricing of Bermudan financial derivatives, illustrated in the last section of the article.

References

[1]
Dario Azzimonti, Julien Bect, Clément Chevalier, and David Ginsbourger. 2016. Quantifying uncertainties on excursion sets under a Gaussian random field prior. SIAM/ASA Journal of Uncertainty Quantification 4, 1 (2016), 850--874.
[2]
Julien Bect, David Ginsbourger, Ling Li, Victor Picheny, and Emmanuel Vázquez. 2012. Sequential design of computer experiments for the estimation of a probability of failure. Statistics and Computing 22, 3 (2012), 773--793.
[3]
Han-Fu Chen. 2006. Stochastic Approximation and Its Applications. Vol. 64. Springer Science 8 Business Media.
[4]
Clément Chevalier, Julien Bect, David Ginsbourger, Emmanuel Vázquez, Victor Picheny, and Yann Richet. 2014. Fast parallel kriging-based stepwise uncertainty reduction with application to the identification of an excursion set. Technometrics 56, 4 (2014), 455--465.
[5]
David John Finney. 1952. Statistical Method in Biological Assay. Charles Griffin 8 Co., Ltd., London.
[6]
Peter I. Frazier, Shane G. Henderson, and Rolf Waeber. 2019. Probabilistic bisection converges almost as quickly as stochastic approximation. Mathematics of Operations Research 44, 2 (2019), 651--667.
[7]
Robert B. Gramacy and Mike Ludkovski. 2015. Sequential design for optimal stopping problems. SIAM Journal on Financial Mathematics 6, 1 (2015), 748--775.
[8]
Philipp Hennig and Christian J. Schuler. 2012. Entropy search for information-efficient global optimization. Journal of Machine Learning Research 13, (June 2012), 1809--1837.
[9]
Bruno Jedynak, Peter I. Frazier, and Raphael Sznitman. 2012. Twenty questions with noise: Bayes optimal policies for entropy loss. Journal of Applied Probability 49, 1 (2012), 114--136.
[10]
V. Roshan Joseph and C. F. J. Wu. 2002. Operating window experiments: A novel approach to quality improvement. Journal of Quality Technology 34, 4 (2002), 345.
[11]
Michael Ludkovski. 2018. Kriging metamodels and experimental design for Bermudan option pricing. Journal of Computational Finance 22, 1 (2018), 37--77.
[12]
Barry T. Never. 1994. AD-optimality-based sensitivity test. Technometrics 36, 1 (1994), 61--70.
[13]
Raghu Pasupathy and Sujin Kim. 2011. The stochastic root-finding problem: Overview, solutions, and open questions. ACM Transactions on Modeling and Computer Simulation 21, 3, Article 19 (February 2011), 23 pages.
[14]
Pritam Ranjan, Derek Bingham, and George Michailidis. 2008. Sequential experiment design for contour estimation from complex computer codes. Technometrics 50, 4 (2008), 527--541.
[15]
Jaakko Riihimäki and Aki Vehtari. 2010. Gaussian processes with monotonicity information. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Vol. 9. 645--652.
[16]
Sergio Rodriguez and Mike Ludkovski. 2018. Probabilistic bisection with spatial metamodels. arXiv preprint arXiv:1807.00095 (2018).
[17]
Daniel Russo and Benjamin Van Roy. 2016. An information-theoretic analysis of Thompson sampling. Journal of Machine Learning Research 17, 68 (2016), 1--30.
[18]
David Siegmund. 1985. Sequential Analysis: Tests and Confidence Intervals. Springer Science 8 Business Media.
[19]
Rolf Waeber. 2013. Probabilistic Bisection Search for Stochastic Root-Finding. Ph.D. Dissertation. Cornell University.
[20]
Rolf Waeber, Peter I. Frazier, and Shane G. Henderson. 2013. Bisection search with noisy responses. SIAM Journal on Control and Optimization 51, 3 (2013), 2261--2279.

Cited By

View all
  • (2024)Adaptive metamodeling simulation optimization: Insights, challenges, and perspectivesApplied Soft Computing10.1016/j.asoc.2024.112067165(112067)Online publication date: Nov-2024

Index Terms

  1. Generalized Probabilistic Bisection for Stochastic Root Finding

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Modeling and Computer Simulation
    ACM Transactions on Modeling and Computer Simulation  Volume 30, Issue 1
    January 2020
    165 pages
    ISSN:1049-3301
    EISSN:1558-1195
    DOI:10.1145/3382041
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 February 2020
    Accepted: 01 July 2019
    Revised: 01 November 2018
    Received: 01 October 2017
    Published in TOMACS Volume 30, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Stochastic root-finding
    2. quantile sampling
    3. sequential design

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)86
    • Downloads (Last 6 weeks)22
    Reflects downloads up to 04 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Adaptive metamodeling simulation optimization: Insights, challenges, and perspectivesApplied Soft Computing10.1016/j.asoc.2024.112067165(112067)Online publication date: Nov-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media