Summary
We show two distribution-independent algorithms to estimate the mean of bounded random variables, one with the knowledge of variance, the other without. These algorithms guarantee that the estimate is within the desired precision with an error probability less than or equal to the requirement. Some simplified stopping rules are also given.
Similar content being viewed by others
References
Bennett, G. (1962), ‘Probability inequalities for the sum of independent random variables’, Journal of the American Statistical Association 57, 33–45.
Bernstein, S. (1927), Theory of Probability, Moscow.
Canetti, R., Even, G. & Goldreich, O. (1995), ‘Lower bounds for sampling algorithms for estimating the average’, Information Processing Letters 53, 17–25.
Cheng, J. & Druzdzel, M. J. (2000), ‘AIS-BN: An adaptive importance sampling algorithm for evidential reasoning in large Bayesian networks’, Journal of Artificial Intelligence Research 13, 155–188.
Dagum, P. & Chavez, M. R. (1993), ‘Approximating probabilistic inference in Bayesian belief networks’, IEEE Transactions on Pattern Analysis and Machine Intelligence 15(3), 246–255.
Dagum, P. & Horvitz, E. (1993), ‘A Bayesian analysis of simulation algorithms for inference in belief networks’, Networks 23, 499–516.
Dagum, P., Karp, R., Luby, M. & Ross, S. (2000), ‘An optimal algorithm for Monte Carlo estimation’, SIAM Journal on Computing 29(5), 1481–1496.
Dagum, P. & Luby, M. (1997), ‘An optimal approximation algorithm for Bayesian inference’, Artificial Intelligence 93, 1–27.
Hoeffding, W. (1963), ‘Probability inequalities for sums of bounded random variables’, Journal of the American Statistical Association 58, 13–29.
Karmarkar, N., Karp, R., Lipton, R., Lovasz, L. & Luby, M. (1993), ‘A Monte-Carlo algorithm for estimating the permanent’, SIAM Journal on Computing 22(2), 284–293.
Karp, R. M., Luby, M. & Madras, N. (1989), ‘Monte Carlo approximation algorithms for enumeration problems’, Journal of Algorithms 10, 429–448.
Pradhan, M. & Dagum, P. (1996), Optimal Monte Carlo estimation of belief networks inference, in ‘Proceedings of the Twelfth Annual Conference on Uncertainty in Artificial Intelligence (UAI-96)’, Portland, Oregon, pp. 446–453.
Siegmund, D. (1985), Sequential Analysis: tests and confidence intervals, Springer-Verlag, New York.
Acknowledgment
I would like to thank the anonymous reviewers and Marek J. Druzdzel for their useful comments that considerably improved the presentation of this paper.
Author information
Authors and Affiliations
Additional information
This research was supported by the National Science Foundation under Faculty Early Career Development (CAREER) Program, grant IRI-9624629, and by the Air Force Office of Scientific Research under grant number F49620-00-1-0112.
Rights and permissions
About this article
Cite this article
Cheng, J. Sampling algorithms for estimating the mean of bounded random variables. Computational Statistics 16, 1–23 (2001). https://doi.org/10.1007/s001800100049
Published:
Issue Date:
DOI: https://doi.org/10.1007/s001800100049