Abstract
Record values can be viewed as order statistics from a sample whose size is determined by the values and the order of occurrence of observations. They are closely connected with the occurrence times of a corresponding non-homogenous Poisson process and reliability theory. In this paper, the information properties of record values are presented based on Shannon information. Several upper and lower bounds for the entropy of record values are obtained. It is shown that, the mutual information between record values is distribution free and is computable using the distribution of the record values of the sequence from the uniform distribution.
Similar content being viewed by others
References
Ahmadi, J. (2000). Record Values, Theory and Applications. Ph. D. Dissertation, Ferdowsi University of Mashhad, Iran.
Ahmadi, J. and Arghami, N. R. (2001a). Some univariate stochastic orders on record values. Commun. Statist.-Theor. Meth., 30, 69–74.
Ahmadi, J. and Arghami, N. R. (2001b). On the Fisher information in record values. Metrika, 53, 195–206.
Ahmadi, J. and Arghami, N. R. (2003a). Comparing the Fisher information in record values and iid observations. Statistics, 37, 435–441.
Ahmadi, J. and Arghami, N. R. (2003b). Nonparametric confidence and tolerance intervals based on record data. Statist. Papers, 37, 435–441.
Ahmadi, J. and Balakrishnan, N. (2004). Confidence intervals for quantiles in terms of record range. Statist. Probab. Lett., 68, 395–405.
Ahmadi, J. and Balakrishnan, N. (2005). Preservation of some reliability properties by current records and record ranges. To appear in Statistics.
Arnold, B. C., Balakrishnan, N. and Nagaraja, H. N. (1998) Records. John Wiley & Sons, New York.
Chandler, K. N. (1952). The distribution and frequency of record values. J. Roy. Statist. Soc. Ser. B, 14, 220–228.
Ebrahimi, N., Soofi, E. S. and Zahedi, H. (2004). Information properties of order statistics and spacings. IEEE Trans. Inform. Theory, 50, 177–183.
Gulati, S. and Padgett, W. J. (1995). Nonparametric function estimation from inversely sampled record breaking data. Can. J. Stat. 23, 359–368.
Gulati, S. and Padgett, W. J. (2003). Parametric and Nonparametric Inference from Record-breaking Data. Lecture Notes in Statistics, 172, Springer-Verlag, New York.
Hofmann, G. and Balakrishnan, N. (2004). Fisher Information in k-records. Ann. Inst. Statis. Math, 56, 383–396.
Hofmann, G. and Nagaraja, H. N. (2003). Fisher information in record data. Metrika, 57, 177–193.
Kagan, A. M., Linnik, Yu. V. and Rao, C. R. (1973). Characterization Problems in Mathematical Statistics. John Wiley & Sons, New York.
Kamps, U. (1994). Reliability properties of record values from non-identically distributed random variables. Commun. Statist.-Theor. Meth., 23, 2101–2112.
Kamps, U. (1995). A Concept of Generalized Order Statics. Teubner, Stuttgart, Germany.
Kapur, J. N. (1989). Maximum Entropy Models in Sciences and Engineering. John Wiley & Sons, New York.
Kochar, S. C. (1990). Some partial ordering results on record values. Commun. Statist.-Theor. Meth., 19, 299–306.
Nevzorov, V. (2001). Records: Mathematical Theory. Translation of Mathematical Monographs. 194, Amer. Math. Soc. Providence, RI. USA.
Raqab, M. Z. and Awad, A. M. (2000). Characterizations of the Pareto and related distributions. Metrika, 52, 63–67.
Samaniego, F. J. and Whitaker, L. R. (1986). On estimating population characteristics from record-breaking observations. I: Parametric results, Naval Research Logistics Quarterly, 33, 531–543.
Samaniego, F. J. and Whitaker, L. R. (1988). On estimating population characteristics from record-breaking observations. II: Nonparametric results. Naval Research Logistics Quarterly, 35, 221–236.
Shaked, M. and Shanthikumar, J. G. (1994). Stochastic Orders and Their Applications. Academic Press, New York.
Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379–432.
Stepanov, A. V., Balakrishnan, N. and Hofmann, G. (2003). Exact distribution and Fisher information of weak record values. Statist. Probab. Lett, 64, 69–81.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Baratpour, S., Ahmadi, J. & Arghami, N.R. Entropy properties of record statistics. Statistical Papers 48, 197–213 (2007). https://doi.org/10.1007/s00362-006-0326-7
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/s00362-006-0326-7