Considerations of sample and feature size
D Foley - IEEE Transactions on Information Theory, 1972 - ieeexplore.ieee.org
D Foley
IEEE Transactions on Information Theory, 1972•ieeexplore.ieee.orgIn many practical pattern-classification problems the underlying probability distributions are
not completely known. Consequently, the classification logic must be determined on the
basis of vector samples gathered for each class. Although it is common knowledge that the
error rate on the design set is a biased estimate of the true error rate of the classifier, the
amount of bias as a function of sample size per class and feature size has been an open
question. In this paper, the design-set error rate for a two-class problem with multivariate …
not completely known. Consequently, the classification logic must be determined on the
basis of vector samples gathered for each class. Although it is common knowledge that the
error rate on the design set is a biased estimate of the true error rate of the classifier, the
amount of bias as a function of sample size per class and feature size has been an open
question. In this paper, the design-set error rate for a two-class problem with multivariate …
In many practical pattern-classification problems the underlying probability distributions are not completely known. Consequently, the classification logic must be determined on the basis of vector samples gathered for each class. Although it is common knowledge that the error rate on the design set is a biased estimate of the true error rate of the classifier, the amount of bias as a function of sample size per class and feature size has been an open question. In this paper, the design-set error rate for a two-class problem with multivariate normal distributions is derived as a function of the sample size per class and dimensionality . The design-set error rate is compared to both the corresponding Bayes error rate and the test-set error rate. It is demonstrated that the design-set error rate is an extremely biased estimate of either the Bayes or test-set error rate if the ratio of samples per class to dimensions is less than three. Also the variance of the design-set error rate is approximated by a function that is bounded by .
ieeexplore.ieee.org