Abstract
In the context of machine learning from examples this paper deals with the problem of estimating the quality of attributes with and without dependencies among them. Kira and Rendell (1992a,b) developed an algorithm called RELIEF, which was shown to be very efficient in estimating attributes. Original RELIEF can deal with discrete and continuous attributes and is limited to only two-class problems. In this paper RELIEF is analysed and extended to deal with noisy, incomplete, and multi-class data sets. The extensions are verified on various artificial and one well known real-world problem.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Breiman L., Friedman J.H., Olshen R.A., Stone C.J.: Classification and Regression Trees. Wadsforth International Group 1984
Hunt, E., Martin, J. & Stone, P.: Experiments in Induction. New York: Academic Press 1966
Kira, K. & Rendell, L.: A practical approach to feature selection. In: Proc. Intern. Conf. on Machine Learning. (Aberdeen, July 1992) D. Sleeman & P. Edwards (eds.), Morgan Kaufmann 1992, pp. 249–256
Kira K. & Rendell L.: The feature selection problem: traditional methods and new algorithm. In: Proc. AAAI'92. San Jose, CA, July 1992
Kononenko I., Bratko I., Roškar E.: Experiments in inductive learning of medical diagnostic rules. In: Proc. International School for the Synthesis of Expert Knowledge Workshop. Bled, Slovenia, August 1984.
Kononenko I.: Semi-naive Bayesian classifier. In: Proc. European Working Session on Learning, (Porto, March 1991), Y. Kodratoff (ed.), Springer Verlag 1991, pp.206–219
Mantaras R.L.: ID3 Revisited: A distance based criterion for attribute selection. In: Proc. Int. Symp. Methodologies for Intelligent Systems. Charlotte, North Carolina, U.S.A., Oct. 1989
Quinlan, R.: Induction of decision trees. Machine learning 1, 81–106 (1986)
Smyth P. & Goodman R.M.: Rule induction using information theory. In. G. Piatetsky-Shapiro & W. Frawley (eds.): Knowledge Discovery in Databases. MIT Press 1990
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1994 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kononenko, I. (1994). Estimating attributes: Analysis and extensions of RELIEF. In: Bergadano, F., De Raedt, L. (eds) Machine Learning: ECML-94. ECML 1994. Lecture Notes in Computer Science, vol 784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57868-4_57
Download citation
DOI: https://doi.org/10.1007/3-540-57868-4_57
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-57868-0
Online ISBN: 978-3-540-48365-6
eBook Packages: Springer Book Archive