Abstract
Various benchmarking studies have shown that artificial neural networks and support vector machines have a superior performance when compared to more traditional machine learning techniques. The main resistance against these newer techniques is based on their lack of interpretability: it is difficult for the human analyst to understand the motivation behind these models’ decisions. Various rule extraction techniques have been proposed to overcome this opacity restriction. However, most of these extraction techniques are devised for classification and only few algorithms can deal with regression problems.
In this paper, we present ITER, a new algorithm for pedagogical regression rule extraction. Based on a trained ‘black box’ model, ITER is able to extract human-understandable regression rules. Experiments show that the extracted model performs well in comparison with CART regression trees and various other techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., Vanthienen, J.: Benchmarking state of the art classification algorithms for credit scoring. Journal of the Operational Research Society 54(6), 627–635 (2003)
Barakat, N., Diederich, J.: Eclectic rule-extraction from support vector machines. International Journal of Computational Intelligence 2(1), 59–62 (2005)
Breiman, L., Friedman, J.H., Olsen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth and Brooks (1984)
Fung, G., Sandilya, S., Rao, R.B.: Rule extraction from linear support vector machines. In: 11th ACM SIGKDD international conference on Knowledge discovery in data mining, pp. 32–40 (2005)
Martens, D., Baesens, B., Van Gestel, T., Vanthienen, J.: Adding comprehensibility to support vector machines using rule extraction techniques. In: Credit Scoring and Credit Control IX (2005)
Núñez, H., Angulo, C., Català, A.: Rule extraction from support vector machines. In: European Symposium on Artificial Neural Networks (ESANN), pp. 107–112 (2002)
Quinlan, J.R.: Learning with Continuous Classes. In: 5th Australian Joint Conference on Artificial Intelligence, pp. 343–348 (1992)
Setiono, R., Leow, W.K., Zurada, J.M.: Extraction of rules from artificial neural networks for nonlinear regression. IEEE Transactions on Neural Networks 13(3), 564–577 (2002)
Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)
Viaene, S., Derrig, R., Baesens, B., Dedene, G.: A comparison of state-of-the-art classification techniques for expert automobile insurance fraud detection. Journal of Risk And Insurance (Special Issue on Fraud Detection) 69(3), 433–443 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huysmans, J., Baesens, B., Vanthienen, J. (2006). ITER: An Algorithm for Predictive Regression Rule Extraction. In: Tjoa, A.M., Trujillo, J. (eds) Data Warehousing and Knowledge Discovery. DaWaK 2006. Lecture Notes in Computer Science, vol 4081. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11823728_26
Download citation
DOI: https://doi.org/10.1007/11823728_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37736-8
Online ISBN: 978-3-540-37737-5
eBook Packages: Computer ScienceComputer Science (R0)