Abstract
The study reported was devoted to investigate to what extent bagging approach could lead to the improvement of the accuracy machine learning regression models. Four algorithms implemented in the KEEL tool, including two evolutionary fuzzy systems, decision trees for regression, and neural network, were used in the experiments. The results showed that some bagging ensembles ensured higher prediction accuracy than single models.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Alcalá-Fdez, J., et al.: KEEL: A Software Tool to Assess Evolutionary Algorithms for Data Mining Problems. Soft Computing 13(3), 307–318 (2009)
Banfield, R.E., et al.: A Comparison of Decision Tree Ensemble Creation Techniques. IEEE Trans. on Pattern Analysis and Machine Intelligence 29(1), 173–180 (2007)
Breiman, L.: Bagging Predictors. Machine Learning 24(2), 123–140 (1996)
Büchlmann, P., Yu, B.: Analyzing Bagging. Annals of Statistics 30, 927–961 (2002)
Canul-Reich, J., Shoemaker, L., Hall, L.O.: Ensembles of Fuzzy Classifiers. In: Proc. IEEE International Conference on Fuzzy Systems, FUZZ-IEEE 2007, pp. 1–6 (2007)
Casillas, J., Cordón, O., Herrera, F.: COR: A Methodology to Improve ad hoc Data-Driven Linguistic Rule Learning Methods by Inducing Cooperation Among Rules. IEEE Trans. on System, Man and Cybernetics, Part B: Cybernetics 32(4), 526–537 (2002)
Chen, T., Ren, J.: Bagging for Gaussian Process Regression. Neurocomputing 72(7-9), 1605–1610 (2009)
Cordón, O., Herrera, F.: A Three-stage Evolutionary Process for Learning Descriptive and Approximate Fuzzy Logic Controller Knowledge Bases from Examples. International Journal of Approximate Reasoning 17(4), 369–407 (1997)
Islam, M.M., et al.: Bagging and Boosting Negatively Correlated Neural Networks. IEEE Trans. on Systems, Man, and Cybernetics, Part B: Cybernetics 38(3), 771–784 (2008)
Kégl, B.: Robust Regression by Boosting the Median. In: Proceedings of the 16th Conference on Computational Learning Theory, pp. 258–272 (2003)
Kim, D.: Improving the Fuzzy System Performance by Fuzzy System Ensemble. Fuzzy Sets and Systems 98(1), 43–56 (1998)
Korytkowski, M., Rutkowski, L., Scherer, R.: From Ensemble of Fuzzy Classifiers to Single Fuzzy Rule Base Classifier. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2008. LNCS (LNAI), vol. 5097, pp. 265–272. Springer, Heidelberg (2008)
Król, D., Lasota, T., Trawiński, B., Trawiński, K.: Investigation of Evolutionary Optimization Methods of TSK Fuzzy Model for Real Estate Appraisal. International Journal of Hybrid Intelligent Systems 5(3), 111–128 (2008)
Lasota, T., Mazurkiewicz, J., Trawiński, B., Trawiński, K.: Comparison of Data Driven Models for the Validation of Residential Premises Using KEEL. International Journal of Hybrid Intelligent Systems (in press, 2009)
Moller, F.: A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning. Neural Networks 6, 525–533 (1990)
Polikar, R.: Ensemble Learning. Scholarpedia 4(1), 27–76 (2009)
Quinlan, J.R.: Learning with Continuous Classes. In: 5th Australian Joint Conference on Artificial Intelligence (AI 1992), Singapore, pp. 343–348 (1992)
Schapire, R.E.: The Strength of Weak Learnability. Mach. Learning 5(2), 197–227 (1990)
Wang, I., Witten, I.H.: Induction of Model Trees for Predicting Continuous Classes. In: van Someren, M., Widmer, G. (eds.) ECML 1997. LNCS, vol. 1224, pp. 128–137. Springer, Heidelberg (1997)
Wang, L.X., Mendel, J.M.: Generating Fuzzy Rules by Learning from Examples. IEEE Trans. on Systems, Man and Cybernetics 22(6), 1414–1427 (1992)
Wolpert, D.H.: Stacked Generalization. Neural Networks 5(2), 241–259 (1992)
Yan, J.: Ensemble SVM Regression Based Multi-View Face Detection System. In: IEEE Workshop on Machine Learning for Signal Processing, pp. 163–169 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lasota, T., Telec, Z., Trawiński, B., Trawiński, K. (2009). Exploration of Bagging Ensembles Comprising Genetic Fuzzy Models to Assist with Real Estate Appraisals. In: Corchado, E., Yin, H. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2009. IDEAL 2009. Lecture Notes in Computer Science, vol 5788. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04394-9_67
Download citation
DOI: https://doi.org/10.1007/978-3-642-04394-9_67
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04393-2
Online ISBN: 978-3-642-04394-9
eBook Packages: Computer ScienceComputer Science (R0)