Learning curve in concept drift while using active learning paradigm
Pages 98 - 106
Abstract
Classification of evolving data stream requires adaptation during exploitation of algorithms to follow the changes in data. One of the approaches to provide the classifier the ability to adapt changes is usage of sliding window - learning on the basis of the newest data samples. Active learning is the paradigm in which algorithm decides on its own which data will be used as training samples; labels of only these samples need to be obtained and delivered as the learning material. This paper will investigate the error of classic sliding window algorithm and its active version, as well as its learning curve after sudden drift occurs. Two novel performance measures will be introduces and some of their features will be highlighted.
References
[1]
Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Machine Learning 6, 37-66 (1991)
[2]
Asuncion, A., Newman, D.J.: UCI ML Repository. University of California, School of Information and Computer Science, Irvine, CA (2007), http://www.ics.uci.edu/~mlearn/MLRepository.html
[3]
Black, M.M., Hickey, R.J.: Classification of customer call data in the presence of concept drift and noise. In: Bustard, D.W., Liu, W., Sterritt, R. (eds.) Soft-Ware 2002. LNCS, vol. 2311, p. 74-87. Springer, Heidelberg (2002)
[4]
Delany, S., Cunningham, P., Tsymbal, A.: A comparison of ensemble and case-base main- tenance techniques for handling concept drift in spam filtering. In: Proc. of the 19th Int. Conf. on Artificial Intelligence. AAAI Press, Menlo Park (2006)
[5]
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, NY (2001)
[6]
Hilas, C.: Designing an expert system for fraud detection in private telecommunications networks. Expert Syst. 36(9), 11559-11569 (2009)
[7]
Kelly, M., Hand, D., Adams, N.: The impact of changing populations on classifier performance. In: Proc. of the 5th ACM SIGKDD Int. Conf. on Knowledge discovery and data mining. ACM, New York (1999); Kurlej, B., Woźniak, M.: Active Learning Approach to Concept Drift Problem. Logic Journal of IGPL, Oxford Journals; (in-press)
[8]
Lattner, A., Miene, A., Visser, U., Herzog, O.: Sequential pattern mining for situation and behavior prediction in simulated robotic soccer. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, pp. 118-129. Springer, Heidelberg (2006)
[9]
Patcha, A., Park, J.: An overview of anomaly detection techniques: Existing solutions and latest technological trends. Comput. Netw. 51(12), 3448-3470 (2007)
[10]
Procopio, M., Mulligan, J., Grudic, G.: Learning terrain segmentation with classifier ensembles for autonomous robot navigation in unstructured environments. J. Field Robot. 26(2), 145-175 (2009)
[11]
Schlimmer, J., Granger, R.: Incremental learning from noisy data. Machine Learning 1(3), 317-354 (1986)
[12]
Thrun, S., et al.: Winning the DARPA Grand Challenge. Journal of Field Robotics 23(9), 661-692 (2006)
[13]
Tsymbal, A.: The problem of concept drift: definitions and related work, Technical Report TCD-CS-2004-15, Department of Computer Science, Trinity College Dublin (2004)
[14]
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23(1), 69-101 (1996)
- Learning curve in concept drift while using active learning paradigm
Recommendations
Concept drift type identification based on multi-sliding windows
Highlights- This method not only makes a preliminary division of concept drift, but also gives a more detailed classification.
AbstractConcept drift is a common and important issue in streaming data analysis and mining. Thus far, many concept drift detection methods have been proposed but may not be able to identify the type of concept drift, which will result in some ...
Adaptive online learning for classification under concept drift
In machine learning and predictive analytics, the underlying data distributions tend to change with the course of time known as concept drift. Accurate labelling in case of supervised learning algorithms is essential to build consistent ensemble models. ...
Detecting concept drift: An information entropy based method using an adaptive sliding window
Concept drift in data stream poses many challenges and difficulties in mining this tradition-distinct database. In this paper, we focus on detecting concept drift in evolving data stream. We propose a novel method to detect concept drift using entropy ...
Comments
Information & Contributors
Information
Published In
Sponsors
- Alps Adria University of Klagenfurt: Alps Adria University of Klagenfurt
- ieee-cis: IEEE Computational Intelligence Society
- INNS: International Neural Networks Society
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 06 September 2011
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024