Authors:
Hatim Alsuwat
;
Emad Alsuwat
;
Marco Valtorta
;
John Rose
and
Csilla Farkas
Affiliation:
Department of Computer Science and Engineering, University of South Carolina, Columbia, SC and U.S.A.
Keyword(s):
Concept Drift, Concept Drift Detection, Nonstationary Environments, Bayesian Networks, Latent Variables.
Related
Ontology
Subjects/Areas/Topics:
Artificial Intelligence
;
Business Analytics
;
Computational Intelligence
;
Data Analytics
;
Data Engineering
;
Evolutionary Computing
;
Knowledge Discovery and Information Retrieval
;
Knowledge-Based Systems
;
Machine Learning
;
Soft Computing
;
Symbolic Systems
Abstract:
Concept drift is a significant challenge that greatly influences the accuracy and reliability of machine learning models. There is, therefore, a need to detect concept drift in order to ensure the validity of learned models. In this research, we study the issue of concept drift in the context of discrete Bayesian networks. We propose a probabilistic graphical model framework to explicitly detect the presence of concept drift using latent variables. We employ latent variables to model real concept drift and uncertainty drift over time. For modeling real concept drift, we propose to monitor the mean of the distribution of the latent variable over time. For modeling uncertainty drift, we suggest to monitor the change in beliefs of the latent variable over time, i.e., we monitor the maximum value that the probability density function of the distribution takes over time. We implement our proposed framework and present our empirical results using two of the most commonly used Bayesian netw
orks in Bayesian experiments, namely the Burglary-Earthquake Network and the Chest Clinic network.
(More)