Levelwise search and borders of theories in knowledge discovery
H Mannila, H Toivonen - Data mining and knowledge discovery, 1997 - Springer
Data mining and knowledge discovery, 1997•Springer
One of the basic problems in knowledge discovery in databases (KDD) is the following:
given a data set r, a class L of sentences for defining subgroups of r, and a selection
predicate, find all sentences of L deemed interesting by the selection predicate. We analyze
the simple levelwise algorithm for finding all such descriptions. We give bounds for the
number of database accesses that the algorithm makes. For this, we introduce the concept of
the border of a theory, a notion that turns out to be surprisingly powerful in analyzing the …
given a data set r, a class L of sentences for defining subgroups of r, and a selection
predicate, find all sentences of L deemed interesting by the selection predicate. We analyze
the simple levelwise algorithm for finding all such descriptions. We give bounds for the
number of database accesses that the algorithm makes. For this, we introduce the concept of
the border of a theory, a notion that turns out to be surprisingly powerful in analyzing the …
Abstract
One of the basic problems in knowledge discovery in databases (KDD) is the following: given a data set r, a class L of sentences for defining subgroups of r, and a selection predicate, find all sentences of L deemed interesting by the selection predicate. We analyze the simple levelwise algorithm for finding all such descriptions. We give bounds for the number of database accesses that the algorithm makes. For this, we introduce the concept of the border of a theory, a notion that turns out to be surprisingly powerful in analyzing the algorithm. We also consider the verification problem of a KDD process: given r and a set of sentences S L determine whether S is exactly the set of interesting statements about r. We show strong connections between the verification problem and the hypergraph transversal problem. The verification problem arises in a natural way when using sampling to speed up the pattern discovery step in KDD.
Springer