Mining Quantitative Correlated Patterns Using an Information利用信息挖掘定量关联模式.pptVIP

Mining Quantitative Correlated Patterns Using an Information-Theoretic Approach Yiping Ke, James Cheng, Wilfred Ng Presentation Outline: Contributions of the paper Introduction What are QCPs? Definitions Background Information Theory (entropy, MI, NMI) Mining QCPs All-confidence Discretization problem (interval combining) Attribute-level pruning Interval-level pruning QCoMine algorithm Contributions of the paper Presents a new algorithm for mining patterns on databases based on theory borrowed from information theory: entropy mutual information Achieves discretization of attribute domain using supervised interval combining to preserve dependency between attributes Introduction Similar to association rule mining in principle but evaluating for association rules can be too expensive on VLDBs Trivial result-set {pregnant} ? {edema} {pregnant, female} ? {edema} Unproductive rules as a result of co-occurrence effects {pregnant, dataminer} ? {edema}. So occupation and edema condition are related? Unlike association mining, mining for QCP consider the dependency of the attribute sets of the database to generate highly correlated patterns Similar to generating “maximal informative k-itemsets”, but here we consider dependency in the attribute sets Introduction…contd. The idea behind mining QCP Evaluate the attribute set and look for ‘strong’ dependencies between attributes Next find correlated interval sets in the dependent attributes and generate patterns from them Thus, QCPs are not restricted by frequently co-occurring attributes Definitions: Quantitative Database A pattern X, is a set of attributes or random variable = {x1, x2, x3, …, xm} whose outcomes can be numerical or quantitative and have possibilities p(vx) = {p1, p2, p3, …, pm} These attributes can be either categorical in which case domain of xi, dom(x) is in the interval {lx, ux} where lx = ux And it is quantitative if where xi[lx, ux] is the interval of xi, lx = ux A pattern X is called a k-pattern if |att