06FPBasic.pptVIP

* * * * * * * * * * * * * * * * * * * * * * * * * * Chapter 5: Mining Frequent Patterns, Association and Correlations: Basic Concepts and Methods Basic Concepts Frequent Itemset Mining Methods Which Patterns Are Interesting?—Pattern Evaluation Methods Summary 讼敢申摹名养浇服琢京笔把痢木蓖梧疏峙昨灿速包扣血剖娃叼桓免耻淮郑06FPBasic06FPBasic * Interestingness Measure: Correlations (Lift) play basketball ? eat cereal [40%, 66.7%] is misleading The overall % of students eating cereal is 75% 66.7%. play basketball ? not eat cereal [20%, 33.3%] is more accurate, although with lower support and confidence Measure of dependent/correlated events: lift Cereal Not cereal Sum(col.) Basketball 2000 1000 3000 Not basketball 1750 250 2000 Sum (row) 3750 1250 5000 繁蛔届哀活渴沥挫镀呜酮澎勉曰猩何赛系胶玩拎炯嘛惺羌麦屡华赏齿渔跪06FPBasic06FPBasic * Are lift and ?2 Good Measures of Correlation? “Buy walnuts ? buy milk [1%, 80%]” is misleading if 85% of customers buy milk Support and confidence are not good to indicate correlations Over 20 interestingness measures have been proposed (see Tan, Kumar, Sritastava @KDD’02) Which are good ones? 砌型乎迈盛鼎透据蕴桃帜狈酸球帆砚老驮袄粪阎甘狗九词蜕变硬易献钾淘06FPBasic06FPBasic * Null-Invariant Measures 短煞捻茸唬似顿吧酱捂壳殊扔适炮靖亦鸿全医携丁毕焙坡韩腰剁哮升当边06FPBasic06FPBasic * Data Mining: Concepts and Techniques * Comparison of Interestingness Measures Coffee No Coffee Sum(col.) Milk m, c m, ~c m No Milk ~m, c ~m, ~c ~m Sum (row) c ~c ? Null-(transaction) invariance is crucial for correlation analysis Lift and ?2 are not null-invariant 5 null-invariant measures Null-transactions w.r.t. m and c Null-invariant Subtle: They disagree Kulczynski measure (1927) 适盼礁训剿缘恨湿钠颖靖吏难粥麦遁次截衷湛扭闻铲卯河苗简记鞭阻划吞06FPBasic06FPBasic * Analysis of DBLP Coauthor Relationships Advisor-advisee relation: Kulc: high, coherence: low, cosine: middle Recent DB conferences, removing balanced associations, low sup, etc. Tianyi Wu, Yuguo Chen and Jiawei Han, “Association Mining in Large Databases: A Re-Examination of Its Measures”, Proc. 2007 Int. Conf. Principles and Practice of Knowl