EECS 800 Research SeminarMining Biological Data.ppt

EECS 800 Research SeminarMining Biological Data Instructor: Luke Huan Fall, 2006 Administrative Last day to add/change sections without written permission Send a request to reserve reference books in Spahr library Outline for today A road map of frequent item set mining Efficient and scalable frequent itemset mining methods Mining various kinds of association rules Summary What Is Frequent Pattern Analysis? Motivation: Finding inherent regularities in data What products were often purchased together?— Beer and diapers?! What are the subsequent purchases after buying a PC? What are the commonly occurring subsequences in a group of genes? What are the shared substructures in a group of effective drugs? What Is Frequent Pattern Analysis? Frequent pattern: a pattern (a set of items, subsequences, substructures, etc.) that occurs frequently in a data set First proposed by Agrawal, Imielinski, and Swami [AIS93] in the context of frequent itemsets and association rule mining Applications Identify motifs in bio-molecules DNA sequence analysis, protein structure analysis Identify patterns in micro-arrays Business applications: Market basket analysis, cross-marketing, catalog design, sale campaign analysis, etc. Data An item is an element (a literal, a variable, a symbol, a descriptor, an attribute, a measurement, etc) A transaction is a set of items A data set is a set of transactions A database is a data set Where Data are Collected Retailer stores On-line shopping record Genetic profiling Business records Entities and attributes The Nature of the Data Large volume of data Gigabytes Terabytes Usually very sparse Most of the items are task-irrelevant Frequent Patterns Pattern (Itemset): a set of items E.g., acm={a, c, m} Support of patterns Sup(acm)=3 Given min_sup=3, acm is a frequent pattern Frequent pattern mining: find all frequent patterns in a database Association Rules Frequent Pattern Mining: A Road Map Boolean vs. quantitative associations occupation(