chap5_alternative_classification.ppt

(C) Vipin Kumar, Parallel Issues in Data Mining, VECPAR 2002 (C) Vipin Kumar, Parallel Issues in Data Mining, VECPAR 2002 Data Mining Classification: Alternative Techniques Rule-Based Classifier Classify records by using a collection of “if…then…” rules Rule: (Condition) ? y where Condition is a conjunctions of attributes y is the class label LHS: rule antecedent or condition RHS: rule consequent Examples of classification rules: (Blood Type=Warm) ? (Lay Eggs=Yes) ? Birds (Taxable Income < 50K) ? (Refund=Yes) ? Evade=No Rule-based Classifier (Example) Application of Rule-Based Classifier A rule r covers an instance x if the attributes of the instance satisfy the condition of the rule Rule Coverage and Accuracy Coverage of a rule: Fraction of records that satisfy the antecedent of a rule Accuracy of a rule: Fraction of records that satisfy both the antecedent and consequent of a rule How does Rule-based Classifier Work? Characteristics of Rule-Based Classifier Mutually exclusive rules Classifier contains mutually exclusive rules if the rules are independent of each other Every record is covered by at most one rule Exhaustive rules Classifier has exhaustive coverage if it accounts for every possible combination of attribute values Each record is covered by at least one rule From Decision Trees To Rules Rules Can Be Simplified Effect of Rule Simplification Rules are no longer mutually exclusive A record may trigger more than one rule Solution? Ordered rule set Unordered rule set – use voting schemes Rules are no longer exhaustive A record may not trigger any rules Solution? Use a default class Ordered Rule Set Rules are rank ordered according to their priority An ordered rule set is known as a decision list When a test record is presented to the classifier It is assigned to the class label of the highest ranked rule it has triggered If none of the rules fired, it is assigned to the default class Rule Ordering Schemes Rule-based ordering Individual rul