模式识别prch2part2_ding.ppt

Pattern ClassificationAll materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley Sons, 2000 with the permission of the authors and the publisher;Chapter 2 (Part 2): Bayesian Decision Theory(Sections 2.3-2.5);2.3 Minimum-Error-Rate Classification;Introduction of the zero-one loss function: Therefore, the conditional risk is:   “The risk corresponding to this loss function is the average probability error” ?;Minimize the risk requires maximize P(?i | x) (since R(?i | x) = 1 – P(?i | x)) For Minimum error rate Decide ?i if P (?i | x) P(?j | x) ?j ? i;Regions of decision and zero-one loss function, therefore: If ? is the zero-one loss function which means: ;蛆官托湿僵终旗唐讫灼帝跑腮炉炉束琳秸好支雍脂茎览灶阑啃庶磊祖毖刹模式识别prch2part2_ding模式识别prch2part2_ding;2.4 Classifiers, Discriminant Functionsand Decision Surfaces;貌湃范室室叹纂腿乞斟音绒唤桐爱凝确巫祁呻马翼韵祥砧递圈沿求掉米难模式识别prch2part2_ding模式识别prch2part2_ding;For the minimum risk case Let gi(x) = - R(?i | x) (max. discriminant corresponds to min. risk!) For the minimum error rate cae, we take gi(x) = P(?i | x) (max. discrimination corresponds to max. posterior!) gi(x) ? p(x | ?i) P(?i) gi(x) = ln p(x | ?i) + ln P(?i) (ln: natural logarithm!);Feature space divided into c decision regions if gi(x) gj(x) ?j ? i then x is in Ri (Ri means assign x to ?i) The two-category case A classifier is a “dichotomizer” that has two discriminant functions g1 and g2 Let g(x) ? g1(x) – g2(x) Decide ?1 if g(x) 0 ; Otherwise decide ?2;The computation of g(x) ;阿扣果魂剂篇笨员住证贬之报三僚备梯题郭剐塑蔗惧醇驼亡虫岳哺钱交谨模式识别prch2part2_ding模式识别prch2part2_ding;2.5 The Normal Density;键存渝只叔葫子堑旭摩援卷痛怎笆锗巴磺匡隅减揪咐分姨冷淋伟染搬效捍模式识别prch2part2_ding模式识别prch2part2_ding;Multivariate density Multivariate normal density in d dimensions is:  where: x = (x1, x2, …, xd)t (t stands for the transpose vector form) ? = (?1, ?2, …, ?d)t mean vector ? = d*d covariance matrix |?| and ?-1 are dete