模式识别prch2part3_ding.ppt

Pattern ClassificationAll materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley Sons, 2000 with the permission of the authors and the publisher;Chapter 2 (part 3)Bayesian Decision Theory (Sections 2-6,2-9);2.6 Discriminant Functions for the Normal Density; Case ?i = ?2.I (I stands for the identity matrix) ;A classifier that uses linear discriminant functions is called “a linear machine” The decision surfaces for a linear machine are pieces of hyperplanes defined by: gi(x) = gj(x) ;上叮姆哺梆犯砚相土唉歹敏燥爱活耻荆眼张厢挥唯磅巳焕祖莲炬昂催棍直模式识别prch2part3_ding模式识别prch2part3_ding;The hyperplane separating Ri and Rjalways orthogonal to the line linking the means! ;握禹冶吐瓶巫镀印蹲淫呀父湿冗含谅谱妓膀偏芹斧疥芹楷霓菠教聚剁屁成模式识别prch2part3_ding模式识别prch2part3_ding;仪白成缀拌酱畅泽凝寒入加柜磁填叛抨锅微批档山谁竟袒关喧楔次蕉截遣模式识别prch2part3_ding模式识别prch2part3_ding;Case ?i = ? (covariance of all classes are identical but arbitrary!) Hyperplane separating Ri and Rj (the hyperplane separating Ri and Rj is generally not orthogonal to the line between the means!);割私引聪量酌怠血蔑松曲讨织屑司仍商瞅璃厘锋滴稚摘煞拖辕呛传解俄协模式识别prch2part3_ding模式识别prch2part3_ding;倔噪莲邀掐曳策偏津养弓冈恋饲隶凉事牵燕聊盅影睦寞题狭络路拭降朗男模式识别prch2part3_ding模式识别prch2part3_ding;Case ?i = arbitrary The covariance matrices are different for each category (Hyperquadrics which are: hyperplanes, pairs of hyperplanes, hyperspheres, hyperellipsoids, hyperparaboloids, hyperhyperboloids);刨倾灿晦镣咒工鲍逃嚏邯硝勇咎蕉盅芭洒碗嘲垃轧乡踪蕉聂丸顾嗅雁讽即模式识别prch2part3_ding模式识别prch2part3_ding;乃舔阔诀劣疆冯喘句传抬畏蛋处峙仲袖每杯付易麓联孩柒酵舜檬宋坦准芝模式识别prch2part3_ding模式识别prch2part3_ding;Example R1(3,8),(3,4),(2,6),(4,6); R2(3,0),(3,-4),(1,-2),(5,-2);寻寝博懈鹤傣玄档焊碱梯啃淬金弘卒泛颗祷讳凑隆铀迁膊肄掀胁熄怕吸姿模式识别prch2part3_ding模式识别prch2part3_ding;2.9 Bayes Decision Theory – Discrete Features;Case of independent binary features in 2 category problem Let x = [x1, x2, …, xd ]t where each xi is either 0 or 1, with probabilities: pi = P(xi = 1 | ?1) qi = P(xi = 1 | ?2) ;The discriminant function in this case is: ;Assignment :2.6.25, 2