62 IPL 分段线性判别函数(II) - Read.PPTVIP

模式识别  Pattern Recognition 第四章 线性判别函数 内容目录 4.1 引言 基于样本的Bayes分类器：通过估计类条件概率密度函数，设计相应的判别函数 决策边界的估计 Classification is viewed as “learning good decision boundaries” that separate the examples belonging to different classes in a data set. 决策边界的估计 Specify a parametric form of the decision boundary (e.g., linear or quadratic) . Find the “best” decision boundary of the specified form using a set of training examples. This is done by minimizing a criterion function e.g., “training error” (or “sample risk”) 直接确定判别函数 基于样本的直接确定判别函数方法： 设定判别函数形式，用样本集确定参数。 使用准则函数，表达分类器应满足的要求。 这些准则的“最优”并不一定与错误率最小相一致：次优分类器。 实例：正态分布最小错误率贝叶斯分类器在特殊情况下，是线性判别函数g(x)=wTx（决策面是超平面），能否基于样本直接确定w? 线性判别函数 d维空间中的线性判别函数的一般形式： 两类问题的分类决策规则 线性判别函数的几何意义 If g(x) is linear, the decision boundary is a hyperplane. The orientation of the hyperplane is determined by w and its location by w0. w is the normal to the hyperplane. If w0=0, the hyperplane passes through the origin. 线性判别函数的几何意义 g(x) provides an algebraic measure of the distance of x from the hyperplane. 线性判别函数的几何意义 Substitute the above expression in g(x): This gives the distance of x from the hyperplane: w0 determines the distance of the hyperplane from the origin: 线性判别函数的几何意义 决策面(decision boundary)H方程：g(x)=0 向量w是决策面H的法向量 g(x)是点x到决策面H的距离的一种代数度量 广义线性判别函数 线性判别函数是形式最为简单的判别函数，但是它不能用于复杂情况。 例：设计一个一维分类器，使其功能为： 广义线性判别函数(2) 广义线性判别函数(3) 按照上述原理，任何非线性函数g(x)用级数展开成高次多项式后，都可转化成线性判别函数来处理。 广义线性判别函数 Generalized discriminant - a is a dimensional weight vector - the functions yi(x) are called φ functions The functions yi(x) map points from the d-dimensional x-space to the -dimensional y-space (usually d ) 广义线性判别函数 The resulting discriminant function is not linear in x but it is linear in y. The generalized discriminant separates points in the transformed space by a hyperplane passing through the origin. 广义线性判别函数 Example: Maps a line in x-space to a parabola in y-space. The plane aty=0 divides the y-space in two decision regions The