Chapter 6 Support Vector Machines 《神经网络与 及机器学习》 .pptVIP

Copyright ?2009 by Pearson Education, Inc. Upper Saddle River, New Jersey 07458 All rights reserved. Neural Networks and Learning Machines, Third Edition Simon Haykin Chapter 6 Support Vector Machines Figure 6.1 Illustration of the idea of an optimal hyperplane for linearly separable patterns: The data points shaded in blue are support vectors. Figure 6.2 Geometric interpretation of algebraic distances of points to the optimal hyperplane for a two-dimensional case. Figure 6.3 Soft margin hyperplane (a) Data point xi (belonging to class C1, represented by a small square) falls inside the region of separation, but on the correct side of the decision surface. (b) Data point xi (belonging to class C2, represented by a small circle) falls on the wrong side of the decision surface. Figure 6.4 Illustrating the two mappings in a support vector machine for pattern classification: (i) nonlinear mapping from the input space to the feature space; (ii) linear mapping from the feature space to the output space. Table 6.2 Figure 6.6 (a) Polynomial machine for solving the XOR problem. (b) Induced images in the feature space due to the four data points of the XOR problem. Figure 6.7 Experiment on SVM for the double-moon of Fig. 1.8 with distance d = –6. Figure 6.8 Experiment on SVM for the double-moon of Fig. 1.8 with distance d = –6.5. Figure 6.9 Linear regression (a) Illustrating an ?-insensitive tube of radius ?, fitted to the data points shown as X’s. (b) The corresponding plot of the ? -insensitive loss function. Figure P6.15 Figure P6.17 Figure P6.25 * * Copyright ?2009 by Pearson Education, Inc. Upper Saddle River, New Jersey 07458 All rights reserved. Neural Networks and Learning Machines, Third Edition Simon Haykin