模式识别与人工智能之十一PPT.pptx

Pattern Recognition artificial IntelligenceLecture 11: 聚类算法（七）Model-based clustering (2)Artificial Neural NetworksBiological and artificial networksCompetitive Learning NetworksCompetitive LearningSelf-Organizing Map (SOM)Adaptive Resonance Theory (ART)Relationship between K-means, FCM and Competitive Learning NetworkBiological and artificial networksBiology：Biological and artificial networksArtificial The artificial neural network is a group of neurons organized in several layers:Input layer:?receives inputs from sources external to the network;Output layer:?generates outputs to the external world.Hidden layer(s):?layers in between of the input and output layers, not visible from outside the network.Learning laws:?mathematical rules for modifying the weights of a network iteratively according the inputs (and outputs if the learning is supervised).Biological and artificial networksMathematical Explanation A neuron is modeled mathematically as the following:Activation - the net input signal:The net input to the ith node is a weighted sum of all inputs: Where is the input signal from the jth node, is the synaptic connectivity between the jth node and the ith node.Biological and artificial networksMathematical Explanation Curve of Sigmoid function Competitive Learning NetworksCompetitive learningCompetitive learning is a typical unsupervised learning network, similar to the statistical clustering analysis methods (k-means). The purpose is to discover groups/clusters composed of similar patterns represented by vectors in the n-D space. The competitive learning network has two layers.Competitive Learning NetworksCompetitive learningthe input layer composed of nodes to which an input pattern is presented, and the output layer composed of nodes There different variations in the computation for the output, depending on the specific data and purpose. In the simplest computation, the net input, the activation,