C3-N和eural-Network.pptVIP

* Pyramidal:金字塔形的,锥体的 Cerebral cortex: 大脑皮层 * * * * Chapter 3 Neural Network Xiu-jun GONG (Ph. D) School of Computer Science and Technology, Tianjin University gongxj@ /faculties/gongxj/course/ai/ Outline Introduction Training a single TLU Network of TLUs—Artificial Neural Network Pros Cons of ANN Summary Biological /Artificial Neural Network SMI32-stained pyramidal neurons in cerebral cortex. Structure of a typical neuron x2 w2 ? wn … x1 w1 ? f(s) F(s) xn Artificial Intelligence Recognition modeling Neuroscience Definition of ANN Stimulate Neural Network: SNN, NN It is an interconnected group of artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation. In most cases an ANN is an adaptive system that changes its structure based on external or internal information that flows through the network. Applications of ANN Function approximation, or regression analysis, including time series prediction and modeling. Classification, including pattern and sequence recognition, novelty detection and sequential decision making. Data processing, including filtering, clustering, blind signal separation and compression. Extension of a TLU Threshold Logic Unit - Perceptron (Neuron) Inputs are not limited be boolean values Outputs are not limited be binary functions Output functions of a perceptron θ Characters of sigmoid function Smooth, continuous, and monotonically increasing (derivative is always positive) Bounded range - but never reaches max or min The logistic function is often used Linear Separable function by TLU A network of TLUs x1 x2 y1 y2 f 1 -1 -1 1 1 0.5 0.5 0.5 XOR Even-Parity Function Training single neuron What is the learning/training The methods The Delta Procedure The Generalized Delta Procedure The Error-Correction Procedure Reform the representation of a perceptron x1 x2 … xn xn+1 ≡ 1 W1 W2 Wn Wn+` f = f (s) S=W?X Summing Junction Activa