人工智能与神经网络笔记8.pptVIP

* * AI NN Notes Chapter 9 Feedback Neural Networks §9.1 Basic Concepts Attractor: a state toward which the system evolves in time starting from certain initial conditions. Basin of attraction: the set of initial conditions which initiates the evolution terminating in the attractor. Fixed point: if an attractor is in a form of a unique point in state space. Limit Cycle: if an attractor consists of a periodic sequence of states. Hopfield Network and its Basic Assumptions 1 2 n v v v 1 2 n T T T 1 2 n i i i n 2 1 w w w w 21 12 n1 w w n2 1n 2n 1. 1 layer, n neurons 2. T -- Threshold of neuron i 3. w -- weight from j to i 4. v -- output of neuron j 5. i -- external input to the i-th neuron ij i j The total input of the i-th neuron is net = ? i J=1 j?i n w v + i - T = W V + i - T , for I=2, …, n ij j i i i t i i where W = w w w i i1 i2 in . . . V = v v v 1 2 n The complete matrix description of the linear portion of the system shown in the figure is given by net = WV + i - t where net = net net net i = i i i 1 2 n 1 2 n are vectors containing activation, external input to each neuron and threshold vector, respectively. t = T T T 1 n 2 W is an n?n matrix containing network weights: W = w w w = w w w w w w w w w w w w 0 0 0 0 1 2 n t t t 12 13 1n 21 23 2n 31 32 3n n1 n2 n3 w = w ij ji w = 0 ii and §9.2 Discrete-Time Hopfield Network Assuming that the neuron’s activation function is sgn, the transition rule of the i-th neuron would be -1, if net 0 (inhibited state) +1, if net 0 (excitatory state) v ? If, for a given time, only a single neuron is allowed to update its output and only one entry in vector v is allowed to change, this is an asynchronous operation, under which each element of the output vector is updated separately while taking into account the most recent values f