y 资讯工程所医学影像处理实验室 - 医学影像处理实验室mipl.ppt

Chapter 2 Learning Processes 授課教師: 張傳育 博士 (Chuan-Yu Chang Ph.D.) E-mail: chuanyu@yuntech.edu.tw Tel: (05)5342601 ext. 4337 Office: ES709 Introduction The neural network has the ability to learn from its environment, and to improve its performance through learning. A neural network learns about its environment through an interactive process of adjustments applied to its synaptic weights and bias levels. Learning in Neural Networks Stimulated by an environment Undergoes changes as a results of this stimulation Because of the changes, responds in a new way to the environment The solution of a learning problem is called a learning algorithm. Adjustments to the synaptic weights The algorithm starts from an arbitrary setting of the neuron’s synaptic weights Adjustments to the synaptic weights are made on a continuous basis Computation of adjustments are completed inside a time interval Error Correction Learning The output signal is compared to a desired response . The corrective adjustments are designed to make the output signal yk(n) come closer to the desired response dk(n) in a step-by-step manner. Error Correction Learning The error signal Minimizing a cost function The step-by-step adjustments to the synaptic weights of neuron k are continued until the system reaches a steady state. According to the delta rule, the adjustment wkj(n) applied to the synaptic weight wkj at time step n is defined by Error Correction Learning The delta rule The adjustment made to a synaptic weight of a neuron is proportional to the product of the error signal and the input signal of the synapse in question. The updated value of synaptic weight wkj is Memory-Based Learning All of the past experiences are explicitly stored in a large memory of correctly classified input-output examples {(xi, di)} 所有memory-based learning algorithm會有兩個重要成分 定義鄰近區域(local neighborhood)的準則 Nearest neighbor rule: the training example that lies in the immediate neighborhood of the test vector xtest. 如果