《213_Deap_Learning》.pdf

Machine Learning Techniques ( ) Lecture 13: Deep Learning Hsuan-Tien Lin ( ) htlin@csie.ntu.edu.tw Department of Computer Science Information Engineering National Taiwan University ( ) Hsuan-Tien Lin (NTU CSIE) Machine Learning Techniques 0/24 Deep Learning Roadmap 1 Embedding Numerous Features: Kernel Models 2 Combining Predictive Features: Aggregation Models 3 Distilling Implicit Features: Extraction Models Lecture 12: Neural Network automatic pattern feature extraction from layers of neurons with backprop for GD/SGD Lecture 13: Deep Learning Deep Neural Network Autoencoder Denoising Autoencoder Principal Component Analysis Hsuan-Tien Lin (NTU CSIE) Machine Learning Techniques 1/24 Deep Learning Deep Neural Network Physical Interpretation of NNet Revisited x0 1 1 1 x1 tanh x2 w1 tanh w2 w3 ij jk kq tanh . . . tanh xd s2 tanh x 2 3 3 each layer: pattern feature extracted from data, remember? :-) how many neurons? how many layers? —more generally, what structure? subjectively,