2013_Google speech recognition Lecture 14-Neural Networks.pdfVIP

Speech recognition Lecture 14: Neural Networks Andrew Senior andrewsenior@ Google NYC December 12, 2013 Andrew Senior andrewsenior@ 1 1 Introduction to Neural networks 2 Neural networks for speech recognition Neural network features for speech recognition Hybrid neural networks History Variations 3 Language modelling Andrew Senior andrewsenior@ 2 The perceptron Input x1 Input x2 Input x3 Input x4 Input x5 Output w1w2w3w4w5 A perceptron is a linear classifier: f (x) = 1 if w .x 0 (1) = 0 otherwise. (2) Add an extra “always one” input to provide an offset or “bias”. The weights w can be learned