深度学习完整全套教案教学电子课件.pptVIP

第一章概论

1.1深度学习的兴起

1.2什么是深度学习？

1.3为什么采用深度学习？

1.4深度学习的应用

1.5问题或挑战

1.1深度学习的兴起第一章概论

神经网络发展历程

1989

LeNet

1.1深度学习的兴起第一章概论

PhasesofNeuralNetworkResearch

•1940s-1960s:Cybernetics:Brainlikeelectronicsystems,

morphedintomoderncontroltheoryandsignal

processing.

•1960s-1980s:Digitalcomputers,automatatheory,

computationalcomplexitytheory:simpleshallowcircuits

areverylimitedinwhattheycanrepresent…

•1980s-1990s:Connectionism:complex,non-linear

networks,back-propagation.

•1990s-2010s:Computationallearningtheory,graphical

models:Learningiscomputationallyhard,simple

shallowcircuitsareverylimitedinwhattheycanlearn…

•2006:Deeplearning:End-to-endtraining,large

datasets,explosioninapplications.

1.1深度学习的兴起第一章概论

Citationsofthe“LeNet”paper

•RecalltheLeNetwasamodernvisualclassificationnetwork

thatrecognizeddigitsforzipcodes.Itscitationslooklike

this:

SecondphaseDeepLearning“Winter”Thirdphase

•The2000swereagoldenageformachinelearning,and

markedtheascentofgraphicalmodels.Butnotsofor

neuralnetworks.

1.1深度学习的兴起第一章概论

GeofferyHintonYannLeCunYoshuaBengio

杰弗里-辛顿杨立昆约书亚-本吉奥

深度学习领域的“三巨头”，2019年度的图灵奖获得者

1.1深度学习的兴起第一章概论

l反向传播l卷积神经网络l序列的概率建模

l玻尔兹曼机l改进反向传播算法l高维词嵌入与注意力机制

l卷积神经网络的修正l拓宽神经网络的视角l生成对抗网络

GeofferyHintonYannLeCunYoshuaBengio

杰弗里-辛顿杨立昆约书亚-本吉奥

第一章概论

1.1深度学习的兴起

1.2