16-卷积神经网络背景.pptxVIP

DeepLearninganditsApplicationConvolutionalneuralnetworks

FrankRosenblatt,~1957:PerceptronTheMarkIPerceptronmachinewasthefirstimplementationoftheperceptronalgorithm.Themachinewasconnectedtoacamerathatused20×20cadmiumsulfidephotocellstoproducea400-pixelimage.recognizedlettersofthealphabetupdaterule:Abitofhistory...2ThisimagebyRockyAcostaislicensedunderCC-BY3.0Rosenblatt,Frank(1957),ThePerceptron--aperceivingandrecognizingautomaton.Report85-460-1,CornellAeronauticalLaboratory.SJTUDeepLearningLecture.

Abitofhistory...recognizablemathIllustrationofRumelhartetal.,1986byLaneMcIntosh,copyrightCS231n20176Rumelhartetal.,1986:Firsttimeback-propagationbecamepopularRumelhart,DavidE.;Hinton,GeoffreyE.;Williams,RonaldJ.(1986-10-09).Learningrepresentationsbyback-propagatingerrors.Nature.323(6088):533–536.SJTUDeepLearningLecture.

[HintonandSalakhutdinov2006]ReinvigoratedresearchinDeepLearningAbitofhistory...IllustrationofHintonandSalakhutdinov2006byLaneMcIntosh,copyrightCS231n20177GeoffreyEHinton,RuslanRSalakhutdinov(2006).Reducingthedimensionalityofdatawithneuralnetworks.science.313(5786)SJTUDeepLearningLecture.

Abitofhistory:HubelWiesel,1959RECEPTIVEFIELDSOFSINGLENEURONESINTHECATSSTRIATECORTEX1962RECEPTIVEFIELDS,BINOCULARINTERACTIONANDFUNCTIONALARCHITECTUREINTHECATSVISUALCORTEX1968...9SJTUDeepLearningLecture.

AbitofhistoryTopographicalmappinginthecortex:nearbycellsincortexrepresentnearbyregionsinthevisualfieldRetinotopyimagescourtesyofJesseGomezintheStanfordVisionPerceptionNeuroscienceLab.10HumanbrainVisualcortexSJTUDeepLearningLecture.

HierarchicalorganizationIllustrationofhierarchicalorganizationinearlyvisualpathwaysbyLaneMcIntosh,copyrightCS231n201711SJTUDeepLearningLecture.

Abitofhistory:Neocognitron[KunihikoFukushima福岛邦彦1980]“s