基于改进fisher准则的深度卷积神经网络识别算法-北京工业大学学报.pdfVIP

第41卷 第6期 北 京 工 业 大 学 学 报 Vol.41 No.6 2015年 6月 JOURNAL OF BEIJING UNIVERSITY OFTECHNOLOGY Jun. 2015 基于改进Fisher准则的深度卷积神经网络识别算法 孙艳丰,齐光磊,胡永利,赵摇 璐 (北京工业大学 城市交通学院多媒体与智能软件技术北京市重点实验室,北京摇 100124) 摘摇 要:为了有效利用深度学习技术自动提取特征的能力,并解决当训练样本量减少或者迭代次数降低时识别性 能急速下降的问题,提出了基于Fisher准则的深度学习算法. 该方法在前馈传播时,采用卷积神经网络自动提取图 像的结构信息等特征,同时利用卷积网络共享权值和池化、下采样等方法减少了权值个数,降低了模型复杂度;在 反向传播权值调整时,采用了基于Fisher 的约束准则. 在权值的迭代调整时既考虑误差的最小化,又同时让样本保 持类内距离小,类间距离大,从而使权值能更加快速地逼近有利于分类的最优值,当样本量不足或训练迭代次数不 多时可有效地提高系统的识别率. 大量的实验结果证明:该基于Fisher准则的混合深度学习算法在标签样本不足 或者较少训练次数的情况下依然能达到较好的识别效果. 关键词:深度学习;卷积神经网络;Fisher准则;反向传播(BP)算法;人脸识别;手写字识别 中图分类号:TP183 文献标志码:A 文章编号:0254-0037(2015)06-0835-07 doi:10.11936/ bjutxb2014110040 Deep Convolution Neural Network Recognition Algorithm Based on Improved Fisher Criterion SUN Yan鄄feng,QI Guang鄄lei,HU Yong鄄li,ZHAO Lu (Beijing Key Laboratory of Multimedia and Intelligent Software Technology,College of Metropolitan Transportation, Beijing University of Technology,Beijing 100124,China) Abstract:To effectively make use of deep learning technology automatic feature extraction ability,and solve the problem when the training sample size reduced or the iteration times reduced the recognition performance fell sharply,thispaper proposed a deep learning algorithm based on Fisher criterion. In the feedforward spread,this method used convolution neural network to extract automatically image features such as structural information, and used convolution network of sharing weights and pooling, sub鄄 sampling methodstoreducetheweightnumber,andthemethodreducedthemodelcomplexity. Whenthe back propagation adjusted the weights,it adopted the constraints ba