Hinton 代码 -- backprop.docxVIP

% Version 1.000%% Code provided by Ruslan Salakhutdinov and Geoff Hinton%% Permission is granted for anyone to copy, use, modify, or distribute this% program and accompanying programs and documents for any purpose, provided% this copyright notice is retained and prominently displayed, along with% a note saying that the original programs are available from our% web page.% The programs and documents are distributed without any warranty, express or% implied. As the programs were written for research purposes only, they have% not been tested to the degree that would be advisable in any important% application. All use of these programs is entirely at the users own risk.% This program fine-tunes an autoencoder with backpropagation.% Weights of the autoencoder are going to be saved in mnist_weights.mat% and trainig and test reconstruction errors in mnist_error.mat% You can also set maxepoch, default value is 200 as in our paper. maxepoch=200;fprintf(1,\nFine-tuning deep autoencoder by minimizing cross entropy error. \n);fprintf(1,60 batches of 1000 cases each. \n);load mnistvhload mnisthpload mnisthp2load mnistpo makebatches;[numcases numdims numbatches]=size(batchdata);N=numcases; %%%% PREINITIALIZE WEIGHTS OF THE AUTOENCODER %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%w1=[vishid; hidrecbiases];w2=[hidpen; penrecbiases];w3=[hidpen2; penrecbiases2];w4=[hidtop; toprecbiases];w5=[hidtop; topgenbiases]; w6=[hidpen2; hidgenbiases2]; w7=[hidpen; hidgenbiases]; w8=[vishid; visbiases];%%%%%%%%%% END OF PREINITIALIZATIO OF WEIGHTS %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%l1=size(w1,1)-1;l2=size(w2,1)-1;l3=size(w3,1)-1;l4=size(w4,1)-1;l5=size(w5,1)-1;l6=size(w6,1)-1;l7=size(w7,1)-1;l8=size(w8,1)-1;l9=l1; test_err=[];train_err=[];for epoch = 1:maxepoch%%%%%%%%%%%%%%%%%%%% COMPUTE TRAINING RECONSTRUCTION ERROR %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%err=0; [numcases numdims numbatches]=size(batchdata);N=numcases; for batch = 1:numbatches data = [batchdata(:,:,batch)]; data = [data