迁移学习算法研究.pptxVIP

迁移学习算法研究 庄福振 中国科学院计算技术研究所 2016 年 4 月 18 日 2 传统监督机器学习(1/2) 2020-8-20 [from Prof. Qiang Yang] 传统监督机器学习(2/2) 3 2020-8-20 传统监督学习 迁移学习 4 2020-8-20 实际应用学习场景 迁移 学习 运用已有的知识对不同但相关领域问题进行求解的一种新的机器学习方法 放宽了传统机器学习的两个基本假设 迁移学习场景(1/4) 5 2020-8-20 迁移学习场景无处不在 异构特征空间 6 The apple is the pomaceous fruit of the apple tree, species Malus domestica in the rose family Rosaceae ... Banana is the common name for a type of fruit and also the herbaceous plants of the genus Musa which produce this commonly eaten fruit ... Training: Text Future: Images Apples Bananas 迁移学习场景(2/4) 2020-8-20 [from Prof. Qiang Yang] Xin Jin, Fuzhen Zhuang, Sinno Jialin Pan, Changying Du, Ping Luo, Qing He: Heterogeneous Multi-task Semantic Feature Learning for Classification. CIKM 2015 : 1847-1850. Test Test Training Training Classifier Classifier 72.65% DVD Electronics Electronics 84.60% Electronics Drop! 迁移学习场景(3/4) 7 2020-8-20 [from Prof. Qiang Yang] 8 DVD Electronics Book Kitchen Clothes Video game Fruit Hotel Tea Impractical! 迁移学习场景(4/4) 2020-8-20 [from Prof. Qiang Yang] Outline Concept Learning for Transfer Learning Concept Learning based on Non-negative Matrix Tri-factorization for Transfer Learning Concept Learning based on Probabilistic Latent Semantic Analysis for Transfer Learning Transfer Learning using Auto-encoders Transfer Learning from Multiple Sources with Autoencoder Regularization Supervised Representation Learning: Transfer Learning with Deep Auto-encoders 9 2020-8-20 Concept Learning based on Non-negative Matrix Tri-factorization for Transfer Learning Concept Learning for Transfer Learning 10 2020-8-20 Introduction Many traditional learning techniques work well only under the assumption: Training and test data follow the same distribution Training (labeled) Classifier Test (unlabeled) Enterprise News Classification: including the classes “Product Announcement”, “Business scandal”, “Acquisition”, … … Product announcement: HPs just-released LaserJet Pro P1100 printe