（九）在线学习.pdfVIP

鍦ㄧ嚎瀛︿範锛圤nline Learning 锛 JerryLead csxulijie@ 鍘熼鐩彨鍋歍he perception and large margin classifiers 锛屽叾瀹炴帰璁ㄧ殑鏄湪绾垮涔犮€傝繖閲屽皢 棰樼洰鎹簡鎹€備互鍓嶈璁虹殑閮芥槸鎵归噺瀛︿範锛坆atch learning锛夛紝灏辨槸缁欎簡涓€鍫嗘牱渚嬪悗锛屽湪鏍蜂緥涓 瀛︿範鍑哄亣璁惧嚱鏁癶銆傝€屽湪绾垮涔犲氨鏄鏍规嵁鏂版潵鐨勬牱渚嬶紝杈瑰涔狅紝杈圭粰鍑虹粨鏋溿€ 鍋囪鏍蜂緥鎸夌収鍒版潵鐨勫厛鍚庨『搴忎緷娆″畾涔変负(肀 (1), 肀 (1) ), (肀 (2), 肀 (2) ), 鈥? (肀 (饊仛), 肀 (饊仛)) 銆俋 涓烘牱 鏈壒寰侊紝y 涓虹被鍒爣绛俱€傛垜浠殑浠诲姟鏄埌鏉ヤ竴涓牱渚媥 锛岀粰鍑哄叾绫诲埆缁撴灉y 鐨勯娴嬪€硷紝涔嬪悗 鎴戜滑浼氱湅鍒皔 鐨勭湡瀹炲€硷紝鐒跺悗鏍规嵁鐪熷疄鍊兼潵閲嶆柊璋冩暣妯″瀷鍙傛暟锛屾暣涓繃绋嬫槸閲嶅杩唬鐨勮繃绋嬶紝 鐩村埌鎵€鏈夌殑鏍蜂緥瀹屾垚銆傝繖涔堢湅鏉ワ紝鎴戜滑涔熷彲浠ュ皢鍘熸潵鐢ㄤ簬鎵归噺瀛︿範鐨勬牱渚嬫嬁鏉ヤ綔涓哄湪绾垮涔 鐨勬牱渚嬨€傚湪鍦ㄧ嚎瀛︿範涓垜浠富瑕佸叧娉ㄥ湪鏁翠釜棰勬祴杩囩▼涓娴嬮敊璇殑鏍蜂緥鏁般€ 鎷夸簩鍊煎垎绫绘潵璁诧紝鎴戜滑鐢▂=1 琛ㄧず姝ｄ緥锛寉=-1 琛ㄧず璐熶緥銆傚洖鎯冲湪璁ㄨ鏀寔鍚戦噺鏈轰腑鎻愬埌 鐨勬劅鐭ョ畻娉曪紙perception algorithm 锛夈€傛垜浠殑鍋囪鍑芥暟涓 鍏朵腑x 鏄痭 缁寸壒寰佸悜閲忥紝胃鏄痭+1 缁村弬鏁版潈閲嶃€傚嚱鏁癵 鐢ㄦ潵灏嗮€寖饊亣 肀ヨ绠楃粨鏋滄槧灏勫埌-1 鍜? 涓娿€傚叿浣撳叕寮忓涓嬶細 杩欎釜涔熸槸logistic 鍥炲綊涓璯 鐨勭畝鍖栧舰寮忋€ 鐜板湪鎴戜滑鎻愬嚭涓€涓湪绾垮涔犵畻娉曞涓嬶細 鏂版潵涓€涓牱渚?x, y) 锛屾垜浠厛鐢ㄤ粠涔嬪墠鏍蜂緥瀛︿範鍒扮殑鈩庰€寖 (肀?鏉ュ緱鍒版牱渚嬬殑棰勬祴鍊 y 锛屽鏋 鈩庰€寖 (肀? = 肀 锛堝嵆棰勬祴姝ｇ‘锛夛紝閭ｄ箞涓嶆敼鍙樜革紝鍙嶄箣 胃 鈮 胃 + yx 涔熷氨鏄锛屽鏋滃浜庨娴嬮敊璇殑鏍蜂緥锛屛歌繘琛岃皟鏁存椂鍙渶鍔犱笂锛堝疄闄呬笂涓烘渚嬶級鎴栬€呭噺 鍘伙紙瀹為檯璐熶緥锛夋牱鏈壒寰亁 鍊煎嵆鍙€偽稿垵濮嬪€间负鍚戦噺0 銆傝繖閲屾垜浠叧蹇冪殑鏄€寖饊亣 x 鐨勭鍙凤紝鑰屼笉 鏄畠鐨勫叿浣撳€笺€傝皟鏁存柟娉曢潪甯哥畝鍗曘€傜劧鑰岃繖涓畝鍗曠殑璋冩暣鏂规硶杩樻槸寰堟湁鏁堢殑锛屽畠鐨勯敊璇巼涓 浠呮槸鏈変笂鐣岀殑锛岃€屼笖杩欎釜涓婄晫涓嶄緷璧栦簬鏍蜂緥鏁板拰鐗瑰緛缁村害銆 涓嬮潰瀹氱悊闃愯堪浜嗛敊璇巼涓婄晫锛 瀹氱悊锛圔lock and Novikoff锛夛細 缁欏畾鎸夌収椤哄簭鍒版潵鐨?肀 (1), 肀 (1) ), (肀 (2), 肀 (2) ), 鈥? (肀 (饊仛), 肀 (饊仛))鏍蜂緥銆傚亣璁惧浜庢墍鏈夌殑鏍蜂緥 鈥栱饱 (饊仏) 鈥 鈮 D 锛屼篃灏辨槸璇寸壒寰佸悜閲忛暱搴︽湁鐣屼负 D 銆傛洿杩涗竴姝ワ紝鍋囪瀛樺湪涓€涓崟浣嶉暱搴﹀悜閲 ( ) ( ) ( ) 鈥 鈥 (饊仏) 饊亣 饊仏 饊亣 饊仏 饊亣 饊仏 u ( 饊仮 = 1)涓攜 鈭 (饊仮 肀 ) 鈮 饊嬀 銆備篃灏辨槸璇村浜巠=1 鐨勬渚嬶紝(饊仮 肀 ) 鈮 饊嬀 锛屽弽渚?饊仮 肀 ) 鈮 鈭掟€嬀 锛 2 u 鑳藉鏈夝€嬀 鐨勯棿闅斿皢姝ｄ緥鍜屽弽渚嬪垎寮€銆傞偅涔堟劅鐭ョ畻娉曠殑棰勬祴鐨勯敊璇牱渚嬫暟涓嶈秴杩?D) 銆