斯坦福ML公开课笔记12.PDFVIP

/yanxiangzhang /stdcoutzyx 鏂潶绂廙L 鍏紑璇剧瑪璁?2 鏈枃瀵瑰簲鏂潶绂廙L 鍏紑璇剧殑绗?2 涓棰戯紝绗?2 涓棰戜笌鍓嶉潰鐩稿叧鎬у苟涓嶅ぇ锛屽紑鍚簡 涓€涓柊鐨勮瘽棰樷€斺€旀棤鐩戠潱瀛︿範銆備富瑕佸唴瀹瑰寘鎷棤鐩戠潱瀛︿範涓殑K 鍧囧€艰仛绫?K-means)绠楁硶锛 娣峰悎楂樻柉鍒嗗竷妯″瀷(Mixture of Gaussians, MoG)锛屾眰瑙oG 妯″瀷鐨凟M 绠楁硶锛屼互鍙奅M 鐨勪竴 鑸寲褰㈠紡锛屽湪EM 鐨勪竴鑸寲褰㈠紡涔嬪墠锛岃繕鏈変竴涓皬鐭ヨ瘑鐐癸紝鍗矹ensen 涓嶇瓑寮?Jensen鈥檚 inequality) 銆 K-Means 绠楁硶 鍦ㄤ箣鍓嶇殑绠楁硶鍜屾ā鍨嬩腑锛岃缁冩暟鎹兘鏄甫鏈夋爣璁扮殑锛岃繖鏍风殑绠楁硶鏄湁鐩戠潱瀛︿範銆傚綋璁粌 鏁版嵁娌℃湁鏍囪鏃讹紝鎴愪负鏃犵洃鐫ｅ涔犮€傝仛绫荤畻娉曞氨鏄棤鐩戠潱瀛︿範鏈€甯歌鐨勪竴绉嶏紝缁欏畾涓€缁勬暟鎹紝 闇€瑕佽仛绫荤畻娉曞幓鍙戞帢鏁版嵁涓殑闅愯棌缁撴瀯銆 鑱氱被绠楁硶搴旂敤寰堝箍銆備妇渚嬫潵璇达紝瀵瑰熀鍥犺繘琛岃仛绫伙紝鍙互鍙戞帢涓嶅悓鐗╃涓叿鏈夌浉鍚屽姛鑳界殑 鍩哄洜鐗囨锛涘椤惧琛屼负杩涜鑱氱被鍙互鎶婂競鍦哄垎涓轰笉鍚岀殑鍑犱釜閮ㄥ垎锛岄拡瀵逛笉鍚岀殑椤惧鍙互閲囩敤 涓嶅悓鐨勪績閿€绛栫暐锛涘湪 google 鐨勬柊闂婚椤碉紝瀵规柊闂昏繘琛岃仛绫伙紝浣垮緱鎻忚堪鍚屼竴浜嬩欢鐨勬姤閬撲笉鍏 閮ㄥ睍绀猴紱鍦ㄥ浘鐗囧垎鍓蹭腑锛屽彲浠ュ埄鐢ㄥ浘鐗囦笉鍚岄儴鍒嗙殑鐩镐技鎬ф潵鐞嗚В鍥剧墖淇℃伅绛夈€ ( ) ( ) 1 2 (肀? 涓嬮潰瀵筀-Means 绠楁硶鐨勬祦绋嬭繘琛屼粙缁嶏紝缁欏畾杈撳叆鏁版嵁涓篠 = *肀 ,肀 , 鈥?肀 +锛孠-Means 绠楁硶濡備笅锛 1) 閫夋嫨鍒濆鐨刱 涓仛绫讳腑蹇凁€寚 ,饊寚 , 鈥?饊寚 鈭 鈩濏睕 1 2 肀 2) 瀵规瘡涓牱鏈暟鎹潵璇达紝灏嗗叾绫诲埆鏍囧彿璁句负璺濈鍏舵渶杩戠殑鑱氱被涓績鐨勬爣鍙凤紝鍗 (i) (肀? label = 肀庰€仧肀攎in ||肀 鈭掟€寚 || (1) 肀 肀 3) 灏嗘瘡涓仛绫讳腑蹇冪殑鍊兼洿鏂颁负涓庤绫诲埆涓績鐩稿悓绫诲埆鐨勬墍鏈夋牱鏈殑骞冲潎鍊硷紝鍗 肀 ( ) 鈭 肀 (肀? 肀朂1戆?肀欗睅肀忢睊肀 =肀?肀 饊寚 鈮 (2) 肀 肀 ( ) 鈭 肀 肀朂1戆?肀欗睅肀忢睊肀 =肀? 4) 閲嶅绗? 姝ュ拰绗? 姝ワ紝鐩村埌鑱氱被涓績鐨勫彉鍖栦綆浜庨槇鍊间负姝 瀵逛簬K-Means 鏉ヨ锛屽畠瑕佷紭鍖栫殑鐩爣鍑芥暟鍙互鐪嬫垚濡備笅褰㈠紡锛 肀