澶у濂?灏忛槼鏉ヤ负澶у瑙ｇ瓟浠ヤ笂鐨勯棶棰樸€備俊鎭鐩婂拰淇℃伅澧炵泭鐜囩殑鍖哄埆锛屼俊鎭鐩婅繖涓緢澶氫汉杩樹笉鐭ラ亾,鐜板湪璁╂垜浠竴璧锋潵鐪嬬湅鍚э紒
1銆佷俊鎭鐩婏紙kullback鈥揕eibler divergence锛夊張绉癷nformation divergence锛宨nformation gain锛宺elative entropy 鎴栬€匥lic銆?/p>
2銆佷俊鎭鐩婂湪姒傜巼璁哄拰淇℃伅璁轰腑锛屼俊鎭鐩婃槸闈炲绉扮殑锛岀敤浠ュ害閲忎袱绉嶆鐜囧垎甯働鍜孮鐨勫樊寮傘€?/p>
3銆佷俊鎭鐩婃弿杩颁簡褰撲娇鐢≦杩涜缂栫爜鏃讹紝鍐嶄娇鐢≒杩涜缂栫爜鐨勫樊寮傘€?/p>
4銆侀€氬父p浠ｈ〃鏍锋湰鎴栬瀵熷€肩殑鍒嗗竷锛屼篃鏈夊彲鑳芥槸绮剧‘璁＄畻鐨勭悊璁哄垎甯冦€?/p>
5銆丵浠ｈ〃涓€绉嶇悊璁猴紝妯″瀷锛屾弿杩版垨鑰呭p鐨勮繎浼笺€?/p>
6銆佸敖绠′俊鎭鐩婇€氬父琚洿瑙傚湴浣滀负鏄竴绉嶅害閲忔垨璺濈锛屼絾浜嬪疄涓婁俊鎭鐩婂苟涓嶆槸銆?/p>
7銆佸氨姣斿淇℃伅澧炵泭涓嶆槸瀵圭о鐨勶紝浠嶱鍒癚鐨勪俊鎭鐩婇€氬父涓嶇瓑浜庝粠q鍒癙鐨勪俊鎭鐩娿€?/p>
8銆佷俊鎭鐩婃槸f澧炵泭锛坒-divergences锛夌殑涓€绉嶇壒娈婃儏鍐点€?/p>
9銆佸湪1951骞寸敱solomon kullback 鍜孯ichard leibler棣栧厛鎻愬嚭浣滀负涓や釜鍒嗗竷鐨勭洿鎺ュ鐩婏紙directed divergence锛夈€?/p>
10銆佸畠涓庡井绉垎涓殑澧炵泭涓嶅悓锛屼絾鍙互浠嶣regman澧炵泭锛圔regman divergence锛夋帹瀵煎緱鍒般€?/p>
鏈枃鍒版鍒嗕韩瀹屾瘯锛屽笇鏈涘澶у鏈夋墍甯姪銆?/p>