信息论基本公式
熵：<Object: word/embeddings/oleObject1.bin>
联合熵：
<Object: word/embeddings/oleObject2.bin>
条件熵：
<Object: word/embeddings/oleObject3.bin>
熵的链式规则：
<Object: word/embeddings/oleObject4.bin>
<Object: word/embeddings/oleObject5.bin>
<Object: word/embeddings/oleObject6.bin>
相对熵（Kullback Leibler Distance）：
<Object: word/embeddings/oleObject7.bin>
，p，q为两个概率分布。
互信息：
<Object: word/embeddings/oleObject8.bin>
<Object: word/embeddings/oleObject9.bin>
条件互信息：
<Object: word/embeddings/oleObject10.bin>
互信息的 ...