The Shannon entropy of a message is the number of binary digits, or bits, needed to encode it.

• 一个讯息中的夏侬熵就是将此讯息编码所需的位元数目。