请输入您要查询的字词:

 

单词 HartleyFunction
释义

Hartley function


Definition

The Hartley function is a of uncertainty, introduced by Hartley in 1928. If we pick a sample from a finite setMathworldPlanetmath A uniformly at random, the revealed after we know the is given by the Hartley function

H(A):=logb(|A|).

If the base of the logarithm is 2, then the uncertainty ismeasured in bits. If it is the natural logarithmMathworldPlanetmath, then the is nats. It is also known as the Hartley entropy.


Remark:

The Hartley function is a special case of Shannon’s entropyMathworldPlanetmath. Each element in the sample space A is associated with probability p=1/|A|. For an element ωA, the Hartley of the event {ω} is -log(p)=log(|A|), which is constant over ωA. The average over the whole sample space is thus also equal to log(|A|).


Characterization

The Hartley function only depends on the number of elements in aset, and hence can be viewed as a functionMathworldPlanetmath on natural numbersMathworldPlanetmath.Rényi showed that the Hartley function in base 2 is the onlyfunction mapping natural numbers to real numbers that

  1. 1.

    H(mn)=H(m)+H(n)    (),

  2. 2.

    H(m)H(m+1)    (monotonicity), and

  3. 3.

    H(2)=1    (normalization).

Condition 1 says that the uncertainty of the Cartesian product oftwo finite sets A and B is the sum of uncertainties of A andB. Condition 2 says that a larger set has larger uncertainty.

随便看

 

数学辞典收录了18232条数学词条,基本涵盖了常用数学知识及数学英语单词词组的翻译及用法,是数学学习的有利工具。

 

Copyright © 2000-2023 Newdu.com.com All Rights Reserved
更新时间:2025/5/4 22:24:27