GPSInformationandRate-ToleranceGPS信息和限误差信息率.PDFVIP

GPS Information and Rate-Tolerance and its Relationships with Rate Distortion and Complexity Distortions Chenguang LU1 Abstract: I proposed rate tolerance and discussed its relation to rate distortion in my book “A Generalized Information Theory” published in 1993. Recently, I examined the structure function and the complexity distortion based on Kolmo- gorov’s complexity theory. It is my understanding now that complexity-distortion is only a special case of rate tolerance while constraint sets change from fuzzy sets into clear sets that look like balls with the same radius. It is not true that the complexity distortion is generally equivalent to rate distortion as claimed by the researchers of complexity theory. I con- clude that a rate distortion function can only be equivalent to a rate tolerance function and both of them can be described by a generalized mutual information formula where P(Y|X) is equal to P(Y|Tolerance). The paper uses GPS as an example to derive generalized information formulae and proves the above conclusions using mathematical analyses and a coding example. The similarity between the formula for measuring GPS information and the formula for rate distortion function can deepen our understanding the generalized information measure. Keywords: generalized information, semantic information; GPS information; rate distortion; data compression; Kullback formula; Bayesian formula GPS 信息和限误差信息率 ——及其和信息率失真及复杂性失真之间的关系 鲁晨光 1 摘 要：在我 1993 年发表的《广义信息论》中，我提出限误差信息率(或者叫: 信息率容差，rate-tolerance)并讨 论了它和信息率失真之间的关系。最近我了解到 Kolmogorov 的结构函数及基于其复杂性理论的复杂性失真。我 现在知道复杂性失真只是限误差信息率在限制集合由模糊变为清晰并呈球形时的特例; 复杂性理论研究者肯定 的复杂性失真和信息率失真之间的一般等价关系是不对的；一个信息率失真函数只能等价于一个特定的限误差信 息率函数，两者都能用P(Y|X )=|P(Y|容许误差)时的广义互信息公式描述。文中用 GPS 作为例子推导出广义信息公 式，并且通过数学分析和编码举例证明了上述结论