汉语词同现网络的小世界效应和无标度特性刘知远,孙茂松.pdf

汉语词同现网络的小世界效应和无标度特性 刘知远，孙茂松 （清华大学计算机科学与技术系，清华信息科学与技术国家实验室，北京 100084 ） 摘 要：人类语言的某些重要方面可以通过复杂网络来刻画。本文基于不同规模和类型的语料库，建立了汉语 词同现网络，并从复杂网络的角度对这些网络进行了系统的实验考察。实验结果表明汉语词同现网络具有复杂 网络的两个基本性质：(1) 网络的平均最短路径为2.63-2.75 ，聚合系数远大于相同参数下的随机网络，这揭示了 汉语同现网络的小世界效应；(2) 网络中词的度大体上呈幂律分布，表明汉语同现网络具有无标度特性。本文还 对实验中所得到的汉语核心词典进行了定量分析。 关键词：词的同现；复杂网络；小世界；无标度；核心词典 中图分类号：TP391 Chinese Word Co-occurrence Network: Its Small World Effect and Scale-free Property Liu Zhi-yuan, Sun Mao-song (Department of Computer Science and Technology, Tsinghua University, Beijing 100084) Abstract ：Some perspectives of human languages can be characterized by complex network analysis. In this paper, word co-occurrence networks for the Chinese language are automatically constructed based on very large manually word-segmented Chinese corpora with different size and style at first. Then systematic observations on these networks are made from the complex network’s point of view. Experimental results show that these networks display two important features of complex networks: (1) The average distance between two words is 2.63-2.75, and the clustering coefficient is much greater than that given by a random network with the same parameters, exhibiting a typical small-world effect; and (2) The degree distributions of these networks generally obey the power-law, i.e., the scale-free property. Related factors of kernel lexicons derived from these experiments are also discussed in a quantitative way. Keywords: word co-occurrence; complex networks; small world; scale-free; kernel lexicon 1.引言 自然界和人类社会中的大量复杂系统，如生态网、神经网、Internet 、社会网络等，越来越成为相关学科的 研究热点。复杂网络理论则试图在这些互不相同的复杂网络之中找出它们的共性规律。 20世纪的后40年里，Erdos和Renyi[1]建立的随机图理论(ER模型)一直是人们研究复杂网络