淺议概率统计在语言学上应用.docVIP

摘 要 数学作为一门应用性很强的学科，如何将理论与现实问题有效结合起来是一大难题。而语言学作为一门重要的社会科学，与自然科学的精确性存在很大区别。研究现实表明数学将可以在语言学等社会学科上得到极大应用。本文首先介绍数学、语言学和数理语言学之间的关系及其内在联系，然后再从概率论和统计学两个角度分别简述其在语言学上应用。概率论方面主要介绍语言文字的熵，讨论其信息量，并以汉字为例兼论常见语言的字母熵，从而窥探每个文字背后蕴含的信息量度。统计学方面主要通过统计方法介绍语言单位的出现频率，计算作家的语言风格，以及计算语言存在的绝对年代和亲属语言分化的年代，并简要介绍齐普夫定律。 关键词： 数理语言学；概率论；统计学；熵；齐普夫定律；马尔可夫链；语言年代学 ABSTRACT Applied Mathematics, as an application of a strong discipline, has a major problem that how to combine the theory and practical problems effectively. Linguistics as an important social sciences, , has a big difference with natural sciences accuracy. The reality shows that mathematics has been greatly used in linguistics and social sciences. This paper first introduces the relationship between their internal relations of mathematics, linguistics, and mathematical linguistics, and then from two angles of the probability theory and statistics, respectively, outlined its application in linguistics. Probability theory describes the entropy of the language to discuss their information content, and on the entropy of the letters of the common language of Chinese characters, for example, in order to spy on the measure of the information contained in each text behind. In statistics we discuss on the frequency of occurrence of the linguistic unit by statistical methods, the computing language of the writers style, as well as computing language of absolute age and age of relatives of language differentiation, and then a brief introduction to Zipfs Law. Key words: Mathematical Linguistics; Probability Theory; Statistics; Entropy; Zipfs Law; Markov Chain; Glottochronology 目 录 摘要…………………………………………………………………………………Ⅰ 目录…………………………………………………………………………………Ⅱ 1数学、语言学和数理语言学………………………………………………………1 1.1数学在语言学上的渗透及其意义………………………………………………1 1.2数理语言学及其分支……………………………………………………………2 1.2.1统计语言学…………………………………………………………………2 1.2.2 代数语言学 ………………………………………………………………… 3 2概率及其在语言学中应用…………………………………………………3 2.1熵、语言的熵………………………………………………………………3 2.2汉字的熵………………………………………