信息检索7-西北工业大学课件.ppt

Chen Qun School of Computer, NWPU 11/2016;Today;Content Analysis;Techniques for Content Analysis;Text Processing;Document Processing Steps;Statistical Properties of Text;Plotting Word Frequency by Rank;Plotting Word Frequency by Rank;Many similar distributions…;Zipf Distribution(linear and log scale);Zipf Distribution;Rank Freq1 37 system2 32 knowledg3 24 base4 20 problem5 18 abstract6 15 model7 15 languag8 15 implem9 13 reason10 13 inform11 11 expert12 11 analysi13 10 rule14 10 program15 10 oper16 10 evalu17 10 comput18 10 case19 9 gener20 9 form;Zoom in on the Knee of the Curve;Zipf Distribution;Resolving Power (van Rijsbergen 79);Stemming and Morphological Analysis;Simple “S” stemming;Stemmer Examples;;Automated Methods;中文分词技术-必要性;中文分词技术;中文分词技术-难在哪;中文分词技术-难在哪;Assumptions in IR;Statistical Independence;Statistical Independence and Dependence;Statistical Independence vs. Statistical Dependence;Lexical Associations;;;Keyword Correlation