Learning Random Walk Models for Inducing Word Dependency学习随机游走模型对词的依赖性.pptVIP

Learning Random Walk Models for Inducing Word Dependency Distributions Kristina Toutanova Christopher D. Manning Andrew Y. Ng Word-specific information is important for many NLP disambiguation tasks Language modeling for speech recognition I would like to make a collect …. ? Need a good estimate of P(coal|collect) P(cow|collect) P(call|collect) Sparseness: 1 million words is very little data The number of parameters to be estimated is very large – for a vocabulary size of 30,000 words, we have 900 million pair-wise parameters Pair-wise statistics involving two wor