基于改进决策树算法的网络关键资源页面判定-清华大学智能技术与.pdf

1000-9825/2005/16(11)1958 ©2005 Journal of Software Vol.16, No.11 ∗ + , , ((), 100084) Web Key Resource Page Judgment Based on Improved Decision Tree Algorithm + LIU Yi-Qun , ZHANG Min, MA Shao-Ping (State Key Laboratory of Intelligent Technology and Systems (Tsinghua University), Beijing 100084, China) + Corresponding author: Phn: +86-10 E-mail: liuyiqun03@, Received 2004-07-26; Accepted 2005-06-02 Liu YQ, Zhang M, Ma SP. Web key resource page judgment based on improved decision tree algorithm. Journal of Software, 2005,16(11):1958−1966. DOI: 10.1360/jos161958 Abstract : Key resource page is one of the most important search target pages for Web search users. Decision tree learning is one of the most widely-used and practical methods for inductive inference in machine learning. Because of the difficulty in uniform sampling of Web pages, there are not enough negative instances for training a key resource decision tree. To solve the problem, the original algorithm is partly modified to learn from global instead of individual instance information. With the same evaluation method as TREC (Text Retrieval Conference) 2003, large scale retrieval experiments based on improved decision tree algorithm achieves more than 40% improvement than the ones based on the original algorithm. It not only offers an effective way for selecting Web key resource pages, but also shows a possible way to improve decision tree learning performances. Key words: Web information retrieval; key resource page; machine learning; decision tree : ,. ,. Web , . , , . 2003