面向时间敏感对象的垂直搜索引擎关键技术研究-计算机软件专业毕业论文.docxVIP

浙江大学博士学位论文 浙江大学博士学位论文 Abstract 要恻恻mw 捕||川川GU忧阳川qu 9州川mqJW川川川Rdw川川的 要 恻恻mw 捕 || 川川GU 忧 阳川qu 9 州川mqJW 川川川Rdw 川川的o m 恻删VE requests become more and more cle皿币le requirements for personal search and recency- sensitive search gradually heightened. As a result efficient information retrieval based on vertical search engines has become the issues of the sear咄 engine domain. By using fo- cused crawling，in阳lligent scheduling and highdimensional indexing techniques，as well ωbased on domain knowledge and personality，vertical search engines provides up to date， more personality aware and more professional search results. However，the m碍。，r problems exist in most vertical search engines areωfollows: (1) the p部sive crawling mode for crawler system results in a long delay between user query and result retrieval. (2) 由e scheduler of crawler system schedules web page crawling driftless，which makes a very low utilization for crawling resources. (3) 仙。 performance of indexing system is not settle for online upda忧民 and the mergíng results for certain unstruc阳red text objects are terrible. 币lis paper conducts fully study of these problems 制 well as the related key technologies. The major contributions of the paper are presented in the following: Firstly，it proposes a semantic based query triggered crawling (QTC) technique ω settle the problem of long delay between user query and result retrieval caused by passive crawlers. Based on domain knowledge，QTC translates user queηto request parame也rsof po阳ltial target results on domain web sites，and implements an active crawling technique fωus时 on current user queries to solve the problem. Extensive experiments and beta test in reaI commercial applications show 伽at QTC bridges the delay gap between user query and result retrieval ，and brings 10-secondlevel freshness in vertical search results. Secondly，it proposes an object-Ievel changeaware resource scheduling technique to settle the problem of low utilization of crawling resources caused by cr