- 1、本文档共10页,可阅读全部内容。
- 2、原创力文档(book118)网站文档一经付费(服务费),不意味着购买了该文档的版权,仅供个人/单位学习、研究之用,不得用于商业用途,未经授权,严禁复制、发行、汇编、翻译或者网络传播等,侵权必究。
- 3、本站所有内容均由合作方或网友上传,本站不对文档的完整性、权威性及其观点立场正确性做任何保证或承诺!文档内容仅供研究参考,付费前请自行鉴别。如您付费,意味着您自己接受本站规则且自行承担风险,本站不退款、不进行额外附加服务;查看《如何避免下载的几个坑》。如果您已付费下载过本站文档,您可以点击 这里二次下载。
- 4、如文档侵犯商业秘密、侵犯著作权、侵犯人身权等,请点击“版权申诉”(推荐),也可以打举报电话:400-050-0827(电话支持时间:9:00-18:30)。
查看更多
Effective Early Termination Techniques for Text Similarity Join Operator
Effective Early Termination Techniques for
Text Similarity Join Operator*
Selma Ayse ?zalp1, and ?zgür Ulusoy2
1Department of Industrial Engineering, Uludag University, 16059 Gorukle Bursa, Turkey
ayseozalp@.tr
.tr/~ayseozalp
2Department of Computer Engineering, Bilkent University, 06800 Bilkent Ankara, Turkey
oulusoy@.tr
Abstract. Text similarity join operator joins two relations if their join attributes are
textually similar to each other, and it has a variety of application domains including
integration and querying of data from heterogeneous resources; cleansing of data;
and mining of data. Although, the text similarity join operator is widely used, its
processing is expensive due to the huge number of similarity computations
performed. In this paper, we incorporate some short cut evaluation techniques from
the Information Retrieval domain, namely Harman, quit, continue, and maximal
similarity filter heuristics, into the previously proposed text similarity join
algorithms to reduce the amount of similarity computations needed during the join
operation. We experimentally evaluate the original and the heuristic based similarity
join algorithms using real data obtained from the DBLP Bibliography database, and
observe performance improvements with continue and maximal similarity filter
heuristics.
1 Introduction
The text similarity join operator, as its name implies, joins two relations if their join
attributes, which consist of pure text, are highly similar to each other. The similarity
between join attributes is determined by well-known techniques such as tf-idf weighting
scheme [1] and cosine similarity measure from the Information Retrieval (IR) domain.
The text similarity join operator has various application domains. Cohen [2], Gravano et
al. [3], and Schallehn et al. [4] use this operator for the integration of data from
distributed, heterogeneous databases that lack common formal object identifiers. For
instance, in two Web d
您可能关注的文档
- Control of smoke flow in tunnel fires.pdf
- Controlled light storage in a double lambda system.pdf
- Controller Inside Card (VW3 A3 501).pdf
- Controlling factors of spring-summer phytoplankton succession in Lake Taihu.pdf
- Controlling_size_and_yield_of_zeolite_Y_nanocrystals_using.pdf
- Controlling+NonPoint+Source+Pollution+in+Australian+Agricultural+Systems.pdf
- conversation between china and america.ppt
- Conversation class 4 Games.ppt
- Conversation Errors in Web Service Coordination Run-time Detection and Repair.pdf
- CONVERSATIONAL INTERACTIVITY IN SLOW-MOTION A COMPARISON OF PHONE DIALOGUES AND OPERA SCENE.pdf
文档评论(0)