网络环境下的大规模内容计算-PowerPointPre.pptxVIP

网络环境下的大规模内容计算 ------ Web Search and Web Mining;Outline;;抛开争论看Web搜索的发展;Web Mining：海量信息空间内的知识发现;“Web 2.0”：热闹背后有什么？;Motivation:“问题还是那个问题，目标不再是那个目标”;Outline;Organizations of ICT;Related works in I3S@ICT;Data Stream Management;Query Processing Multiple filtering queries processing on single stream Join algorithms on multiple streams Data Stream mining Frequent patterns discovery Clustering Emergence prediction … ;Multiple Strings Matching;Partition: Combinatorial Optimization Matching (ICT-COM);Optimization Analysis 4 subsets were given by COM and assigned with different algorithms. 3-9(AC)，10-13(SBOM)，14-35(SBOM)，36-210(SBOM) The speed of COM is about 3 times faster than the quickest classical one. ICT-COM is an efficient large-scale string matching algorithm. ;Lexical Processing;HHMM Architecture in ICTCLAS III;Class-based segmentation;Role-based Unknown word recognition;Chinese New Word Identification;Chinese New Word Identification;Recognition Sample;Text Mining;From the view of granularity, clustering is a procedure in a uniform granularity, while classification in different granularities. illustration:;;DragPushing as a refinement strategy to enhance the performance of the latter high-speed text classifiers, such as CB or Rocchio. The main motivation behind this strategy is the hypothesis that there still exists room for performance improvement because the learning algorithm itself may have inductive bias, or the text collection may misfit the learning model to some degree. ;DragPushing;训练与分类时间： 与Centroid相当;现象 一套集中式的计算方法为所有类型的用户提供服务往往是众口难调。Google等检索的前提同样的输入总有一个最符合 “大多数”人群需求的结果集。遗憾的是，网络中，“少数人的需求”才是真正的大多数 网络信息的实时性、动态性、多样性和巨大规模只能使得集中式检索放弃传统查全率概念，与此同时仍然避免不了大量的垃圾。 原因分析 一方面是知识不完全、计算不完备情况下的集中、近似计算 另一方面是存在大规模个性差异的信息需求 二者的本身是“不匹配”的 直观求解 人人平等：每个人都是需求方也都是提供方，没有传统意义上的独立服务器 各人自扫门前雪：我只关注我想要的东西和我能提供的东西 人人为我，我为人人：遵循最基本的原则，包括内容路由规则、SW Effect, PL等;P2P计算与构造个性化信息空间的初步设想;WonGoo : 基于P2P的内容关联平台;WonGoo@WAX ： Researcher Network;Community Identification ;Outline;共享系统与算法工具包;定位１：小规模