MapReduce操作案例47课件讲解.pptxVIP

MapReduce操作案例

词频统计分布式计算应用目录

词频统计01

词频统计需求统计单词出现的次数数据样例代码实现：MapperpublicstaticclassTokenizerMapperextendsMapperObject,Text,Text,IntWritable{privatefinalstaticIntWritableone=newIntWritable(1);privateTextword=newText();publicvoidmap(Objectkey,Textvalue,Contextcontext)throwsIOException,InterruptedException{StringTokenizeritr=newStringTokenizer(value.toString());while(itr.hasMoreTokens()){word.set(itr.nextToken());context.write(word,one);}}}

词频统计代码实现：ReducerpublicstaticclassIntSumReducerextendsReducerText,IntWri