Information Retrieval amp; Web Information Access.ppt

Inverted Indexing with MapReduce Built-In Shuffle and Sort: aggregate values by keys Map Reduce D1: java resource java class D2: java travel resource D3: … Key Value java (D1, 2) resource (D1, 1) class (D1,1) Key Value java (D2, 1) travel (D2,1) resource (D2,1) Key Value java {(D1,2), (D2, 1)} resource {(D1, 1), (D2,1)} class {(D1,1)} travel {(D2,1)} … Slide adapted from Jimmy Lin’s presentation MIAS Tutorial Summer 2011 * Inverted