压实度的改进.pptx

压实度的改进汇报人简介：***科技领域专家，工程师About myselfBeen working on HBase for 6 yearsHBase committer / PMCSenior Staff Engineer at HortonworksPage ? Hortonworks Inc. 2014Date Tiered CompactionInspired by Cassandra’s Date Tiered CompactionWrite access pattern is mainly sequential writes by time of data arrivalRead access pattern is mainly time-range scansPage ? Hortonworks Inc. 2014Date Tiered Compaction Cont’dNew time windows appearOld ones get merged into exponentially largerwindowsFrom /2014/12/18/date-tiered-compaction/h/2014/12/18/date-tiered-compaction/t/2014/12/18/date-tiered-compaction/tps://labs.s/2014/12/18/date-tiered-compaction/p/2014/12/18/date-tiered-compaction/ot/2014/12/18/date-tiered-compaction///2014/12/18/date-tiered-compaction/2/2014/12/18/date-tiered-compaction/014//2014/12/18/date-tiered-compaction/1/2014/12/18/date-tiered-compaction/2//2014/12/18/date-tiered-compaction/1/2014/12/18/date-tiered-compaction/8/2014/12/18/date-tiered-compaction//dat/2014/12/18/date-tiered-compaction/e/2014/12/18/date-tiered-compaction/-/2014/12/18/date-tiered-compaction/ti/2014/12/18/date-tiered-compaction/e/2014/12/18/date-tiered-compaction/re/2014/12/18/date-tiered-compaction/d/2014/12/18/date-tiered-compaction/-/2014/12/18/date-tiered-compaction/comp/2014/12/18/date-tiered-compaction/a/2014/12/18/date-tiered-compaction/ctio/2014/12/18/date-tiered-compaction/n/2014/12/18/date-tiered-compaction//Page ? Hortonworks Inc. 2014Major config parametersBase window: smallest time window for first tierWindows per tier: scale factor of window sizes from one tier to the nextMax storefile age: how old it has to be before compaction stops – biggest tierIncoming windows threshold: number of files in incoming window before we compact to first tier/book.html#ops.date.tieredhttp://book.html#ops.date.tiered//book.html#ops.date.tieredhb/book.html#ops.date.tiereda/book.html#ops.date.tieredse.ap/book.html#ops.date.tiereda/book.html#ops.date.tieredch/book.html#ops.date.tierede/book.html#ops.date.tiere