深入浅出HBase培训课件.ppt

HMaster、HRegionServer、HRegion、Store、MemStore、StoreFile、HLog、HFile、KeyValue 冗余master时：需要在conf中创建backup-masters文件，增加冗余master的主机名 groupIdorg.apache.hbase/groupId artifactIdhbase-client/artifactId version0.98.8-hadoop2/version 未验证 importtsv -Dimporttsv.columns=HBASE_ROW_KEY,cf:reportTime,cf:msisdn,cf:apmac,cf:acmac:cf:host,cf:siteType,cf:upPackNum,cf:downPackNum,cf:upPayLoad,cf:downPayLoad,cf:httpStatus -Dimporttsv.bulk.output=hdfs://itcast221:9000/temp datatsv hdfs://itcast221:9000/wlanout/part-r-00000 create test,base,cf,data put test,key1,base:name,baseName1 put test,key2,base:name,baseName2 put test,key3,base:name,baseName3 put test,key1,base:age,baseAge1 put test,key2,base:age,baseAge2 put test,key3,base:age,baseAge3 put test,key1,data:name,dataName1 put test,key2,data:name,dataName2 put test,key3,data:name,dataName3 put test,key1,data:age,dataAge1 put test,key2,data:age,dataAge2 put test,key3,data:age,dataAge3 put test,key1,cf:name,cfName1 put test,key2,cf:name,cfName2 put test,key3,cf:name,cfName3 put test,key1,cf:age,cfAge1 put test,key2,cf:age,cfAge2 put test,key3,cf:age,cfAge3 Hbase到Hive使用 同一个列族，不同的列限定符 CREATE EXTERNAL TABLE hbase_table_2(key string, name string,age String)STORED BY org.apache.hadoop.hive.hbase.HBaseStorageHandler WITH SERDEPROPERTIES (hbase.columns.mapping = cf:name,cf:age) TBLPROPERTIES( = test); Hbase到Hive使用 不同列族，不同列限定符 CREATE EXTERNAL TABLE hbase_table_3(key string, base_name string,base_age String,cf_name string, cf_age String)STORED BY org.apache.hadoop.hive.hbase.HBaseStorageHandler WITH SERDEPROPERTIES (hbase.columns.mapping = base:name,base:age,cf:name,cf:age) TBLPROPERTIES( = test); hive到Hbase的使用 在hive中创建一张临时中间表 create table hbase_temp(key int,val string) row format delimited fields terminated by ,; 批量导入数据 load data local inpath /root/1.txt overwrite into table hbase_temp; 从临时表加载数据到hbase_table 单列族数据导入 insert overwrite table hbase_table select * from hbase_temp; 多列族数据导入 insert overwrite table hbase_table_1 partition (day=2