認證數(shù)據(jù)工程師Hyperbase實驗

HyperBase實驗1.進入hyperbase命令行（集群中的任何一個節(jié)點都可以）#hbaseshell2.創(chuàng)建一個test表，并使用put方式在test表中插入數(shù)據(jù)create'hbasebxu','f1'put'hbasebxu','1','f1:id','1001'put'hbasebxu','1','f1:name','xubin'put'hbasebxu','1','f1:age','18’put'hbasebxu','2','f1:id','1002'put'hbasebxu','2','f1:name','xubin'put'hbasebxu','2','f1:age','18'3.使用scan和count統(tǒng)計test表信息4.下線表，更改屬性disable'test'alter'test',{NAME=>'cf',COMPRESSION=>'snappy',DATA_BLOCK_ENCODING=>'PREFIX'}5.上線表，通過WebUI檢查更改是否生效enable'test'desc'test'6.使用Put命令單條插入數(shù)據(jù)，進行split/compaction，如下所示put'test','row4','cf:a','value4'put'test','row5','cf:b','value5'put'test','row6','cf:c','value6'flush'test'split'test','row3'delete'test','row6','cf:c'7.導(dǎo)出json文件查看表屬性describeInJson'test','true','/tmp/test.json'文件生成在本地目錄/tmp下8.查看META表，并drop表scan'hbase:meta'disable'test'drop'test'9.創(chuàng)建hyperdrive表，使用SQLBulkload批量導(dǎo)入數(shù)據(jù)beeline–ujdbc:hive2://tdh-101:10000/default-nhive-phive123droptableifexistsholo_hyperdrive;createtablebxu_hyperdrive(rowkeystring,numint,countryint,rdstring)storedashyperdrivetblproperties('hyperdrive.table.splitkey'='"110000000","120000000","130000000","140000000","150000000","160000000","170000000","180000000","190000000"');//數(shù)據(jù)準(zhǔn)備hadoopfs-mkdir/tmp/bxu/hbasehadoopfs-putdata.csv/tmp/bxu/hbase//登錄inceptor#beeline–ujdbc:hive2://tdh-101:10000/default-nhive-phive123//建表createexternaltablebxuholo_text(rowkeystring,numint,countryint,rdint)rowformatdelimitedfieldsterminatedby','location'/tmp/bxu/hbase1';showtables;select*fromholo_textlimit10;//插入數(shù)據(jù)insertoverwritetablebxu_hyperdriveselect*frombxuholo_textorderbyrowkey;10.對上一步驟創(chuàng)建的表建立索引，并查看效果hbaseshell//添加全局索引CREATEGLOBALINDEXindex_numONbxu_hyperdrive(num);//建立全局索引，在beeline中執(zhí)行rebuild_global_index'bxu_hyperdrive','index_num'//生成索引數(shù)據(jù)，在hbaseshell中執(zhí)行//結(jié)果查看select*frombxu_hyperdrivewherenum=503;//不走索引select/*+USE_INDEX(eUSINGindex_num)*/*frombxu_hyperdriveewherenum=503;//走索引beeline-ujdbc:hive2://tdh-101:10000/default-nhive-phive123select*frombxu_hyperdrivewherenum=503;setngmr.exec.mode=local;select*frombxu_hyperdrivewherenum=503;11.更改hyperbase依賴，指定hyperbase依賴ES通過ManagerWeb界面添加ES服務(wù)在hyperbase界面更改依賴，如下圖12.添加全文索引CREATEFULLTEXTINDEXONbxu_hyperdrive(num,rd)SHARDNUM1;在beeline中執(zhí)行13.生成索引數(shù)據(jù)rebuild_fulltext_index'bxu_hyperdrive'在hbaseshell中執(zhí)行14.設(shè)置local模式inceptor中：setngmr.exec.mode=local;15.在界面上查看全文索引是否創(chuàng)建成功：01:9200/_plugin/head/16.使用全文索引語法驗證全文索引能力select*frombxu_hyperdrivewherecontains(num,"term'503'")orderbynumlimit10;select*frombxu_hyperdrivewherecontains(rd,"term'50'")orderbyrdlimit10;select*frombxu_hyperdrivewherecontains(rd,"prefix'50'")orderbyrdlimit10;select*frombxu_hyperdrivewherecontains(rd,"wildcard'50*'")orderbyrdlimit10;17.全文索引的使用示例contains(列名，檢