試驗(yàn)4熟悉常用的HBase操作

1、實(shí)驗(yàn)4熟悉常用的HBase操作姓名：包生友專業(yè)年級：軟件 143學(xué)號：20140126991 .實(shí)驗(yàn)?zāi)康? .理解HBase在Hadoop體系結(jié)構(gòu)中的角色；2 .熟練使用HBase操作常用的Shell命令；3 .熟悉HBase操作常用的Java API。2 .實(shí)驗(yàn)環(huán)境操作系統(tǒng)：LinuxHadoop版本：2.6.0或以上版本HBase版本：1.1.2或以上版本JDK版本：1.6或以上版本Java IDE： Eclipse3 .實(shí)驗(yàn)內(nèi)容和完成情況1 .編程實(shí)現(xiàn)以下指定功能，并用 Hadoop提供的HBase Shell命令完成相同任務(wù):(完整可執(zhí)行代碼見代碼 /QuestionOne.java)

2、(1)列出HBase所有的表的相關(guān)信息，例如表名；Shell:Listhbase( nain) :OS1:list TABLEsi1In o.seconds圖1列出HBase所有表的相關(guān)信息編程：/(1)列出HBase所有的表的相關(guān)信息，例如表名、創(chuàng)建時間等public static void listTables() throws IOException init();/建立連接HTableDescriptorhTableDescriptors口 = admin.listTables();for(HTableDescriptorhTableDescriptor :hTableDescript

3、ors)System.out.println("表名:"+hTableDescriptor.getNameAsString();close();關(guān)閉連接(2)在終端打印出指定的表的所有記錄數(shù)據(jù)；Shell:scan 's1'scan '與1'ROWCOLUMH+CELL0 row(s) Ln 6.12BB 弓電亡ond6圖2打印指定表的所有記錄數(shù)據(jù)編程：/(2)在終端打印出指定的表的所有記錄數(shù)據(jù)public static void getData(String tableName)throws IOExceptioninit()；Table

4、table = connection.getTable(TableName.valueOf(tableName);Scan scan = new Scan();ResultScanner scanner = table.getScanner(scan);for (Result result:scanner)printRecoder(result);close();打印一條記錄的詳情public static void printRecoder(Result result)throws IOExceptionfor(Cell cell:result.rawCells()System.out.pr

5、int("行健:"+new String(CellUtil.cloneRow(cell);System.out.print("列簇:"+new String(CellUtil.cloneFamily(cell);System.out.print("列:"+new String(CellUtil.cloneQualifier(cell);System.out.print("值:"+new String(CellUtil.cloneValue(cell);System.out.println("時間戳:&qu

6、ot;+cell.getTimestamp();(3)向已經(jīng)創(chuàng)建好的表添加和刪除指定的列族或列；p.s：此題請先在 Shell中創(chuàng)建si作為示例表：create 's1','score'a)在si表，添加數(shù)據(jù)：Shell:put 's1','zhangsan','score:Math','69'hbase(rain):903:0> put 'si' zhangsan' f 'seo re:th ,1691 0 row(s) in 9.©660 seco

7、ndsht>a5e(rain);904：0> isNaneError: urtdefintd local variable or 眄ethod、l3' forhbase(naln):oo5：0> listTABLESI1 row(s) in 0+6&lG records圖3給si添加數(shù)據(jù)編程：向表添加數(shù)據(jù)public static void insertRow(String tableName,StringrowKey,StringcolFamily,Stringcol,Stringval) throws lOException init()；Table ta

8、ble = connection.getTable(TableName.valueOf(tableName);Put put = new Put(rowKey.getBytes();put.addColumn(colFamily.getBytes(), col.getBytes(), val.getBytes();table.put(put);table.close();close();insertRow("s1",'zhangsan','score','Math','69')b)在si表，刪除指定的列：She

9、ll:delete 's1','zhangsan','score:Math'hba«e(natri)deLet& *sl',1 zhangan1, Tscor：Math0 row(s) in G.6970 seconds圖4刪除數(shù)據(jù)編程：刪除數(shù)據(jù)public static void deleteRow(String tableName,StringrowKey,StringcolFamily,String col) throws lOException init();Table table = connection.ge

10、tTable(TableName.valueOf(tableName);Delete delete = new Delete(rowKey.getBytes();刪除指定列族delete.addFamily(Bytes.toBytes(colFamily);刪除指定列delete.addColumn(Bytes.toBytes(colFamily),Bytes.toBytes(col);table.delete(delete);table.close();close();deleteRow("s1",'zhangsan','score',&#

11、39;Math')(4)清空指定的表的所有記錄數(shù)據(jù)；Shell:truncate 's1hbage(n-atn ) ：Q18: ROHItsiwangwZ row(s) tn e.G?io18LUMN+CELLcoluin=score：Mth, GQlu'ir>=5Core;Math.set ondsti.mc5tanp=14fi2 23561681Bl vlue=B5tine3tanp=1462Z35732643( velue=75hbaseCnatn):G19i0> truncate 'si'Trunsting *51 * tabic (

12、it may take a while);-DLdblincj tdble.-Truncating table.».fl rt)w(s) tn 3.7870 secondshbase(r*in) :Q26: 0> wczn ' 51'ROWCOLJUN+CELLQ口國(5) In 6,1490圖5清空指定表的所有記錄數(shù)據(jù)編程：/(4)清空指定的表的所有記錄數(shù)據(jù)public static void clearRows(String tableName)throws IOExceptioninit()；TableNametablename = TableName.v

13、alueOf(tableName);admin.disableTable(tablename);admin.deleteTable(tablename);HTableDescriptorhTableDescriptor = new HTableDescriptor(tableName);admin.createTable(hTableDescriptor);close();(5)統(tǒng)計表的行數(shù)。Shell:count 's1'hbase(natn)：C21：count Fl0 row(s) inseconds-> 0圖6統(tǒng)計表的行數(shù)編程：/(5)統(tǒng)計表的行數(shù)public s

14、tatic void countRows(String tableName)throws IOExceptioninit();Table table = connection.getTable(TableName.valueOf(tableName);Scan scan = new Scan();ResultScanner scanner = table.getScanner(scan);intnum = 0;for (Result result = scanner.next();result!=null;result=scanner.next()num+;System.out.println

15、("行數(shù):"+ num);scanner.close();close();HBase存儲的表并插入數(shù)2.現(xiàn)有以下關(guān)系型數(shù)據(jù)庫中的表和數(shù)據(jù)，要求將其轉(zhuǎn)換為適合于據(jù):學(xué)生表（Student）學(xué)號（S_No）姓名(S_Name)T生另 ij ( S_Sex)年齡(S_Age)2015001Zhangsanmale232015003Maryfemale222015003Lisimale24課程表(Course)課&# ( C_No)課程名（C_Name）學(xué)分(C_Credit)123001Math2.0123002Computer Science5.0123003Engli

16、sh3.0選課表（SC）學(xué)號（SC_Sno）課# ( SC_Cno)成績(SC_Score)201500112300186201500112300369201500212300277201500212300399201500312300198201500312300295學(xué)生Student表p.s：主鍵的列名是隨機(jī)分配的，因此無需創(chuàng)建主鍵列創(chuàng)建表：create 'Student','S_No','S_Name','S_Sex','S_Age'hba5&(natn):create RStudent'1

17、1 S ho','S_Name',1i_Se>" ,'S Age 8 row(s) inseconds=> Hbase;liable - Student hba，e(pwln):白lli TABLE Student si2 roN(s) in 0.D130 seconds=> "student*, Fl"hba5e(natn) :624:05" scan 'Student' nowcoljmn+cell6oh(m) In 0OHO seconds圖7創(chuàng)建Student表插入數(shù)據(jù)插入數(shù)據(jù)sh

18、ell命令第一行數(shù)據(jù)put 'Student','s001','S_No','2015001'put 'Student','s001','S_Name','Zhangsan'put 'Student','s001','S_Sex','male'put 'Student','s001','S_Age','23'第二行數(shù)據(jù)put 'Stu

19、dent','s002','S_No','2015002'put 'Student','s002','S_Name','Mary'put 'Student','s002','S_Sex','female'put 'Student','s002','S_Age','22'第三行數(shù)據(jù)put 'Student','s003'

20、,'S_No','2015003'put 'Student','s003','S_Name','Lisi'put 'Student','s003','S_Sex','male'put 'Student','s003','S_Age','24'hba5e(r»ain): 9263 row(E) in 9*6&90hbasetrain);027：0>Q

21、row() in 0tbiRf>hbi)5enai.n):日 28 :*0 row(s) tn 3+1640hbast?(EE n ) ： 37S: fl>a 。國(弓)tn a.e&BBhbase(r*i5i.n): 030 :G> ROHsoaiS031 saai s9911 row(s) tn 0.6310put 'Student1 J £眄1' , S_N。','加15361 seconds put ' Stu dent * J 5&01 . 'S_Name，/ Zlianysan 啜pcnnd

22、qput 'Student1(F s901T '5_5ex't 'nalc seconds put ' Student * J 5001' / S_ftgp' /Z1EEtzcindsxmn " Student'CCLUMN+CELLcnlumn-S_/ige; , tlrm ：a叩=148223640633G, v&Iue=23calumn-S_Narnei, tinestamp=14S2Z36366 212, valu=Zhangah cciluEn=，二No: , ttmestampl4822 2S339S

23、8e, value=2915eeicaluHn=S_Sex:, tinestanp=14S2363S5041, value=nale seconds圖8添加數(shù)據(jù)并查看hbase(nain):639:scan Student'ROWCOLUMNCELLsoait a1 unn=s_Age： ( 11 nest487? 36400=1, vdlue=23soeicolumn=S_Name:, ttmestamp-1482236366213, vaLue=Zhangsan5991column-slNo:. ti'ncstanp=14B：2J6339539l value-2015051

24、5091column=S Sex: ( timc5t<)rip=1482Z363B5041, valuc-mal.e5002column=S_Age;, timestdnp=1482Z3O551274. Vdlue=22的睚c&luFin=s_Narie*, ttnestamps 1482236522212, value=Mar/colurin=S_No: fvalue=2S150&2SO02colurin=S Sex： d ttnestanp=14S22365G47ta, value=fendle5003coturin-S_Ajge: , tinestaFip>=

25、 1482236672914, value-245003c»luFin=S_Name:, ttnestaRp=14&23d(i21456, value-LtstsE)B3caLumn=&_No:ttnestanp=1482216687972, value=2015e93s9833 row(s) ti e.C5Z0colurin=5_Sex: , ttnestanp=14S223663&3ai, valueale seconds圖9添加3個學(xué)生課程Course表創(chuàng)建表：create 'Course','C_No','C_N

26、ame','C_Credit'hbase(nain):640i©> create *Courser,No1CNane*,Credit1 0 row(s) in 1*2696 seconds二？ Hbase:Table - Course圖10創(chuàng)建Course表插入數(shù)據(jù):插入數(shù)據(jù)shell命令第一行數(shù)據(jù)put 'Course','c001','C_No','123001'put 'Course','c001','C_Name','Math&

27、#39;put 'Course','c001','C_Credit','2.0'第二行數(shù)據(jù)put 'Course','c002','C_No','123002'put 'Course','c002','C_Name','Computer'put 'Course','c002','C_Credit','5.0'第三行數(shù)據(jù)put 'Cou

28、rse','c003','C_No','123003'put 'Course','c003','C_Name','English'put 'Course','c003','C_Credit','3.0'=> Hbase:Table - hbase(Hain):041:6> 0 row(s) tn 0,0150Courseput 'Course', 'cOSl1, 'C_

29、N>', '1230&1' secondshbdie(p'atn); 342 0 row(s) In 0,0136343：0>0 row(E) tn 0.06S0put 'Course'*'c091','C_Mane'.'Hath' seconds put 'Lou6a'£®91'，'匚匚edit','z.g' seconds圖11添加數(shù)據(jù)hbase(l*at n): 35fcG row(sJ in 0.

30、O11Bput '匚cju廣二e',Ct)日3 secondsC_NDr , 123003hb0寫已(Fain): 057:0> 6 row(s) tn Breesehb«se(H«in):056:0*0 row(s) in 0,CC90hbaseCfwln ): 859: ROWC001C081 caeiCO02 e002 cOOZCB93c993C0933 row(s) in 0,0500put 'Cour5t' # 'c0031 , <C_Nap»e, # 'English1 s?rrnds put

31、 'Course','C0531j'C Credit1F'3*9* seconds san " Course 1COLUMN+CELLcolurin-C_Credtt: , tiriestanp-149223683302, valje-2.0 eolunri=C_Ndne;, tinestdmp= vlue=Mdth column=c no：r tte£tampi48223b8e0249, value±i2300i colunn=C_Credit: r ttri2EtaMp=l4922m7”3的6,

32、 valuers,0 calunn=C_Nane;, tine st amp=148 2237S S47G1f value=Conputer colurin=C_ho; t twestanp=1482237042433 , value=L23002 calunn=C C redttr, ttme&tamp=14B2237181559, value=3.3 calunn=C_Nane: , tiFiestamp=1482237167697, value=English caluFin=C Np： t ttrestanp=14BZ237156C37p valrue=1230S3 secon

33、ds圖12添加3個課程選課表創(chuàng)建表：create 'SC','SC_Sno','SC_Cno','SC_Score'hba5e(natn);060;create 1 SC'>1SC_Sno1 t 'SC_Cno1f1SC_Score 0 row(s) in 1 + 2700 seconds=> Hbase:Table - SC圖13創(chuàng)建表SC插入數(shù)據(jù):插入數(shù)據(jù)shell命令第一行數(shù)據(jù)put 'SC','sc001','SC_Sno','201500

34、1'put 'SC','sc001','SC_Cno','123001'put 'SC','sc001','SC_Score','86'第二行數(shù)據(jù)put 'SC','sc002','SC_Sno','2015001'put 'SC','sc002','SC_Cno','123003'put 'SC','sc00

35、2','SC_Score','69'第三行數(shù)據(jù)put 'SC','sc003','SC_Sno','2015002'put 'SC','sc003','SC_Cno','123002'put 'SC','sc003','SC_Score',77'第四行數(shù)據(jù)put 'SC','sc004','SC_Sno','20150

36、02'put 'SC','sc004','SC_Cno','123003'put 'SC','sc004','SC_Score','99'第五行數(shù)據(jù)put 'SC','sc005','SC_Sno','2015003'put 'SC','sc005','SC_Cno','123001'put 'SC','sc0

37、05','SC_Score','98'第六行數(shù)據(jù)put 'SC','sc006','SC_Sno','2015003'put 'SC','sc006','SC_Cno','123002'put 'SC','sc006','SC_Score','95'hbds&(nain);OCO；O> create T5C1 +1SC_5no' * SC.Cn

38、o','SC.Score' fl row(s tn 1 .；703 seconils=> Hbasc:Table - SChbosc(riain>O61:O> put ' 5CP, 1 scDDl1 , 1 SC Goo 1 ,'20150&1'0 ron(i3 tn 0*0120 占txundshbaetniain) :862: 0s»G row(£ J in e.6100put '務(wù)匚*,'£C991(，'SCCno ,(123061 secondshbsXn 號

39、 in);比 3：g put 'SC , 1 scOOl' / 5C_5cQre' /06' 0 row(s) In B.G290 seconds圖14插入數(shù)據(jù)hbase(matn):312 ROW5<0315sM"日仃SC092SC0025C00Z3C003SC093SC0D35C004SCD045CBQ4scea3C0055<OOSSCBflfiSC0Q6SC0066 row(s) in 3.0510士七日n rSC(COLUMN+CELLColurin=SC Cno: , tinestamp=1482237297903, vaLue=

40、123001 toluFin=SC_5core ;, ttnestan|>4, vaTue=BG cnlumn=sc_srnr, tl nptflr»p=i48?237785573 vsXus=?ai5OBi 8luFin=sU"。：，tinestanp9, VdLue-123 cclurin-SC Scarc:, tinestonp-1 value-69 column-sOno;, tinestanpl4Q223742Z049, vaLue=2015001 coXuflrt=sc_cno:

41、, tInestanp=148223749Z242 t Vdlue=123O02 column=sc_score:, tLmestanp=i482237Sebe3rt value=77 colunn=SC_£iio:, ttnestaf*ip=14822374756261 value=2015QG2 colurin=£C_CfiO；, tinestar*p3 vaLue=1230O3 CDluFn=5C_5core:, tinestanp=14S2238015244 f value=99 coluFn=sc_sno:, tinestanp=i4S2

42、2377S3343d i/aLue=zai5O02 colunn=SC_Cn5：t tinestamp=140323809Oe26 j V3Lue-123301 colunn=SC Score; , tV'iestonp=lSZZJ&ieggosF value=93 coluFin-SC Sno；, tTnestrp-1482238061590, value-2015003 C01uri=SC_Cntj： li門, vsluesVfte? colunr*=SC_Score:, ttmestanp#187;1, value=9B colunn-sOnoi

43、, tncstanp-l182238l370D4# valuc-29150e3 seconds圖15數(shù)據(jù)顯示Summary:Tableto okay.Number of regions: 1Deployed on： ubuntu,33307.1482233950045Table Student is ok四.Number or regio ns: 1Deployed on: ubuntu,33307,1482233950845Tbie SC ft okay.Number of regions: 1Deployed oni： ubun (U, 33307,14822 J3950B45Tdble

44、si is okay.Number of regions: iDeployed on; ubuntu33307J48223396064STable book ts okay.Number of regions: 1Deployed an: ubunru,333O7j482233O$45Table hbase;namespace Is okay.HBaseFsc< ccrrmand line cpNariS：VertlDn: 1.Z2Niimlr i41ve/km 1Number of d tad regior senners: 0Master ubuntM網(wǎng)三1,148223394

45、63;6<7Numhpr nf hAr<np Fn，Tprv 口*vr甫/nfld 7 0Number of requests: 0Numb«r of region $: JNumbf ofregtonf »trankton oNumber of empty REG10KINFO_qUALlFIER rows in hba»：meu: 0Number M ub也：fiN umber of regbons： 1Depjicyed on uburiu.33307J4S2?3395&M57ablc Course b«kdy.Number o

46、f regions:；Deployed。n. ubur i 皿,犯307J 4B2233950M50 into niistcn cr z d otcctco.siauis: ok圖16 QuestionOne運(yùn)行后控制臺消息同時，請編程完成以下指定功能：(完整可執(zhí)行代碼見代碼/QuestionTwo.java )(1) createTable(String tableName, String fields)創(chuàng)建表，參數(shù)tableName為表的名稱，字符串?dāng)?shù)組fields為存儲記錄各個域名稱的數(shù)組。要求當(dāng)HBase已經(jīng)存在名為tableName的表的時候，先刪除原有的表，然后再創(chuàng)建新的表。代碼:

47、 public static void createTable(String tableName,String口 fields) throws lOException init()；TableNametablename = TableName.valueOf(tableName);if(admin.tableExists(tablename)System.out.println("table is exists!");admin.disableTable(tablename);admin.deleteTable(tablename);/ 刪除原來的表HTableDescri

48、ptorhTableDescriptor = new HTableDescriptor(tablename);for(String str:fields)HColumnDescriptorhColumnDescriptor = new HColumnDescriptor(str);hTableDescriptor.addFamily(hColumnDescriptor);admin.createTable(hTableDescriptor);close();(2) addRecord(String tableName, String row, String fields, String口 va

49、lues)向表tableName、行row (用S_Name表示)和字符串?dāng)?shù)組 files指定的單元格中添加對 應(yīng)的數(shù)據(jù)values。其中fields中每個元素如果對應(yīng)的列族下還有相應(yīng)的列限定符的話，用“columnFamily:column 表示。例如，同時向 “ Math"、 "Computer Science"、 "English 三列添加成績時，字符串?dāng)?shù)組 fields 為 "Score:Math" ," Score; Computer Science"," Score:English” ,數(shù)組v

50、alues存儲這三門課的成績。代碼：public static void addRecord(String tableName,Stringrow,String口 fields,String values) throws IOException init();Table table = connection.getTable(TableName.valueOf(tableName);for(inti = 0;i != fields.length;i+)Put put = new Put(row.getBytes();String口 cols = fieldsi.split(":&qu

51、ot;);put.addColumn(cols0.getBytes(), cols1.getBytes(), valuesi.getBytes();table.put(put);table.close();close();(3) scanColumn(String tableName, String column)瀏覽表tableName某一列的數(shù)據(jù)，如果某一行記錄中該列數(shù)據(jù)不存在，則返回 null。要 求當(dāng)參數(shù)column為某一列族名稱時，如果底下有若干個列限定符，則要列出每個列限定符代表的列的數(shù)據(jù)；當(dāng)參數(shù) column為某一列具體名稱(例如 “Score:Math)時，只需要列出 該列的數(shù)

52、據(jù)。代碼：public static void scanColumn(String tableName,String column)throws IOException init();Table table = connection.getTable(TableName.valueOf(tableName);Scan scan = new Scan();scan.addFamily(Bytes.toBytes(column);ResultScanner scanner = table.getScanner(scan);for (Result result = scanner.next(); r

53、esult != null; result = scanner.next() showCell(result);table.close();close();/格式化輸出public static void showCell(Result result)Cell cells = result.rawCells();for(Cell cell:cells)System.out.println("RowName:"+new String(CellUtil.cloneRow(cell)+"");System.out.println("Timetamp:

54、"+cell.getTimestamp()+"");System.out.println("column Family:"+new String(CellUtil.cloneFamily(cell)+"");System.out.println("row Name:"+new String(CellUtil.cloneQualifier(cell)+"");System.out.println("value:"+new String(CellUtil.cloneVa

55、lue(cell)+"");(4) modifyData(String tableName, String row, String column)修改表tableName,行row (可以用學(xué)生姓名 S_Name表示)，歹U column指定的單元格 的數(shù)據(jù)。代碼：public static void modifyData(String tableName,Stringrow,Stringcolumn,Stringval)throws IOExceptioninit();Table table = connection.getTable(TableName.valueOf(

56、tableName);Put put = new Put(row.getBytes();put.addColumn(column.getBytes(),null,val.getBytes();table.put(put);table.close();close(); deleteRow(String tableName, String row)刪除表tableName中row指定的行的記錄。public static void deleteRow(String tableName,String row)throws IOExceptioninit();Table table = connect

57、ion.getTable(TableName.valueOf(tableName);Delete delete = new Delete(row.getBytes();刪除指定列族delete.addFamily(Bytes.toBytes(colFamily);刪除指定列/delete.addColumn(Bytes.toBytes(colFamily),Bytes.toBytes(col);table.delete(delete);table.close();close();k 777u=:、Probl * Tasks Java Map/ cons 總、 D B <terminated>QuestionTwo Java Application/usr/lib/jvm/java Ia x Eh 送匣J典 E里巧.log4j:WARN No appenders could b& found for logger (org,apache.hado log4j:WARN Please initialize the Iag4j system properly.logq;WARN See hup:/I/log4j/h2/faq.himI#noconflj SLF4J: Class