實驗4熟悉常用的HBase操作

1、實驗4熟悉常用的HBase操作姓名：包生友 專業(yè)年級：軟件143 學號：20140126991. 實驗?zāi)康?. 理解HBase在Hadoop體系結(jié)構(gòu)中的角色；2. 熟練使用HBase操作常用的Shell命令；3. 熟悉HBase操作常用的Java API。2. 實驗環(huán)境操作系統(tǒng)：LinuxHadoop版本：2.6.0或以上版本HBase版本：或以上版本JDK版本：1.6或以上版本Java IDE：Eclipse3. 實驗內(nèi)容和完成情況1. 編程實現(xiàn)以下指定功能，并用Hadoop提供的HBase Shell命令完成相同任務(wù)：（完整可執(zhí)行代碼見 代碼/QuestionOne.java）（1）列出H

2、Base所有的表的相關(guān)信息，例如表名；Shell:List圖1 列出HBase所有表的相關(guān)信息編程：/(1)列出HBase所有的表的相關(guān)信息，例如表名、創(chuàng)建時間等public static void listTables() throws IOException init();/建立連接 HTableDescriptor hTableDescriptors = admin.listTables(); for(HTableDescriptor hTableDescriptor :hTableDescriptors) ("表名:"+hTableDescriptor.getNam

3、eAsString(); close();/關(guān)閉連接（2）在終端打印出指定的表的所有記錄數(shù)據(jù)；Shell:scan 's1'圖2 打印指定表的所有記錄數(shù)據(jù)編程：/(2)在終端打印出指定的表的所有記錄數(shù)據(jù)public static void getData(String tableName)throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Scan scan = new Scan(); ResultScanner scanner = table.ge

4、tScanner(scan); for (Result result:scanner) printRecoder(result); close();/打印一條記錄的詳情public static void printRecoder(Result result)throws IOException for(Cell cell:result.rawCells() ("行健: "+new String(CellUtil.cloneRow(cell); ("列簇: "+new String(CellUtil.cloneFamily(cell); ("

5、列: "+new String(CellUtil.cloneQualifier(cell); (" 值: "+new String(CellUtil.cloneValue(cell); ("時間戳: "+cell.getTimestamp(); （3）向已經(jīng)創(chuàng)建好的表添加和刪除指定的列族或列；p.s：此題請先在Shell中創(chuàng)建s1作為示例表: create 's1','score'a)在s1表,添加數(shù)據(jù)：Shell: put 's1','zhangsan','score:M

6、ath','69'圖3 給s1添加數(shù)據(jù)編程：/向表添加數(shù)據(jù)public static void insertRow(String tableName,String rowKey,String colFamily,String col,String val) throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Put put = new Put(rowKey.getBytes(); put.addColumn(colFamily.getByte

7、s(), col.getBytes(), val.getBytes(); table.put(put); table.close(); close();insertRow("s1",'zhangsan','score','Math','69')b)在s1表，刪除指定的列：Shell:delete 's1','zhangsan','score:Math'圖4 刪除數(shù)據(jù)編程：/刪除數(shù)據(jù)public static void deleteRow(String tableN

8、ame,String rowKey,String colFamily,String col) throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Delete delete = new Delete(rowKey.getBytes(); /刪除指定列族 delete.addFamily(Bytes.toBytes(colFamily); /刪除指定列 delete.addColumn(Bytes.toBytes(colFamily),Bytes.toBytes(co

9、l); table.delete(delete); table.close(); close();deleteRow("s1",'zhangsan','score','Math')（4）清空指定的表的所有記錄數(shù)據(jù)；Shell:truncate 's1'圖5 清空指定表的所有記錄數(shù)據(jù)編程:/(4)清空指定的表的所有記錄數(shù)據(jù)public static void clearRows(String tableName)throws IOException init(); TableName tablename = Ta

10、bleName.valueOf(tableName); admin.disableTable(tablename); admin.deleteTable(tablename); HTableDescriptor hTableDescriptor = new HTableDescriptor(tableName); admin.createTable(hTableDescriptor); close();（5）統(tǒng)計表的行數(shù)。Shell:count 's1'圖6 統(tǒng)計表的行數(shù)編程：/(5)統(tǒng)計表的行數(shù)public static void countRows(String table

11、Name)throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Scan scan = new Scan(); ResultScanner scanner = table.getScanner(scan); int num = 0; for (Result result = scanner.next();result!=null;result=scanner.next() num+; ("行數(shù):"+ num); scanner.close(); c

12、lose();2. 現(xiàn)有以下關(guān)系型數(shù)據(jù)庫中的表和數(shù)據(jù)，要求將其轉(zhuǎn)換為適合于HBase存儲的表并插入數(shù)據(jù)：學生表（Student）學號（S_No）姓名（S_Name）性別（S_Sex）年齡（S_Age）2015001Zhangsanmale232015003Maryfemale222015003Lisimale24課程表（Course）課程號（C_No）課程名（C_Name）學分（C_Credit）123001Math2.0123002Computer Science5.0123003English3.0 選課表（SC）學號（SC_Sno）課程號（SC_Cno）成績（SC_Score）20150

13、0112300186201500112300369201500212300277201500212300399201500312300198201500312300295 學生Student表p.s：主鍵的列名是隨機分配的，因此無需創(chuàng)建主鍵列創(chuàng)建表：create 'Student','S_No','S_Name','S_Sex','S_Age'圖7 創(chuàng)建Student表插入數(shù)據(jù):插入數(shù)據(jù)shell命令第一行數(shù)據(jù)put 'Student','s001','S_No',&

14、#39;2015001'put 'Student','s001','S_Name','Zhangsan'put 'Student','s001','S_Sex','male'put 'Student','s001','S_Age','23'第二行數(shù)據(jù)put 'Student','s002','S_No','2015002'put &#

15、39;Student','s002','S_Name','Mary'put 'Student','s002','S_Sex','female'put 'Student','s002','S_Age','22'第三行數(shù)據(jù)put 'Student','s003','S_No','2015003'put 'Student','s00

16、3','S_Name','Lisi'put 'Student','s003','S_Sex','male'put 'Student','s003','S_Age','24'圖8 添加數(shù)據(jù)并查看圖9 添加3個學生 課程Course表創(chuàng)建表：create 'Course','C_No','C_Name','C_Credit'圖10 創(chuàng)建Course表插入數(shù)據(jù)：插入數(shù)據(jù)s

17、hell命令第一行數(shù)據(jù)put 'Course','c001','C_No','123001'put 'Course','c001','C_Name','Math'put 'Course','c001','C_Credit','2.0'第二行數(shù)據(jù)put 'Course','c002','C_No','123002'put 'Course

18、','c002','C_Name','Computer'put 'Course','c002','C_Credit','5.0'第三行數(shù)據(jù)put 'Course','c003','C_No','123003'put 'Course','c003','C_Name','English'put 'Course','c003'

19、;,'C_Credit','3.0'圖11 添加數(shù)據(jù)圖12 添加3個課程 選課表創(chuàng)建表：create 'SC','SC_Sno','SC_Cno','SC_Score'圖13 創(chuàng)建表SC插入數(shù)據(jù)：插入數(shù)據(jù)shell命令第一行數(shù)據(jù)put 'SC','sc001','SC_Sno','2015001'put 'SC','sc001','SC_Cno','123001'put &

20、#39;SC','sc001','SC_Score','86'第二行數(shù)據(jù)put 'SC','sc002','SC_Sno','2015001'put 'SC','sc002','SC_Cno','123003'put 'SC','sc002','SC_Score','69'第三行數(shù)據(jù)put 'SC','sc003',&

21、#39;SC_Sno','2015002'put 'SC','sc003','SC_Cno','123002'put 'SC','sc003','SC_Score','77'第四行數(shù)據(jù)put 'SC','sc004','SC_Sno','2015002'put 'SC','sc004','SC_Cno','123003'

22、;put 'SC','sc004','SC_Score','99'第五行數(shù)據(jù)put 'SC','sc005','SC_Sno','2015003'put 'SC','sc005','SC_Cno','123001'put 'SC','sc005','SC_Score','98'第六行數(shù)據(jù)put 'SC','sc006&

23、#39;,'SC_Sno','2015003'put 'SC','sc006','SC_Cno','123002'put 'SC','sc006','SC_Score','95'圖14 插入數(shù)據(jù)圖15 數(shù)據(jù)顯示圖16 QuestionOne運行后控制臺消息同時，請編程完成以下指定功能：（完整可執(zhí)行代碼見 代碼/QuestionTwo.java）（1）createTable(String tableName, String fields)

24、創(chuàng)建表，參數(shù)tableName為表的名稱，字符串數(shù)組fields為存儲記錄各個域名稱的數(shù)組。要求當HBase已經(jīng)存在名為tableName的表的時候，先刪除原有的表，然后再創(chuàng)建新的表。代碼：public static void createTable(String tableName,String fields) throws IOException init(); TableName tablename = TableName.valueOf(tableName); if(admin.tableExists(tablename) ("table is exists!");

25、 admin.disableTable(tablename); admin.deleteTable(tablename);/刪除原來的表 HTableDescriptor hTableDescriptor = new HTableDescriptor(tablename); for(String str:fields) HColumnDescriptor hColumnDescriptor = new HColumnDescriptor(str); hTableDescriptor.addFamily(hColumnDescriptor); admin.createTable(hTableDe

26、scriptor); close();（2）addRecord(String tableName, String row, String fields, String values)向表tableName、行row（用S_Name表示）和字符串數(shù)組files指定的單元格中添加對應(yīng)的數(shù)據(jù)values。其中fields中每個元素如果對應(yīng)的列族下還有相應(yīng)的列限定符的話，用“columnFamily:column”表示。例如，同時向“Math”、“Computer Science”、“English”三列添加成績時，字符串數(shù)組fields為“Score:Math”,”Score；Computer Sc

27、ience”,”Score:English”，數(shù)組values存儲這三門課的成績。代碼：public static void addRecord(String tableName,String row,String fields,String values) throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); for(int i = 0;i != fields.length;i+) Put put = new Put(row.getBytes(); String c

28、ols = fieldsi.split(":"); put.addColumn(cols0.getBytes(), cols1.getBytes(), valuesi.getBytes(); table.put(put); table.close(); close();（3）scanColumn(String tableName, String column)瀏覽表tableName某一列的數(shù)據(jù)，如果某一行記錄中該列數(shù)據(jù)不存在，則返回null。要求當參數(shù)column為某一列族名稱時，如果底下有若干個列限定符，則要列出每個列限定符代表的列的數(shù)據(jù)；當參數(shù)column為某一列具體

29、名稱（例如“Score:Math”）時，只需要列出該列的數(shù)據(jù)。代碼：public static void scanColumn(String tableName,String column)throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Scan scan = new Scan(); scan.addFamily(Bytes.toBytes(column); ResultScanner scanner = table.getScanner(scan); for

30、(Result result = scanner.next(); result != null; result = scanner.next() showCell(result); table.close(); close();/格式化輸出public static void showCell(Result result) Cell cells = result.rawCells(); for(Cell cell:cells) ("RowName:"+new String(CellUtil.cloneRow(cell)+" "); ("Time

31、tamp:"+cell.getTimestamp()+" "); ("column Family:"+new String(CellUtil.cloneFamily(cell)+" "); ("row Name:"+new String(CellUtil.cloneQualifier(cell)+" "); ("value:"+new String(CellUtil.cloneValue(cell)+" "); （4）modifyData(Str

32、ing tableName, String row, String column)修改表tableName，行row（可以用學生姓名S_Name表示），列column指定的單元格的數(shù)據(jù)。代碼：public static void modifyData(String tableName,String row,String column,String val)throws IOException init(); Table table = connection.getTable(TableName.valueOf(tableName); Put put = new Put(row.getBytes(); put.addColumn(column.getBytes(),null,val.getBytes(); table.put(put); table.close(); close();（5）deleteRow(String tableName, String row)刪除表tableName中row指定的行的記錄。public static void deleteRow(String tableName,String row)throws IOException init(); Table table = connection