數(shù)據(jù)立方與HBase性能對比測試報告_20130620

1、概述31.1目的31.2測試內(nèi)容3測試環(huán)境測試組網(wǎng)10.2.2設(shè)備配置10.2.3測試工具 Gan glia 監(jiān)控工具測試方法12.測試用例 數(shù)據(jù)立方測試用例.13.數(shù)據(jù)立方可靠性測試 13.數(shù)據(jù)立方入性能 1.6.數(shù)據(jù)立方查詢性能 26.3.2 HBase 測試用例HBase 可靠性測試 3.8.入庫性能.413.2.3 HBase查詢性能測試 51.四、測試結(jié)果.測試用例執(zhí)行情況 67.4.2性能測試結(jié)果 73.數(shù)據(jù)立方與HBase數(shù)據(jù)入庫速率 73數(shù)據(jù)立方與HBase數(shù)據(jù)入庫對比 75數(shù)據(jù)立方與HBa

2、se查詢性能對比 76五、測試總結(jié).7.9.一、 概述1.1目的本次將數(shù)據(jù)立方(Datacube)與HBase在相同硬件配置、網(wǎng)絡(luò)環(huán)境下，進行性能對 比測試，從而驗證數(shù)據(jù)立方在計算處理方面優(yōu)越于HBase。1.2測試內(nèi)容本次將數(shù)據(jù)立方(Datacube)與HBase進行性能對比測試，測試內(nèi)容為：產(chǎn)品可靠 性、單客戶端數(shù)據(jù)入庫速率、多客戶端數(shù)據(jù)入庫速率、數(shù)據(jù)查詢性能。測試的記錄結(jié)構(gòu)為：hbase(ma in ):001:0> describe 'usertable'DESCRIPTION :'usertable', NAME =>'f1'

3、;, DATA_BLOCK_ENCODING => 'NONE',BLOOMFILTER => 'NONE', REPLICATION_SCOPE =>'0', VERSIONS =>3,COMPRESSItrueON => 'NONE', MIN_VERSIONS =>'0', TTL =>'2147483647',KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536

4、9;, IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true', NAME =>'f2',DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => 'O', VERSIONS => 3, COMPRESSION => 'NONE', MIN_V

5、ERSIONS => 'O', TTL => '2147483647', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true', NAME => 'f3', DATA_BLOCK_ENCODING => 'NONE

6、9;, BLOOMFILTER => 'NONE', REPLICATION_SCOPE =>'0', VERSIONS =>'3',COMPRESSION => 'NONE', MIN_VERSIONS =>'0', TTL =>'2147483647',KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false'

7、;, ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true'數(shù)據(jù)生成方式:? HBase數(shù)據(jù)生成：dataload 的配置方式為：# Copyright (c) 2010 Yahoo! Inc. All rights reserved.# Licensed under the Apache License, Version 2.0 (the "License"); you# may not use this file except in compliance with the License.

8、 You一；4# may obta in a copy of the Lice nse at# :/lice nses/LICENSE-2.0# Un less required by applicable law or agreed to in writ ing, software# distributed under the License is distributed on an "AS IS" BASIS,# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or# implied. See the Lice nse for the specific Ian guage gover ning# permissi ons and limitati ons un der the Lice nse. See accompa nying# LICENSE file.# Yahoo! Cloud Syste