cloudera安裝部署手冊

clouderaCDH安裝功能名稱：業(yè)務名稱：編寫人：編寫日期：2014-7-28確認人：確認日期：修訂記錄日期版本作者/修改者描述審核人TOC\o"1-5"\h\z導言 6說明 6\o"CurrentDocument"集群節(jié)點 6\o"CurrentDocument"硬件 6\o"CurrentDocument"軟件版本 6準備工作 6\o"CurrentDocument"操作系統(tǒng) 6\o"CurrentDocument"磁盤 6是否需要raid 6磁盤劃分 6磁盤裸設備的掛載 7\o"CurrentDocument"關閉防火墻 8\o"CurrentDocument"修改主機名并配置 Hosts 8\o"CurrentDocument"修改主機名 8\o"CurrentDocument"設置每臺主機的hosts 8\o"CurrentDocument"ssh免登陸配置 9創(chuàng)建公鑰和密鑰 9配置與其他機器的免密碼登陸 10\o"CurrentDocument"同步集群時間ntp 10\o"CurrentDocument"配置ntpserver集群時鐘 11\o"CurrentDocument"ntp客戶端配置 12測試 12\o"CurrentDocument"上傳安裝包以及搭建yum源 14安裝cloudera需要的文件如下安裝包 14上傳yum源需要的文件到/var/www/html目錄下 14\o"CurrentDocument"啟動httpd服務 14測試 HTTPD 15\o"CurrentDocument"編輯yum源配置文件 16\o"CurrentDocument"安裝 createrepo 17\o"CurrentDocument"創(chuàng)建源索引 17\o"CurrentDocument"cm安裝 18\o"CurrentDocument"上傳cm安裝啟動程序 18\o"CurrentDocument"安裝cm的install.bin 18\o"CurrentDocument"cdh安裝 21\o"CurrentDocument"登陸 CM 21指定主機 22群集安裝 23\o"CurrentDocument"安裝parcel 23\o"CurrentDocument"配置CDH-5.3.0-1.cdh5.3.0.p0.30-el6.parcel.sha1 23\o"CurrentDocument"配置parcel 24\o"CurrentDocument"選擇parcel和cm等 27\o"CurrentDocument"安裝CMJDK和分發(fā)數(shù)據(jù)包等 29\o"CurrentDocument"分配parcel 31\o"CurrentDocument"檢查各個主機 31\o"CurrentDocument"選擇需要安裝的服務 32\o"CurrentDocument"分配角色并安裝 33\o"CurrentDocument"驗證和使用 36\o"CurrentDocument"zookeeper 36\o"CurrentDocument"hbase 36\o"CurrentDocument"hdfs 36\o"CurrentDocument"使用shell驗證hbase安裝 37導言說明本指導書以濰坊交警 hadoop集群為例，指導安裝 CDH集群節(jié)點見hadoop服務器角色清單硬件共14臺“華為RH2288-HV2XeonE5-2620,內存容量：192G,4塊2TSATA硬盤”軟件版本cdh5.3.0準備工作操作系統(tǒng)操作系統(tǒng)使用64位CentOS6.5磁盤是否需要raid集群datanode不需要安裝 raid磁盤，hadoop的hdfs本身具有冗余和并發(fā)機制，namenode為了保證數(shù)據(jù)安全，需要安裝 raid。磁盤劃分磁盤劃分datanode要求盤符的劃分所有節(jié)點要相同，之后的hadoop所有相關安裝路徑等也需要相同。Namenode劃分如下：共有 2塊raid盤

Datanode如下：4塊物理盤[root?localhost-]#Datanode如下：4塊物理盤[root?localhost-]#肝-h科GGMGGTT月65171r1965:.u4911TOC\o"1-5"\h\z/dev/sdaS 20Gtinpfs 95G/dev/sdal 97M/dev/sda2 48LG/dev/sdaS 蟲"/dev/sdaz 1,zr已用2.6GS8K32M19BM151M199M196M已用麻捶載點

工就/1%/dev/shm34%/boot1%/home2%已用2.6GS8K32M19BM151M199M196M已用麻捶載點

工就/1%/dev/shm34%/boot1%/home2%/tnp1拈/hdf5/datal工出/hdfs'data2[root?Iocalhost文件系統(tǒng)dev/sdaStmpf5dev/sdaldev/sda?Rdev/s-da6

dev/sdbl

dev/sdcl

'dev/sddl

d&v/sda7tGGMGGTTTTh1&57178882-彝299s■■■I.整4$ml已用2.6g13SM151m1^6m196M1&6m139MH用L6G95G61M457G.已用理掛被點L4%IK34%1%2%L%L5S1%LK/dev/shm/boat/haire/hdfs/daral

/hdfs/data2

/hdfs/daral

/hdfs/data-l磁盤裸設備的掛載a查看裸設備：fdisk十b進入分區(qū)fdisk/dev/sdac分區(qū)后的格式化mkfs.ext4/dev/sda4d掛載mount/dev/sda4/home/datale永久掛載，使掛載重啟后有效vi/etc/fstab添加/dev/sda4 /home/data1 ext4defaults 12保存，reboot機器確認掛載成功f卸載umount/dev/sda4關閉防火墻集群所有機器執(zhí)行：[root@node41~]#serviceiptablesstopiptables:Flushingfirewallrules:[OK]iptables:SettingchainstopolicyACCEPT:filter[OK]iptables:Unloadingmodules:[OK][root@node41~]#chkconfigiptablesoff每個機器都需要關閉防火墻修改主機名并配置Hosts修改主機名[root@notitl3repa5.3,0J#ui/etc/sv5config/networkFETUORKlMG-=yeETID5TEfAJE=nodel3每臺機器設置不同的主機名設置每臺主機的hosts在每個機器設置Hostsvi/etc/hosts.29node29.30node30.31node31.32node32.33node33.34node34.35node35.36node36.37node37.38node38.39node39.40node40.41node41保存退出，重啟機器查看主機名是否變化[root@node29~]#ssh免登陸配置創(chuàng)建公鑰和密鑰[root@node29~]#ssh-keygen-trsaGeneratingpublic/privatersakeypair.Enterfileinwhichtosavethekey(/root/.ssh/id_rsa):Enterpassphrase(emptyfornopassphrase):Entersamepassphraseagain:Youridentificationhasbeensavedin/root/.ssh/id_rsa.Yourpublickeyhasbeensavedin/root/.ssh/id_rsa.pub.Thekeyfingerprintis:b9:ef:52:0d:94:42:fa:13:f7:ea:bb:ce:34:50:07:5froot@node29Thekey'srandomartimageis:TOC\o"1-5"\h\z+--[RSA2048] +| E|| ..oo. || ..ooo|| .=.o || So.|| +... || ..+ || .=. || +Oo|++[root@node29~]#[root@node29.ssh]#pwd/root/.ssh[root@node29.ssh]#catid_rsa.pub>>authorized_keys[root@node29.ssh]#cd..[root@node29~]#chmod-R700.ssh/[root@node29~]#cd.ssh/[root@node29.ssh]#chmod644authorized_keys[root@node29.ssh]#sshnode29Theauthenticityofhost'node29(9)'can'tbeestablished.RSAkeyfingerprintisbe:77:86:0c:7e:76:b8:f4:b8:5d:e4:ed:e0:50:14:b5.Areyousureyouwanttocontinueconnecting(yes/no)?yesWarning:Permanentlyadded'node29,9'(RSA)tothelistofknownhosts.Lastlogin:TueJul2919:46:492014from79此時自身已經可以 ssh,配置與其他機器的免密碼登陸[root@node29.ssh]#pwd/root/.ssh[root@node29.ssh]#ssh-copy-id-iid_rsa.pubroot@node138[roocBnodellS.ssh]#ssh-cop7-id-iid_i:sa.putiTheaiirhenctclryofhost'nodel38(38)1car'tbeestablished.RSAkeyfin^eEprintis7￡:fb:6fda:5a:￡5:Se:*72:Lc:25:bb:07:5c:87.Areyousureyouuant;tocontinuecormecting(yes/no)?yesWarning:Feumanentlyadded'ncdeL33,iO51.61.133'(R5A)tothelistotknowhosta+password：Nowtty工口gginqintothemachinezwithfrssh'ioot@nodel36,frtandcheckIn:.ssh/authcirized_keystomakesureuehaven'taddedextrake^sthatyoutreren,texpecring.[root@node30~]#chmod-R700/root/.ssh/[root@node30~]#chmod644/root/.ssh/authorized_keys重新在29上查看ssh30成功[root@node29.ssh]#sshnode30Lastlogin:TueJul2919:48:342014from79[root@node30~]#其他datanode同理，需要各個機器之間都可以通過 ssh免密碼登陸。同步集群時間ntpntp服務端設為3集群時區(qū)和時間需要保持完全一致，相差最多不要超過 15S,否則將導致集群運行出現(xiàn)問題?？梢钥紤]使用時間同步軟件，此處手動同步集群時間：92[root@node29~]#date-s21:21:40date-s20141229同步到硬件時鐘[root@node29~]#hwclockw配置ntpserver集群時鐘1、node13配置：vi/etc/ntp.confdriftfile/var/lib/ntp/driftrestrictdefaultkodnomodifynotrapnopeernoqueryrestrict-6defaultkodnomodifynotrapnopeernoqueryrestrictrestrict-6::1restrictmasknomodifynotrapserver #localclockfudge stratum1includefile/etc/ntp/crypto/pwkeys/etc/ntp/keys[root@node29etc]#servicentpdstart正在啟動ntpd:[確定]設置開機自動啟動：[root@node29etc]#chkconfigntpdon查看狀態(tài)：[root@node29etc]#ntpq-psttwhenpol1reachdelayoffsetjitterremoterefidlocalhost.RMOT.161- 640,0000.0000.00。jINFT.16u- 640.0000.0000.000[root@node29etc]#ntpstatunsynchronisedtimeserverre-startingpollingserverevery64s等待5分鐘[root@node29etc]#ntpstatsynchronisedtolocalnetatstratum11timecorrecttowithin448ms

pollingserverevery64s[iroot@nocle29etcl#ntpq-pSttwhenpollreachdelayoffsetjitterremoterefid1ocalhost.rmot￥16T- 64 00.0000.0000.000?LOCAL10),LOCL.105m64 37d0。0Q.0000.00。ntp客戶端配置vintp.confdriftfile/var/lib/ntp/driftrestrictdefaultkodnomodifynotrapnopeernoqueryrestrict-6defaultkodnomodifynotrapnopeernoqueryrestrictrestrict-6::1server3includefile/etc/ntp/crypto/pwkeys/etc/ntp/keys#server #localclock 這兩行注釋掉#fudge9 stratum10所有客戶端機器都使用如上修改配置scp-rntp.conf node24:/etc/scp-rntp.conf node56:/etc/所有客戶端啟動ntp在所有客戶機上執(zhí)行如下命令同步一次時鐘，如果時鐘偏差多大會導致無法同步，1000s之內[root@node41?]#ntpdate-u35Aug22:35:22ntpdate[76821]:steptimeserver9offset -65.756888測試sec測試2.6.3.netstat-tlunp|grepntp[rgi>nM&29udp 0njdp 0udp 0udp [rgi>nM&29udp 0njdp 0udp 0udp nudp □udp Qfttc]#mm-tlunp|ur^pnip010.□:12300.0.00^1210feao：;?ff：?ff;fea*;67WQ；：1：1230：-123CltCl#"■"ftRAUD&15a7/nrpdfil537/riip<lffl5P/ntpd?153T/ntp<iB1537/ntpd1、客戶機啟動ntpd[root@node30?]#ntpstatUnabletotalktoNTPdaemon.Isitrunning?

[root@node30~]#servicentpdstart正在啟動ntpd:[確定][root@node30~]#ntpstatunsynchronisedtimeserverre-startingpollingserverevery64s[root@node30~]#隔段時間后：[root@node30~]#ntpstatsynchronisedtolocalnetatstratum11reach!jitterQ.QQD50,856(LOCK)offsero.ooo-195.09O.fXJOlocalhostnode29LOCAL(0)@nod電？0—]#ntpq-preinore refid■RMOT.local(Q).LOCL.timecorrecttowithin948mspollingserverevery64s[root@node30~]#4、排查:e-d■reach!jitterQ.QQD50,856(LOCK)offsero.ooo-195.09O.fXJOlocalhostnode29LOCAL(0)@nod電？0—]#ntpq-preinore refid■RMOT.local(Q).LOCL.timecorrecttowithin948mspollingserverevery64s[root@node30~]#4、排查:e-d■610111Mhen377377正確同步狀態(tài)[root&nodeJQ-]#ntpstatsynchronisedtoNTPserver(10,51.82.29)atstratum12timecorrecttowithin962mspollingserverevery64s錯誤同步狀態(tài):[root?nodeSLntpstatsynchronisedta1ocalnetarstratum11timeGorrect七。within448m5pollingservereverySs[roor@nade31.顯示未正常與29同步，將自己作為了服務器[root@node35~]#cat/var/log/messages2、說明：服務端是上層的客戶端，所以服務端和客戶端的配置是相通的設置配置文件中的“restrict”項，主要用于控制客戶端對服務器的訪問fudgestratum1 設置本地時鐘源的層次為 1,這樣如果NTPD服務從本地時鐘源獲取時間的話， NTPD對外宣布的時間層次為2。

*有時候同步過程慢，需等待很多分鐘:[root@node41?]#ntpstatunsynchronisedpollingserverevery16s[root@node41~]#ntpstatsynchronisedtoNTPserver(9)atstratum3timecorrecttowithin487mspollingserverevery64s需要的文件如下安裝包上傳安裝包以及搭建yum源需要的文件如下安裝包1CentOS_6.5CentOS6.5安裝光盤2cm5.3.0CDH安裝包（需要分發(fā)到各個機器安裝）3parcelCloudera-Manager_Agent安裝包（需要分發(fā)到各個機器安裝）4RPM-GPG-KEYcloudera5cloudera-manager-installer.bincm安裝啟動包安裝cloudera.7.2. 上傳yum源需要的文件到/var/www/html目錄下在3（任何機器都可以）搭建yum上傳yum源需要的文件到 /var/www/html目錄下[toot@node13cd/var/ww/html/[EootOnodel?htuljf11tocal69S2SOdtuxL-XE-X?icottoot4096Hac315:99CentOS6.5druxr-xt-x5rootLoot4U95Dec3000:276530-tw-r-L一1lootroot715QJ.8148Max32D:12cn5,3,Q,zipdrwxt-XE-x2rootroot4U96Kar911：11parcel-rwxt-xE-x1rootroot169。Dec2914:56RJ71-GP&-KEY-clou(lerachmod-R755/var/www/html/*啟動httpd服務servicehttpdstartchkconfighttpdon

2.7.4.測試HTTPD/CentOS6.5/CLID-231.22113/CentOS_6.5/Indexof/CentOS6.5NameLastiwdifiGdSi工pOesuriDtimNameOnlOEBwildT口圖129-Dcc-2014OnlOEBwildT口圖129-Dcc-201421:4439-Dei-30Ll21:43-29-Dec-2014H:4421229-Dec-201121:4318K2'3-DCr-20L421型一http:〃3/cm5.3.0/,10,231.220.13/cm5.3.Li/Indexof/cin5.3.0NameLastnrodifiBdSizeDesuriDtitmParentTOC\o"1-5"\h\zRPMSJ 29-Dec-2014 23:57mirrcirE 30-Dec^2014 00:22xpodata/ 30-Dec=2014 OC:27reDodatabak/SO-Dec-2014 C0:23Jh^ch^/2.2.15(C^n-tOS)S克rruat3Port8Q3/parcel/G11231.220.13/p*i^4L/Indexof/parcelNam- Lastmodifi-dSiwuDEseriptionaFaruntDiixtnry -用CDH?5.3.0^^出⑸3＜邛0.30-26.arcel09-Mar-201511:141.5G團CDH-5.3,0T.cdE5.3,Q.dQ,3。一36.parcel.shnl09-Mar-2015IL;11 41牌nanifest.j￡cn 09-Mar-201E IL:1142KApache/2.L15(CentOS)Serverat7A231.2觀13Fort8Q編輯yum源配置文件[root@node13yum.repos.d]#pwd/etc/yum.repos.d[root@node13yum.repos.d]#viCentOS-Base.repo[base]name=CentOS-$releasever-Base#mirrorlist=http:〃/?release=$releasever&arch=$basearch&repo=osbaseurl=3/CentOS_6.5/gpgcheck=1gpgkey=file:〃/etc/pki/rpm-gpg/RPM-GPG-KEY -CentOS-6#releasedupdates[updates]name=CentOS-$releasever-Updates#mirrorlist=http:〃/?release=$releasever&arch=$basearch&repo=updatesbaseurl=3/CentOS_6.5/gpgcheck=1gpgkey=file:〃/etc/pki/rpm-gpg/RPM-GPG-KEY -CentOS-6#additionalpackagesthatmaybeuseful[extras]name=CentOS-$releasever-Extras#mirrorlist=/?release=$releasever&arch=$basearc

h&repo=extrasbaseurl=3/CentOS_6.5/gpgcheck=1gpgkey=file:〃/etc/pki/rpm-gpg/RPM-GPG-KEY -CentOS-6[root@node13yum.repos.d]#vicloudera-manager.repo[cloudera-manager]#PackagesforClouderaManager,Version5,onRedHatorCentOS6x86_64name=ClouderaManagerbaseurl=http:〃3/cm5.3.0/gpgkey=http:〃3/RPM-GPG-KEY -clouderagpgcheck=1將yum配置文件復制到各個節(jié)點（每個節(jié)點都需要）使得其他節(jié)點也使用本機器的yumscp-rCentOS-Base.reponode14:/etc/yum.repos.d/scp-rcloudera-manager.reponode14:/etc/yum.repos.d/安裝createrepo在yum源機器上（這里是 node13）安裝createrepo[root@node13yum.repos.d]#yuminstallcreaterepo創(chuàng)建源索引在yum源的機器上創(chuàng)建源的索引（需要在每個目錄下建立，這里是只需要在 cm5.3.0目錄下建立，因為CentOS_6.5目錄是centos的安裝盤，默認已經建立 ）[root@node13cm5.3.0]#createrepo.建立后會在cm5.3.0下多出目錄repodata[rootEnodeiatotal16i224ciuS.c[rootEnodeiatotal16i224ciuS.c11rootroot30See300口”2roarroot4096Diec3000:27rootroot4056I>ec3000:23icotuoct4096Oec2923:57rEyodata.ref）o（ldtal）akRPNErccm安裝上傳cm安裝啟動程序上傳cm安裝啟動程序到namenode節(jié)點的任何目錄[tootfinodelSrepo5.3. 11total512-rwxr-Kr-x. 1 root coot 514295 Dec 29 1*4:^9 cloiulera-niajLaigEx:-installer.hzindrwXT-x* 3 ecoC 匚。Qt 4096 D史c 29 14:56 cm5.3.0icwcr-Ki-K. 2 root 匚。口昨 4038 D8 3。?？?；39 parcel■■]■■——■■■■安裝cm的install.bin[root@node13repo5.3.0]#chmod-R755cloudera-manager-installer.bin關閉node13上面的SELinux查看SELinux當前的狀態(tài)，使用命令：getenforcevi/etc/selinux/configSELINUX=disabled保存重啟機器[root@node13~]#getenforceDisabled（顯示為Disabled即為修改成功）[root@node13repo5.3.0]#./cloudera-manager-installer.bin備份提示的文件[root@node13cloudera-scm-server]#mvpertiespertiesbak重試回車iMiinnqtP'r% GluAidurjMdruyerRUUMLdouderaMariBg-sr5ThwCfoucferaManager[「st三11日產^nablps/duio1n5TaHClnudera ^ndbcnsuTr,-^e^l^eCDhcluSTif,rtciu^rl^gc-nly?H5tyouF固、電5MH占二os￡±t'ayg^r-elater'smichines^andthjy^hosenicMr-esh^einternet2二工電二臺.Thisin>tilifr15onlyrflCQnwvnGlfdlfordvnvnstrftiontndpr^vFgfcqkwtd&pl口/ere3a.but1snerr rorproauftwn becauseitIsiiQL1ri?r'a4feJr@iLi??ndriiyr*Qulnt必工疝tdgnten■再/0u『clu^t?時口嶺?."TheClouderiMinagerrmstallerviIIautrmaticol1/;~口"】等cichtQcermnqsy5i<mbi1『訴曰@安iQtrrestfctnstalIthepackagerepcsitaryforcladderaManagerandtl-ejau'AhLfirlnern!<ironni^ntfjBFj、LnstallthejPEifit'5notair■燈如irfstillcd1[n?t^TTaI*,cl 中」r電&力cebEb&dPusrqrmd瘙tab占于基.insxal1andruni：hec-lquderaranigerserrerQnueserwerinit4IIAtinri1巴conplexeTynijc4ntravsEtoClDLiEfErH.HanMer1*ebIntigrfaceinds電thedusterin5tmUw用工tosetupymircOh匚liJud-74M-iriii；?-riLlpporiSthefol1wylrignJ|i1tCif.ififcyfr「qr：-口電廿riseUniterpr Llnij15(UpdateJorIjltctrsconrneri^^d^ikPdwatChtempriseLlrnj?GQ_ipda~p4w-i.iT^-rrscomr^r^ri)oracleent使「pM1自LlnuMSCupditfe當口「1wrecanrwidtDl)dr自亡】pEmerprlSBulmui白(upl=ireaorlaierrecofflfiftrded)*CentDS5fUpdate7airlattrr'e'ccmeridedj.c?ntCS電(UpditB*or^atsrrcccwn即d|il)A5U5i&LimjvErth口5eruerU(SeTvlrePadf?dr1aterrerrmneindedj*ubuiiCu10.Mlts(only:suR.qr工箏cph修”工)?ubunru12.LJ4lts*Ubuntu世LTE、Oeb片門C>.0￡On1,aupporiEStDH4-k)ateManT,0■Canc?l|-c叩耳『>回車 Cliiidi>i>rdEjqpreS1^LltcrKif CHouderaExpressLicenseEll口U5E.RLICENSE.TEROAODOTWITI'^ilSTHE1ETED^rand'^Mwrrrcuit《TME惠耳"TCPfMl^')APPLYTOYOUFCFtheRAODUZFV，越靠AEEJMmFipU'"'W)PP4VT:PEDiR>CtQUfCRJLijINC.(IZUDUUElMi-，.PLEASEF:EApTHESEHERMSCAP=FlJtL.￥-IFMU《'FU1"M'"CUSTOMER")PVANTOUS期TC*FTHEffiWUbEQNSEWLFOF離CQHMWQR竹HE*ENTQirTpTQUREPRESENTTHATrCMJMETHE：1IPL(A糜?.MEMTOFSUCm匚CMRA隔?(??<!TH=pEhHlT'j明口rriijT肝1￡MTg日17TOACCEPTJILL0ATHETfcFHZJW1PWHPITI^ISSETFWTWINiMI P-fiQJEST3DEFINEPEEL-^J耶。7rfiJS1EFII5(COLLECTIVELY4THE.WREEIfENTr'J?N日EH4LFOFSJCHCOMPATiir(口ROTHERENTIT/J.Bn-\bSTHGAhJyOFTHCPfS0DliCT5PYOUACKNO^CDijEAuD^GFiEETHAIE儀》TOU|-|*￥tkfeADALLOFIrte.T處Ml、AlWQCl㈱口口卜THISACiMhhFfclTl；!fi'iFQULT-JOFFET&NP12LLOFTbEIFFJ^EANC>匚DRdlTIDM號OFTUI'S￡u3J*EfflEhT：(亡5￥i5uAffifCTo由古LEGALLYSfrUNtiW再lL6F,Th￡TthMSAkDSObJfclTIOMSSETF0?:7hImThtSi3tE￡*lCN.TIFTOUODMOT^R.EEWITHMXOFTHETERMSOffCOUDJTICmN5OFThCSETEWS.EUHA^r幅河U5EIkV^OPTlOu0二THEPRODUCTSTHEEFFECTIVTDATE"OF7HTEjKHEEMEMTISTheDATEY^UFIRST[DOtWLCAD禺MEOFFWFRCDUCT5.-FartNfpurposeofrhi-g：ftqrPFfRRrw,"Pr？di^t"siiall獷桿an CldleIbfj,憧丹門?口號產.<lE!url*riSTnind^^d.ClmidfiraEinreipriseirlaIand1slatedSDfLffdie..C^ntirsAqrE-Enant.ThisALT~K&niantin-ItIte-eei-Ts-rm5.anyexhibitsatH■匚htad:tatbasEa-Tsrnsaindan^torrnssatFa-thnnThellauwrg547電(a?dcFlEodbelowj.ihf?.*flrewnwTirentire 包眄!5蟲七Wr*he0ar1電營產西收尸已彳外耳Thesubjacrrnrrer-je-ec^?sjper^edl-iqal'DrzheragresriEsTtsbetweenth鼻明whether訐尋1"“千七七印.「ega『d%￡theSU&jKt“HerhereofLicenseDelivery,daude^agrantstc匚uaIee丁en”「舊.“白，nentr4ris-ferdb1￡.npnsiJblRentable.r-eijcKibleandUmlTidili-pr^t7小 事Fhi*rhsPrH^ijct巾]niiri3匕。U密fnarrign].55!*iyfnr￡u仃?！鲈庐a'3nr#rnjl。片口口￥不rheproductisdBlIwedlviaelecEronlcdownloadrraatheftpsfremadea^ajllablefollim^ngcusTomer*￡BxecurlanofTliilSL1:且力弓后ftestrlrrlonSfunlesseKpres^lyotherwise歲er邛。尸th1r>tMsigr電白鶴電網t.^usTwrwillr^：(a)彳口。1中.。irinsli^eor匚「esxe□穹T/中工1*營*orksof工/呻ft二d5H；i.bi11e._r&u*ra￡eng-freerqtrevtrssms^anbewnypartIoriorthe^rodiuctcrarr^iiptiadisco^&rartysourcecariE-0r麗d**"l，ng5do^forj】qbithiP*nHFths?！?力門;； ： CziJGk-<Ck.n>IBl>■日*4A4WKl>ClouderaexpressLicense1Acceptthislicense?<no><Y0>二3SecnrcCITT??F!ii(\v，一3 ，"： ??TALV"■.…x]?一!?：：o!?：：uoUOUuuuUI?::o installing EfibeddeciDatabase

/OK

c1ovd>^^-4nan^q*r-S?rver-db-? iasittp po1myourwebbrowserto3:7180/.Log1ntoclouderaManagerwithusernajne:'amirvandpassword:'adw^ntocontinueinstallation.(NotethatthehostnanenaybeIncorrect.Irtheurldoesnotwork,trythehosrnArp}Puu$?>npnr^wor*lyconr^rTirigrotMs-na.-Mr^)ifyouhaverrcgipuonMLlcq.Fak0suredisabledMrewalIs.likeIptaoles.<ok> Finish installaTionwassuccessful.<OK|>至此安裝cm成功，上圖中列出了cm訪問地址，以及登陸的用戶名和密碼4.cdh安裝4.1.登PSCM-c0]Q,ZJLSO,137：-n..T.r-1>中網畫-c0]Q,ZJLSO,137：-n..T.r-1>中網畫Horfflrxlunlfrl5四cloudera支總■Aa-amdin歡迎使用ClouderaManager.您想要部署哪4版本？力樂ci4u?srEm?rpn(?DitaNufri?tion輪慮獷司匹弗雷門工與并官總附：;二兩開T監(jiān)開卜內^^幫本喇上導丁針,*ClouderaExpress/CkMiderdEnterprise數(shù)據(jù)集嵯器試用版ClouderaEnterprise許可證免嗯S天年PTiT同萬同申麗才/產田用B律悵為C31K?riF^pEE*三行d仔4英r]S-T：4^叁任濟不袈=1、LQudHidWlrtfllpTlA!在三1慵蟲叩可皿BnicEdtonFCEdtbriDvtaHubEdbon書點網明Jl曜制理*兒?川V/Cloud^raMEinagtr接心功H蜻.指定主機為CDH群集安裝指定主機.二仲M于社用亍標聲向?師一主機二林FC「如天府開cm*Wh.CIUtaB1^pr-wi]m琳照|＞擔閏|i斷而斤%暄幀*示：圈庠皿卬胃看更機,彈由厘木超趾.「口到*203劇1QZ31 1310231120I』在上圖的輸入框中輸入需要安裝的主機的 ip地址，多個ip地址之間回車，點擊“搜索”按鈕檢查各個主機的通訊情況。為CDH耕妹安裝指定主機b:WILiT.ii」7,4?口?布仁rr-.--,biL?..匚口1106才3座祖母愷」山口4口Mu.關r三曰“匕的上機i搜H性曲對M上fl進〒5三十得兄曲嗓.席手丁型用曲11?WS±ft.?fWtu^m）四上F1RP15千王機，耳中35干工注顏才己腎iasBMFo&Ni?-1Ut芻■變餐ffiJB# 1023122013口/南鄉(xiāng)W23n32013百/王稹沮占眈t備口F，醞E!的包孑IQM91?2口3nndelMIK1母N231D14百/古禮海修產4?中何和以■1。羽1嘉。羽n色由國用口即口期聿否丁圭，1在鼬目h1節(jié)Mi叵時間.<伯瑞122QW5口值，voaaram第百/干11在有斯4：口盅*訐卬燈,聯(lián)* 10133H32035gft2fto2酬3902fW小主H追再財土2『小段肝1可t1013132037門中百K3231口押”否/外1酒用能制1面他1圓幡可B1I33S133UBddiEKQtW331如OX否丁丁禮田福時孫？父"蹲膽”或*1。羽門20MBMCfef??IC23122C259/王小酒奇林瓦|硼?瓜斯詡B1U9U9M0I?02&i3期融2了工機吊后站W，明他瓜葉亂.10i23l39011noiMJlVQ9S139DAI3/王以氾MHd.1RK仁RE9*ID33133U3n?M：21Q.33I.32OB2苦/王眈岳說明?i*H岫州迎.mucimM尚昶1W.2d1.210^312丁迎疆看E0/網剛1孫* 1023]亶口34naOs34園231“。里3J主也后名/4-114年日的亂㈤1029122035旭施第1OJ3V22C353J至U貓昌3&41咄刖B硒值LN運回a.群集安裝群集安必選性白儲蟀.'?L-i---I.'" 1,：-5*r.* I'： Ji-11；，"釬,TirYT".I，RHE",i：，+,1卜，》，i,, |?￥i. -ft-npartri.當有物件更折不用時，否害￥屈手的斗旗*”中府崎主機上百也捧由iiltJE帔用匚UutlEW而rcr時氾動不出功苣it4上在巳配■的寫flt—焚一—福i：ajfiss?在里??上加。*ff 看劃HHLM丁回?JtMouwjyarjfls-Sr,的皿巴震行七aj￡!<prwaaaQBdq此處沒有CDH版本，需要安裝Parcel4.4.安裝parcel4.4.1.配置CDH-530-1.cdh530.p0.30-el6.parcel.sha1CDH-5.3.0-1.cdh5.3.0.p0.30-el6.parcel.sha 中的數(shù)字要和manifest.json中CDH版本一致在官網下載的parcel中有三個文件，需要配置parcel的版本[root@nodel3parcel]>」ratal1533543-rw-r—E--1 rooc toot 15702994L3 Har 9 11:14 CDH-5,J.(-J.cdhS.3.0,p0?30-616.parcel-iw-r--r--1 root :口ot 4JL Hac 9 11;11 CDH-5.3.(-1.cdh5.3.O.pO?3D-el6*paicel?3hal-i>-r-工l-1 toot =out 42655 Ear 9 11:IL nanitest.j?OE打開manifest.json文件，此文件時json格式，在其中找到parcelName為CDH-5.3.0-1.cdh5.3.0.p0.30-el6.parcel”對應的hash值-匚二TEOirTlai-tUpiated:14191STSOOOOOO-Jparcels4也[Q]白,[1]parceDIsfne:^CIH-S,3.0-1.cdlfi,3.0.>0.30-&18.psrcelw+.Jcompanent^5："工抵皿5OLR.IAEK"t/h”h："8bS5lRTbn6ed6qg“。538d353匚1491E。1見276"由七[3]田上[4]± [5]將此hash拷貝到CDH-530-1.cdh530.p0.30-el6.parcel.sha1 文件中[roat@nodel3parcel]^viCDH-5*3,O-l,cdh.5*340.p0.30-e!6.parcel.sh*l6b55197fcfb6&（1649ac0533d353cl49Lfcc75g2764.4.2. 酉己置parcel配置parcel有二種方式：方式一：使用本地 parcel（安裝cm的機器）將上面配置好的文件拷貝到 /opt/cloudera/parcel-repo目錄下（此目錄會在安裝完 cm后自動創(chuàng)建），[EootBnD（iei46wcei-reDoJ#dm/opt;c1znidara/pucfl1-e?pc[密口口楣口〉后146paxcel-Eepc-JjfLItotal1535548-c?-r 1 cloiJdeia-sciL clDudexa-sm 157DZS9425 M￡.r 3 21:20 cdh-5k3.J-l.cans.a.o.pO.ao-iilG.uaicel-e-j一—1 cloijoera-sett elajdeta-giziii 4L a&r 9 21:28 EDH-5.3,J.cihS.3.U.pfl.3D-<..jia￡caj?sha-EU-E--E：--1 root root ①655 Mar 11 10:24修改cm自動檢測parcel的時間，默認是1小時（登錄cm,在【管理】-【設置】中選擇[parcel]，修改"Parcel更新頻率"，點擊"保存修改"按鈕）IE5Lcloudera「主M右處▼工總詒*▼WflF國未設置姆性能m搦fifz安全IE5Lcloudera「主M右處▼工總詒*▼WflF國未設置姆性能m搦fifz安全H結口和地讓本地Pareti任膈異話普PJ(CHE新狎率遠程Parcel存倚庫URLH他支相外福分椅沿訐網絡育方叉■韓相達首『”「-ii.-lP^fp-nr.F-rrpc11硼V壬百士底/.應■]?用?，|nttp4mi2201g中am， +Itf.f/vcfr'/erlnurlfa：nn■“邛r3(im*rEJ聞f，，U +Itittp.flarchhz&cigaer曰上口MKig^ORKeytr閡eeapmirH +rtflp.^archivexioudEra.eDm^qDD|3-corinie￡tik^4)arEBis/lai +nrpWM'ch^t:loudeH3:nrr-ac:unulcvp^'ctii/1-ly+-f■,,,■■■,---,--=i-QriftireurrMiiov-:,I-t-：t, +型HL山苴.'上‘：」,_h'T-|UL：LT」..」l'LC^'Ll'_L1Jlu'jL-L重啟機器，下次登錄就會在 1分鐘后檢測到parcel。方式二：使用遠程URL存儲庫將之前配置好的 parcel上傳至之前配置好的yum源機器的/var/www/html/parcel目錄下Indexof/parcelNameLn翁tpoodifiudSi五匚De呂aipti口nName建ParurrtDimtnrv團CDH-工&口—1」曲工3.CLpClpare"09-Iar-20151P141.53團CDH-5.及0-Lcdh5.3,0.W.30f1633tceLshal09-Mar-201&11:11 41[?|manifest..ison 03-?ar-201511;：14器Apachc/^t2工5(CcntQS)%n弋r曰t14^31, IS產口j-18Q在“集群安裝”界面，選擇“使用parcel"，點擊右面的“更多選項”，修改“遠程Parcel存儲庫URL”為3/parcel/更多也度P?“i32O^MUtwA^?rtRwtjTl本更多也度P?“i32O^MUtwA^?rtRwtjTl本?Par“，存?年務待nfiPar“，存?KUR.A>pVtioudeT?parcds/DpVtioudrf?Y>vtcwcpo?聊mO2"22(MS-y ?-gwc—guora-m如v—?-??WIN-atemTHOOt-SDTMN^'m ? 一nop—fcnxguo，ae*(6ukMMr(，"ia ? "皿-u-m*CMu>"…— ?-王M上安榮Pareti的目凝-Ttt,pafceKdcfie,目凝言幡■于文眸寫Ut自函才4?0Q黑/和及創(chuàng)longjni力W已第I,p>rctLdf?1*TMflMBS.?itE!Parcel通口iE?為代理攜色二亙卬皿?QeuGsamnao4物■雨partei Pvcei訐【WXfflUPU隹充■pVie時，CkXjoeram，?，取M梅B>SS)D*假號MM-aMKrtMJUL群集安裝遺蝶存他每Cgoj.也W果用削京代?*門電85宴*,00。和1事可1al用房二四，J又"例/W拒升藥4?讓。0，g的心的5&心管牛加*上的*4?k取0】下便用PDE.口口￡件任所可用才，內再尋回于動力茶￡中用E王機上國雷?并備比止2快同CDuGE>“mer冊海動史文造揖力彼ttW*see?便國P”C&(?/)。更冷送明途睜CD45*本伍注士左已&M耳M算牛女向l~sl,綣金左支多達驗上#fl-f?白含義4?M.iW.2可磔七能咫包.息忤霰石安整也KIIRClotxMraManagerA9?h(WltXOft.?itcojoeriMaragtfServerKEftSnKo0定義再州?M返回osaoa00M返回代理■務也代理■務也Re?n出CWgeraMMMVServer51。Meme(時借?倏咫的代看修野??gTFSPM：歸宿上此滔當口o,oeQM如3wS”f詡。:川eF叼偌名疫目的箕看篷務必1口?HJQTttPMCk?Wt選擇parcel和cm等□口川f叼撞設院用二加三華Y1?軌庫冠正而安玉.因走的『陽可1工良閏:藥二力:市KIMJ營?冗升雷日之山UCiOuAfo'.^-jQt-裊歸曲?IS肆JIIJL的基件,31和5擇不空序phE.當何比斗更苜胃甯町，檔專關尸土地井；彈?中輸f;小田?拜金出3.受卓匚d=那Mb.u臨融T賦功能迭祥力* 雷用聲席和。喟frfflFnnzeii?謂?電I!小麗遺抨CDHRS*，UIM工口01旺52口口口加W?R??HFe*MtKIMWnManftfltr府才首行修.DCQouMbMnxierSewJiElKSrffi，已定義存fltth即朝az義度01凱巾43maSLE/艮附薪C.H他到PM為?船的甘，麗Ihtri //fln:hd...c]■■■■?*,<.uW!i.a,r■*■!.-1haiK.MftfeTlifMLWung看其出網加Mfrhtt^i/^wchJvEic.]Q?d?r?(*?utwriwn4clcL'-hKlM!1c^1IucI4f*%L^? L^L適電手解百白也二拜懂Jt和羌ITOEM國25114嗣)，巖丘—白壬要URLIhQp1^102312201好MmFJ上ThucEs圾3LESR?haS威具他口即。為￡和由分件下科■htt|E：//MTEta-VH.c]■■■■a-cnn'-CBEi-inKHbrt-&'vK_44^?BP^GP&=KEff-r,lauhra以LI>un&Liita罐無國it的丹市亓內，trttfi//JFTlH^e.F]*?ri^-4irnH*aSc>f1Ei;wifg值■NBdMfmnpcmiF-IihOSacaara選擇“自定義存儲庫”，如上圖填寫*安嘎匚eEJ3M53E開關工m忸舊1版秘中此^^&必拉韋附敘的」嘰6」事內對mmari際曲■如t印第個電二律元訐戶或鬻無曬總mFim且不正宣信行專空的由“凸不印k*的3N詆匈aflfiQQDON詆匈aflfiQQDO勾選“安裝OracleJavaSE開發(fā)工具包”Cl裝安裝RnggUl?fMode1HlMmHFwCM'UIM■. dirai1，4IM林小鵬Mmt的-IFCr#i^|：U. Mu?€rTth'?lM?,<；,?口即/u電?HMS-SE$M?？?，njeumtmooe81皿和降CEuderi njw專門小瓦&gcpcd占日與斯a4呻好i^er,Dy由加xkxriera-itr*!6,nwawprcrtrznjiKia?nceiMEtnmanageaiBiw日$inaInenestortheMte*" 后。她*nbelweeigE初即H斷然出‘Re?vrMwiMrtjirj口口■貨嗎面以帷qqgm』jssstrvn箝mtnH>1的日.m用moefec口mmca。不升前第e嗝仙:門的北工/加丁rut:-m7史口二也不刖號im"口父no［油料?！鼍蚄rErfimifiPe電如制巾。時mbu晤葡州mumm第EMykTM氣呼E,m*董軀c幃旗質imn闔。m no#iwin在而3圖pem淵*帕竄jo□抑制加量電他跳^帆IKUIUfKC停心福,￡OT/0U啪5即iwk<vform4D$Mer>中yuwm>宜mvbquwmow?inot如亭叫巾就i事呻#?U**r*kM<t □ CnirP^Lrealdu&ter&Itorunnarglea&effmo?whbpbOieCrwerjg叼igeiTiinoaiWMtembuhi陽m加thesanrsjrsfamilisetDrt^lupparfiEdftv匚口H0-ancJabtr-flekE3kE3naoDDdd暮中上?巨群集安裝日世ssh景*口叩昭用巨曾￡燈王帆的mm揖I。棋阪-dt安翌程EWi也5sM重珞M擊王頓燼音RffiXmet殂尸號的親WE■汨T-1a皆空為rou用=1血E密且^皿呻師川H1聚的用戶事皆加尢也既I而胃主機■（作為*I■口面就Lt建方的陽聲,守麗aEMTA鼻曇小看lF耳神.所召主7曲受*i#mm?L?HAKBmm?L??力時4日JHMfe：?？傎F上土愷眇昌帶露加HtilH性手猊怪鼻?N返回10,同時輸入各個主機的密碼（所有主機的密碼均要求一致），修改同時安裝數(shù)量（默認10,同時安裝數(shù)量太多可能會太卡，取決于網速以及機器的性能）安裝CMJDK和分發(fā)數(shù)據(jù)包等群集安裝正在交餐.?中止安整F/叱不唐3Q+主機申*jq小費事心存一口史方??瑞10531-220HI3iflJt鐵也<,.正在安4!ioud*r.3mn：jg9J也曰t屋i書8通91.liDCfeU1Q33I3S141LWttLU0A2.^Dd?2410飛對際241*佬京科b￡unDde2510J!3l220J5I<r特定-諜汨但忌J=10J3I工QUA1t.*JT?如博曳.?0M^71023I1W271L?￡門口集2a1023122flt2fl1t.艇正如注-aocfeZ?10231EW1tnWE—Q加第甯102^1220^01t,自泥jftem*■pde31ID111.220911WS曲Btr工通h返回DQDO9，□?粕,為某一節(jié)點出錯,士上法二蕓同卜包，*，X%虎)￥.E4鹿叁H珀,[當?生春[ 上次[1耨耐閏FQt-IMO9.92MCSTtlXa:/■' x■'nrpn^Ktk.>>￡Hp^9d.nl:|Eesik14JCauJ-dcc±cip?a.'riadtJU-H：I'/ivdlK.EdrK^EdBExip3dHta_i'rn^ca±.mxJ.擊ykJUjf4<ht￡MJt$f-iErrux-CiUHKKFIHErU^HXHipg.P4.bOXFKBtBCtatM|HpiXpd-ml)fBiTripCUltKV；Cd-MdXiB,flBH—V?|T^.tfUT|iBMhMhdTfJ-fcJBGJl￡>TD力M正隹宣■嬖“Ie恒….1Knn/-ILdtJLa?EL?dplU^Uu'td-u1：Hrit%LEinti.±v4tufcr-ju-k>H^kltB>■cUeXtjlhnTOfl“W-ChJJfJPfCilL*Q|C>tCo?Jin■EUit丁—a.jdk.IaqMIHutiJKiTwc口工ET9ri 電ctfurirrJUXUJi^fMCUCK&LEJCirj：*±4,iw^ii■S.nit才n2?方*舊7-，11|Tffh911]《甲山Rj科/qnAoMHMi「/MUM*靖國；『”網"事店叫RBN?U<Zryj_ac|■a'clurEbJ-ktclf,-frlla://ndJuHi'￡dtv^acdae/tvpottHt^.i'ieHp-Evdl.khI^|Hei:nci14J-OauJ-doeiI: j-jdLB^/r/rvdiH.±dx?nEdntfxapDdaE.aytnp?aiaHbJ.前圾沖ischtrnur^r-iF*1---)上?■iH.mftr-—ir?[Tnrl.i".ripniF，tht'1”[Dcrau14[Fillriut*p*akj'.EH?d*■■?!■“￡//"—^/?1曲》?,/丁0nrfirff-aJ-j]]=- ?，"fryingq七li?『tilxrsr.KFMTI■■thhQ^LW4[4|Kflirty 1clit『甲T?■^■1%IT4T 口Fit*/Verify *ndTf^4^414!yum有問題[r^DE歌Syuffi.F^pOS.cO* 1nsol1ll^lSZinartedplL^lns：Ti'STesErnlrror?rerrsh-p^kagek1ie9seexrlcyLaid!ngmlrrsrspaedsFranachadhostfllfl1-今：fi[.："/^KH4/1onca%hnmciDcmA/riqaQmd;wlH[?*rrtDU]could