云計(jì)算與大數(shù)據(jù)試驗(yàn)報(bào)告

1、云計(jì)算與大數(shù)據(jù)實(shí)驗(yàn)實(shí)驗(yàn)報(bào)告實(shí)驗(yàn)二熟悉常用的HDFS操作學(xué)號(hào)：201710610姓名：分?jǐn)?shù)實(shí)驗(yàn)?zāi)康模菏炀歨dfs shell 命令操作理解hdfs shell 和linux shell 命令熟練hdfs shell命令操作理解 hdfs shell 和 linux shell 命令實(shí)驗(yàn)環(huán)境：centos6.5 + jdk1.7.0_79 + hadoop2.4.1 實(shí)驗(yàn)內(nèi)容與完成情況:1 .在simple文件夾下配置Hadoop環(huán)境變量26B8 JpSroDtflaimpile sxnple Al hdfe dfs -helpusage： hadoop ft generic opiiDns)-d

2、ppendTFiU ClocalsrO . . JCfll ignorecrc Fq I -chttkturi . I-chgrp -R CWUP path. . 1-chrod I -RJ . MODE. | 0CTADI0CF PATH . YhOtoinL 卬：dWUENE GAduP： PATH .copyFroruocal -力-p , -capyToLGcal I - p I - z qrwirefrc -crc| srO ,. |-cdoit t -ql . .1(-p (fl I -p). -cnwteswpslnot r CMBpshctnamel df :-K .Jdu i

3、 聞 i =|Q pvtt . .電- get - p (-igHoreCrc f-crd . . RJ /-qetmerqe -nil sr:- IcraJtisT：-：(-iielp ( end . JLi I-fl L-U -R3 .Jnhilf ( p口肌帽,1-inoveF rami Deal , r -itov?tqlcicbI ( 5 re clocaldst-irv srt) . a I - put -* I -p f - rerhesipshQt，許印箏rwtDLf SUWmefe4iane-l-ml -f - r - R - skipTrashJ . . J-fiMlir

4、- ignare- fail- an- iwn- empty) Cdlr -L -R bb( -k l_speot CpvttiM | set - setrep【用,切 fth . s J-stat ( feraat明 th，, j-tail t-fjI - test - AefShi i - text L-ignoreCridl 30 . . J2 .在simple文件夾下執(zhí)行touch words.txt 新建worde.txt ,并對(duì)文本進(jìn)行編輯。并進(jìn)行下載， 移動(dòng)等操作rGDtainpl# sinplel* hdfi -put /single/brdi 1nt f Jnrcccgniz

5、rt optign - put Error Could not create the Jsa Virtual nathins Error A fstsl。:叩Hmt has, occurred ProgfM will exit.ifDOlOf iAplC &1I/01 帆1At1T tl m”giT必 nr-cat/vords txt- Unknoumi connand1?？赪sinp加 sxnpleM hadt dfs -get /ward txt /5im(le?vard. tstb$f h； hMf；事。d心口tflEiiiplF wiinplel# h-rifs df與 gpt /wo

6、rd txt /siinjile/ward TKt19/1U10 14 31 15 心RM util. UativeCadeLcMder Unable to L 口日 d n-ati-sc- - ad Dap Lisrary far ycur pldtfomi. using buittin- jiara cl eses where ispUtable get； 7*crd No 511Kli file or di1rMturyrootOslapleMf5 d4 -mv /word. tsrt /werdstp trt19/1V10 14 3t 54 WARM util. WatlveCede-

7、Laatler LkiabL# 1q lead 辦白七1老-。自4心口 Llnrari far your platforoL. Ullhg bulltln-a*ja Cl whrfi applicablev Vwordi hl No such file or directory ：roDtflEiHple sinplei# hdfs df& -Is /19/11/10 14 如WARN uhL WE 工Utiable to 1Md iidtdM-Modg 口 lisroty far ycur plot form . u) 工 ng builLin- jarn cl打就$ r e邨事1mMe F

8、ound W itEiascirwkr-Mf-x- rsQt wp”gwp。2D16-11-24 Ifl： 34 /tupHE-rM- r&Bf SUrgrQupD 2D16-11-24 14： 3S /US#FrooWsiapU siapUTI |3 .查看所有管理命令，f iapl4J rd立即 at - r-iHift -m&L 向iEPRJECATES： Use 0+ tills script to ewerute Mfs ciMHiandi is deprecartedl nitefld we the hdf d td ese-cute b手號(hào) adriinis-triat仁Qmfi

9、arid. he full iynt?iM 1(：iftdaat dtiMiln rtporc - ufanBM1 Mtr I itMt I 9tt i| m1i fi.AkeHaiwf.pace.-rolltdlts-n曲力Gt立tru*|rhes：kt - reTireshl!ii3ckesl- 41dblid di-cl rOuDta di rnaiwi-letSpncrtucta Cquot dlirnflhc.- 一115口司工tQMt口 nc?. . - - ref reshiSe rui e eAc 1-ref re&hUiterToijroMpMjpplngsJ-rtftfh$

10、u網(wǎng)ru(trrouptCOflf iguration-reT res-hCd ILQueyQI - pF inTicpol4cirl-rfffreshNaMnodes datamdehnt: parit - deleteBlkPaal gCmQdw-st!時(shí)甘 blocfcpoolld L force! i-MfiF rR.ndcfth Hai勺水icdtti3-f etchlnmge I oca I directory：巾ll-Npgdhqt皿 ME-de 5aLIMSnjsp5na t 5napshatDx.r? |i upgrade)-9rtDAtamodkClnfci 晶星，口ipc

11、_port-help end Jreoeri：fteports b4slc 16盛工營(yíng)勵(lì) lnQrmiil.gn and4 .在jack文件夾啟動(dòng)hdfs,mrtVSup-le L t1乎 jack lihrootCLaple 里同建 cd j ackrootfi5liple JtcN V jpsE2S3 JpsreotJhLapU jick Urt dfi. UhL/ll/10 14： 69 40 MMVii util. KativeCadeLoader： Unaiile to 10ad ratiYfHhadacp libra ry for 髀uplatfoniL. using bllltl

12、M-Jwi ClftMCl tfhfift applicableStartlnj natewde5 on siipldHmpl屯 starting naMnod& logging t4 /1崢1m11*口/，2.4口. rcianenode- sinple outInumlJhQEt； statinq datanod& Icqqinq to /sjapl&liaddap-Z 4 1J IciqHti詞dqcip-ir口t-d at anode- siBple. outtar tung &ec 口 nd 日門/ nanEnixSES 0.0. 0. 05. 0.0 0 lUrtlng she-d

13、logging 10乳呷叩，乩”啊qli蛇口即 ，t- sec 口口巾誦/口不而 ngde-5 inpl e. amt-：-* n ：-r. .-i. Nat.veCodeLKdti Unable lo 心八七 舊用厘 library lor /our piatfomL s uimg builtin-java clashes where applicable:口口地slBpl七配kf jpssrn jps267B SeconduryNeiiHHcide克再 NweNodB24S6 DatdM口韭FDaTtsLupine hdfs dfs helphlp： lUnhnoriii CGMdndDi

14、d you aeanq help? This covidnd vith u dash.- rdotCsiBplt 前K件 hd+s dfs -helpUsage hadrap f I generic options)-appendToFlle locals ro . e-cat L-igiflofeCirdl .一】l-digir RJ 6R0UP 附TH-J-dhiod -Rl TOD0 , WE . . | OCTALHDP& 網(wǎng)加,JI - chciwn L-RJ OWkJERli ；L GROUP J MTU.-cpyFroRLocal f pj l-copyTgLocil - pl

15、I nginoreCrc -crd (src . (Ucildt) csunt7 j -Cp i-f -p . . lI -rrpATFnfloshQT I 入力FsghutH啟tw8.115 . Rmr循環(huán)刪除hdfs系統(tǒng)中的目錄：Seneric options syppcurted are-canf Ctioefigufati心外 file口 ropen：Rvalue?fil力linille n-ode. psrtJit for given proipertyiriamenDdejob trackerspecify cohm 與臺(tái)口合弧artid flipf tc toe cdpied t

16、o the 3P r芯du亡& cluster-Libi srs specify cowra sepra-ted ar files tainclude in the tla寫SMtharchives (comalist of archleocm ieparted archlwto be unsrcliived on the compute uchines.The general command line syntax ispin/hedMip comund【generic則$】CMMndOptlcnsiwtltiinple JbcIO* httfs dfs - cat /wmli. txtia

17、/lj/io IE 典；wm util. MativeCDdeLoader： unable ta iMd native-hariocp library far y dlii plat farm. . . using Ituiltin-jmv占 c Lasses Where applicablerg05訓(xùn)iple jackjf ldT dfs -fit /wcrdi. tjctseneiric opt lews supported are conf inflgi ratlin fileC fs the nap reduce cliiterllbjari specify cowd 現(xiàn)網(wǎng)凱記 Mdl

18、,$ to M unartilled oo the cavouie machiDei.The general wiimM line hbrn/hadoop :a-NHna laenericOptions com加加譏:的引：roDtfsiipU jiacldt hdfs dfE -cact onls.txt19/11而 15； 02； 31 WMI itil ItalMMElMien Mlc to M native- hadoop libran for your plathiri. using kdltii-jafa cIeesh 烈hem appli:ible：roDtfsiipk jack

19、 I hadf dfs imr 作盯k txt bnh： had/ cwmnd not found6 .開(kāi)啟hadoop集群堂件叱)我由以*圖 例就工 簾臥山 roalCsifipleOl 亦由- starl-aLL sh frhis script is deprecated, instead use stftrvdfs，sh and mnsm. sh 16/11/10 IS; 12： 27 bfJM util. NitivaCcKtaLoflclar? UnibU to load ndtiw hadoop Iitors ry for your platform . using bulltin

20、-jtva classes where applicableStartinq naKnode on Java HatSputCTKi 64-Bit Server VN wamingi fou Havie loadc d library Ziaple/iiadQap-2.4. 1/lih/native/liNindoop. so which Bight have dl&flbletl jtack guard The vm will try to fin the ftack guard nx.IT 5 highly recoiniKndeid that you Tiw the library wi

21、th eKecstrick c ClibfileX P or link It with neexecs.tacK.siKslelsed 一衛(wèi)技這式Sl 事符G :父梢耒即逼獨(dú)-c unkrown cipher type cfsimple： sshi connect to hmt simple part 22： Nd route fa ho5lHotS(ct( TH3! JW： Could not resolve hostn jffie Hot Spot t IF! ：or service net known hau電Could rwt resnlyc hDtnc have：: Na or rv

22、lce knonwhichf： could not resolve Iwstna-ne whichc hane or serwice not known 占t曰匚k; sslr Cguld not re5口Ive hc5tnamB 箏tact Mane or service not known giiardL : ssh： Lould not resolve hostnne guard. ： Ntaae or service mot knmwni Rou； ssh； could dm res磯ve iwsmamt you： Ham or S打vis non knownE4 6it：馳h;Cau

23、ld not ruolvflh白&tumnE 64-BJtNam ui 專電(也亡cnot kuowrbserverssh：Could not resoV/etiostnane ServerNaie or jerncenot knmnlibrary; ssh： Could not resolve hostnanr-e library; hlane or serwice Fiat known t&- ishk Could not resol we hostriaBe Id： Nrre or service not known fftight- ssh Caultf not resolve he5

24、1mgi飛 ilghi： m占幔 or service net known W Could not resolve hostnaM? W： Nafic or service not known disable ssh- could mat respire hostnaie disabled,加帳 or service not known wamung； ： ssh； Could not resolre hostname earning； : N己me or service not Kddwh Tbe： M： Can Id not rewire bo&tname1 Ttw： Naae or se

25、ryice not kmiM Isded： ssh： Could not resold mstnan型 Ixd4d Nane or seri/lce not knawni will sh; Could rwt re5nlve hs&tnaiw wilL Nne or service mot knciwn stacte ssfr Could not resolve hstnane stack: h.ane gr service not known nw. ； 55h： Could rwt resoIve horstnaw n” ： Nave or service oot known Jaa ss

26、h： CouLd not reioLtfe hostnaiK Java： Naie ci ierlce not knadi出現(xiàn)的問(wèn)題：剛開(kāi)始學(xué)習(xí)Linux , hadoop不太熟悉操作，以及指令的用法不熟悉，多次導(dǎo)致 實(shí)驗(yàn)出現(xiàn)錯(cuò)誤解決方案（列出遇到的問(wèn)題和解決辦法，列出沒(méi)有解決的問(wèn)題）：案#上j 的&盤+仍 :期中 郊imm)L roDt4sripLe =固 1 # cdroDtAftiiple m 一Anacwda- ks. cfqinstall log)yslog 祭典的視為文*1舄爺insull. UgMrkspa*不履用片下有aSrootflsiiple cdl.Ikush. cd.

27、： convhaiid nor foundEidbftBple U cd .Lnth 坤le /( TsbindHhowUb64nedlawtoptrootselimix softsys “rbootetclihlost* foundhliecnetpF4vcsbiaisinfile srwvarrodtfistaple /Itfi cd simpleraotd&i,Rple sinpleJU Ucreate. hqUecllisse卜耐加小工工 ijdtL 工o79data singleemployen-Hadocp 2. 4. tsoftddla singlelegenployees.txt*hLr 0.12.0-3.-L 5rootfisnuU singledsh19/11/10 Ui 3H n wmn util NaUvecodeLiMMr unable