實驗14 mahout數(shù)據(jù)挖掘

廣州大學華軟軟件學院5outhchinaInstituteof5oftiuar(?bnginBering.GU實驗報告封面課程名稱：任課老師:Hadoop大數(shù)據(jù)處理課程代碼:JY1124陳寧穗實驗指導老師:陳寧穗實驗報告名稱：實驗14mahout數(shù)據(jù)挖掘?qū)W生姓名：學號：教學班：遞交日期：簽收人：我申明，本報告內(nèi)的實驗巳按要求完成，報告完全是由我個人完成，并沒有抄襲行為。我巳經(jīng)保留了這份實驗報告的副本。申明人（簽名）：實驗報告評語與評分：評閱老師簽名:

—、實驗名稱：mahout數(shù)據(jù)挖掘二、實驗日期：2015年月日三、實驗目的：熟悉mahout數(shù)據(jù)挖掘。四、實驗用的儀器和材料：硬件：PC電腦一臺；配置：內(nèi)存，4G及以上硬盤250G及以上軟件環(huán)境：操作系統(tǒng)XP，vmware，ubuntu，jdk，hadoop五、實驗的步驟和方法：請用命令完成以下操作1、mahout的安裝與配置：下載并解壓安裝mahout-distribution-0.9.tar.gz（放在hadoop安裝根目錄下），且改名為mahout。hadoop目錄下，tarxzf./mahout-distribution-0.9.tar.gzmvmahout-distribution-0.9mahoutgrid@yln-virtual-machine:-/cpmshout-distribution-0.9-src*tar.gz/home/grid/hadoop-1.2.1grid@yln-virtual-machine下載$cdgrtdgyln-virtual-machinecdhadoop-1.2.1ivy.xmlliblibexecLICENSE.txtlogsmahout-distribution-0.9-src.tar.gzNOTICE.txtivy.xmlliblibexecLICENSE.txtlogsmahout-distribution-0.9-src.tar.gzNOTICE.txtREADME.txtsbinsharesrctmpwebappsC++CHANGES.txtconfcontrtbhadoop-ant-1.2.1.jarhadoop-client-1.2.1.jarhadoop-core-1.2.1.jarhadoop-examples-1.2.1.jarhadoop-minicluster-1.2.1.jarhadoop-test-1.2.1.jarhadoop-tools-1.2.1.jarivy□rtdfflvl-n-virtual-machine:~/hadoop-lt2.1$tarxzf./mahout-dtstrtbutton-O*9-src.tar.qzl2、配置環(huán)境變量:exportHADDOP_HOME=/home/grtd/hadoop-l,2*1exportHADDOPCONF_DIR=/home/grid/hadoop-1.2.1/confexportMAHOUT_HOME=/home/grid/hadoop-11/mahoutexportMAHOUT_CDNF_DIR^/home/grid/hadoop-1.2,1/mahout/confexportPATH=$PATH:$MAHOUT_HOME/conf:$MAHOUT_HOME/binexportHADODPPATH=/hone/grid/hadoop-1.2*1/mahoutexportCLASSPATH=$CLASSPATH:$MAHOUT_HOME/mahout-core-0,9.jar:$MAHOUT_HOME/nahout-examples-0.9,jar:$MAHOUT_HOME/mahout^math-0.9.jar:$MAHDUT_HOME/mahout-utils-0.9*jar:$MAHOUT_HDME/mahout-core-0.9-job.jar:$MAHDUT_HOME/nahout-examples-9*9-job.jargrld@yln-virtual-machine:-/hadoop-1.2*l/mahout$doop-1*2/1grid@yln-virtual.-machine:~grid@yln-virtual-machine:-d/hadoop-1*2*1/confgrid@yln-virtual-machine:~grid@yln-virtual-machine:-doop-l*2/l/mahoutgrid@yln-virtual-machine:~grid@yln-virtual-machine:-d/h8doop-l42*1/mahout/confg「ld@yln-vi「tual-Eaczhine:~griti@yln-virtual-machine:~onf:$MAHOUT_HaME/bingrld@yln-vtrtual-machine:~grid@yln-virtual-machine:~g「id@Vln-victual-machinegrid@yln-virtual-machine:-id/hadoop-1.2*1/mahoutgrid@yln-virtual-machine:~grid@yln-vigrld@yln-virtual-machine:-/hadoop-1.2*l/mahout$doop-1*2/1grid@yln-virtual.-machine:~grid@yln-virtual-machine:-d/hadoop-1*2*1/confgrid@yln-virtual-machine:~grid@yln-virtual-machine:-doop-l*2/l/mahoutgrid@yln-virtual-machine:~grid@yln-virtual-machine:-d/h8doop-l42*1/mahout/confg「ld@yln-vi「tual-Eaczhine:~griti@yln-virtual-machine:~onf:$MAHOUT_HaME/bingrld@yln-vtrtual-machine:~grid@yln-virtual-machine:~g「id@Vln-victual-machinegrid@yln-virtual-machine:-id/hadoop-1.2*1/mahoutgrid@yln-virtual-machine:~grid@yln-vi「tusl-Eachinw:-/hadoop-1*2*l/mahout$/hadoop-1.2.l/mahout$/hadoop-l.N*l/mahout$/hadoop-1.2.l/mahout$/hadoop-1.2.l/mahout$/hadoop-l.N.l/pishout$/hadoop-1.2?l/mahout$/hadoop-1*2.1/mahoutS/hadoop-1.2.l/mahout$/hadoop'1^2*l/mahout$/hadoop-1.2*l/mahout$/hadoop-1.2.l/piahout$exportexportexportexportexportexportHADDOP_HOME=/home/grtd/haHADDOP_CDNF_DIR=/home/griMAHDUT_HOME=/home/grtd/hciMAHOUT_CONF_DIR=/home/griPATH=$PATH:$MAHOUT_HOME/cHADOOP_CLASSPATH=/home/gr/hadoop-1.2.l/mahout$/hadoop-12l/mahout$OUT-HaME/pidhout-core-O^JariSMAHOUT-HOME/mahout-examples-O^Jar:$MAHOUT_HOME/mahout-math-0.9,jar:SMAHDUTHOME/mahout-utils-9.9.jar:$MAHOLIT_HOME/mahout-core-9.9-job.jsr:$MAH0UT_H0ME/mahout-examples-0.9-job.jarqridfflyln-virtual-machine:-/hadoop-1.2,l/mahout$bin/mahoutexportCLASSPATH=$CLASSPATH:$MAHgrid@yln-virtual-machine:-/hadoop-1.2.1$bin/hadoopfs-put/home/grid/mahouttest*txt*/testdata/mahouttest*txtWarning:$HADDOP_HOMEisdeprecated*grid@yIn-virtual-machine:-/hddoop-1^2*1$bin/hadoopfs-Is/Warning:$HADOOP_HOMEisdeprecated*Found2itemsdrwxr-xr-x-gridsupergroup02O14-05-2513:49/homedrwxr-xr-x-gridsupergroup02314-05-2514:12/usergrid@yLn-virtual-machine:-/hadoop-l*2*1$bin/hadoopfs-Is/userWarning:$HAD00P_H0MEisdeprecated*Found1itemsdrwxr-xr-x-gridsupergroup92914-95-2514:12/user/grtdgrid@yLn-virtual-machine:-/hadoop-1^2*1$btn/hadoopfs-Is/user/grtdWarning:$HADOOP_HOMEisdeprecated.Found1itemsdrwxr-xr-x一gridsupergroup02014-05-2514:12/user/grid/testdatagridfflyLn-virtual-machine:~/hadoop-l*2*1$

4、通過語句實現(xiàn)一個keams聚類測試。grtd@yln-virtual-machine:-/hadoop-l*2*l$nahoutorg.apachemahout*clustering*syntheticcontrol*kmeans*JobMAHOU丁_LOCALisnotset;addingHADOOP_CONF_DIRtoclasspath.Warning:$HADDDP_HOMEisdeprecated.Runningonhadoop,using/home/grtd/hadoop-l*2.1/bin/hadoopandHADDOP_CONF_DI/home/grid/hadoop-121/confMAHOUT-JOB:/home/grid/hadoop-1*2.1/mahout/mahout-examples-0.9-job.jarWarning:$HADOOP_HOMEisdeprecated.14/05/2514:14:52WARNdriver*MahoutDriver:Noorg*apachemahout*clustering*syntheticcontrot*kmeans.Job,propsfoundonclasspathfwillusecommand-lineargumentsonly14/05/2514:14:52INFOkmeans*3ob:Runningwithdefaultarguments14/05/2514:14:53INFOkmeans*Job:PreparingInput14/05/2514:14:53WARNmapred.Jobclient:UseGenericOptionsParserforparsingthearguments*ApplicationsshouldimplementToolforthesame*14/05/2514/05/2514/05/2514/05/2514/05/2514:15:0014:15:0014:15:0014:15:0214:15:03INFOinput*FilelnputFomat:Totalinputpathstoprocess:1INFCutil*NativeCodeLoader:Loadedthenattve-hadooplibraryWARNsnappy*LoadSnappy:SnappynativelibrarynotloadedINFOmapred,Jobclient:Running14/05/2514/05/2514/05/2514/05/2514/05/2514:15:0014:15:0014:15:0014:15:0214:15:031,%0,9,8,L29.098,33.176,30.598,40.621,37.411,39.964,1*0:[distance=34.849493818195754]:6031.256,32.266,31.929,45.151,46*880,47.874,25*368,32.211,34,922,42.083,43.550,39*016,30.690,24.274,43.370,47.S4S,38.233,43.442,29.345,31.514,45*461,37*138,46*679,47.275,30.376,29.964,25.919,34.645,42.213,35.778,1.0:[distance=34.9326736651789]:31*067,29.172,31.478,43*893,44.892,37*002,34.92。,34.447,34“796,34.362,44.264,45*602,3S.654,29.989,25*672,37*305,41.770,43.477,32.693,27.280,30.553,36.486,38.904,44.045,,34.740,,31.631,,29.171,,45.360,,42*140,,39.527,26.648,31.721,37.618,48.119,41.691,42.200]60=25.754,35.614,29.091,35.214,34.687,38.602]1,0:[distance=33i61988595879757]:6026.450,34.819,33*548,42.189,38.616,37*232,30.567,33.689,46.348,47*704,46.288,48.179,33.519,31.883,41.486,42.864,46*494,41.128,29.396,34.