HACMP Oracle Rac安裝設(shè)置手冊(cè)

HACMPOracleRac安裝設(shè)置手冊(cè)版本v1.0二零一二年十月北京華勝天成科技股份文檔控制更改記錄版本創(chuàng)立/修改時(shí)間編制/修改者文件/修改內(nèi)容審批人V1.02023.10審閱姓名職位發(fā)布姓名職位目錄TOC\o\h\z\u目錄3第1章HACMPv5.4安裝配置41.1、IP規(guī)劃41.2、安裝HACMP軟件41.2.1、操作系統(tǒng)版本41.2.2、安裝依賴的軟件包51.2.3、安裝HACMPv5.461.3、HACMP配置規(guī)劃81.3.1、配置IP和網(wǎng)絡(luò)81.3.2、編輯/etc/hosts文件91.3.3、創(chuàng)立共享卷組和文件系統(tǒng)91.4、HACMPStandard配置101.4.1、添加cluster和節(jié)點(diǎn)111.4.2、創(chuàng)立并配置資源組111.4.3、同步HACMP的配置131.5、HACMP啟動(dòng)131.5.1、啟動(dòng)HACMP13第2章OracleRAC安裝配置132.1、規(guī)劃132.2、安裝檢查152.3、安裝前配置172.4、安裝CRS202.5、安裝數(shù)據(jù)庫(kù)412.6、創(chuàng)立數(shù)據(jù)庫(kù)472.7、數(shù)據(jù)測(cè)試59HACMPv5.4安裝配置IP規(guī)劃NodeInterfaceNameTypeIPAddressRegisteredInibm03ibm03Public8Hostsfileibm03ibm03-vipVirtual10Hostsfileibm03ibm03-privPrivate8Hostsfileibm04ibm04Public9Hostsfileibm04ibm04-vipVirtual11Hostsfileibm04ibm04-privPrivate9Hostsfile安裝HACMP軟件完成HACMP安裝配置規(guī)劃后，可以開始安裝HACMP軟件，安裝版本為HACMPv5.4。操作系統(tǒng)版本#oslevel-r5300-06安裝依賴的軟件包檢查系統(tǒng)的軟件安裝包，請(qǐng)參照IBM紅皮書中?HighAvailabilityClusterMulti-ProcessingforAIX5LInstallationGuide?。這里我們建議安裝軟件束APP-DEV和SERVER，其中包括的紅皮書要求的大局部軟件包。安裝rsct軟件包：rsct.basic〔可選〕安裝其它軟件包：bos.clvm〔使用并行資源組時(shí)需要，RAC下必須安裝此包〕bos.data#smittyinstall_latestInstallSoftwareTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]INPUTdevice/directoryforsoftware/dev/cd0SOFTWAREtoinstall[_all_latest]PREVIEWonly?(installoperationwillNOToccur)noCOMMITsoftwareupdates?yesSAVEreplacedfiles?noAUTOMATICALLYinstallrequisitesoftware?yesEXTENDfilesystemsifspaceneeded?yesOVERWRITEsameornewerversions?noVERIFYinstallandcheckfilesizes?noIncludecorrespondingLANGUAGEfilesets?yesDETAILEDoutput?noProcessmultiplevolumes?yesACCEPTnewlicenseagreements?yesPREVIEWnewLICENSEagreements?no在“SOFTWAREtoinstall〞一欄中選擇要安裝的軟件包，“ACCEPTnewlicenseagreements〞中接受許可協(xié)議，即完成安裝軟件包。或參考以下腳本命令：#安裝軟件包/usr/lib/instl/sm_instinstallp_cmd-a-Q-d'/dev/cd0'-f'bos.clvmALL@@I:bos.clvm_all_fileagerm_all_filesets''-c''-N''-g''-X''-G''-Y'#安裝HACMPv5.4除了haview，netwiew(Tivoli),的包以外，所有的HACMP的軟件包都要安裝，rm為可選安裝包，對(duì)于根本包在安裝光盤或Expansion光盤上可以查找到。#smittyinstall_latestInstallSoftwareTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]INPUTdevice/directoryforsoftware/dev/cd0SOFTWAREtoinstall[_all_latest]PREVIEWonly?(installoperationwillNOToccur)noCOMMITsoftwareupdates?yesSAVEreplacedfiles?noAUTOMATICALLYinstallrequisitesoftware?yesEXTENDfilesystemsifspaceneeded?yesOVERWRITEsameornewerversions?noVERIFYinstallandcheckfilesizes?noIncludecorrespondingLANGUAGEfilesets?yesDETAILEDoutput?noProcessmultiplevolumes?yesACCEPTnewlicenseagreements?yesPREVIEWnewLICENSEagreements?no在“SOFTWAREtoinstall〞一欄中選擇要安裝的軟件包，“ACCEPTnewlicenseagreements〞中接受許可協(xié)議，即完成安裝軟件包，安裝過程大約在10~30分鐘完成?；騾⒖家韵履_本命令：#安裝HACMP/usr/lib/instl/sm_instinstallp_cmd-a-Q-d'/dev/cd0'-f'cluster.adt.esALL@@I:cluster.adt.es_all_filesets,cluster.doc.en_US.esALL@@I:cluster.doc.en_US.es_all_filesets,cluster.esALL@@I:cluster.es_all_filesets,cluster.es.cfsALL@@I:cluster.es.cfs_all_filesets,cluster.es.cspocALL@@I:cluster.es.cspoc_all_filesets,cluster.es.nfsALL@@I:cluster.es.nfs_all_filesets,cluster.es.pluginsALL@@I:cluster.es.plugins_all_filesets,cluster.es.worksheetsALL@@I:cluster.es.worksheets_all_filesets,cluster.licenseALL@@I:cluster.license_all_filesets,cluster.man.en_US.esALL@@I:cluster.man.en_US.es_all_filesets''-c''-N''-g''-X''-G''-Y'系統(tǒng)提示成功后，完成HACMP補(bǔ)丁升級(jí)，將HACMP補(bǔ)丁上傳至系統(tǒng)目錄下，我們假設(shè)上傳目錄為/tmp/hav54，本地目錄為d:\hav54，上傳命令如下：Windows：“開始〞->“運(yùn)行〞，輸入“cmd〞，根據(jù)以下提示完成補(bǔ)丁上傳：MicrosoftWindowsXP[版本5.1.2600](C)版權(quán)所有1985-2001MicrosoftCorp.C:\DocumentsandSettings\Administrator>ftpremote-host-ip-address輸入用戶名和密碼〔此處需要給用戶設(shè)置密碼，如果為空，AIX拒絕登錄〕，成功登錄后：ftp>cd/tmp/hav54ftp>lcdd:\hav54ftp>promptftp>binftp>mput*.bff上傳完成后退出ftp程序ftp>quit升級(jí)HACMPv5.4補(bǔ)丁#smittyupdate_allUpdateInstalledSoftwaretoLatestLevel(UpdateAll)Typeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]INPUTdevice/directoryforsoftware/tmp/hav54SOFTWAREtoupdate_update_allPREVIEWonly?(updateoperationwillNOToccur)noCOMMITsoftwareupdates?yesSAVEreplacedfiles?noAUTOMATICALLYinstallrequisitesoftware?yesEXTENDfilesystemsifspaceneeded?yesVERIFYinstallandcheckfilesizes?noDETAILEDoutput?noProcessmultiplevolumes?yesACCEPTnewlicenseagreements?yesPREVIEWnewLICENSEagreements?no回車確認(rèn)以上命令，即可完成升級(jí)工作。注意：如果安裝程序提示“沒有找到相關(guān)的fileset〞等類似的提示，可在/tmp/hav54目錄下執(zhí)行命令“#inutoc.〞，重新生成軟件包安裝列表。重新啟動(dòng)AIX安裝完成HACMP后，為防止各種問題，要求將AIX系統(tǒng)重新啟動(dòng)，至此我們完成了所有的安裝工作，可以開始配置HACMP雙機(jī)集群了。#shutdown–FrHACMP配置規(guī)劃配置IP和網(wǎng)絡(luò)AIX網(wǎng)卡IP地址配置：#smiittymktcpipAvailableNetworkInterfacesMovecursortodesireditemandpressEnter.en008-08StandardEthernetNetworkInterfaceen108-09StandardEthernetNetworkInterfaceen20A-08StandardEthernetNetworkInterfaceen30J-08StandardEthernetNetworkInterface選擇想要配置IP地址的網(wǎng)卡，選擇“en0〞，回車確認(rèn)，進(jìn)入下一步配置：MinimumConfiguration&StartupToDeleteexistingconfigurationdata,pleaseuseFurtherConfigurationmenusTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]HOSTNAME[ora01]InternetADDRESS(dotteddecimal)[]NetworkMASK(dotteddecimal)[]NetworkINTERFACEen0NAMESERVERInternetADDRESS(dotteddecimal)[]DOMAINName[]DefaultGatewayAddress(dotteddecimalorsymbolicname)[]Cost[0]DoActiveDeadGatewayDetection?noYourCABLETypeN/ASTARTTCP/IPdaemonsNowno使用同樣的方法配置完成網(wǎng)卡的IP地址。編輯/etc/hosts文件對(duì)于兩個(gè)節(jié)點(diǎn)ibm03和ibm04要配置相同的/etc/hosts文件，使用vi配置hosts文件，建議首先對(duì)原有的hosts文件進(jìn)行備份，配置如下：#cp/etc/hosts/etc/hosts.bak#vi/etc/hosts8ibm039ibm048ibm03-priv9ibm04-priv10ibm03-vip11ibm04-vip創(chuàng)立共享卷組和文件系統(tǒng)創(chuàng)立卷組#smitty_mkbvgAddaBigVolumeGroupTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]VOLUMEGROUPname[vgdata]PhysicalpartitionSIZEinmegabytesPHYSICALVOLUMEnames[hdisk2]FORCEthecreationofvolumegroup?yesActivatevolumegroupAUTOMATICALLYnoatsystemrestart?VolumegroupMAJORNUMBER[100]CreateVGConcurrentCapable?no我們?cè)诮ACMP共享卷組時(shí)，要注意的參數(shù)“ActivatevolumegroupAUTOMATICALLYatsystemrestart?〞該項(xiàng)，設(shè)置為“no〞，是使用HACMP的方式將卷組varyon，而不是系統(tǒng)啟動(dòng)時(shí)由操作系統(tǒng)varyon。MajorNUMBER是指該設(shè)備〔orvg〕的主設(shè)備號(hào)，此處設(shè)置為系統(tǒng)唯一即可，可通過命令查詢可用的majornumber：#lvlstmajor43..59,62...或可通過ls–l/dev/命令查看當(dāng)前所有設(shè)備的主設(shè)備號(hào)，第五列即是。創(chuàng)立邏輯卷和文件系統(tǒng)在ibm03節(jié)點(diǎn)上按照以下操作：#varyoffvgvgdata需將vgdatavaryoff下來，在ora02節(jié)點(diǎn)上才能正確的導(dǎo)入。在ibm04節(jié)點(diǎn)上按照一下操作：#lspvhdisk000c2ef1fa38df28arootvgactivehdisk100c2ef1f38b81facrootvgactivehdisk200c2ecef3846c20eNone查看hdisk2是否為物理卷，否那么需要使用命令將其屬性更改：#chdev–lhdisk2–apv=yes導(dǎo)入卷組和文件系統(tǒng)的定義#smittyimportvgImportaVolumeGroupTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]VOLUMEGROUPname[vgdata]*PHYSICALVOLUMEname[hdisk2]VolumegroupMAJORNUMBER[100]#varyonvgvgdata#varyoffvgvgdataHACMPStandard配置HACMP配置可采用Standard和Extended兩種方式，其中Standard配置可以配置Cluter名稱，節(jié)點(diǎn)，根本網(wǎng)絡(luò)，應(yīng)用效勞器，各種資源和資源組等根本的內(nèi)容，如果要配置永久IP，串口心跳，對(duì)資源組進(jìn)行詳細(xì)的配置等工作那么需要在Extended中完成，可以說Standard菜單是Extended菜單的一個(gè)子集，可以在Extended菜單中完成HACMP的所有配置工作。下面我們以Standard菜單完成HACMP的根本配置工作：添加cluster和節(jié)點(diǎn)配置cluster資源創(chuàng)立并配置資源組同步HACMP的配置HACMP配置菜單如下：#smittyhacmpHACMPforAIXMovecursortodesireditemandpressEnter.InitializationandStandardConfigurationExtendedConfigurationSystemManagement(C-SPOC)ProblemDeterminationTools選擇“InitializationandStandardConfiguration〞，如下菜單：InitializationandStandardConfigurationMovecursortodesireditemandpressEnter.ConfigurationAssistantsConfigureanHACMPClusterandNodesConfigureResourcestoMakeHighlyAvailableConfigureHACMPResourceGroupsVerifyandSynchronizeHACMPConfigurationDisplayHACMPConfigurationHACMPClusterTestTool添加cluster和節(jié)點(diǎn)#smittyhacmp->InitializationandStandardConfigurationConfigureanHACMPClusterandNodesConfigureNodestoanHACMPCluster(standard)Typeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]*ClusterName[ora_cluster]NewNodes(viaselectedcommunicationpaths)[ibm03ibm04]CurrentlyConfiguredNode(s)創(chuàng)立并配置資源組#smittyhacmp->InitializationandStandardConfigurationConfigureHACMPResourceGroupsConfigureHACMPResourceGroupsMovecursortodesireditemandpressEnter.AddaResourceGroupChange/ShowaResourceGroupRemoveaResourceGroupChange/ShowResourcesforaResourceGroup(standard)AddaResourceGroupTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]*ResourceGroupName[ora_rg]*ParticipatingNodes(DefaultNodePriority)[ibm03ibm04]StartupPolicyOnlineOnAllAvailabFalloverPolicyBringOffline(OnErr>FallbackPolicyNeverFallback添加資源至資源組中#smittyhacmp->InitializationandStandardConfigurationConfigureHACMPResourceGroupsConfigureHACMPResourceGroupsMovecursortodesireditemandpressEnter.AddaResourceGroupChange/ShowaResourceGroupRemoveaResourceGroupChange/ShowResourcesforaResourceGroup(standard)Change/ShowAllResourcesandAttributesforaResourceGroupTypeorselectvaluesinentryfields.PressEnterAFTERmakingalldesiredchanges.[EntryFields]ResourceGroupNameora_rgParticipatingNodes(DefaultNodePriority)ibm03ibm04StartupPolicyOnlineOnHomeNodeOnlyFalloverPolicyFalloverToNextPriorityNodeInTheListFallbackPolicyFallbackToHigherPriorityNodeInTheListConcurrentVolumeGroups[vgdata]+Useforcedvaryonofvolumegroups,ifnecessaryfalse+AutomaticallyImportVolumeGroupsfalse+ApplicationServers[]+TapeResources[]+至此，我們完成了資源和資源組的關(guān)聯(lián)。同步HACMP的配置#smittyhacmp->InitializationandStandardConfigurationVerifyandSynchronizeHACMPConfiguration回車確認(rèn)該操作，這樣HACMP的配置已經(jīng)同步到兩個(gè)節(jié)點(diǎn)中了，也就是ibm03和ibm04擁有同樣的配置了。HACMP啟動(dòng)啟動(dòng)HACMP在節(jié)點(diǎn)ibm03上執(zhí)行smittyclstart，回車確認(rèn)即可啟動(dòng)HACMP*Startnow,onsystemrestartorbothnow+StartClusterServicesonthesenodes[ibm03]+BROADCASTmessageatstartup?true+StartupClusterInformationDaemon?false+Reacquireresourcesafterforceddown?false+OracleRAC安裝配置規(guī)劃數(shù)據(jù)庫(kù)配置規(guī)劃ORACLE_BASE/dataCRS_HOME/data/product//crsORACLE_HOME/data/product//dbDB_NAMEorclORACLE_SIDorcl1，orcl2TNS_ADMIN$ORACLE_HOME/network/adminOracle管理帳戶的口令sysSystemoracleoracle數(shù)據(jù)庫(kù)存放位置裸設(shè)備是否使用歸檔方式運(yùn)行數(shù)據(jù)庫(kù)Yes備份方式說明RMAN/TSM裸設(shè)備規(guī)劃設(shè)備名稱數(shù)據(jù)庫(kù)設(shè)施存儲(chǔ)空間/dev/rorcl_ocrOcr信息存放500Mb/dev/rorcl_vdiskvdisk信息存放500Mb/dev/rorcl_spfilespfile信息存放100Mb/dev/rorcl_srvconfigsrvconfig信息存放100Mb/dev/rorcl_systemSystem表空間10G/dev/rorcl_sysauxSysaux表空間10G/dev/rorcl_temp1系統(tǒng)臨時(shí)表空間20G/dev/rorcl_temp2系統(tǒng)臨時(shí)表空間20G/dev/rorcl_undo1撤銷表空間20G/dev/rorcl_undo2撤銷表空間20G/dev/rorcl_undo3撤銷表空間20G/dev/rorcl_undo4撤銷表空間20G/dev/rorcl_usersUser表空間10G/dev/rorcl_toolsTools表空間10G/dev/rorcl_ctl1控制文件1G/dev/rorcl_ctl2控制文件1G/dev/rorcl_ctl3控制文件1G/dev/rorcl_log1a日志文件500Mb/dev/rorcl_log1b日志文件500Mb/dev/rorcl_log2a日志文件500Mb/dev/rorcl_log2b日志文件500Mb/dev/rorcl_log3a日志文件500Mb/dev/rorcl_log3b日志文件500Mb/dev/rorcl_log4a日志文件500Mb/dev/rorcl_log4b日志文件500Mb/dev/rorcl_data1用戶數(shù)據(jù)表空間20G/dev/rorcl_data2用戶數(shù)據(jù)表空間20G/dev/rorcl_data3用戶數(shù)據(jù)表空間20G/dev/rorcl_data4用戶數(shù)據(jù)表空間20G安裝檢查操作系統(tǒng)版本：#oslevel-r5300-06物理內(nèi)存：#lsattr-Elmem0goodsize7744AmountofusablephysicalmemoryinMbytesFalsesize7744TotalamountofphysicalmemoryinMbytesFalse交換區(qū)：#lsps-aPageSpacePhysicalVolumeVolumeGroupSize%UsedActiveAutoTypehd6hdisk0rootvg512MB3yesyeslv系統(tǒng)空間：#df-gFilesystemGBblocksFree%UsedIused%IusedMountedon/dev/hd40.500.4413%47885%//dev/hd25.003.1038%412406%/usr/dev/hd9var1.000.956%7471%/var/dev/hd31.000.6536%10821%/tmp/dev/fwdump0.380.371%41%/var/adm/ras/platform/dev/hd10.500.501%711%/home/proc-----/proc/dev/hd10opt2.001.867%34611%/opt/dev/fslv0015.004.4271%292433%/data/dev/lv000.120.124%181%/var/adm/csd文件集：#lslpp-lbos.adt.basebos.adt.libbos.adt.libmbos.perf.libperfstatbos.perf.perfstatctoolsrsct.basic.rtersctpat.clients.rtexlC.aix50.rtexlC.rteFilesetLevelPath:/usr/lib/objreposbos.adt.base.0COMMITTEDBaseApplicationDevelopmentToolkitbos.adt.lib.0COMMITTEDBaseApplicationDevelopmentLibrariesbos.adt.libm.0COMMITTEDBaseApplicationDevelopmentMathLibrarybos.perf.libperfstat.0COMMITTEDPerformanceStatisticsLibraryInterfacebos.perf.perfstat.1COMMITTEDPerformanceStatisticsInterfacectools.0COMMITTEDProcFilesystemToolsrsct.basic.rte.0COMMITTEDRSCTBasicFunctionrsctpat.clients.rte.0COMMITTEDRSCTEventManagementClientFunctionxlC.aix50.rte.1COMMITTEDXLC/C++RuntimeforAIX5.2xlC.rte.1COMMITTEDXLC/C++RuntimePath:/etc/objreposbos.perf.libperfstat.0COMMITTEDPerformanceStatisticsLibraryInterfacebos.perf.perfstat.1COMMITTEDPerformanceStatisticsInterfacersct.basic.rte.0COMMITTEDRSCTBasicFunction安裝前配置為確保oraclerac安裝成功，系統(tǒng)管理員root用戶需創(chuàng)立相應(yīng)的系統(tǒng)用戶、系統(tǒng)組，以便安裝管理oracle軟件。Root用戶還要修改相關(guān)系統(tǒng)參數(shù)，打破默認(rèn)值對(duì)實(shí)際應(yīng)用的限制。調(diào)試rac節(jié)點(diǎn)之間的高級(jí)功能：rcp/rsh/rlogin，以確定兩節(jié)點(diǎn)之間可以通信正常，可以在rac環(huán)境下進(jìn)行相關(guān)同步操作和心跳監(jiān)控。創(chuàng)立dba組，id為500#smittymkgroup創(chuàng)立oracle用戶，id為601#smittymkuser修改oracle用戶密碼#passwdoracle在oracle用戶下創(chuàng)立.rhosts文件，內(nèi)容為“+〞。#su–oracle$vi.rhosts+修改oracle用戶限制#smittychuserSoftFILEsize[-1]SoftCPUtime[-1]SoftDATAsegment[-1]SoftSTACKsize[-1]SoftCOREfilesize[-1]修改系統(tǒng)配置參數(shù)，增加系統(tǒng)進(jìn)程數(shù)上限#smittychgsysMaximumnumberofPROCESSESallowedperuser[2048]修改網(wǎng)絡(luò)參數(shù)no-p-oudp_sendspace=65536no-p-oudp_recvspace=65536no-p-otcp_sendspace=65536no-p-otcp_recvspace=65536no-p-orfc1323=1no-p-osb_max=1310720no-r-oipqmaxlen=512創(chuàng)立裸設(shè)備mklv-yrac_system_raw_500m-TO-wn-sn-rnvgdata8依次創(chuàng)立以下裸設(shè)備：/dev/rorcl_ocr/dev/rorcl_vdisk/dev/rorcl_spfile/dev/rorcl_srvconfig/dev/rorcl_system/dev/rorcl_sysaux/dev/rorcl_temp1/dev/rorcl_temp2/dev/rorcl_undo1/dev/rorcl_undo2/dev/rorcl_undo3/dev/rorcl_undo4/dev/rorcl_users/dev/rorcl_tools/dev/rorcl_ctl1/dev/rorcl_ctl2/dev/rorcl_ctl3/dev/rorcl_log1a/dev/rorcl_log1b/dev/rorcl_log2a/dev/rorcl_log2b/dev/rorcl_log3a/dev/rorcl_log3b/dev/rorcl_log4a/dev/rorcl_log4b/dev/rorcl_data1/dev/rorcl_data2/dev/rorcl_data3/dev/rorcl_data4更改裸設(shè)備權(quán)限#cd/dev#chownoracle:dba*orcl*修改oracle用戶環(huán)境變量#vi/home/oracle/.profileumask022exportORACLE_BASE=/dataexportORACLE_HOME=$ORACLE_BASE/product//dbexportORA_CRS_HOME=$ORACLE_BASE/product//crsexportLD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/lib32exportORACLE_SID=orclexportPATH=$ORACLE_HOME/bin:$ORA_CRS_HOME/bin:$PATH安裝CRS在ibm03節(jié)點(diǎn)上進(jìn)入CRS安裝盤，執(zhí)行runInstaller啟動(dòng)CRS的安裝；按提示在每個(gè)安裝節(jié)點(diǎn)上以root用戶執(zhí)行rootpre.sh，該腳本在CRS安裝盤上的rootpre目錄下；#./rootpre.sh./rootpre.shoutputwillbeloggedin/tmp/rootpre.out_06-04-13.12:33:04Savingtheoriginalfilesin/etc/ora_save_06-04-13.12:33:04Copyingnewkernelextensionto/etcLoadingthekernelextensionfrom/etcOracleKernelExtensionLoaderforAIXCopyright(c)1998,1999OracleCorporationSuccessfullyloaded/etc/pw-syscall.64bit_kernelwithkmid:0x441e300Successfullyconfigured/etc/pw-syscall.64bit_kernelwithkmid:0x441e300Thekernelextensionwassuccessfulyloaded.ConfiguringAsynchronousI/OAsynchronousI/OisalreadydefinedConfiguringPOSIXAsynchronousI/OCheckingifgroupservicesshouldbeconfiguredGroup"hagsuser"doesnotexist.Creatingrequiredgroupforgroupservices:hagsuserPleaseaddyourOracleuseridtothegroup:hagsuserConfiguringHACMPgroupservicessocketforpossibleusebyOracle.Thegrouporpermissionsofthegroupservicessockethavechanged.PleasestopandrestartHACMPbeforetryingtouseOracle.在兩個(gè)節(jié)點(diǎn)都執(zhí)行root.sh腳本：ibm03#./root.shWARNING:directory'/oracle/product/'isnotownedbyrootWARNING:directory'/oracle/product'isnotownedbyrootCheckingtoseeifOracleCRSstackisalreadyconfiguredCheckingtoseeifany9iGSDisupSettingthepermissionsonOCRbackupdirectorySettingupNSdirectoriesOracleClusterRegistryconfigurationupgradedsuccessfullyWARNING:directory'/oracle/product/'isnotownedbyrootWARNING:directory'/oracle/product'isnotownedbyrootSuccessfullyaccumulatednecessaryOCRkeys.Usingports:CSS=49895CRS=49896EVMC=49898andEVMR=49897.node<nodenumber>:<nodename><privateinterconnectname><hostname>node1:ibm03ibm03-privibm03node2:ibm04ibm04-privibm04CreatingOCRkeysforuser'root',privgrp'system'..Operationsuccessful.Nowformattingvotingdevice:/dev/rora_voteFormatof1votingdevicescomplete.Startupwillbequeuedtoinitwithin30seconds.Addingdaemonsto