IBM Power AIX 6.1+Ha 7.1配置方法.docx

目錄1.說(shuō)明21.1.文檔說(shuō)明21.2.注意事項(xiàng)22.安裝環(huán)境32.1.硬件,帶HMC32.2.軟件33.規(guī)劃33.1.拓?fù)浣Y(jié)構(gòu)規(guī)劃33.2.應(yīng)用服務(wù)器規(guī)劃33.3.資源組規(guī)劃44.安裝步驟44.1.配置2臺(tái)小機(jī)的IP地址。44.2.安裝Power Ha雙機(jī)軟件，并且升級(jí)雙機(jī)軟件。44.3.編輯/etc/hosts與/etc/cluster/rhosts文件。44.4.在主機(jī)的終端上輸入：smitty hacmp54.4.1.初始化一個(gè)群集54.4.2.配置存儲(chǔ)庫(kù)磁盤94.4.3.群集和存儲(chǔ)庫(kù)磁盤創(chuàng)建完成后，可以先同步下雙機(jī)。104.4.4.在存儲(chǔ)上分別映射2塊數(shù)據(jù)盤過(guò)來(lái)，然后在HA主備機(jī)里面執(zhí)行cfgmgr v命令。114.4.5.建立Persistent Node IP Addresses114.4.6.創(chuàng)建資源組134.4.7.配置服務(wù)IP144.4.8.配置應(yīng)用程序啟停腳本144.4.9.使雙機(jī)可以發(fā)現(xiàn)存儲(chǔ)映射過(guò)去的磁盤144.4.10.存儲(chǔ)映射過(guò)去的盤添加到雙機(jī)資源組中154.4.11.同步雙機(jī)配置175.雙機(jī)的基本操作215.1.雙機(jī)的啟動(dòng)215.2.雙機(jī)的停止215.3.雙機(jī)狀態(tài)的查看225.4.保存snapshot226.雙機(jī)的切換測(cè)試226.1.手工停服務(wù)器測(cè)試226.2.切換資源組236.2.1.Smitty cspoc236.2.2.切換應(yīng)用236.3.模擬網(wǎng)卡故障測(cè)試236.4.模擬服務(wù)器異常宕機(jī)測(cè)試247.雙機(jī)的其他操作247.1.lscluster d命令247.2.lscluster m命令247.3.usr/es/sbin/cluster/utilities/clmgr query cluster命令257.4.usr/es/sbin/cluster/utilities/cltopinfo命令267.5.usr/es/sbin/cluster/utilities/clmgr view report topology命令277.6.更換心跳磁盤【心跳盤、repository disk】的命令281. 說(shuō)明1.1. 文檔說(shuō)明本文的環(huán)境是在AIX6.1操作系統(tǒng)下安裝配置hacmp的步驟，其它版本的系統(tǒng)安裝配置基本類似，不同之處，請(qǐng)參考IBM的官方文檔。1.2. 注意事項(xiàng)配置hacmp的一些注意事項(xiàng)：1.2.1. 安裝的版本要符合數(shù)據(jù)中心的版本策略要求1.2.2. 安裝前要做好規(guī)劃，了解應(yīng)用要實(shí)現(xiàn)什么樣的高可靠性需求1.2.3. HA可以實(shí)現(xiàn)排除單點(diǎn)故障，但不是冗余，因此關(guān)鍵部件還要有冗余配置，如電源模塊、雙HBA卡、rootvg鏡像等1.2.4. 配置為HA的主、備節(jié)點(diǎn)不能是同一臺(tái)物理服務(wù)器上的兩個(gè)邏輯分區(qū)1.2.5. 存儲(chǔ)廠商在HA環(huán)境下有定制的磁盤解鎖腳本，EMC、HDS存儲(chǔ)，在HA 的add custom disk methods中增加廠商自定義腳本。1.2.6. 編寫(xiě)的應(yīng)用啟停腳本要事先手工執(zhí)行測(cè)試，并且確保停止腳本在系統(tǒng)異常時(shí)可以停止應(yīng)用，以釋放資源。1.2.7. HA配置完成后，不要將HA的服務(wù)設(shè)置為自啟動(dòng)模式，即HA服務(wù)的啟動(dòng)，要手工啟動(dòng)1.2.8. HA配置完成后，要模擬各種故障場(chǎng)景，充分測(cè)試接管功能是否正常。2. 安裝環(huán)境2.1. 硬件,帶HMCServer1: IBM Power 730(8231 E2C)Server2: IBM Power 730(8231 E2C)2.2. 軟件2.2.1. OS環(huán)境：6100-08-02-13162.2.2. HA環(huán)境：3. 規(guī)劃3.1. 拓?fù)浣Y(jié)構(gòu)規(guī)劃net_ether_01規(guī)劃群集名稱節(jié)點(diǎn)名稱網(wǎng)絡(luò)名稱Boot LabelPersistent LabelService Labelhisserver_clusterhisserver1net_ether_01hisserver1_boot2hisserver1_perhisserver1_serviceHisserver2hisserver2_boot2hisserver2_perhisserver2_service3.2. 應(yīng)用服務(wù)器規(guī)劃應(yīng)用服務(wù)器名稱應(yīng)用服務(wù)器啟動(dòng)腳本路徑應(yīng)用服務(wù)器停止腳本路徑app1/usr/es/script/start.sh/usr/es/script/stop.sh3.3. 資源組規(guī)劃資源組名稱參入節(jié)點(diǎn)應(yīng)用服務(wù)器Service IP Label卷組rg1hisserver1app1hisserver1_servicedatavghisserver2backupvg4. 安裝步驟4.1. 配置2臺(tái)小機(jī)的IP地址。名稱En0En2Hisserver/24/24Hisserver/24/244.2. 安裝Power Ha雙機(jī)軟件，并且升級(jí)雙機(jī)軟件。4.3. 編輯/etc/hosts與/etc/cluster/rhosts文件。/etc/hosts loopback localhost hisserver hisserver hisserver1_boot hisserver2_boot2 hisserver1_per hisserver2_per hisserver1_service hisserver2_service/etc/cluster/rhostshisserver1hisserver2hisserver1_boot2hisserver2_boot2hisserver1_perhisserver2_per4.4. 在主機(jī)的終端上輸入：smitty hacmp4.4.1. 初始化一個(gè)群集.Move cursor to desired item and press Enter.Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination ToolsCustom Cluster ConfigurationCant find what you are looking for ?Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ? .Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields Cluster Name hisserver_cluster Currently Configured Node(s) hisserver1 hisserver2當(dāng)初始化完成群集之后，群集的網(wǎng)絡(luò)、網(wǎng)絡(luò)接口都已經(jīng)自動(dòng)配置好了。-info- start -Warning: to complete this configuration, a repository disk must be defined.Cluster Name: hisserver_clusterCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster Message Encryption: NoneUse Persistent Labels for Communication: NoRepository Disk: NoneCluster IP Address: There are 2 node(s) and 1 network(s) definedNODE hisserver1:Network net_ether_01hisserverhisserver1_bootNODE hisserver2:Network net_ether_01hisserver2_boothisserverNo resource groups definedInitializing.Gathering cluster information, which may take a few minutes.Processing.Storing the following information in file/usr/es/sbin/cluster/etc/config/clvg_confighisserver1:Hdisk:hdisk0PVID:00f874e355ef7a89VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk0PVID:00f874e45588e2d4VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk1PVID:00f874e3338b7141VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk1PVID:00f874e43378f191VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:Nohisserver2:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:NoFREEMAJORS:51.FREEMAJORS:51.Warning: There is no cluster found.cllsclstr: No cluster defined.cllsclstr: Error reading configuration.Communication path hisserver1 discovered a new node. Hostname is hisserver1. Adding it to the configuration with Nodename hisserver1.Communication path hisserver2 discovered a new node. Hostname is hisserver2. Adding it to the configuration with Nodename hisserver2.Discovering IP Network ConnectivityRetrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on node hisserver2Collector on node hisserver1 completedCollector on node hisserver2 completedData collection completeCompleted 10 percent of the verification checksCompleted 20 percent of the verification checksCompleted 30 percent of the verification checksCompleted 40 percent of the verification checksCompleted 50 percent of the verification checksCompleted 60 percent of the verification checksCompleted 70 percent of the verification checksDiscovered 6 interfacesCompleted 80 percent of the verification checksCompleted 90 percent of the verification checksCompleted 100 percent of the verification checksIP Network Discovery completed normallyCurrent cluster configuration:Discovering Volume Group Configuration- end -4.4.2. 配置存儲(chǔ)庫(kù)磁盤.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ?.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry FieldsClusterName hisserver_clusterRepository Disk hdisk2 Cluster IP Address 4.4.3. 群集和存儲(chǔ)庫(kù)磁盤創(chuàng)建完成后，可以先同步下雙機(jī)。.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration同步完成后磁盤情況如下：# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private active4.4.4. 在存儲(chǔ)上分別映射2塊數(shù)據(jù)盤過(guò)來(lái)，然后在HA主備機(jī)里面執(zhí)行cfgmgr v命令。# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private activehdisk3hdisk4主機(jī)上分別執(zhí)行如下命令：Chdev l hdisk3 a pv=yesChdev l hdisk4 a pv=yes/usr/sbin/mkvg -y datavg -s 128 -f -n -V53 -C hdisk3/usr/sbin/mkvg -y backupvg -s 128 -f -n -V54 -C hdisk4varyonvg datavgvaryonvg backupvg然后通過(guò)smitty jfs2建立文件系統(tǒng)。備機(jī)上執(zhí)行如下命令：/usr/sbin/importvg -y datavg hdisk3/usr/sbin/importvg -y backupvg hdisk44.4.5. 建立Persistent Node IP Addresses.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Show Topology Information by Node Add a Node Change/Show a Node Remove a Node Configure Persistent Node IP Label/Addresses Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Persistent Node IP Label/Address Change / Show a Persistent Node IP Label/Address Remove a Persistent Node IP Label/Address配置完P(guān)ersistent IP之后就可以利用Persistent IP登陸了。4.4.6. 創(chuàng)建資源組.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Make Applications Highly Available (Use Smart Assists) Resources Resource Groups Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Resource Group Change/Show Nodes and Policies for a Resource Group Change/Show Resources and Attributes for a Resource Group Remove a Resource Group Configure Resource Group Run-Time Policies Show All Resources by Node or Resource Group Verify and Synchronize Cluster Configuration Learn more about Resource Groups.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Resource Group Name rg1* Participating Nodes (Default Node Priority) hisserver1 hisserver2 + Startup Policy Online On First Available Node + Fallover Policy Fallover To Next Priority Node In The List + Fallback Policy Never Fallback 4.4.7. 配置服務(wù)IP 執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/clmgr add service_ip hisserver1_service NETMASK= NETWORK=net_ether_014.4.8. 配置應(yīng)用程序啟停腳本執(zhí)行如下 命令：/usr/es/sbin/cluster/utilities/claddserv -sapp1 -b/usr/es/script/start.sh -e/usr/es/script/stop.sh4.4.9. 使雙機(jī)可以發(fā)現(xiàn)存儲(chǔ)映射過(guò)去的磁盤. Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration4.4.10. 存儲(chǔ)映射過(guò)去的盤添加到雙機(jī)資源組中. 通過(guò)smitty hacmp實(shí)現(xiàn)Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination Tools Custom Cluster ConfigurationMake Applications Highly Available (Use Smart Assists)Resources Resource Groups Resource Group Name rg1 Participating Nodes (Default Node Priority) hisserver1 hisserver2 Startup Policy Online On First Available Node Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Never Fallback Service IP Labels/Addresses hisserver1_service + Application Controllers app1 + Volume Groups datavg backupvg + Use forced varyon of volume groups, if necessary false + Automatically Import Volume Groups false + Filesystems (empty is ALL for VGs specified) + Filesystems Consistency Check fsck + Filesystems Recovery Method sequential + Filesystems mounted before IP configured false + Filesystems/Directories to Export (NFSv2/3) + Filesystems/Directories to Export (NFSv4) + Stable Storage Path (NFSv4) + Filesystems/Directories to NFS Mount Network For NFS Mount + Tape Resources + Raw Disk PVIDs + Primary Workload Manager Class + Secondary Workload Manager Class + Miscellaneous Data WPAR Name + User Defined Resources +. 通過(guò)執(zhí)行命令實(shí)現(xiàn)執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/claddres -g rg1 SERVICE_LABEL=hisserver1_service APPLICATIONS=app1 VOLUME_GROUP=datavg backupvg FORCED_VARYON=false VG_AUTO_IMPORT=false FILESYSTEM= FSCHECK_TOOL=fsck RECOVERY_METHOD=sequential FS_BEFORE_IPADDR=false EXPORT_FILESYSTEM= EXPORT_FILESYSTEM_V4= STABLE_STORAGE_PATH= MOUNT_FILESYSTEM= NFS_NETWORK= SHARED_TAPE_RESOURCES= DISK= MISC_DATA= WPAR_NAME= USERDEFINED_RESOURCES=4.4.11. 同步雙機(jī)配置. Smitty hacmpMove cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?. 同步雙機(jī)配置Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration-info- start -Verification to be performed on the following:Cluster TopologyCluster ResourcesVerification will interactively correct verification errors.Retrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on