IBM Power AIX 6.1+Ha 7.1配置方法.docx

目錄1.說明21.1.文檔說明21.2.注意事項22.安裝環(huán)境32.1.硬件,帶HMC32.2.軟件33.規(guī)劃33.1.拓撲結(jié)構(gòu)規(guī)劃33.2.應用服務器規(guī)劃33.3.資源組規(guī)劃44.安裝步驟44.1.配置2臺小機的IP地址。44.2.安裝Power Ha雙機軟件，并且升級雙機軟件。44.3.編輯/etc/hosts與/etc/cluster/rhosts文件。44.4.在主機的終端上輸入：smitty hacmp54.4.1.初始化一個群集54.4.2.配置存儲庫磁盤94.4.3.群集和存儲庫磁盤創(chuàng)建完成后，可以先同步下雙機。104.4.4.在存儲上分別映射2塊數(shù)據(jù)盤過來，然后在HA主備機里面執(zhí)行cfgmgr v命令。114.4.5.建立Persistent Node IP Addresses114.4.6.創(chuàng)建資源組134.4.7.配置服務IP144.4.8.配置應用程序啟停腳本144.4.9.使雙機可以發(fā)現(xiàn)存儲映射過去的磁盤144.4.10.存儲映射過去的盤添加到雙機資源組中154.4.11.同步雙機配置175.雙機的基本操作215.1.雙機的啟動215.2.雙機的停止215.3.雙機狀態(tài)的查看225.4.保存snapshot226.雙機的切換測試226.1.手工停服務器測試226.2.切換資源組236.2.1.Smitty cspoc236.2.2.切換應用236.3.模擬網(wǎng)卡故障測試236.4.模擬服務器異常宕機測試247.雙機的其他操作247.1.lscluster d命令247.2.lscluster m命令247.3.usr/es/sbin/cluster/utilities/clmgr query cluster命令257.4.usr/es/sbin/cluster/utilities/cltopinfo命令267.5.usr/es/sbin/cluster/utilities/clmgr view report topology命令277.6.更換心跳磁盤【心跳盤、repository disk】的命令281. 說明1.1. 文檔說明本文的環(huán)境是在AIX6.1操作系統(tǒng)下安裝配置hacmp的步驟，其它版本的系統(tǒng)安裝配置基本類似，不同之處，請參考IBM的官方文檔。1.2. 注意事項配置hacmp的一些注意事項：1.2.1. 安裝的版本要符合數(shù)據(jù)中心的版本策略要求1.2.2. 安裝前要做好規(guī)劃，了解應用要實現(xiàn)什么樣的高可靠性需求1.2.3. HA可以實現(xiàn)排除單點故障，但不是冗余，因此關鍵部件還要有冗余配置，如電源模塊、雙HBA卡、rootvg鏡像等1.2.4. 配置為HA的主、備節(jié)點不能是同一臺物理服務器上的兩個邏輯分區(qū)1.2.5. 存儲廠商在HA環(huán)境下有定制的磁盤解鎖腳本，EMC、HDS存儲，在HA 的add custom disk methods中增加廠商自定義腳本。1.2.6. 編寫的應用啟停腳本要事先手工執(zhí)行測試，并且確保停止腳本在系統(tǒng)異常時可以停止應用，以釋放資源。1.2.7. HA配置完成后，不要將HA的服務設置為自啟動模式，即HA服務的啟動，要手工啟動1.2.8. HA配置完成后，要模擬各種故障場景，充分測試接管功能是否正常。2. 安裝環(huán)境2.1. 硬件,帶HMCServer1: IBM Power 730(8231 E2C)Server2: IBM Power 730(8231 E2C)2.2. 軟件2.2.1. OS環(huán)境：6100-08-02-13162.2.2. HA環(huán)境：3. 規(guī)劃3.1. 拓撲結(jié)構(gòu)規(guī)劃net_ether_01規(guī)劃群集名稱節(jié)點名稱網(wǎng)絡名稱Boot LabelPersistent LabelService Labelhisserver_clusterhisserver1net_ether_01hisserver1_boot2hisserver1_perhisserver1_serviceHisserver2hisserver2_boot2hisserver2_perhisserver2_service3.2. 應用服務器規(guī)劃應用服務器名稱應用服務器啟動腳本路徑應用服務器停止腳本路徑app1/usr/es/script/start.sh/usr/es/script/stop.sh3.3. 資源組規(guī)劃資源組名稱參入節(jié)點應用服務器Service IP Label卷組rg1hisserver1app1hisserver1_servicedatavghisserver2backupvg4. 安裝步驟4.1. 配置2臺小機的IP地址。名稱En0En2Hisserver/24/24Hisserver/24/244.2. 安裝Power Ha雙機軟件，并且升級雙機軟件。4.3. 編輯/etc/hosts與/etc/cluster/rhosts文件。/etc/hosts loopback localhost hisserver hisserver hisserver1_boot hisserver2_boot2 hisserver1_per hisserver2_per hisserver1_service hisserver2_service/etc/cluster/rhostshisserver1hisserver2hisserver1_boot2hisserver2_boot2hisserver1_perhisserver2_per4.4. 在主機的終端上輸入：smitty hacmp4.4.1. 初始化一個群集.Move cursor to desired item and press Enter.Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination ToolsCustom Cluster ConfigurationCant find what you are looking for ?Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ? .Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields Cluster Name hisserver_cluster Currently Configured Node(s) hisserver1 hisserver2當初始化完成群集之后，群集的網(wǎng)絡、網(wǎng)絡接口都已經(jīng)自動配置好了。-info- start -Warning: to complete this configuration, a repository disk must be defined.Cluster Name: hisserver_clusterCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster Message Encryption: NoneUse Persistent Labels for Communication: NoRepository Disk: NoneCluster IP Address: There are 2 node(s) and 1 network(s) definedNODE hisserver1:Network net_ether_01hisserverhisserver1_bootNODE hisserver2:Network net_ether_01hisserver2_boothisserverNo resource groups definedInitializing.Gathering cluster information, which may take a few minutes.Processing.Storing the following information in file/usr/es/sbin/cluster/etc/config/clvg_confighisserver1:Hdisk:hdisk0PVID:00f874e355ef7a89VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk0PVID:00f874e45588e2d4VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk1PVID:00f874e3338b7141VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk1PVID:00f874e43378f191VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:Nohisserver2:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:NoFREEMAJORS:51.FREEMAJORS:51.Warning: There is no cluster found.cllsclstr: No cluster defined.cllsclstr: Error reading configuration.Communication path hisserver1 discovered a new node. Hostname is hisserver1. Adding it to the configuration with Nodename hisserver1.Communication path hisserver2 discovered a new node. Hostname is hisserver2. Adding it to the configuration with Nodename hisserver2.Discovering IP Network ConnectivityRetrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on node hisserver2Collector on node hisserver1 completedCollector on node hisserver2 completedData collection completeCompleted 10 percent of the verification checksCompleted 20 percent of the verification checksCompleted 30 percent of the verification checksCompleted 40 percent of the verification checksCompleted 50 percent of the verification checksCompleted 60 percent of the verification checksCompleted 70 percent of the verification checksDiscovered 6 interfacesCompleted 80 percent of the verification checksCompleted 90 percent of the verification checksCompleted 100 percent of the verification checksIP Network Discovery completed normallyCurrent cluster configuration:Discovering Volume Group Configuration- end -4.4.2. 配置存儲庫磁盤.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ?.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry FieldsClusterName hisserver_clusterRepository Disk hdisk2 Cluster IP Address 4.4.3. 群集和存儲庫磁盤創(chuàng)建完成后，可以先同步下雙機。.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration同步完成后磁盤情況如下：# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private active4.4.4. 在存儲上分別映射2塊數(shù)據(jù)盤過來，然后在HA主備機里面執(zhí)行cfgmgr v命令。# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private activehdisk3hdisk4主機上分別執(zhí)行如下命令：Chdev l hdisk3 a pv=yesChdev l hdisk4 a pv=yes/usr/sbin/mkvg -y datavg -s 128 -f -n -V53 -C hdisk3/usr/sbin/mkvg -y backupvg -s 128 -f -n -V54 -C hdisk4varyonvg datavgvaryonvg backupvg然后通過smitty jfs2建立文件系統(tǒng)。備機上執(zhí)行如下命令：/usr/sbin/importvg -y datavg hdisk3/usr/sbin/importvg -y backupvg hdisk44.4.5. 建立Persistent Node IP Addresses.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Show Topology Information by Node Add a Node Change/Show a Node Remove a Node Configure Persistent Node IP Label/Addresses Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Persistent Node IP Label/Address Change / Show a Persistent Node IP Label/Address Remove a Persistent Node IP Label/Address配置完Persistent IP之后就可以利用Persistent IP登陸了。4.4.6. 創(chuàng)建資源組.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Make Applications Highly Available (Use Smart Assists) Resources Resource Groups Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Resource Group Change/Show Nodes and Policies for a Resource Group Change/Show Resources and Attributes for a Resource Group Remove a Resource Group Configure Resource Group Run-Time Policies Show All Resources by Node or Resource Group Verify and Synchronize Cluster Configuration Learn more about Resource Groups.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Resource Group Name rg1* Participating Nodes (Default Node Priority) hisserver1 hisserver2 + Startup Policy Online On First Available Node + Fallover Policy Fallover To Next Priority Node In The List + Fallback Policy Never Fallback 4.4.7. 配置服務IP 執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/clmgr add service_ip hisserver1_service NETMASK= NETWORK=net_ether_014.4.8. 配置應用程序啟停腳本執(zhí)行如下 命令：/usr/es/sbin/cluster/utilities/claddserv -sapp1 -b/usr/es/script/start.sh -e/usr/es/script/stop.sh4.4.9. 使雙機可以發(fā)現(xiàn)存儲映射過去的磁盤. Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration4.4.10. 存儲映射過去的盤添加到雙機資源組中. 通過smitty hacmp實現(xiàn)Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination Tools Custom Cluster ConfigurationMake Applications Highly Available (Use Smart Assists)Resources Resource Groups Resource Group Name rg1 Participating Nodes (Default Node Priority) hisserver1 hisserver2 Startup Policy Online On First Available Node Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Never Fallback Service IP Labels/Addresses hisserver1_service + Application Controllers app1 + Volume Groups datavg backupvg + Use forced varyon of volume groups, if necessary false + Automatically Import Volume Groups false + Filesystems (empty is ALL for VGs specified) + Filesystems Consistency Check fsck + Filesystems Recovery Method sequential + Filesystems mounted before IP configured false + Filesystems/Directories to Export (NFSv2/3) + Filesystems/Directories to Export (NFSv4) + Stable Storage Path (NFSv4) + Filesystems/Directories to NFS Mount Network For NFS Mount + Tape Resources + Raw Disk PVIDs + Primary Workload Manager Class + Secondary Workload Manager Class + Miscellaneous Data WPAR Name + User Defined Resources +. 通過執(zhí)行命令實現(xiàn)執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/claddres -g rg1 SERVICE_LABEL=hisserver1_service APPLICATIONS=app1 VOLUME_GROUP=datavg backupvg FORCED_VARYON=false VG_AUTO_IMPORT=false FILESYSTEM= FSCHECK_TOOL=fsck RECOVERY_METHOD=sequential FS_BEFORE_IPADDR=false EXPORT_FILESYSTEM= EXPORT_FILESYSTEM_V4= STABLE_STORAGE_PATH= MOUNT_FILESYSTEM= NFS_NETWORK= SHARED_TAPE_RESOURCES= DISK= MISC_DATA= WPAR_NAME= USERDEFINED_RESOURCES=4.4.11. 同步雙機配置. Smitty hacmpMove cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?. 同步雙機配置Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration-info- start -Verification to be performed on the following:Cluster TopologyCluster ResourcesVerification will interactively correct verification errors.Retrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on