IBM Power AIX 6.1+Ha 7.1配置方法

1、目錄1.說明21.1.文檔說明21.2.注意事項(xiàng)22.安裝環(huán)境32.1.硬件,帶HMC32.2.軟件33.規(guī)劃33.1.拓?fù)浣Y(jié)構(gòu)規(guī)劃33.2.應(yīng)用服務(wù)器規(guī)劃33.3.資源組規(guī)劃44.安裝步驟44.1.配置2臺小機(jī)的IP地址。44.2.安裝Power Ha雙機(jī)軟件，并且升級雙機(jī)軟件。44.3.編輯/etc/hosts與/etc/cluster/rhosts文件。44.4.在主機(jī)的終端上輸入：smitty hacmp54.4.1.初始化一個群集54.4.2.配置存儲庫磁盤94.4.3.群集和存儲庫磁盤創(chuàng)建完成后，可以先同步下雙機(jī)。104.4.4.在存儲上分別映射2塊數(shù)據(jù)盤過來，然后在HA主備機(jī)里面

2、執(zhí)行cfgmgr v命令。114.4.5.建立Persistent Node IP Addresses114.4.6.創(chuàng)建資源組134.4.7.配置服務(wù)IP144.4.8.配置應(yīng)用程序啟停腳本144.4.9.使雙機(jī)可以發(fā)現(xiàn)存儲映射過去的磁盤144.4.10.存儲映射過去的盤添加到雙機(jī)資源組中154.4.11.同步雙機(jī)配置175.雙機(jī)的基本操作215.1.雙機(jī)的啟動215.2.雙機(jī)的停止215.3.雙機(jī)狀態(tài)的查看225.4.保存snapshot226.雙機(jī)的切換測試226.1.手工停服務(wù)器測試226.2.切換資源組236.2.1.Smitty cspoc236.2.2.切換應(yīng)用236.3.模擬網(wǎng)

3、卡故障測試236.4.模擬服務(wù)器異常宕機(jī)測試247.雙機(jī)的其他操作247.1.lscluster d命令247.2.lscluster m命令247.3.usr/es/sbin/cluster/utilities/clmgr query cluster命令257.4.usr/es/sbin/cluster/utilities/cltopinfo命令267.5.usr/es/sbin/cluster/utilities/clmgr view report topology命令277.6.更換心跳磁盤【心跳盤、repository disk】的命令281. 說明1.1. 文檔說明本文的環(huán)境是在AI

4、X6.1操作系統(tǒng)下安裝配置hacmp的步驟，其它版本的系統(tǒng)安裝配置基本類似，不同之處，請參考IBM的官方文檔。1.2. 注意事項(xiàng)配置hacmp的一些注意事項(xiàng)：1.2.1. 安裝的版本要符合數(shù)據(jù)中心的版本策略要求1.2.2. 安裝前要做好規(guī)劃，了解應(yīng)用要實(shí)現(xiàn)什么樣的高可靠性需求1.2.3. HA可以實(shí)現(xiàn)排除單點(diǎn)故障，但不是冗余，因此關(guān)鍵部件還要有冗余配置，如電源模塊、雙HBA卡、rootvg鏡像等1.2.4. 配置為HA的主、備節(jié)點(diǎn)不能是同一臺物理服務(wù)器上的兩個邏輯分區(qū)1.2.5. 存儲廠商在HA環(huán)境下有定制的磁盤解鎖腳本，EMC、HDS存儲，在HA 的add custom dis

5、k methods中增加廠商自定義腳本。1.2.6. 編寫的應(yīng)用啟停腳本要事先手工執(zhí)行測試，并且確保停止腳本在系統(tǒng)異常時可以停止應(yīng)用，以釋放資源。1.2.7. HA配置完成后，不要將HA的服務(wù)設(shè)置為自啟動模式，即HA服務(wù)的啟動，要手工啟動1.2.8. HA配置完成后，要模擬各種故障場景，充分測試接管功能是否正常。2. 安裝環(huán)境2.1. 硬件,帶HMCServer1: IBM Power 730(8231 E2C)Server2: IBM Power 730(8231 E2C)2.2. 軟件2.2.1. OS環(huán)境：6100-08-02-13162.2.2. HA環(huán)境：3. 規(guī)劃3.

6、1. 拓?fù)浣Y(jié)構(gòu)規(guī)劃net_ether_01規(guī)劃群集名稱節(jié)點(diǎn)名稱網(wǎng)絡(luò)名稱Boot LabelPersistent LabelService Labelhisserver_clusterhisserver1net_ether_01hisserver1_boot2hisserver1_perhisserver1_serviceHisserver2hisserver2_boot2hisserver2_perhisserver2_service3.2. 應(yīng)用服務(wù)器規(guī)劃應(yīng)用服務(wù)器名稱應(yīng)用服務(wù)器啟動腳本路徑應(yīng)用服務(wù)器停止腳本路徑app1/usr/es/script/start.sh/usr/es/scrip

7、t/stop.sh3.3. 資源組規(guī)劃資源組名稱參入節(jié)點(diǎn)應(yīng)用服務(wù)器Service IP Label卷組rg1hisserver1app1hisserver1_servicedatavghisserver2backupvg4. 安裝步驟4.1. 配置2臺小機(jī)的IP地址。名稱En0En2Hisserver/24/24Hisserver/24/244.2. 安裝Power Ha雙機(jī)軟件，并且升級雙機(jī)軟件。4.3. 編輯/etc/hosts與/etc/cluster/rhosts文件。/etc/hosts l

8、oopback localhost hisserver hisserver hisserver1_boot hisserver2_boot2 hisserver1_per hisserver2_per hisserver1_service hisserver2_service/etc/cluster/rhostshisserver1hisserver2hisserver1_boot2hisserver2_boot2hiss

9、erver1_perhisserver2_per4.4. 在主機(jī)的終端上輸入：smitty hacmp4.4.1. 初始化一個群集.Move cursor to desired item and press Enter.Cluster Nodes and NetworksCluster Applications and ResourcesSystem Management (C-SPOC)Problem Determination ToolsCustom Cluster ConfigurationCant find what you are looking for ?Not su

10、re where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and pre

11、ss Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ? .Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry Fields Cluster Name hisserver_cluster Currently Configur

12、ed Node(s) hisserver1 hisserver2當(dāng)初始化完成群集之后，群集的網(wǎng)絡(luò)、網(wǎng)絡(luò)接口都已經(jīng)自動配置好了。-info- start -Warning: to complete this configuration, a repository disk must be defined.Cluster Name: hisserver_clusterCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster Message Encryption:

13、NoneUse Persistent Labels for Communication: NoRepository Disk: NoneCluster IP Address: There are 2 node(s) and 1 network(s) definedNODE hisserver1:Network net_ether_01hisserverhisserver1_bootNODE hisserver2:Network net_ether_01hisserver2_boothisserverNo resou

14、rce groups definedInitializing.Gathering cluster information, which may take a few minutes.Processing.Storing the following information in file/usr/es/sbin/cluster/etc/config/clvg_confighisserver1:Hdisk:hdisk0PVID:00f874e355ef7a89VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohi

15、sserver2:Hdisk:hdisk0PVID:00f874e45588e2d4VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk1PVID:00f874e3338b7141VGname:rootvgVGmajor:10Conc-capable:NoVGactive:YesQuorum-required:Nohisserver2:Hdisk:hdisk1PVID:00f874e43378f191VGname:rootvgVGmajor:10Conc-capabl

16、e:NoVGactive:YesQuorum-required:Nohisserver1:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:Nohisserver2:Hdisk:hdisk2PVID:00f874e33239aab1VGname:NoneVGmajor:0Conc-capable:NoVGactive:NoQuorum-required:NoFREEMAJORS:51.FREEMAJORS:51.Warning: There is no c

17、luster found.cllsclstr: No cluster defined.cllsclstr: Error reading configuration.Communication path hisserver1 discovered a new node. Hostname is hisserver1. Adding it to the configuration with Nodename hisserver1.Communication path hisserver2 discovered a new node. Hostname is hisserver2. Adding i

18、t to the configuration with Nodename hisserver2.Discovering IP Network ConnectivityRetrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on node hisserver2Collector on node hisserver1 completedCollector on node hisse

19、rver2 completedData collection completeCompleted 10 percent of the verification checksCompleted 20 percent of the verification checksCompleted 30 percent of the verification checksCompleted 40 percent of the verification checksCompleted 50 percent of the verification checksCompleted 60 percent of th

20、e verification checksCompleted 70 percent of the verification checksDiscovered 6 interfacesCompleted 80 percent of the verification checksCompleted 90 percent of the verification checksCompleted 100 percent of the verification checksIP Network Discovery completed normallyCurrent cluster configuratio

21、n:Discovering Volume Group Configuration- end -4.4.2. 配置存儲庫磁盤.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not

22、 sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and

23、press Enter. Setup a Cluster, Nodes and Networks Define Repository Disk and Cluster IP Address What are the repository disk and cluster IP address ?.Type or select values in entry fields.Press Enter AFTER making all desired changes. Entry FieldsClusterName hisserver_clusterRepository Disk hdi

24、sk2 Cluster IP Address 4.4.3. 群集和存儲庫磁盤創(chuàng)建完成后，可以先同步下雙機(jī)。.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ?

25、Not sure where to start ?.Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration同步完成后磁盤情況如下：# lspvhdisk0 00f874e355ef

26、7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private active4.4.4. 在存儲上分別映射2塊數(shù)據(jù)盤過來，然后在HA主備機(jī)里面執(zhí)行cfgmgr v命令。# lspvhdisk0 00f874e355ef7a89 rootvg activehdisk1 00f874e3338b7141 rootvg activehdisk2 00f874e33239aab1 caavg_private activehdisk3hdisk4主機(jī)上分別執(zhí)行如下命令：Chdev l

27、 hdisk3 a pv=yesChdev l hdisk4 a pv=yes/usr/sbin/mkvg -y datavg -s 128 -f -n -V53 -C hdisk3/usr/sbin/mkvg -y backupvg -s 128 -f -n -V54 -C hdisk4varyonvg datavgvaryonvg backupvg然后通過smitty jfs2建立文件系統(tǒng)。備機(jī)上執(zhí)行如下命令：/usr/sbin/importvg -y datavg hdisk3/usr/sbin/importvg -y backupvg hdisk44.4.5. 建立Persistent

28、 Node IP Addresses.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor t

29、o desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Show Topology Information by N

30、ode Add a Node Change/Show a Node Remove a Node Configure Persistent Node IP Label/Addresses Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Persistent Node IP Label/Address Change / Show a Persistent Node IP Label/Address Remove a Persistent No

31、de IP Label/Address配置完P(guān)ersistent IP之后就可以利用Persistent IP登陸了。4.4.6. 創(chuàng)建資源組.Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking

32、 for ? Not sure where to start ?.Move cursor to desired item and press Enter. Make Applications Highly Available (Use Smart Assists) Resources Resource Groups Verify and Synchronize Cluster Configuration.Move cursor to desired item and press Enter. Add a Resource Group Change/Show Node

33、s and Policies for a Resource Group Change/Show Resources and Attributes for a Resource Group Remove a Resource Group Configure Resource Group Run-Time Policies Show All Resources by Node or Resource Group Verify and Synchronize Cluster Configuration Learn more about Resource Groups.Type or s

34、elect values in entry fields.Press Enter AFTER making all desired changes. Entry Fields* Resource Group Name rg1* Participating Nodes (Default Node Priority) hisserver1 hisserver2 + Startup Policy Online On First Available Node + Fallover Policy Fallover To Next Priority Node In The List + Fallback

35、Policy Never Fallback 4.4.7. 配置服務(wù)IP 執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/clmgr add service_ip hisserver1_service NETMASK= NETWORK=net_ether_014.4.8. 配置應(yīng)用程序啟停腳本執(zhí)行如下 命令：/usr/es/sbin/cluster/utilities/claddserv -sapp1 -b/usr/es/script/start.sh -e/usr/es/script/stop.sh4.4.9. 使雙機(jī)可以發(fā)現(xiàn)存儲映射過去的

36、磁盤. Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find what you are looking for ? Not sure where to start ?.Move cursor to desired item

37、and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration4.4.10. 存儲映射過去的盤添加到雙機(jī)資源組中. 通過smitty hacmp實(shí)現(xiàn)Cluster Nodes and NetworksCluster Applications

38、and ResourcesSystem Management (C-SPOC)Problem Determination Tools Custom Cluster ConfigurationMake Applications Highly Available (Use Smart Assists)Resources Resource Groups Resource Group Name rg1 Participating Nodes (Default Node Priority) hisserver1 hisserver2 Startup Policy Online On First Avai

39、lable Node Fallover Policy Fallover To Next Priority Node In The List Fallback Policy Never Fallback Service IP Labels/Addresses hisserver1_service + Application Controllers app1 + Volume Groups datavg backupvg + Use forced varyon of volume groups, if necessary false + Automatically Import Volume Gr

40、oups false + Filesystems (empty is ALL for VGs specified) + Filesystems Consistency Check fsck + Filesystems Recovery Method sequential + Filesystems mounted before IP configured false + Filesystems/Directories to Export (NFSv2/3) + Filesystems/Directories to Export (NFSv4) + Stable Storage Path (NF

41、Sv4) + Filesystems/Directories to NFS Mount Network For NFS Mount + Tape Resources + Raw Disk PVIDs + Primary Workload Manager Class + Secondary Workload Manager Class + Miscellaneous Data WPAR Name + User Defined Resources +. 通過執(zhí)行命令實(shí)現(xiàn)執(zhí)行如下命令：/usr/es/sbin/cluster/utilities/claddres -g rg1 SER

42、VICE_LABEL=hisserver1_service APPLICATIONS=app1 VOLUME_GROUP=datavg backupvg FORCED_VARYON=false VG_AUTO_IMPORT=false FILESYSTEM= FSCHECK_TOOL=fsck RECOVERY_METHOD=sequential FS_BEFORE_IPADDR=false EXPORT_FILESYSTEM= EXPORT_FILESYSTEM_V4= STABLE_STORAGE_PATH= MOUNT_FILESYSTEM= NFS_NETWORK= SHARED_TA

43、PE_RESOURCES= DISK= MISC_DATA= WPAR_NAME= USERDEFINED_RESOURCES=4.4.11. 同步雙機(jī)配置. Smitty hacmpMove cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Cant find

44、 what you are looking for ? Not sure where to start ?. 同步雙機(jī)配置Move cursor to desired item and press Enter. Initial Cluster Setup (Typical) Manage the Cluster Manage Nodes Manage Networks and Network Interfaces Discover Network Interfaces and Disks Verify and Synchronize Cluster Configuration-info- start -Verification to be performed on the following:Cluster TopologyCluster ResourcesVerification will interactively correct verification errors.Retrieving data from available cluster nodes. This could take a few minutes.Start data collection on node hisserver1Start data collection on