P570雙機(jī)互備 DS5100 SAN存儲(chǔ) HACMP6.1詳細(xì)配置方法

1、一.硬件配置1.存儲(chǔ)設(shè)備與現(xiàn)有的DS5100存儲(chǔ)相連接，并且劃分出兩個(gè)空間，分別給ORACLE11G數(shù)據(jù)庫(kù)和SAP應(yīng)用程序來(lái)試用，預(yù)留出300G空間 如下所示：給分區(qū)映射空間分配置如下圖所示：二.軟件配置操作系統(tǒng)版本6100-06-03-1048版本6.1 使用串口卡做心跳.三.IP配置主機(jī)名：GWPRD1GWPRD2bootstdbyservice10.1.126.100;10.1.126.99 向外提供服務(wù)IP 如：注：boot和servicel在同一個(gè)網(wǎng)段，boot與stdby在不同的網(wǎng)段有2個(gè)應(yīng)用，一個(gè)是ORACEL;SAP 互為備份模式，四.軟件安裝及補(bǔ)丁1. 操作系統(tǒng)的安裝/ 61

2、00-06-03-1048 是當(dāng)時(shí)最新的補(bǔ)丁2. 操作系統(tǒng)相關(guān)包安裝（有些默認(rèn)已經(jīng)安裝了）3. 安裝 是當(dāng)時(shí)最新的補(bǔ)丁hacmp61-IZ92782此項(xiàng)目為兩臺(tái)分別安裝上串口卡和串口線做心跳，（配置hd是IP網(wǎng)絡(luò)） 可以用ip別名的方法來(lái)跑心跳，但用來(lái)跑心跳的這個(gè)網(wǎng)段必須不能和其他所有接口在同一個(gè)網(wǎng)段。五.實(shí)施步驟1. 在兩臺(tái)GWPRD1上設(shè)置IP地址（1） 在GWPRD1機(jī)上A. 配置boot1網(wǎng)卡->#smitty (smitty tcpip ->Communications Applications and Services->TCP/IP->Minimum Co

3、nfiguration & Startup選擇en0 * HOSTNAME GWPRD1* Internet ADDRESS (dotted decimal Network MASK (dotted decimal * Network INTERFACE en1NAMESERVERInternet ADDRESS (dotted decimal DOMAIN Name Default GATEWAY Address 10.1.126.254 B. 配置stdby1網(wǎng)卡->#smitty->Communications Applications and Services-&g

4、t;TCP/IP->Minimum Configuration & Startupselect en2* HOSTNAME GWPRD1* Internet ADDRESS (dotted decimal Network MASK (dotted decimal * Network INTERFACE en3NAMESERVERInternet ADDRESS (dotted decimal DOMAIN Name Default GATEWAY Address 10.1.126.254 （2）在GWPRD2機(jī)上A. 配置boot2網(wǎng)卡->#smitty->Commu

5、nications Applications and Services->TCP/IP->Minimum Configuration & Startupselect en0* HOSTNAME GWPRD2* Internet ADDRESS (dotted decimal Network MASK (dotted decimal * Network INTERFACE en1NAMESERVERInternet ADDRESS (dotted decimal DOMAIN Name Default GATEWAY Address 10.1.126.254 B. 配置std

6、by2網(wǎng)卡->#smitty->Communications Applications and Services->TCP/IP->Minimum Configuration & Startupselect en2* HOSTNAME GWPRD2* Internet ADDRESS (dotted decimal Network MASK (dotted decimal * Network INTERFACE en3NAMESERVERInternet ADDRESS (dotted decimal DOMAIN Name Default GATEWAY Ad

7、dress 10.1.126.254 2. 在兩臺(tái)GWPRD1上修改/etc/hosts文件，內(nèi)容如下（1）在GWPRD1機(jī)上127.0.0.1 loopback localhost GWPRD1 192.168.1.2 boot1 GWPRD1 stdby1 GWPRD1 svc1 boot2 GWPRD2 192.168.2.3 stdby2 GWPRD2 10.1.126.99 svc2（2）在GWPRD2機(jī)上127.0.0.1 loopback localhost GWPRD2192.168.1.2 boot1 GWPRD1 stdby1 GWPRD1 svc1 boot2 GWPRD

8、2 192.168.2.3 stdby2 GWPRD2 10.1.126.99 svc23.在GWPRD1上建立共享卷組建立oravg共享卷組->#smitty mkvg選Add an Original Volume GroupAdd a Big Volume GroupAdd a Scalable Volume Group則出現(xiàn)VOLUME GROUP name oravgPhysical partition SIZE in megabytes * PHYSICAL VOLUME names hdisk2 注：根據(jù)客戶現(xiàn)場(chǎng)提供，這里假設(shè)為hdisk2Activate volume gr

9、oup AUTOMATICALLY noat system restart?Volume Group MAJOR NUMBER Create VG concurrent Capable? yes 并行是YES 其它如：主備和互備在創(chuàng)建VG時(shí)應(yīng)選擇NO Auto-varyon in Concurrent Mode? no 這里一樣的主備和互備 NO /并行是YES注：看oravg是否是激活狀態(tài)，如果是激活，則需要#varyoffvg oravgGWPRD1上import共享卷組（1） import oravg共享卷組->#smitty (smitty importvg出現(xiàn)：VOLUME G

10、ROUP name oravg* PHYSICAL VOLUME name hdisk2+Volume Group MAJOR NUMBER +#注意：sapvg同上面方法一樣。（2） 修改oravg共享卷組屬性->#smitty (smitty chvgselect * VOLUME GROUP name oravgVOLUME GROUP name oravg* ACTIVATE volume group AUTOMATICALLY noat system restart?* A QUORUM of disks required to keep the volume yesgroup

11、 on-line?Convert this VG to Concurrent Capable? no* Autovaryon VG in Concurrent Mode? no注意：sapvg同上面方法一樣。5.在兩臺(tái)GWPRD1上建立應(yīng)用服務(wù)器啟動(dòng)腳本(1在GWPRD1上 （建在根目錄下的目錄oracleapp 在/oracleapp下分別建立, , 然后修改文件屬性為777:#mkdir /oracleapp#chmod 777 *, dbstop.sh 這兩個(gè)啟動(dòng)腳本，分別放ORACLE11數(shù)據(jù)庫(kù)的啟，停腳本(2 在GWPRD2上在/oracleapp下分別建立, , 然后修改文件屬性為

12、777:# mkdir /oracleapp # rm rm R /oracleapp#chmod 777 *, dbstop.sh 這兩個(gè)啟動(dòng)腳本，分別放ORACLE11數(shù)據(jù)庫(kù)的啟，停腳本注意：sapapp同上面一樣方法，兩臺(tái)P570位置是一樣的，是根下 “/”, dbstop.sh 這兩個(gè)啟動(dòng)腳本，分別放sap應(yīng)用環(huán)境的啟，停腳本的設(shè)置 以下步驟（1）-（8）只在GWPRD1上做(1定義CLUSTER#smitty hacmp 或者選擇Initialization and Standard Configuration Extended Configuration選擇Add Nodes to

13、 an HACMP Cluster Extended Topology ConfigurationConfigure an HACMP Cluster輸入字段 Add/Change/Show an HACMP ClusteCluster Name chclusterNew Nodes (via selected communication paths +Currently Configured Node(s有時(shí)添加節(jié)點(diǎn)時(shí)，出現(xiàn)不成，會(huì)提示如：COMMAND STATUSCommand: on stdout: yes stderr: noBefore command completion, ad

14、ditional instructions may appear below.(1 定義節(jié)點(diǎn)定義GWPRD1節(jié)點(diǎn)#smitty hacmp選擇Extended Configuration 選擇Extended Topology Configuration 選擇Configure HACMP Nodes 選擇Add a Node to the HACMP Cluster輸入字段Node Name GWPRD1Communication Path to Node 定義GWPRD1節(jié)點(diǎn) 注：在GWPRD1上做選擇Extended Configuration 選擇 Extended Topology

15、Configuration選擇Configure HACMP Nodes選擇Add a Node to the HACMP Cluster輸入字段Node Name GWPRD2Communication Path to Node (2 定義網(wǎng)絡(luò)A. 定義IP網(wǎng)絡(luò)#smitty hacmp選擇Extended Configuration選擇Extended Topology Configuration選擇Configure HACMP Networks選擇Add a Network to the HACMP Cluster 選擇# Pre-defined IP-based Network Ty

16、pes中的ether輸入字段 Network Name net_ether_01* Network Type ether* Netmask 255.255.255.0 +* Enable IP Address Takeover via IP Aliases yes +IP Address Offset for Heartbeating over IP Aliases (3 定義網(wǎng)絡(luò)接口A. 定義IP網(wǎng)絡(luò)接口定義boot1接口:# smitty hacmp選擇 Extended Configuration選擇Extended Topology Configuration選擇Configure H

17、ACMP Communication Interfaces/Devices選擇Add Communication Interfaces/Devices選擇 Add Pre-defined Communication Interfaces and Devices選擇 Communication Interfaces選擇輸入字段* IP Label/Address boot1 +* Network Type ether* Network Name net_ether_01* Node Name GWPRD1 +Network Interface 定義stdby1接口:選擇Extended Conf

18、iguration選擇Extended Topology Configuration選擇Configure HACMP Communication Interfaces/Devices選擇Add Communication Interfaces/Devices選擇 Add Pre-defined Communication Interfaces and Devices選擇 Communication Interfaces選擇net_ether_01 (0.0.0.0/0 輸入字段* IP Label/Address stdby1 +* Network Type ether* Network N

19、ame net_ether_01* Node Name GWPRD1 +Network Interface 定義boot2接口:選擇Extended Configuration選擇Extended Topology Configuration選擇Configure HACMP Communication Interfaces/Devices選擇Add Communication Interfaces/Devices選擇 Add Pre-defined Communication Interfaces and Devices選擇 Communication Interfaces選擇net_eth

20、er_01 (0.0.0.0/0 輸入字段* IP Label/Address boot2 +* Network Type ether* Network Name net_ether_01* Node Name GWPRD2 +Network Interface 定義stdby2接口:選擇Extended Configuration選擇Extended Topology Configuration選擇Configure HACMP Communication Interfaces/Devices選擇Add Communication Interfaces/Devices選擇 Add Pre-d

21、efined Communication Interfaces and Devices選擇 Communication Interfaces選擇net_ether_01 (0.0.0.0/0 輸入字段* IP Label/Address stdby2 +* Network Type ether* Network Name net_ether_01* Node Name GWPRD2 +Network Interface (5 定義Service IP在GWPRD1操作:# smitty hacmp選擇Initialization and Standard Configuration選擇Conf

22、igure Resources to Make Highly Available選擇Configure Service IP Labeles/Addresses選擇Add a service IP Labeles/Addresses輸入字段* IP Label/Address svc1 + * Network Name net_ether_01 +6.1一樣注意：svc2同上面一樣方法。(6 定義應(yīng)用服務(wù)器定義oracleapp應(yīng)用服務(wù)器: # smitty hacmp選擇Initialization and Standard Configuration選擇Configure Resource

23、s to Make Highly Available選擇Configure Application Servers選擇Add an Application Server 輸入字段* Server Name oracleapp * Start Script * Stop Script 注意：sapapp同上面配置方法一樣。（7）定義共享資源組 定義chcluster_rg_1資源組# smitty hacmp選擇Initialization and Standard Configuration選擇Configure HACMP Resource Group選擇Add a Resource Gro

24、upResource Group Name chcluster_rg_1*Participating Nodes (Default Node Priority GWPRD1 GWPRD2 +Startup Policy Online On Home Node O> + Fallover Policy Fallover To Next Prio> +Fallback Policy Fallback To Higher Pr> +定義chcluster_rg_2資源組# smitty hacmp選擇Initialization and Standard Configuration

25、選擇Configure HACMP Resource Group選擇Add a Resource GroupResource Group Name chcluster_rg_2*Participating Nodes (Default Node Priority GWPRD2 GWPRD1 +Startup Policy Online On Home Node O> + Fallover Policy Fallover To Next Prio> +Fallback Policy Fallback To Higher Pr> +(8 修改資源組屬性修改chcluster_rg

26、_1 資源組屬性:# smitty hacmp選擇Initialization and Standard Configuration選擇Configure HACMP Resource Group選擇Change/Show Resources for a Cascading Resource Group(standard輸入字段Resource Group Name chcluster_rg_1Participating Nodes (Default Node Priority GWPRD1 GWPRD2Startup Policy Online On Home Node O>Fallo

27、ver Policy Fallover To Next Prio>Fallback Policy Fallback To Higher Pr>Service IP Labels/Addresses svc1 +Application Servers oracleapp +Volume Groups oravg +手動(dòng)輸入U(xiǎn)se forced varyon of volume groups, if necessary false +Filesystems (empty is ALL for VGs specified +修改chcluster_rg_2 資源組屬性:# smitty

28、hacmp選擇Initialization and Standard Configuration選擇Configure HACMP Resource Group選擇Change/Show Resources for a Cascading Resource Group(standard輸入字段Resource Group Name chcluster_rg_2Participating Nodes (Default Node Priority GWPRD2 GWPRD1Startup Policy Online On Home Node O>Fallover Policy Fallove

29、r To Next Prio>Fallback Policy Fallback To Higher Pr>Service IP Labels/Addresses svc2 +Application Servers sapapp +Volume Groups sapvg +手動(dòng)輸入U(xiǎn)se forced varyon of volume groups, if necessary false +Filesystems (empty is ALL for VGs specified +7. 同步HACMP配置注：該步只在GWPRD1上做# smitty hacmp選擇Initializat

30、ion and Standard Configuration選擇不用輸入，直接到這里回車就同步了。注：一直等到同步成功為止COMMAND STATUSCommand: OK stdout: yes stderr: noBefore command completion, additional instructions may appear below.TOPCluster Name: chclusterCluster Connection Authentication Mode: StandardCluster Message Authentication Mode: NoneCluster

31、Message Encryption: NoneUse Persistent Labels for Communication: NoThere are 2 node(s and 2 network(s definedNODE GWPRD1:Network net_ether_01Network net_rs232_01tty1 /dev/tty0NODE GWPRD2:Network net_ether_01Network net_rs232_01tty2 /dev/tty0Resource Group chcluster_rg_1Startup Policy Online On Home

32、Node OnlyFallover Policy Fallover To Next Priority Node In The ListFallback Policy Fallback To Higher Priority Node In The ListParticipating Nodes GWPRD1 GWPRD2Service IP Label svc1Resource Group chcluster_rg_2Startup Policy Online On Home Node OnlyFallover Policy Fallover To Next Priority Node In T

33、he ListFallback Policy Fallback To Higher Priority Node In The ListParticipating Nodes GWPRD2 GWPRD1Service IP Label svc28.查看HACMP進(jìn)程是否正常（正常有2-4個(gè)Cluster進(jìn)程）# lssrc g clustersubsystem group PID statusclstrmge cluster 22454 activeclsmuxpd cluster 15874 active9. HACMP服務(wù)的啟動(dòng)和停止啟動(dòng): 要兩個(gè)節(jié)點(diǎn)同時(shí)啟動(dòng)，停止時(shí)只停止1個(gè)節(jié)點(diǎn)#smit

34、ty clstart Start Cluster Services 輸入字段 * Start now, on system restart or both now +Start Cluster Services on these nodes GWPRD1 GWPRD2 +BROADCAST message at startup? true +Startup Cluster Lock Services? false +Startup Cluster Information Daemon? true Reacquire resources after forced down ? false +停止

35、: 停止的時(shí)只停止1個(gè)節(jié)點(diǎn)#smitty clstopStop Cluster Services輸入字段* Stop now, on system restart or both now +Stop Cluster Services on these nodes GWPRD1 +BROADCAST cluster shutdown? true +* Shutdown mode gracefulmove+ 注：shutdown mode請(qǐng)選擇move.,意 思是讓備機(jī)自動(dòng)接管用這個(gè)命令smitty clstart 啟動(dòng)HACMP 程序用這個(gè)命令smitty clstop停止HACMP程序 敲兩下

36、回車，就等，svc1 對(duì)外提供的服務(wù)，切換到另一臺(tái)GWPRD2上。查看svc1服務(wù)在那臺(tái)小機(jī)上。（GWPRD1,GWPRD2 分別可以在兩臺(tái)大機(jī)上看到）#netstat -rn# hostnameGWPRD1# netstat -irName Mtu Network Address Ipkts Ierrs Opkts Oerrs Collen0 1500 link#2 e4.1f.13.4f.bd.64 21982 0 19999 3922 0en0 1500 192.168.1 boot1 21982 0 19999 3922 0en0 1500 10.1.126 svc1 21982 0

37、19999 3922 0en2 1500 link#3 e4.1f.13.4f.e8.28 11252 0 12429 2078 0en2 1500 192.168.2 stdby1 11252 0 12429 2078 0lo0 16896 link#1 41321 0 41320 0 0lo0 16896 127 loopback 41321 0 41320 0 0lo0 16896 :1%1 41321 0 41320 0 0# netstat -inName Mtu Network Address Ipkts Ierrs Opkts Oerrs Collen0 1500 link#2

38、e4.1f.13.4f.bd.64 22071 0 20060 3922 0en0 1500 192.168.1 192.168.1.2 22071 0 20060 3922 0en0 1500 10.1.126 10.1.126.100 22071 0 20060 3922 0en2 1500 link#3 e4.1f.13.4f.e8.28 11268 0 12444 2078 0en2 1500 192.168.2 192.168.2.2 11268 0 12444 2078 0lo0 16896 link#1 41381 0 41380 0 0lo0 16896 127 127.0.0

39、.1 41381 0 41380 0 0lo0 16896 :1%1 41381 0 41380 0 0如果再給svc1服務(wù)切回來(lái)，正常模式。只給GWPRD1上啟動(dòng)HACMP，就可以了。注意：另一臺(tái)GWPRD2:主機(jī)和上面方法一樣。六.測(cè)試（寫的比較簡(jiǎn)單，可以看以前的文章）1.# lsvg o2.# ifconfig aboot stdby 兩條網(wǎng)線分別拔下來(lái)，來(lái)做測(cè)試，用halt q(慎用 用關(guān)機(jī)的做測(cè)試完成。測(cè)試正常七.完畢后緒：IBM1. 請(qǐng)您在啟動(dòng)ha的時(shí)候同時(shí)啟動(dòng)clinfo進(jìn)程。#smit clstartksh: There is not enough space in the f

40、ile system.Start Cluster ServicesType or select values in entry fields.Press Enter AFTER making all desired changes.Entry Fields* Start now, on system restart or both now +Start Cluster Services on these nodes aix61haos1 +* Manage Resource Groups Automatically +BROADCAST message at startup? true +Startup Cluster Information Daemon? true <- +Ignore verific