HA51安裝和配置.doc

Hacmp 5.1 的配置方法Hacmp 自從出了5.1 版本后， 很多客戶向IBM技術(shù)支持中心打電話咨詢配置方法。的確，hacmp5.1 較以前的版本無論是從界面還是從配置方法都有了很大的改變。具體內(nèi)容我們可以從IBM hacmp5。1 紅皮書上獲知。但對(duì)于大部分hacmp 軟件使用者來說，最重要的是要有一個(gè)快速入門的步驟。因此我會(huì)在這里介紹一下hacmp 的入門安裝與配置。一， Hacmp 的軟件安裝。 1 安裝前提 如果您的操作系統(tǒng)是AIX，那么您要安裝維護(hù)補(bǔ)丁包以上，目前最高的補(bǔ)丁版本是并且您還要安裝RSCT 0 或更高版本。以下的包也是必須要安裝的： bos.adt.lib bos.adt.libm bos.adt.syscalls .tcp.client .tcp.server bos.rte.SRC bos.rte.libc bos.rte.libcfg bos.rte.libcur bos.rte.libpthreads bos.rte.odm 如果您要安裝并行的資源組，還要安裝下面的包： bos.rte.lvm.rte 5 or higher bos.clvm.enh.rsct.basic.rte pat.basic.hacmp pat.clients.hacmp2 開始安裝一般基本上除了haview ，netwiew ( Tivoli),的 包以外，所有的hacmp的包都要安裝。3 打補(bǔ)丁。 注意，客戶總是忽略給hacmp打補(bǔ)丁這一步驟。其實(shí)對(duì)hacmp來說，補(bǔ)丁是十分重要的。很多 發(fā)現(xiàn)的缺陷都已經(jīng)在補(bǔ)丁中被解決了。有的客戶嚴(yán)格的按照正確步驟安裝和配置完hacmp的軟件后，發(fā)現(xiàn)takeover 有問題，ip接管有問題，機(jī)器自動(dòng)宕機(jī)等等千奇百怪的問題，其實(shí)都與補(bǔ)丁有關(guān)。所以客戶一定要注意打補(bǔ)丁這個(gè)環(huán)節(jié)。現(xiàn)在hacmp最新的補(bǔ)丁是：IY53044 - Latest HACMP for AIX R510 Fixes as of January 2004大家可以從IBM網(wǎng)站上下載，或者打800-810-1818 熱線電話索要。 4 重啟機(jī)器。 在hacmp 5。1 中 為了安全起見，不再使用/.rhosts 文件來控制兩臺(tái)機(jī)器之間的命令和數(shù)據(jù)交換，而是引進(jìn)的一個(gè)新的進(jìn)程clcomd 。 如果你編輯/etc/inittab文件就會(huì)發(fā)現(xiàn)安裝完hacmp后，在最后添加了一行：clcomdES:2:once:startsrc -s clcomdES /dev/console 2&1 。因此重新啟機(jī)后， ps ef |grep clomd ,會(huì)發(fā)現(xiàn)：root 12908 6478 0 Apr 12 - 0:21 /usr/es/sbin/cluster/clcomd d ，證明該進(jìn)程啟動(dòng)了。Hacmp5.1使用/usr/es/sbin/cluster/etc/rhosts 文件來代替 /.rhosts 文件的功能。 注意：如果兩個(gè)節(jié)點(diǎn)間的通訊發(fā)生了什么問題，可以檢查rhots 文件，或者編輯rhosts文件加入兩個(gè)節(jié)點(diǎn)的網(wǎng)絡(luò)信息。二， hacmp5.1 的配置我們以兩臺(tái)機(jī)器為例：test1 和test2 , 共享三塊7133 硬盤。1 首先配置兩臺(tái)機(jī)器的ip 和vg , 以及/etc/hosts 和application 啟動(dòng)/停止腳本 test1:/netstat -inName Mtu Network Address Ipkts Ierrs Opkts Oerrs Collen0 1500 link#2 0.4.ac.49.f2.d5 77960 0 47805 0 0en0 1500 100.1 77960 0 47805 0 0en1 1500 link#3 0.6.29.ec.44.d6 33 0 11 0 0en1 1500 192.168.0 33 0 11 0 0test2:/netstat -inName Mtu Network Address Ipkts Ierrs Opkts Oerrs Collen0 1500 link#2 0.4.ac.49.60.23 31138 0 82582 0 0en0 1500 100.1 31138 0 82582 0 0en1 1500 link#3 0.4.ac.3e.b9.4b 36 0 13 0 0en1 1500 192.168.0 36 0 13 0 0test1 : hdisk0 0004383268b07574 rootvg activehdisk3 000438325e22bca7 test1vghdisk4 00043832125e5aa8 Nonehdisk5 000438323d0e4487 Nonetest2 : hdisk0 000d29574085126d rootvg activehdisk5 000438325e22bca7 test1vghdisk6 00043832125e5aa8 Nonehdisk7 000438323d0e4487 None/etc/hosts test2_boot1 test2 test1_boot1 test1 test1_boot2 test2_boot test1_svc test2_svc test1_per test1_pertest2:/ha51ls l -rwxr-xr-x 1 root system 65 Apr 13 13:51 start-rw-r-r- 1 root system 31 Apr 13 11:49 start.log-rwxr-xr-x 1 root system 66 Apr 13 14:01 start1-rw-r-r- 1 root system 31 Apr 13 14:01 start1.log-rwxrwxrwx 1 root system 64 Apr 13 11:48 stop-rw-r-r- 1 root system 31 Apr 13 11:48 stop.log-rwxr-xr-x 1 root system 66 Apr 13 14:01 stop1-rw-r-r- 1 root system 31 Apr 13 14:01 stop1.logvi start date /ha51/start.logbanner start app1 /tmp/hacmp.outvi stop date /ha51/stop.logbanner stop app1 /tmp/hacmp.outvi start1 date /ha51/start1.logbanner start app2 /tmp/hacmp.outvi stop1 date /ha51/stop1.log banner stop app2 /tmp/hacmp.out注意：在兩個(gè)節(jié)點(diǎn)要保證hosts 和 啟動(dòng)/停止腳本要一樣存在。2. 用smitty hacmp 來配置hacmp 添加cluster 和node smitty hacmp Initialization and Standard Configuration Extended Configuration System Management (C-SPOC) Problem Determination ToolsAdd Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP ConfigurationDisplay HACMP Configuration * Cluster Name ha51tsc New Nodes (via selected communication paths)m test2_boot1 test1_boot1 Currently Configured Node(s)這一部很重要，一般我們都是把每個(gè)節(jié)點(diǎn)的boot1 作為communication path . New node可以一起加，也可以一個(gè)一個(gè)的加。當(dāng)回車以后，系統(tǒng)會(huì)自己discover hacmp 的資源顯示如下：。IP Network Discovery completed normallyCurrent cluster configuration:No resource groups definedCluster Description of Cluster: ha51tscCluster Security Level: StandardThere are 2 node(s) and 1 network(s) definedNODE test1: Network net_ether_02 test1_boot1 test1_boot2 NODE test2: Network net_ether_02 test2_boot1 test2_boot2 。添加高可用資源（service ip , application server , vg and jfs ） 添加服務(wù)ip地址 Add Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP Configuration Display HACMP Configuration Configure Service IP Labels/Addresses Configure Application Servers Configure Volume Groups, Logical Volumes and Filesystems Configure Concurrent Volume Groups and Logical Volumes Add a Service IP Label/Address Change/Show a Service IP Label/Address Remove Service IP Label(s)/Address(es)* IP Label/Address test1_svc Network Name net_ether_02 * IP Label/Address test2_svc Network Name net_ether_02 添加application server Configure Service IP Labels/Addresses Configure Application Servers Configure Volume Groups, Logical Volumes and Filesystems Configure Concurrent Volume Groups and Logical Volumes Add an Application Server Change/Show an Application Server Remove an Application Server* Server Name app1* Start Script /ha51/start* Stop Script /ha51/stop* Server Name app2* Start Script /ha51/start1* Stop Script /ha51/stop1添加共享vg , jfs 注意在前面的步驟中我們看到已經(jīng)有一個(gè)共享VG test1vg 存在了，它使用傳統(tǒng)的方法：1 在test1 節(jié)點(diǎn)上創(chuàng)建test1vg , lv,jfs 2 Varyoffvg 3 在test2 上 importvg 4 Varyoffvg 現(xiàn)在我們?cè)囍胔acmp的功能去創(chuàng)建test2vg Configure Service IP Labels/Addresses Configure Application Servers Configure Volume Groups, Logical Volumes and Filesystems Configure Concurrent Volume Groups and Logical Volumes Shared Volume Groups Shared Logical Volumes Shared File Systems Synchronize Shared LVM Mirrors Synchronize a Shared Volume Group Definition List All Shared Volume Groups Create a Shared Volume Group Create a Shared Volume Group with Data Path Devices Set Characteristics of a Shared Volume Group Import a Shared Volume Group Mirror a Shared Volume Group Unmirror a Shared Volume Group 在選擇菜單中同時(shí)用F7 選擇test1 和 test2 test1 test2 選中PVID00043832125e5aa8 Node Names test1,test2 PVID 00043832125e5aa8VOLUME GROUP name test2vg Physical partition SIZE in megabytes 4 Volume group MAJOR NUMBER 49 test2:/ha51lspvhdisk0 000d29574085126d rootvg activehdisk5 000438325e22bca7 test1vghdisk6 00043832125e5aa8 test2vghdisk7 000438323d0e4487 Nonetest1:/ha51lspvhdisk0 0004383268b07574 rootvg activehdisk3 000438325e22bca7 test1vghdisk4 00043832125e5aa8 test2vghdisk5 000438323d0e4487 None同樣方法你可以在兩個(gè)節(jié)點(diǎn)上同時(shí)創(chuàng)建ljfs Shared Volume Groups Shared Logical Volumes Shared File Systems Synchronize Shared LVM MirrorsSynchronize a Shared Volume Group Definition Journaled File Systems Enhanced Journaled File Systems Add a Journaled File System Add a Journaled File System on a Previously Defined Logical Volume List All Shared File Systems Change / Show Characteristics of a Shared File System Remove a Shared File System Add a Standard Journaled File System Add a Compressed Journaled File System Add a Large File Enabled Journaled File Systemtest1vg test1,test2test2vg test1,test2Node Names test1,test2 Volume group name test1vg* SIZE of file system 10 * MOUNT POINT /test1jfs PERMISSIONS read/write Mount OPTIONS Start Disk Accounting? no Fragment Size (bytes) 4096 Number of bytes per inode 4096 Allocation Group Size (MBytes) 8系統(tǒng)會(huì)自動(dòng)在test1上添加test1jfs 文件系統(tǒng)，并且自動(dòng)會(huì)在兩個(gè)節(jié)點(diǎn)上作update . 但是根據(jù)我自己的經(jīng)驗(yàn)，最好還是用傳統(tǒng)的方式在一個(gè)結(jié)點(diǎn)上創(chuàng)建vg ，lv, jfs . 然后再import 到另一個(gè)節(jié)點(diǎn)上。 這里有一個(gè)tips , 如果在這里創(chuàng)建共享jfs 遇到問題，可以先手工把vg 在一個(gè)結(jié)點(diǎn)上varyon , 然后再創(chuàng)建就可以了。 創(chuàng)建資源組 Initialization and Standard Configuration Extended Configuration System Management (C-SPOC) Problem Determination ToolsAdd Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP Configuration Display HACMP ConfigurationAdd a Resource Group Change/Show a Resource Group Remove a Resource Group Change/Show Resources for a Resource Group (standard)CascadingRotating Concurrent Custom * Resource Group Name res1* Participating Node Names / Default Node Priority test1 test2同樣方法可以添加res2 接下來可以配置資源組，當(dāng)然也可以在Extended Configuration 中去詳細(xì)配置。我們姑且先在Initialization and Standard Configuration 中配置。 Smitty cm_config_hacmp_resource_groups_menu_dmnAdd a Resource Group Change/Show a Resource Group Remove a Resource GroupChange/Show Resources for a Resource Group (standard)選擇res1 Resource Group Name res1 Participating Node Names (Default Node Priority) test1 test2* Service IP Labels/Addresses test1_svc Volume Groups mtest1vg Filesystems (empty is ALL for VGs specified) /test1jfs Application Servers mapp1同樣的方法配置res2 檢查和同步hacmp配置Initialization and Standard Configuration Extended Configuration System Management (C-SPOC) Problem Determination ToolsAdd Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP Configuration Display HACMP ConfigurationCluster Description of Cluster: ha51tscCluster Security Level: StandardThere are 2 node(s) and 1 network(s) definedNODE test1: Network net_ether_02 test2_svc test1_svc test1_boot2 test1_boot1 NODE test2: Network net_ether_02 test2_svc test1_svc test2_boot1 test2_boot2 Resource Group res1 Behavior cascading Participating Nodes test1 test2 Service IP Label test1_svcResource Group res2 Behavior cascading Participating Nodes test2 test1 Service IP Label test2_svc注意nodetest1 的ip 地址排列，雖然test_boot2 排在test_boot1前面，但是實(shí)驗(yàn)證明，service 地址依然會(huì)綁定在communication path 上。 現(xiàn)在就可以做Initialization and Standard Configuration Verify and Synchronize HACMP Configuration . 然后start 一下hacmp ，看看take over 是否都正常。 注意，很多客戶是把所有的hacmp 包括應(yīng)用都配好后再試起hacmp, 作takeover 測(cè)試，這是很不好的一種習(xí)慣。因?yàn)槿谌氲目赡芤蛩靥嗔?，一旦有了問題，我們還要隔離問題，先把hacmp配置簡(jiǎn)化，再一步步作pd , 那么先前的配置就白做了。所以建議客戶階段性的監(jiān)測(cè)一下hacmp3 到此為止我們的hacmp已經(jīng)基本配置完成了。剩下的要在Extended Configuration中配置了。 在Extended Configuration中我們還可以配置 tty 心跳 網(wǎng)絡(luò) ， hdisk 心跳網(wǎng)絡(luò)，Persistent Node IP ，application monitor 等等。 下面我們先介紹一下配置hdisk 心跳網(wǎng)絡(luò)，這也是hacmp5.1 里的一個(gè)新的功能。 首先我們要一個(gè) Enhanced concurrent VG , 這個(gè)vg 不需要一定是放在concurrent 資源組里的vg , 當(dāng)然也可以用concurrent 資源組里的硬盤來做心跳網(wǎng)絡(luò)。這個(gè)concurrent vg 可以通過傳統(tǒng)方法建立。1 Mkvg c convg 2 在一個(gè)節(jié)點(diǎn)上varyoffvg , 另一個(gè)節(jié)點(diǎn)上importvg 現(xiàn)在我們介紹用hacmp 來創(chuàng)建concurrent vg . Initialization and Standard Configuration Extended Configuration System Management (C-SPOC)Problem Determination Tools Add Nodes to an HACMP Cluster Configure Resources to Make Highly Available Configure HACMP Resource Groups Verify and Synchronize HACMP Configuration Display HACMP ConfigurationConfigure Service IP Labels/Addresses Configure Application Servers Configure Volume Groups, Logical Volumes and Filesystems Configure Concurrent Volume Groups and Logical Volumes Concurrent Volume Groups Concurrent Logical Volumes Synchronize Concurrent LVM Mirrors List All Concurrent Volume Groups Create a Concurrent Volume Group Create a Concurrent Volume Group with Data Path Devices Set Characteristics of a Concurrent Volume Group Import a Concurrent Volume Group Mirror a Concurrent Volume Group Unmirror a Concurrent Volume Group 選中test1 and test2 選中共享硬盤Node Names test1,test2 PVID 000438323d0e4487 VOLUME GROUP name convg PhysicalpartitionSIZEinmegabytes 4 Volume group MAJOR NUMBER 49 Enhanced Concurrent Mode true下面看一下兩個(gè)節(jié)點(diǎn)的硬盤狀況：test1: hdisk0 0004383268b07574 rootvg activehdisk3 000438325e22bca7 test1vghdisk4 00043832125e5aa8 test2vghdisk5 000438323d0e4487 convgtest2 : hdisk0 000d29574085126d rootvg activehdisk5 000438325e22bca7 test1vghdisk6 00043832125e5aa8 test2vghdisk7 000438323d0e4487 convg現(xiàn)在檢查hdisk 網(wǎng)絡(luò)的狀況，在一個(gè)節(jié)點(diǎn)上向hdisk 寫數(shù)據(jù)，從另一個(gè)節(jié)點(diǎn)上讀數(shù)據(jù)，很像 我們?cè)谂渲胻ty 網(wǎng)絡(luò)之前，檢查一下tty 是否連通。 注意：我原來的操作系統(tǒng)是aix5.2 01 ， 安裝了hacmp5.1 打了最新的補(bǔ)丁。但是在/usr/sbin/rsct/bin 下找不到dhb_read 命令。 它應(yīng)該是屬于rsct 的，后來我把a(bǔ)ix5.2 打倒ml02 , rsct 所有的包都生級(jí)了，reboot 機(jī)器后，找到了dhb_read 命令。1 Add /usr/sbin/rsct/bin/ to /etc/environment 里的path 中2 重新login test1 和test2 使path 生效3 在test1 上運(yùn)行：dhb_read -p hdisk5 r4 在test2 上運(yùn)行：dhb_read -p hdisk7 t 在test1 上：test1:/dhb_read -p hdisk5 -rReceive Mode:Waiting for response . . .Link operating normally 在test2上：test2:/usr/sbin/rsct/bindhb_read -p hdisk7 -tTransmit Mode:Detected remote utility in receive mode. Waiting for response . . .Link operating normally證明通訊正常。 添加hdisk heart beat 網(wǎng)絡(luò)和設(shè)備Initialization and Standard Configuration Extended Configuration System Management (C-SPOC) Problem Determination ToolsDiscover HACMP-related Information from Configured Nodes Extended Topology Configuration Extended Resource Configuration Extended Event Configuration Extended Performance Tuning Parameters Configuration Security and Users ConfigurationSnapshot ConfigurationExt