LVS負(fù)載均衡群集

1、第七章第七章 LVS負(fù)載均衡群集負(fù)載均衡群集 理論部分LVS負(fù)載均衡群集如何通過ACL為個(gè)別用戶設(shè)置訪問權(quán)限？rsync上行、下行同步有何區(qū)別？rsync+inotify實(shí)時(shí)同步是如何實(shí)現(xiàn)的？課程回顧了解群集的結(jié)構(gòu)與工作模式學(xué)會(huì)配置NFS共享服務(wù)學(xué)會(huì)構(gòu)建LVS負(fù)載均衡群集技能展示本章結(jié)構(gòu)LVS負(fù)載均衡群集負(fù)載均衡群集案例案例1：LVS-NAT群集群集案例案例2：LVS-DR群集群集集群技術(shù)概述集群技術(shù)概述LVS虛擬服務(wù)器虛擬服務(wù)器LVS群集應(yīng)用基礎(chǔ)群集應(yīng)用基礎(chǔ)構(gòu)建負(fù)載均衡群集構(gòu)建負(fù)載均衡群集NFS共享存儲(chǔ)服務(wù)共享存儲(chǔ)服務(wù)群集的含義Cluster，集群、群集由多臺(tái)主機(jī)構(gòu)成，但對外只表現(xiàn)為一個(gè)整體

2、群集的類型負(fù)載均衡（Load Balancer）群集高可用（High Available）群集高性能運(yùn)算（High Performance Computer）群集集群技術(shù)概述3-1負(fù)載均衡的結(jié)構(gòu)第一層，負(fù)載調(diào)度器（Load Balancer或Director）第二層，服務(wù)器池（Server Pool）第三層，共享存儲(chǔ)（Share Storage）集群技術(shù)概述3-2InternetInternetNAS存儲(chǔ)設(shè)備備用調(diào)度器主調(diào)度器HA服務(wù)器池共享存儲(chǔ)負(fù)載調(diào)度器群集IP地址（VIP）負(fù)載均衡的工作模式地址轉(zhuǎn)換（NAT）模式IP隧道（TUN）模式直接路由（DR）模式集群技術(shù)概述3-3InternetI

3、nternetInternetInternetInternetInternetNAT模式TUN模式DR模式Linux Virtual Server針對Linux內(nèi)核的負(fù)載均衡解決方案1998年5月，由我國的章文嵩博士創(chuàng)建官方網(wǎng)站：/關(guān)于LVS虛擬服務(wù)器2-1rootlocalhost # modprobe ip_vsrootlocalhost # cat /proc/net/ip_vsIP Virtual Server version 1.2.1 (size=4096)Prot LocalAddress:Port Schedule

4、r Flags - RemoteAddress:Port Forward Weight ActiveConn InActConn確認(rèn)內(nèi)核對確認(rèn)內(nèi)核對LVSLVS的支持的支持LVS的負(fù)載調(diào)度算法輪詢（Round Robin）加權(quán)輪詢（Weighted Round Robin）最少連接（Least Connections）加權(quán)最少連接（Weighted Least Connections）關(guān)于LVS虛擬服務(wù)器2-2rootlocalhost # cd /misc/cd/Packages/rootlocalhost Packages# rpm -ivh ipvsadm-1.25-9.el6.i686

5、.rpmrootlocalhost Packages# ipvsadm -vipvsadm v1.25 2008/5/15 (compiled with popt and IPVS v1.2.1)v安裝安裝ipvsadm管理工具管理工具創(chuàng)建虛擬服務(wù)器主要操作選項(xiàng)n-A添加虛擬服務(wù)器n-t設(shè)置群集地址（VIP，Virtual IP）n-s指定負(fù)載調(diào)度算法使用ipvsadm工具4-1rootlocalhost # ipvsadm -A -t 72:80 -s rr添加、刪除服務(wù)器節(jié)點(diǎn)主要操作選項(xiàng)n-a添加真實(shí)服務(wù)器n-d刪除真實(shí)服務(wù)器n-r指定真實(shí)服務(wù)器（Real Serve

6、r）的地址n-m使用NAT模式；-g、-i分別對應(yīng)DR、TUN模式n-w為節(jié)點(diǎn)服務(wù)器設(shè)置權(quán)重，默認(rèn)為1使用ipvsadm工具4-2rootlocalhost # ipvsadm -a -t 72:80 -r 1:80 -mrootlocalhost # ipvsadm -a -t 72:80 -r 2:80 -mrootlocalhost # ipvsadm -a -t 72:80 -r 3:80 -mrootlocalhost # ipvsadm -a -t 1

7、72:80 -r 4:80 -mrootlocalhost # ipvsadm -d -r 4:80 -t 72:80查看群集及節(jié)點(diǎn)情況主要操作選項(xiàng)n-L查看LVS群集方案n-n以數(shù)字形式顯示地址信息n-c查看各節(jié)點(diǎn)的負(fù)載連接情況使用ipvsadm工具4-3rootlocalhost # ipvsadm -L -nTCP 72:80 rr - 1:80 Masq 1 2 7 - 2:80 Masq 1 3 9 - 3:80

8、 Masq 1 2 8 - 4:80 Masq 1 4 6rootlocalhost # ipvsadm -LncIPVS connection entriespro expire state source virtual destinationTCP 01:51 FIN_WAIT 10:49712 72:80 1:80TCP 01:52 FIN_WAIT 10:49720 72:80 2:80 保存負(fù)載分配策略導(dǎo)出工具：ipvsadm-sa

9、ve導(dǎo)入工具：ipvsadm-restore系統(tǒng)服務(wù)：/etc/init.d/ipvsadm默認(rèn)策略文件：/etc/sysconfig/ipvsadm使用ipvsadm工具4-4rootlocalhost # ipvsadm-save /etc/sysconfig/ipvsadmrootlocalhost # cat /etc/sysconfig/ipvsadm-A -t 72:http -s rr-a -t 72:http -r 1:http -m -w 1-a -t 72:http -r 192.168

10、.7.22:http -m -w 1-a -t 72:http -r 3:http -m -w 1rootlocalhost # service ipvsadm stoprootlocalhost # service ipvsadm startLVSLVS策略的默認(rèn)存放位置策略的默認(rèn)存放位置Network File System，網(wǎng)絡(luò)文件系統(tǒng)依賴于RPC（遠(yuǎn)端過程調(diào)用）需安裝nfs-utils、rpcbind軟件包系統(tǒng)服務(wù)：nfs、rpcbind共享配置文件：/etc/exportsNFS共享存儲(chǔ)服務(wù)2-1rootlocalhost # yum -y

11、 install nfs-utils rpcbindrootlocalhost # chkconfig nfs onrootlocalhost # chkconfig rpcbind on配置NFS共享修改/etc/exports文件依次啟動(dòng)rpcbind、nfs服務(wù)確認(rèn)已發(fā)布的共享掛載NFS共享目錄mount -t nfs 服務(wù)器:/共享路徑 掛載點(diǎn)NFS共享存儲(chǔ)服務(wù)2-2rootlocalhost # mkdir -p /opt/wwwrootrootlocalhost # vi /etc/exports/opt/wwwroot /24(rw,sync,no_root

12、_squash)/var/ftp/pub 1(ro) 10(rw)rootlocalhost # service rpcbind startrootlocalhost # service nfs startrootlocalhost # showmount -eExport list for localhost.localdomain:/var/ftp/pub 1/opt/wwwroot /24共享路徑共享路徑 客戶機(jī)地址客戶機(jī)地址( (權(quán)限選項(xiàng)權(quán)限選項(xiàng)) )rootlocalhost # yum -y i

13、nstall rpcbindrootlocalhost # chkconfig rpcbind onrootlocalhost # service rpcbind startrootlocalhost # showmount -e 72Export list for 72:/var/ftp/pub 1/opt/wwwroot /24rootlocalhost # mount 72:/opt/wwwroot /var/www/htmlrootlocalhost # tail -1 /et

14、c/mtab72:/opt/wwwroot /var/www/html nfs rw,vers=4,addr=72,clientaddr=77 0 0客戶機(jī)也必須支持客戶機(jī)也必須支持RPCRPC掛載掛載NFSNFS共享目錄共享目錄請思考：常見的服務(wù)器群集有哪幾種類型？使用ipvsadm建立LVS群集的基本過程是什么？如何配置、使用NFS共享目錄？小結(jié)案例環(huán)境LVS調(diào)度器作為Web服務(wù)器池的網(wǎng)關(guān)使用輪詢（rr）調(diào)度算法構(gòu)建LVS-NAT群集2-1Web服務(wù)器池:節(jié)點(diǎn)1-節(jié)點(diǎn)41-24/24InternetIn

15、ternetNFS共享：/var/www/html50/24LVS負(fù)載調(diào)度器woeth0: 7272/24eth1: 54/24群集地址：72配置過程LVS調(diào)度器的配置：SNAT策略、LVS-NAT策略Web節(jié)點(diǎn)服務(wù)器的配置：httpd服務(wù)訪問72/，并驗(yàn)證群集分配情況構(gòu)建LVS-NAT群集2-2rootlocalhost # vi /etc/sysctl.confnet.ipv4.ip_forward = 1rootlocalhost # sysct

16、l -prootlocalhost # iptables -t nat -A POSTROUTING -s /24 -o eth0 -j SNAT -to-source 72rootlocalhost # service ipvsadm stoprootlocalhost # ipvsadm -A -t 72:80 -s rrrootlocalhost # ipvsadm -a -t 72:80 -r 1:80 -mrootlocalhost # ipvsadm -a -t 172.1

17、6.16.172:80 -r 2:80 -mrootlocalhost # ipvsadm -a -t 72:80 -r 3:80 -mrootlocalhost # ipvsadm -a -t 72:80 -r 4:80 -mrootlocalhost # service ipvsadm saverootlocalhost # chkconfig ipvsadm onSNATSNAT地址轉(zhuǎn)換策略地址轉(zhuǎn)換策略LVS-NATLVS-NAT群集模式群集模式rootlocalhost # y

18、um -y install httpdrootlocalhost # mount 50:/opt/wwwroot /var/www/htmlrootlocalhost # vi /var/www/html/index.htmlLVS負(fù)載均衡群集測試網(wǎng)頁/rootlocalhost # service httpd startrootlocalhost # chkconfig httpd on各節(jié)點(diǎn)的網(wǎng)頁相同各節(jié)點(diǎn)的網(wǎng)頁相同rootlocalhost # ipvsadm -LnIP Virtual Server version 1.2.1 (size=4096)Prot Lo

19、calAddress:Port Scheduler Flags - RemoteAddress:Port Forward Weight ActiveConn InActConnTCP 72:80 rr - 1:80 Masq 1 2 9 - 2:80 Masq 1 3 8 - 3:80 Masq 1 2 9 - 4:80 Masq 1 4 7查看群集分配情況查看群集分配情況案例環(huán)境LVS調(diào)度器只作為Web訪問入口Web訪問出口由各節(jié)點(diǎn)服務(wù)器分別承擔(dān)構(gòu)建LVS-DR群集4-1Web服務(wù)器

20、池:節(jié)點(diǎn)1-節(jié)點(diǎn)477-180/24InternetInternetNFS共享：/var/www/html50/24LVS負(fù)載調(diào)度器73/24群集地址：72配置過程 LVS調(diào)度器外網(wǎng)接口eth0、群集接口eth0:0調(diào)整/proc內(nèi)核參數(shù)，關(guān)閉重定向響應(yīng)配置LVS-DR群集策略構(gòu)建LVS-DR群集4-2rootlocalhost # ip addr show dev eth0 inet 73/24 brd 55 scope global eth0 inet 172

21、.16.16.172/24 brd 55 scope global eth0:0rootlocalhost # vi /etc/sysctl.confnet.ipv4.conf.all.send_redirects = 0net.ipv4.conf.default.send_redirects = 0net.ipv4.conf.eth0.send_redirects = 0rootlocalhost # sysctl -p/proc/proc參數(shù)調(diào)整參數(shù)調(diào)整群集地址接口群集地址接口rootlocalhost # service ipvsadm stoprootlocalh

22、ost # ipvsadm -A -t 72:80 -s rrrootlocalhost # ipvsadm -a -t 72:80 -r 77 -grootlocalhost # ipvsadm -a -t 72:80 -r 78 -grootlocalhost # ipvsadm -a -t 72:80 -r 79 -grootlocalhost # ipvsadm -a -t 72:80 -r 172.16.16.

23、180 -grootlocalhost # service ipvsadm saveLVS-DRLVS-DR群集模式群集模式配置過程 Web節(jié)點(diǎn)服務(wù)器外網(wǎng)接口eth0、群集接口lo:0調(diào)整/proc內(nèi)核參數(shù)，關(guān)閉ARP響應(yīng)添加到群集IP地址的本地路由記錄配置并啟用httpd服務(wù)構(gòu)建LVS-DR群集4-3rootlocalhost # ip addr show dev loinet /8 scope host lo inet 72/0 brd 55 scope global lo:0rootlocalhost # vi /etc/

24、sysctl.confnet.ipv4.conf.all.arp_ignore = 1net.ipv4.conf.all.arp_announce = 2net.ipv4.conf.default.arp_ignore = 1net.ipv4.conf.default.arp_announce = 2net.ipv4.conf.lo.arp_ignore = 1net.ipv4.conf.lo.arp_announce = 2rootlocalhost # sysctl -p/proc/proc參數(shù)調(diào)整參數(shù)調(diào)整群集地址接口群集地址接口rootlocalhost # vi /etc/rc.loc

25、al/sbin/route add -host 72 dev lo:0rootlocalhost # route add -host 72 dev lo:0添加本機(jī)訪問添加本機(jī)訪問VIPVIP的路由的路由測試LVS-DR群集訪問72/，并驗(yàn)證群集分配情況構(gòu)建LVS-DR群集4-4rootlocalhost # ipvsadm -LnIP Virtual Server version 1.2.1 (size=4096)Prot LocalAddress:Port Scheduler Flags - RemoteAddress:Port Forward Weight ActiveConn InActConnTCP 72:80 rr - 77:80