利用LVS+Keepalived實(shí)現(xiàn)高性能高可用負(fù)載均衡服務(wù)器

1、LVS+Keepalived 介紹LVSLVS 是 LinuxVirtualServer 的簡寫，意即 Linux 虛擬服務(wù)器，是一個虛擬的服務(wù)器集群系統(tǒng)。本項(xiàng)目在1998 年 5 月由章文嵩博士成立，是中國國內(nèi)最早出現(xiàn)的自由軟件項(xiàng)目之一。目前有三種 IP 負(fù)載均衡技術(shù)(VS/NAKVS/TUN 和 VS/DR);十種調(diào)度算法(rrr|wrr|lc|wlc|lblc|lblcr|dh|sh|sed|nq)。KeepalviedKeepalived 在這里主要用作 RealServer 的健康狀態(tài)檢查以及 LoadBalance 主機(jī)和 BackUP主機(jī)之間 failover 的實(shí)現(xiàn)二.網(wǎng)站負(fù)載

2、均衡拓樸圖IP 信息列表：名稱 IPLVS-DR-Master LVS-DR-BACKUP LVS-DR-VIP WEB1-Realserver WEB2-Realserver0 GateWay復(fù)制代碼三.安裝 LVS 和 Keepalvied 軟件包1 .下載相關(guān)軟件包#mkdir/usr/local/src/lvs #cd/usr/local/src/lvs #wgethttp:/www.linuxvirtualserver.Org/softwar

3、e/kernel-2.6/ipvsadm-1.24.tar.gz #wgethttp:/www.keepalived.0rg/software/keepalived-1.1.15.tar.gz復(fù)制代碼2 .安裝 LVS 和 Keepalived#lsmod|grepip_vs #uname-r 2.6.18-53.el5PAE #ln-s/usr/src/kernels/2.6.18-53.el5PAE-i686/usr/src/linux #tarzxvfipvsadm-1.24.tar.gz #cdipvsadm-1.24 #make&makeinstall #find/-name

4、ipvsadm#查看 ipvsadm 的位置 #tarzxvfkeepalived-1.1.15.tar.gz #cdkeepalived-1.1.15 #./configure&make&makeinstall #find/-namekeepalived# #cp/usr/local/etc/rc.d/init.d/keepalived/etc/rc.d/init.d/ #cp/usr/local/etc/sysconfig/keepalived/etc/sysconfig/ #mkdir/etc/keepalived #cp/usr/local/etc/keepalived

5、/keepalived.conf/etc/keepalived/ #cp/usr/local/sbin/keepalived/usr/sbin/#servicekeepalivedstart|stop#做成系統(tǒng)啟動服務(wù)方便管理.復(fù)制代碼四.配置 LVS 實(shí)現(xiàn)負(fù)載均衡1.LVS-DR,配置 LVS 腳本實(shí)現(xiàn)負(fù)載均衡注：此腳本在于演示方便大家理解 lvs,在 keepalived 方案中不要啟動此腳本，所以看后面有注掉，很多朋友對此有問題。關(guān)于 LVS 的 keepalvied 的 HA 方案，完全由 keepalived.conf一個文件搞定，特此聲明！#vi/usr/local/sbin/lv

6、s-dr.sh #!/bin/bash #description:startLVSofDirectorServer #Writtenby:NetSeek GW= #websitedirectorvip. SNS_VIP= SNS_RIP1= SNS_RIP2=0 ./etc/rc.d/init.d/functions logger$0calledwith$1 case$1in start) #setsquidvip,/sbin/ipvsadm-set30

7、560/sbin/ifconfigeth0:0$SNS_VIPbroadcast$SNS_VIPnetmask55broadcast$SNS_VIPup /sbin/routeadd-host$SNS_VIPdeveth0:0 /sbin/ipvsadm-A-t$SNS_VIP:80-swrr-p3 /sbin/ipvsadm-a-t$SNS_VIP:80-r$SNS_RIP1:80-g-w1 /sbin/ipvsadm-a-t$SNS_VIP:80-r$SNS_RIP2:80-g-w1 touch/var/lock/subsys/ipvsadm/dev/null2&

8、amp;1 ; stop)查看 keepalived 位置 /sbin/ipvsadm-C /sbin/ipvsadm-Z ifconfigeth0:0down routedel$SNS_VIP rm-rf/var/lock/subsys/ipvsadm/dev/null2&1 echoipvsadmstoped ; status) if!-e/var/lock/subsys/ipvsadm;then echoipvsadmstoped exit1 else echoipvsadmOK fi ; *) echoUsage:$0start|stop|status exit1 esac e

9、xit0復(fù)制代碼2.配置 Realserver 腳本.#vi/usr/local/sbin/realserver.sh #!/bin/bash #description:Configrealserverloandapplynoarp #Writtenby:NetSeek SNS_VIP=,./etc/rc.d/init.d/functions case$1in start) ifconfiglo:0$SNS_VIPnetmask55broadcast$SNS_VIP /sbin/routeadd-h

10、ost$SNS_VIPdevlo:0 echo1/proc/sys/net/ipv4/conf/lo/arp_ignore echo2/proc/sys/net/ipv4/conf/lo/arp_announce echo1/proc/sys/net/ipv4/conf/all/arp_ignore echo2/proc/sys/net/ipv4/conf/all/arp_announcesysctl-p/dev/null2&1echoRealServerStartOK stop) ifconfiglo:0down routedel$SNS_VIP/dev/null2&1 ec

11、ho0/proc/sys/net/ipv4/conf/lo/arp_ignore echo0/proc/sys/net/ipv4/conf/lo/arp_announce echo0/proc/sys/net/ipv4/conf/all/arp_ignore echo0/proc/sys/net/ipv4/conf/all/arp_announce echoRealServerStoped;*) echoUsage:$0start|stop exit1 esac exit0 復(fù)制代碼或者采用 secondaryipaddress 方式配置#vi/etc/sysctl.confnet.ipv4.

12、conf.lo.arp_ignore=1 net.ipv4.conf.lo.arp_announce=2 net.ipv4.conf.all.arp_ignore=1 net.ipv4.conf.all.arp_announce=2 code #sysctl?p #ipaddradd/32devlo #ipaddlist 查看是否綁定 3.啟動 lvs-dr 腳本和 realserver 啟本，在 DR 上可以查看 LVS 當(dāng)前狀態(tài)： #watchipvsadm?ln復(fù)制代碼五.利用 Keepalvied 實(shí)現(xiàn)負(fù)載均衡和和高可用性1.配置在主負(fù)載均衡服務(wù)器上配置 kee

13、palived.conf#vi/etc/keepalived/keepalived.conf!ConfigurationFileforkeepalived global_defs notification_email notification_email_fromsns- smtp_server #smtp_connect_timeout30router_idLVS_DEVEL）# 20081013writtenby:netseek# VIP1vrrp_instanceVI_1stateMASTER#備份服務(wù)器上將 MASTERS 為 BACKUPinterfaceeth0v

14、irtual_router_id51priority100#備份服務(wù)上將 100 改為 99advert_int1authenticationauth_typePASSauth_pass1111）virtual_ipaddress# （如果有多個 VIP,繼續(xù)換行填寫.）virtual_server80delay_loop6#（每隔 10 秒查詢 realserver 狀態(tài)）lb_algowrr#（lvs 算法）lb_kindDR#（DirectRoute）persistence_timeout60#（同一 IP 的連接 60 秒內(nèi)被分配到同一臺

15、 realserver）protocolTCP#（用 TCP 協(xié)議檢查 realserver 狀態(tài)）real_server80weight3#（權(quán)重）TCP_CHECKconnect_timeout10#（10 秒無響應(yīng)超時）nb_get_retry3delay_before_retry3connect_port80）real_server080weight3TCP_CHECKconnect_timeout10nb_get_retry3delay_before_retry3connect_port80 復(fù)制代碼2 .BACKUP 服務(wù)器同上配置，

16、先安裝/etc/keepalived/keepalived.conf3 .停掉 lvs_dr.sh 演示腳本vi/etc/rc.local#/usr/local/sbin/lvs-dr.sh 將 lvs-dr.sh 這個腳本注釋掉。#/usr/local/sbin/lvs-dr.shstop 停止 lvs-dr 腳本#/etc/init.d/keepalivedstart 啟動 keepalived 服務(wù)，keepalived 就能利用keepalived.conf 配置文件，實(shí)現(xiàn)負(fù)載均衡和高可用整個 LVS 負(fù)均衡 HA 方案，由 keepalived.conf 一個文件即可搞定！4 .查看

17、 lvs 服務(wù)是否正常#watchipvsadm?lnIPVirtualServerversion1.2.1(size=4096)ProtLocalAddressortSchedulerFlags-RemoteAddressortForwardWeightActiveConnInActConn TCP:80wrrpersistent60 -0:80Route300 -:80Route300復(fù)制代碼#tail?f/var/log/message 監(jiān)聽日志，查看狀態(tài)，測試 LVS 負(fù)載均衡及高可用性是否有效。5.停 Maste

18、r 服務(wù)器的 keepalived 服務(wù)，查看 BAKCUP 艮務(wù)器是否能正常接管服務(wù)。四.相關(guān)參考1.LVS 基礎(chǔ)知識匯總LVS 的算法介紹 http:/viewthread.php?tid=69學(xué)習(xí) LVS 的三種轉(zhuǎn)發(fā)模式 http:/viewthread.php?tid=77LVS 中的 IP 負(fù)載均衡技術(shù) http:/viewthread.php?tid=68更多的請到 負(fù)載均衡版查看Keepalived 相關(guān)參考資料。/documentation.html如果自己手工編譯 keepalived