利用LVS+Keepalived實(shí)現(xiàn)高性能高可用負(fù)載均衡服務(wù)器

1、利用LVS+Keepalived實(shí)現(xiàn)高性能高可用負(fù)載均衡服務(wù)器2008-11-05 21:23:48- 版權(quán)聲明：原創(chuàng)作品，允許轉(zhuǎn)載，轉(zhuǎn)載時請務(wù)必以超鏈接形式標(biāo)明文章 原始出處 、作者信息和本聲明。否則將追究法律責(zé)任。 作者:NetSeek url/url(IT運(yùn)維專家網(wǎng)|集群架構(gòu)|性能調(diào)優(yōu))歡迎轉(zhuǎn)載,轉(zhuǎn)載時請務(wù)必以超鏈接形式標(biāo)明文章原始出處和作者信息及本聲明.更新時間:2008-10-27一背景:隨著你的網(wǎng)站業(yè)務(wù)量的增長你網(wǎng)站的服務(wù)器壓力越來越大？需要負(fù)載均衡方案！商業(yè)的硬件如F5又太貴，你們又是創(chuàng)業(yè)型互聯(lián)公司如何有效節(jié)約成本，節(jié)省不必要的浪費(fèi)？

2、同時實(shí)現(xiàn)商業(yè)硬件一樣的高性能高可用的功能？有什么好的負(fù)載均衡可伸張可擴(kuò)展的方案嗎？答案是肯定的！有！我們利用 LVS+Keepalived基于完整開源軟件的架構(gòu)可以為你提供一個負(fù)載均衡及高可用的服務(wù)器。LVS+Keepalived 介紹LVSLVS是Linux Virtual Server的簡寫，意即Linux虛擬服務(wù)器，是一個虛擬的服務(wù)器集群系統(tǒng)。本項(xiàng)目在1998年5月由章文嵩博士成立，是中國國內(nèi)最早出現(xiàn)的自由軟件項(xiàng)目之一。目前有三種IP負(fù)載均衡技術(shù)（VS/NAT、VS/TUN和VS/DR）；八種調(diào)度算法（rr,wrr,lc,wlc,lblc,lblcr,dh,sh）。KeepalviedK

3、eepalived在這里主要用作RealServer的健康狀態(tài)檢查以及LoadBalance主機(jī)和BackUP主機(jī)之間failover的實(shí)現(xiàn)二. 網(wǎng)站負(fù)載均衡拓樸圖IP信息列表：名稱IPLVS-DR-Master LVS-DR-BACKUP LVS-DR-VIPWEB1-Realserver WEB2-Realserver 0GateWay三. 安裝LVS和Keepalvied軟件包1. 下載相關(guān)軟件包#mkdir /usr/local/src/lvs

4、#cd /usr/local/src/lvs#wget /software/kernel-2.6/ipvsadm-1.24.tar.gz #wget /software/keepalived-1.1.15.tar.gz 2. 安裝LVS和Keepalived#lsmod |grep ip_vs#uname -r2.6.18-53.el5PAE#ln -s /usr/src/kernels/2.6.18-53.el5PAE-i686/ /usr/src/linux#tar zxvf i

5、pvsadm-1.24.tar.gz#cd ipvsadm-1.24#make && make install#find / -name ipvsadm # 查看ipvsadm的位置#tar zxvf keepalived-1.1.15.tar.gz#cd keepalived-1.1.15#./configure && make && make install#find / -name keepalived # 查看keepalived位置 #cp /usr/local/etc/rc.d/init.d/keepalived /etc/rc.d/

6、init.d/#cp /usr/local/etc/sysconfig/keepalived /etc/sysconfig/#mkdir /etc/keepalived#cp /usr/local/etc/keepalived/keepalived.conf /etc/keepalived/#cp /usr/local/sbin/keepalived /usr/sbin/#service keepalived start|stop #做成系統(tǒng)啟動服務(wù)方便管理.四. 配置LVS實(shí)現(xiàn)負(fù)載均衡1 LVS-DR，配置LVS腳本實(shí)現(xiàn)負(fù)載均衡#vi /usr/local/sbin/lvs-dr.sh#!/

7、bin/bash# description: start LVS of DirectorServer#Written by :NetSeek GW=# website director vip.SNS_VIP=SNS_RIP1=SNS_RIP2=0./etc/rc.d/init.d/functionslogger $0 called with $1case "$1" instart) # set squid vip /sbin/ipv

8、sadm -set 30 5 60 /sbin/ifconfig eth0:0 $SNS_VIP broadcast $SNS_VIP netmask 55broadcast $SNS_VIP up /sbin/route add -host $SNS_VIP dev eth0:0 /sbin/ipvsadm -A -t $SNS_VIP:80 -s wrr -p 3 /sbin/ipvsadm -a -t $SNS_VIP:80 -r $SNS_RIP1:80 -g -w 1 /sbin/ipvsadm -a -t $SNS_VIP:80 -r $SNS_RIP2:

9、80 -g -w 1 touch /var/lock/subsys/ipvsadm >/dev/null 2>&1 ;stop) /sbin/ipvsadm -C /sbin/ipvsadm -Z ifconfig eth0:0 down ifconfig eth0:1 down route del $SNS_VIP route del $SS_VIP rm -rf /var/lock/subsys/ipvsadm >/dev/null 2>&1 echo "ipvsadm stoped" ;status) if ! -e /var/

10、lock/subsys/ipvsadm ;thenecho "ipvsadm stoped"exit 1 elseecho "ipvsadm OK" fi ;*) echo "Usage: $0 start|stop|status" exit 1esacexit 0 2 配置Realserver腳本.#vi /usr/local/sbin/realserver.sh#!/bin/bash# description: Config realserver lo and apply noarp #Written by :NetSeek ht

11、tp:/ SNS_VIP= . /etc/rc.d/init.d/functions case "$1" instart) ifconfig lo:0 $SNS_VIP netmask 55 broadcast $SNS_VIP /sbin/route add -host $SNS_VIP dev lo:0 echo "1" >/proc/sys/net/ipv4/conf/lo/arp_ignore echo "2" >/proc/sys

12、/net/ipv4/conf/lo/arp_announce echo "1" >/proc/sys/net/ipv4/conf/all/arp_ignore echo "2" >/proc/sys/net/ipv4/conf/all/arp_announce sysctl -p >/dev/null 2>&1 echo "RealServer Start OK" ;stop) ifconfig lo:0 down route del $SNS_VIP >/dev/null 2>&1

13、 echo "0" >/proc/sys/net/ipv4/conf/lo/arp_ignore echo "0" >/proc/sys/net/ipv4/conf/lo/arp_announce echo "0" >/proc/sys/net/ipv4/conf/all/arp_ignore echo "0" >/proc/sys/net/ipv4/conf/all/arp_announce echo "RealServer Stoped" ;*) echo "

14、;Usage: $0 start|stop" exit 1esac exit 0 或者采用secondary ip address方式配置# vi /etc/sysctl.conf net.ipv4.conf.lo.arp_ignore = 1 net.ipv4.conf.lo.arp_announce = 2 net.ipv4.conf.all.arp_ignore = 1 net.ipv4.conf.all.arp_announce = 2 code #sysctl p #ip addr add /32 dev lo #ip add list 查看是否綁定

15、3. 啟動lvs-dr腳本和realserver啟本，在DR上可以查看LVS當(dāng)前狀態(tài):#watch ipvsadm ln五利用Keepalvied實(shí)現(xiàn)負(fù)載均衡和和高可用性1.配置在主負(fù)載均衡服務(wù)器上配置keepalived.conf#vi /etc/keepalived/keepalived.conf! Configuration File for keepalivedglobal_defs notification_email cnseek notification_email_from sns-lvs smtp_server # smtp_connect_timeout

16、 30 router_id LVS_DEVEL# 20081013 written by :netseek# VIP1vrrp_instance VI_1 state MASTER #備份服務(wù)器上將MASTER改為BACKUP interface eth0 virtual_router_id 51 priority 100 # 備份服務(wù)上將100改為99 advert_int 1 authentication auth_type PASSauth_pass 1111 virtual_ipaddress #(如果有多個VIP，繼續(xù)換行填寫.) virtual_serve

17、r 80 delay_loop 6 #(每隔10秒查詢realserver狀態(tài)) lb_algo wrr #(lvs 算法) lb_kind DR #(Direct Route) persistence_timeout 60#(同一IP的連接60秒內(nèi)被分配到同一臺realserver) protocol TCP#(用TCP協(xié)議檢查realserver狀態(tài)) real_server 80 weight 3 #(權(quán)重)TCP_CHECK connect_timeout 10 #(10秒無響應(yīng)超時)nb_get_retry 3delay_befor

18、e_retry 3connect_port 80 real_server 0 80 weight 3TCP_CHECK connect_timeout 10nb_get_retry 3delay_before_retry 3connect_port 80 2. BACKUP服務(wù)器同上配置，先安裝lvs再按裝keepalived,仍后配置/etc/keepalived/keepalived.conf，只需將紅色標(biāo)示的部分改一下即可.3. vi /etc/rc.local #/usr/local/sbin/lvs-dr.sh 將lvs-dr.sh這個腳本注釋掉。步 #/usr/local/sbin/lvs-dr.sh stop 停止lvs-dr腳本 #/etc/init.d/keepalived start 啟動keepalived 服務(wù)，keepalived就能利用keepalived.conf 配置文件，實(shí)現(xiàn)負(fù)載均衡和高可用.4. 查看lvs服務(wù)是否正常#watch ipvsadm lnIP Virtual