基于AWS構(gòu)建DevOps實(shí)踐

1、基于AWS構(gòu)建DevOps實(shí)踐技術(shù)創(chuàng)新 變革未來目錄基于 Ansible 的運(yùn)維Immutable InfrastructureEC2 AutoScalingECS + EC2 AutoScaling基于Ansible 的運(yùn)維理想情況配置統(tǒng)一快速構(gòu)建運(yùn)行環(huán)境 版本控制OperatorsAZ 1AZ 2AZ 3APPWEBSomeone實(shí)際情況實(shí)際情況配置不統(tǒng)一調(diào)試?yán)щy 擴(kuò)容麻煩Immutable Infrastructure什么是 Immutable Infrastructure初始化之后即變成只讀狀態(tài)有任何修改創(chuàng)建新的實(shí)例替換需要高度自動化Immutable Infrastructure 的

2、優(yōu)點(diǎn)配置一致版本控制，變更追蹤故障恢復(fù)可變架構(gòu) vs 不可變架構(gòu)VSPetsCattleEC2 AutoScaling發(fā)布發(fā)布ALB / NLBAuto Scaling GroupAMIUpdateConfigure filesCodeS3 bucketDeveloperDeployment System發(fā)布ALB / NLBAuto Scaling GroupUpdateConfigure filesCodeS3 bucketDeveloperDeployment SystemAMI發(fā)布ALB / NLBAuto Scaling GroupUpdateConfigure filesCodeS

3、3 bucketDeveloperDeployment SystemAMI自動伸縮ALB / NLBConfigure filesCodeS3 bucket擴(kuò)容AMIAuto Scaling GroupCloudWatch Alarm CPU Utilazation = 80%ALB / NLBConfigure filesCodeS3 bucket擴(kuò)容AMIAuto Scaling GroupALB / NLBConfigure filesCodeS3 bucketEC2 Autoscaling 的缺點(diǎn)Auto Scaling GroupAuto Scaling GroupAMIAMI容器化

4、開發(fā)人員： 打包代碼以及 程序運(yùn)行環(huán)境運(yùn)維人員： 提供基礎(chǔ)設(shè)施 管理容器調(diào)度ECS + EC2 AutoScaling彈性擴(kuò)容/ 縮容彈性擴(kuò)容/ 縮容Amazon ECS Task DefinitionClusterAmazon ECS ServiceALB / NLB32874 32879 32880 32892容器層擴(kuò)容Amazon ECS Task DefinitionClusterAmazon ECSServiceALB / NLB32874 32879 32880 3289231392容器層擴(kuò)容CloudWatch AlarmService CPU Utilazation = 80%

5、實(shí)例層擴(kuò)容Amazon ECSTask Definition Amazon ECSServiceALB / NLB32874 32879 32880 3289231392實(shí)例層擴(kuò)容Amazon ECSTask Definition Amazon ECSServiceALB / NLB32874 32879 32880 3289231392AWS Lambdaevent (time-based)Cloudwatch實(shí)例層擴(kuò)容Amazon ECSTask Definition Amazon ECSServiceALB / NLB32874 32879 32880 3289231392CloudWa

6、tch Alarm CloudwatchContainer spaces = 1eventEC2 Autoscale-out(time-based)User dataAWS Lambda彈性擴(kuò)容/ 縮容Amazon ECS Task DefinitionAmazon ECS ServiceALB / NLB32874 32879 32880 3289231392Auto Scaling group容器層縮容Amazon ECS Task DefinitionAmazon ECS ServiceALB / NLB32874 32879 32880 3289231392Auto Scaling g

7、roup容器層縮容CloudWatch AlarmService CPU Utilazation = 4實(shí)例層縮容EC2 Autoscale-inAmazon ECSTask DefinitionAmazon ECS ServiceALB / NLB32874 32879 32880 32892Auto Scaling groupSNS TopicLamda Function實(shí)例層縮容lifecycle hooks - Terminating:waitTerminating:waitAmazon ECSTask DefinitionAmazon ECS ServiceALB / NLB3287

8、4 32879 32880 32892Auto Scaling groupSNS TopicLamda FunctionDraining實(shí)例層縮容lifecycle hooks - Terminating:waitAmazon ECSTask DefinitionAmazon ECS ServiceALB / NLB32879 32892Auto Scaling groupSNS TopicLamda FunctionDraining3102733872lifecycle hooks - Terminating:wait實(shí)例層縮容Amazon ECSTask DefinitionAmazon

9、ECS ServiceALB / NLB32879 32892Auto Scaling grouplifecycle hooks - Terminating:waitSNS TopicLamda Functionagent3102733872System Manager APIAutomation Documents實(shí)例層縮容Amazon ECSTask DefinitionAmazon ECS ServiceALB / NLB32880 32892Auto Scaling group3102733872實(shí)例層縮容CI/CD灰度部署/ 藍(lán)綠部署灰度部署/ 藍(lán)綠部署CI/CDALB / NLBE

10、CS Service service-prod app:1ECS Task Definitionapp:1Amazon ECRECS Service service-stage app:1TG-ProdTG-Stage灰度部署CICD SystemDeveloperDeveloper灰度部署ALB / NLBECS Service service-prod app:1Amazon ECRECS Service service-stage app:1TG-ProdTG-StageCICD SystemECS Task Definitionapp:1DeveloperCICD System灰度部署

11、ALB / NLBECS Service service-prod app:1Amazon ECRECS Service service-stage app:1TG-ProdTG-StageECS Task Definitionapp:1DeveloperCICD System灰度部署ALB / NLBECS Service service-prod app:1Amazon ECRECS Service service-stage app:1TG-ProdTG-StageECS Task Definitionapp:2DeveloperCICD System灰度部署ALB / NLBECS S

12、ervice service-prod app:1Amazon ECRECS Service service-stage app:2TG-ProdTG-StageECS Task Definitionapp:2DeveloperCICD System灰度部署ALB / NLBECS Service service-prod app:1Amazon ECRECS Service service-stage app:2TG-ProdTG-StageECS Task Definitionapp:2DeveloperCICD System灰度部署ALB / NLBECS Service service

13、-prod app:2Amazon ECRECS Service service-stage app:2TG-ProdTG-StageECS Task Definitionapp:2DeveloperCICD System灰度部署ALB / NLBECS Service service-prod app:2Amazon ECRECS Service service-stage app:2TG-ProdTG-StageECS Task Definitionapp:2CI/CD灰度部署/ 藍(lán)綠部署Amazon ECS Task Definition app:1ECS Service Desired

14、 Count = 4 app:1ALB / NLBAmazon Route 53TG-ProdDeveloperCICD SystemAuto Scaling groupALB / NLBTG-ProdECS Service Desired Count = 0 app:0ECS Task Definitionapp:2Task Definitionapp:1ServiceDesired Count = 4app:1AmazonRoute 53TG-ProdDeveloperCICD SystemAuto Scaling groupTG-ProdECS Service Desired Count

15、 = 0 app:0ALB / NLBALB / NLBECS Task Definitionapp:2Amazon ECS Task Definition app:1ECS Service Desired Count = 4 app:1AmazonRoute 53TG-ProdECS Service Desired Count = 4 app:2TG-ProdDeveloperCICD SystemAuto Scaling groupALB / NLBALB / NLBECS Task Definitionapp:2Amazon ECS Task Definition app:1ECS Se

16、rvice Desired Count = 4 app:1TG-ProdECS Service Desired Count = 4 app:2TG-ProdAmazonRoute 53DeveloperCICD SystemAuto Scaling groupALB / NLBALB / NLBECS Task Definitionapp:2Amazon ECS Task Definition app:1ECS Service Desired Count = 0 app:1TG-ProdECS Service Desired Count = 4 app:2TG-ProdAmazonRoute

17、53DeveloperCICD SystemAuto Scaling groupALB / NLBALB / NLBECS Task Definitionapp:2ECS Service Desired Count = 4 app:2AmazonRoute 53DeveloperCICD SystemTG-ProdAuto Scaling groupAmazon ECS Task Definition app:1ECS Service Desired Count = 0 app:1TG-ProdALB / NLBALB / NLBECS Task Definitionapp:2數(shù)據(jù)存儲層關(guān)系數(shù)據(jù)庫緩存集群(MySQL)(million)消息隊(duì)列(SQS)搜索引擎(ES)靜態(tài)資源存靜態(tài)資源分儲(S3)發(fā)(CDN)業(yè)務(wù)接入層用戶視頻游戲金融活動禮物消息好友群組 Feed流 其他外網(wǎng)負(fù)載層AWS ELB用戶展現(xiàn)層安卓IOSH5第三方CMS審核&數(shù)據(jù)操作 &運(yùn)營配置數(shù)據(jù)數(shù)據(jù)統(tǒng)計(jì)&報(bào)表算法CDN回調(diào)個(gè)性推薦數(shù)據(jù)回傳應(yīng)用架構(gòu)單獨(dú)擴(kuò)展數(shù)據(jù)存儲層關(guān)系數(shù)據(jù)庫緩存集群(MySQL)(Codis)消息隊(duì)列(SQS)搜索引擎(ES)靜態(tài)資源存