07-CCTC2016-九州云張雷-生產(chǎn)環(huán)境中使用Docker自動化部署升級OpenStack的運維實踐

●JeffreyZhang(張雷)●From99cloud(九州云)●Nickname/Github:Jeffrey4l●Email:zhang.lei.fly@●OpenStackKollaCore●Blog:http://xcodest.me●OpenStack&Docker●WhatisKolla●KollaCommunity●KollaArchitecture●Demo●nova-docker○DockerdriverforOpenStackNova●Magnum○ContainersServiceforOpenStack●kuryr○DockerremotedriverforOpenStackNeutron●Kolla○DeployingOpenStackusingDocker●OpenStackdeployisdifficult○Deploytools■Fuel(mirantis)■openstack-ansible(rackspace)■puppet●OpenStackOpsisdifficult●“Kolla”isGreekforglue●AnOpenStackprojecthostedon○/openstack/kolla●Provides○Production-readydockerimages○DeploymenttoolsforoperatingOpenStackclouds.●SimplifyDeployandOperator○ansible●Docker○Image○Fasterdeploy●Immutable●Portable●Massivecommunity●Branding●Growth●Green○Kollaisevengreener●Additionalcomplexity●Designedbycommunity●Designedforscale●Designedforchoice●Allactivehighavailability●FullImmutableinfrastructure●Cephbackendstorage●DistrochoiceofCentOS,RHEL,UbuntuandOracleLinux●Buildfrompackagesorbuildfromsource●Deploythebigtenantat100nodesscale●Smallruntimedependencyfootprintofdocker-pyanddocker-engine●Serviceincludeceph,mariadb,rabbitmq,memcached,keystone,glance,cinder,nova,neutron(ovs&linuxbridge),heat,swift,ironicetc.●Dockercontainerforatomicupgrades●Securityenhancement●Addedupgradeaction●Addedreconfigureaction●Diagnostics●Deploymenttimereduce80%●Namedvolumeforpersistence●Qemu2.3usedinRPMbaseddistro●MariaDBlightsoutrecovery●Newservice:ElasticSearch,Heke,Kibana,Manila,Mistral●Eachchangegoesthroughagatingprocesswithconsistsof○2-ACKreviewprocess○B(yǎng)uildforalldistributionallcontainers○B(yǎng)uildasmallersubnetofcontaineranddeploythem○RuntestcasesagainstthedeployedAIO○Inthefuturedeploymulti-nodeintheOpenStackinfrastructure●UseImagedependency●Usejinja2templatelanguage,enhancetheDockerfile●Supportmultidistro○CentOS/RHEL,Ubuntu/Debian,OracleLinux●Supportmultiinstalltype○source&binaryFROM{{namespace}}/{{image_prefix}}nova-base:{{tag}}MAINTAINER{{maintainer}}{%ifinstall_type=='binary'%}{%ifbase_distroin['centos','fedora','oraclelinux','rhel']%}RUNyum-yinstallopenstack-nova-api\&&yumcleanalloinubuntuRUNapt-getinstall-y--no-install-recommends\nova-api\python-memcache\&&apt-getclean{%endif%}{%endif%}●useAnsiblefororchestration○Providekolla-ansiblescript○Useansibleinventorytocontroltherunningservicesonhost○SupportAIOandmulti-nodeenv○Supportallactiveclusterincluderabbitmqandmariadb●usehostnetwork--nethost●non-rootuserforsecurity●need`--privileged`insomecontainer,likelibvirt●Supportk8sinNewtonCommands:prechecksDopre-deploymentchecksforhostsmariadb_recoveryRecoveracompletelystoppedmariadbclusterpost-deploypulltallkollacontainersyondeploynodemagesforcontainersonlypullsnorunnnigcontainerchangesigureOpenStackservicertificatesGenerateselfsignedcertificateforTLSForDevelopmentOnlyupgradeUpgradesexistingOpenStackEnvironment●Ansibleprocessesmain.yml○ansibleprocessesconfig.yml■Customizationaugmentationfilemergedwithopinionatedconfigurationtemplates■JSONconfigurationcopied■mergedconfigfilecopiedtobind-mound○Ansibleprocessesbootstrap.yml■Createservicedatabase■Createservicedatabaseuser■Startbootstrapcontainer■Cleanupbootstrapcontainer○Ansibleprocessesstart.yml■Finalcontainerstarted●Deploy●Reconfigure●Upgrade●Kolla-k8s●Plugin●monitor●timezone●linuxulimit●dockerstoragedriver:devicemapper,overlayfs,btrfs●JoinusonIRC:#kollaonFreenode