kubeblocks 數據庫容器化和標準化之路

KubeBlocks數據庫容器化和標準化之路蔡松露｜云猿生CTO 01云、K8s和數據庫演化趨勢 03KubeBlocks的設計理念和核心特點04數據庫容器化的常見問題05數據庫私有化平臺案例云、K8s和數據庫演化趨勢趕超公有云K8sisnewpaas業(yè)務層PaaS層PaaS層服務發(fā)現配置管理聲明式APIPOD服務發(fā)現配置管理聲明式APIPODservicePVC/PVsecretconfigmapTaintTolerationAffinityAnti-AffinityeventK8sPaaS全景圖里還缺最后一塊：dbpaasdbPaaS的挑戰(zhàn)數據庫種類太多運維操作復雜數據庫種類太多運維運維操作引擎環(huán)境RedisMySQLPG開發(fā)和維護成本高引入新引擎成本高數據庫容器化后能不能像搭積木一樣在K8s上進行管理呢？首先思考：如何解決軟件工程復雜性問題文件系統(tǒng)的模型POSIX-POSIX-open()-write()xfsxfsK8s擴展的模型網絡系統(tǒng)的模型KubeBlocks通過抽象和分層來管理數據庫KubeBlocksOperator實現KubeBlocksAddonsKubeBlocksAddonsllcKubeBlocksAPIAddonAPIkbcliKubeBlocksCloudkbcliKubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫KubeBlocksKubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcKubeBlocksAPIAddonAPIkbcliKubeBlocksCloudkbcliKubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫kbclikbcliKubeBlocksKubeBlocksCloudKubeBlocksKubeBlocksOperator實現KubeBlocksAPIAddonAPIConfigmapServiceSecretPodPVC…KubeBlocksAddonsKubeBlocksAddonsllcKubeBlocks通過抽象和分層來管理數據庫KubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcAddonAPIKubeBlocksAPIAddonAPIkbcliKubeBlocksCloudkbcliKubeBlocksCloudServiceSecretConfigmap…PodPVC把KubeBlocksAPI映射到數據庫-MySQLComponent:Component:ProxyCluster:MySQL↓Component:OrchestratorComponent:Component:OrchestratorComponent:MySQLInstanceSetInstanceSetInstanceSetInstanceSetInstanceSetInstanceSetInstance InstanceInstanceInstanceInstanceInstanceInstanceInstanceInstanceInstanceServiceService ServiceServiceServiceService把KubeBlocksAPI映射到數據庫-Redis主備 Cluster:Redis Component:RedisComponent:Sentinel InstanceSetInstanceSet InstanceInstanceInstanceInstance Instance ServiceService把KubeBlocksAPI映射到數據庫-Redis集群 Cluster:RedisClusterComponent:RedisComponent:RedisComponent:RedisComponent:Component:RedisComponent:RedisComponent:RedisComponent:RedisInstanceSetInstanceSetInstanceSetInstanceSet↓ Instance↓ InstanceSetInstanceSetInstanceSetInstanceSet↓ Instance↓ ↓ Instance↓ ↓Instance↓Instance↓ InstanceSetInstanceInstanceInstanceInstanceInstanceInstanceInstanceInstanceInstanceInstanceInstance↓↓↓ ServiceServiceServiceServiceServiceServiceServiceServiceServiceService把KubeBlocksAPI映射到數據庫-OB三節(jié)點 ! Component:OBServer↓ InstanceSet↓ Instance Instance Instance Service把KubeBlocksAPI映射到數據庫-OB主備 ! Component:OBServer↓ InstanceSet↓ InstanceInstance Service把KubeBlocksAPI映射到數據庫-PolarDB-X Component:CNComponent:GMSComponent:DN-0Component:DN-1Component:DN-2 InstanceSetInstanceSetInstanceSetInstanceSetInstanceSetInstanceInstanceInstanceInstanceInstance InstanceInstanceInstanceInstanceInstance InstanceInstanceInstanceInstanceInstance Instance↓ ServiceServiceServiceServiceService把KubeBlocksAPI映射到數據庫-KafkaCluster:KafkaComponent:Component:BrokerComponent:Component:ExporterComponent:ControllerInstanceSetInstanceSetInstanceSetInstanceSetInstanceSetInstanceSetInstanceInstanceInstance↓Instance InstanceInstanceInstanceInstance↓InstanceServiceServiceServiceServiceServiceServiceKubeBlocks通過抽象和分層來管理數據庫KubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcAddonAPIKubeBlocksAPIkbcliKubeBlocksCloudkbcliKubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫KubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcAddonAPIAddonAPIkbcliKubeBlocksCloudkbcliKubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫KubeBlocksKubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcAddonAPIKubeBlocksAPIAddonAPIkbcli?支持不同的副本有不同的配置（鏡像、資源、參數）kbcli?支持不同的副本有不同的配置（鏡像、資源、參數）KubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫KubeBlocksKubeBlocksOperator實現KubeBlocksAddonsllcKubeBlocksAddonsllcAddonAPIKubeBlocksAPIAddonAPIkbclikbcliKubeBlocksCloudServiceSecretConfigmap…PodPVCKubeBlocks通過抽象和分層來管理數據庫KubeBlocksOperator實現KubeBlocksAPIAddonAPIKubeBlocksAPIAddonAPIServiceSecretConfigmap…PodPVCkbcliKubeBlocksCloudKubeBlocksAddonsllc例子：RedisAddon支持Redis多種部署形態(tài)單節(jié)點單節(jié)點(e.g.TwemProxy/Camellia)HA,"'SentinelSentinelSentinelSentinelSentinelSentinel Sentinel SentinelSentinel/apecloud/kubeblocks-addons/tree/main1.編寫ComponentDefinition：Redis/Sentinel/Proxy…- volumeMounts:…/apecloud/kubeblocks-addons/blob/main/addons/redis/templates/componentdefinition-red2.編寫ComponentDefinition：Redis/Sentinel/Proxyeocmpd-redis-sentinel.yamlvolumeMounts:…/apecloud/kubeblocks-addons/blob/main/addons/redis/templates/componentdefinition-redis-sentin3.編寫ComponentDefinition：Redis/Sentinel/Proxyooocmpd-redis-twemproxy.yaml ooocmpd-redis-twemproxy.yaml/apecloud/kubeblocks-addons/blob/main/addons/redis/templates/componentdefinition-redis-twempro4.編寫ClusterDefinition：組裝Redis/Sentinel/Proxykind:ClusterDefinitionmetadata:name:redisspec:topologies:-name:standalone2.主從+SentinelcompDef:“cmpd-redis2.主從+Sentinel-name:compDef:“cmpd-redis”-name:redis-compDef:“cmpd-redis-sentinel”-name:replication-twemproxycomponents:3.RedisProxy3.RedisProxySentinel-name:redis-sentinelcompDef:“cmpd-redis-sentinel”l-name:redislcompDef:“cmpd-redis-twemproxy”ll/apecloud/kubeblocks-addons/blob/main/addons/redis/tll5.使用RedisAddon創(chuàng)建和管理Redis數據庫cluster-cd-cluster-cd-cpu:“1.0”volumeClaimTemplates:……通過kbclikbcliclustercreatekbcliclustercreate/apecloud/kubeblocks-addons/blob/main/examples/redis/cluster-cd-topolKubeBlocks已經集成了35數據庫引擎家star》Dor1s/apecloud/kubeblocks-addons/tree/main/addons數據庫容器化常見問題容器化會不會影響數據庫的性能？K8s適合管理有狀態(tài)服務么？如何解決K8s和Operator的升級？虛擬化與容器化方案對比VMVMmicroVM?Firecracker用戶態(tài)gVisorrunC性能：runC>microVM>VM>gVisor安全性：VM≈microVM≈gVisor>runCKubeBlocks基于runC容器進行的性能優(yōu)化KubeBlocks基于runC容器進行的性能優(yōu)化KubeBlocks基于runC容器進行的性能優(yōu)化品品XFSPING_IN…PING_M…SETGETINCRLPUSHRPUSHLPOPRPOPSADDHSETSPOPZADDZPOPMINLPUSHLRANGE…MSETPING_IN…PING_M…SETGETINCRLPUSHRPUSHLPOPRPOPSADDHSETSPOPZADDZPOPMINLPUSHLRANGE…MSET數據庫容器化常見問題容器化會不會影響數據庫的性能？K8s適合管理有狀態(tài)服務么？如何解決K8s和Operator的升級？從StatefulSet到InstanceSetInstanceSetStatefulSetInstanceSetStat