Rook-EdgeFS技術(shù)深度剖析課件

Deepdive:Rook/EdgeFSRookEdgeFS技術(shù)深度剖析Deepdive:Rook/EdgeFS1WhatisRook?Cloud-NativeStorageOrchestratorExtendsKuberneteswithcustomtypesandcontrollersAutomatesdeployment,bootstrapping,configuration,provisioning,scaling,upgrading,migration,disasterrecovery,monitoring,andresourcemanagementFrameworkformanystorageprovidersandsolutionsOpenSource(Apache2.0)HostedbytheCloud-NativeComputingFoundation(CNCF)WhatisRook?Cloud-NativeStor2StorageONKubernetesDeploystoragesystemsINTOtheclusterHarnessthepowerofKubernetesAutomatedmanagementbysmartsoftwarePortableabstractionsforallourstorageneedsStorageONKubernetesDeploys3RookisaFrameworkRookismorethanjustacollectionofOperatorsandCRDsFrameworkforstorageproviderstointegratetheirsolutionsintocloud-nativeenvironmentsStorageresourcenormalizationOperatorpatterns/plumbingCommonpolicies,specs,logicTestingeffortEdgeFS,Ceph,CockroachDB,Minio,NFS,Cassandra,andmore…RookisaFrameworkRookismor4NewRookOperatorsApacheCassandraNexentaEdgeFSNewRookOperatorsApacheCassa5RookEdgeFSDeployedasKubernetesOperatorFullservicelife-cyclemanagement:install,update,rolling-upgrade,uninstall,re-installMonitoringwithPrometheusandGrafanaEasyofusebuilt-inGUIwithCRDWizard!RunsinEmbeddedenvironments:<1GBDRAM,2CPUcores!ConsumesLocallyconnectedrawdisksordirectoriesProvidesGloballyavailableDataprotocolsS3andS3X(NoSQLandPOSIX-likeextension)Scale-OutHigh-PerformanceNFSScale-OutiSCSIBlockDevicesRookEdgeFSDeployedasKuberne6EdgeFSConnectedDataGlobalDeduplicationCloudsConnectivityGeo-TransparencyGlobalNamespaceProtocolTransparencyS3,S3X,NFS,iSCSISegment1MySpace/WorkHDDNSSD0HDD0ISGWLinkNFSGWS3GWSegmentNMySpace/HomeHDDNSSD0HDD0ISGWLinkNFSGWS3GW*Block-levelGeo-Deduplication*Metadata-OnlyTransfers*LocalCaching*IntelligentPrefetchingUpto50xbandwidthsavings!EdgeFSConnectedDataGlobalDe7EdgeFSCloudConnectorsPresentsS3Everywhere,Transparentlysyncingregions!Metadata-OnlysynchronizationwithLocalCachingandPrefetching.Globallyde-duplicatescross-sitecalls.Operateswithunmodified,nativeobjectsSupportedconnectorsasofEdgeFSv1.2AWSS3:StableAlibabaOSS:BetaGCPGS:BetaAzureBlob:AlphaEdgeFSCloudConnectorsPresent8EdgeFSMulti-CloudLayerGeo-ScalabilitySpansanetworkofgeographicallydistributedsites,connectedasoneglobalnamespaceGit-likearchitecturewithfault-toleranceandimmutable,versionedmetadatadesignScalesequallywellforObject,File,Built-InNoSQLorBlockdevicesGeo-TransparencyAlwaysON,bi-directionalaccesstosameS3bucket,NFSexportAutomatic“Last-Writer-Wins”updatestrategyforS3,SnapviewGroupsforNFS/iSCSIGeo-ConsistencySnapviewgroups“floating”withinconnectedgeo-namespaceAnygranularityofprotection:Files,Directories,Buckets,LUNs,NoSQLDatabasesGeo-LocalityandActiveE-LRUCachingMetadataisalwaysreplicated,dataisprefetchedon-demandandcachedlocallyModificationssynchronizedasynchronously,thusgeographicallyeventualEdgeFSMulti-CloudLayerGeo-Sc9EdgeFSUseCasesMulti-CloudCDNWorkflowEfficientdistributionofcontentwithadvancedlocalcachingfeaturesAvoidfullreplication,withoptionalpin/unpin/cloneoflocallycachedcontentSynchronizationofprimarysourcecontentonAWS,Azure,Alibaba,GCPandothersCloudHigh-AvailabilityAutomaticfailoveroffailedcloudlinkstoredundantdatasetinadifferentregionOperateinofflinemodeforupto7days,synchronizingeventuallyEdge/IoTToorFromCloudCaptureedgedatainlocalcacheandprivatecloudsforAI/MLprocessingImprovelinkutilizationbysendingde-duplicateddataasynchronouslyAccessglobalnamespacetransparently,whileavoidingtheneedtodofullreplicationKubernetesPersistentVolumesacrosscloudsBi-directionalPVswithgeo-transparentsynchronizationacrossregionsCSImanagedFileorBlockPVs,ConsistencygroupsDatasegmentationandregionawarenessEdgeFSUseCasesMulti-CloudCD10RookNetworking1G,10G,25G,40G,100G…Great.But,itissharingsamePodnetworkwiththeconvergedApps?Notanymore!RookNetworking1G,10G,25G,411Multi-HomedNetworkSelectingMultus-CNIBackedbyIntel,leadingthespaceFlexibleselectionofSDNsEnablesNamespaceIsolationFuturealternativesontheRoadmapCNI-GenieKnitterMultusNetworkAttachmentDefinitionforBackend:Multi-HomedNetworkSelectingM12Multi-HomedEdgeFSPodSwitchNetwork,MTU=9000BackendSwitchNetwork,MTU=9000StoragePodStoragePodS3XStoragePodS3XStoragePodBackendIsolationFrontendIsolationAppPersistentVolumeAppIngressAppPersistentVolumeAppEgressPodSwitchNetwork,MTU=9000StoragePodStoragePodS3XStoragePodS3XStoragePodOneFlatPodNetworkAppPersistentVolumeAppIngressAppPersistentVolumeAppEgressBenefitsoftransitioningtoIsolatedMulti-HomedNetwork:ImprovedPerformancecharacteristicsImprovedDataSecurityImprovedQoSandSLAMulti-HomedEdgeFSPodSwitchN13S3XDeploymentDemoSetupTargetPod0(4TB)HDDSSDHDDHDDHDDTargetPod1(4TB)HDDSSDHDDHDDHDDTargetPod2(4TB)HDDSSDHDDHDDHDDTargetPod3(4TB)HDDSSDHDDHDDHDDS3XCOSBenchWorkerHost1Host2Host3Host4PhysicalCharacteristics:4-nodesKubernetesclusterv1.14,1SSDper4HDD,15%SSDoftotalHDDcapacity,64GBRAMperHost,CPUE5-2630,2.2GHz10GPodNetwork,10GBackendNetwork,bothJumboMTURookS3XDeploymentandCOSBenchworkgeneratorrunsonseparatehostsRookEdgeFSClusterCRD:S3XDeploymentDemoSetupTarget14PerformanceAnalysis25-29%betterresponsetime!39-43%betterbandwidth!TestwasdesignedtocomparePodvs.Multi-HomedNetworksSingle10Gconnectedmulti-threadedapp,2MBS3objecttransfers,3syncreplicas,6TBrandomI/OdatasetPerformanceAnalysis25-29%bet15SummaryRookCommunityisgrowing!TopContributors:Upbound.io,RedHat,Nexenta/DDN,SUSE,Cloudability,moreiscoming!EdgeFSisemergingtoaddressMulti-CloudandEdge/IoTneedsMulti-Homednetworkisgoingtobeavailableinupcoming1.1releaseSummaryRookCommunityisgrowi16Thankyou!/rook/rookhttps://rook.io/https://edgefs.io/Thankyou!17Deepdive:Rook/EdgeFSRookEdgeFS技術(shù)深度剖析Deepdive:Rook/EdgeFS18WhatisRook?Cloud-NativeStorageOrchestratorExtendsKuberneteswithcustomtypesandcontrollersAutomatesdeployment,bootstrapping,configuration,provisioning,scaling,upgrading,migration,disasterrecovery,monitoring,andresourcemanagementFrameworkformanystorageprovidersandsolutionsOpenSource(Apache2.0)HostedbytheCloud-NativeComputingFoundation(CNCF)WhatisRook?Cloud-NativeStor19StorageONKubernetesDeploystoragesystemsINTOtheclusterHarnessthepowerofKubernetesAutomatedmanagementbysmartsoftwarePortableabstractionsforallourstorageneedsStorageONKubernetesDeploys20RookisaFrameworkRookismorethanjustacollectionofOperatorsandCRDsFrameworkforstorageproviderstointegratetheirsolutionsintocloud-nativeenvironmentsStorageresourcenormalizationOperatorpatterns/plumbingCommonpolicies,specs,logicTestingeffortEdgeFS,Ceph,CockroachDB,Minio,NFS,Cassandra,andmore…RookisaFrameworkRookismor21NewRookOperatorsApacheCassandraNexentaEdgeFSNewRookOperatorsApacheCassa22RookEdgeFSDeployedasKubernetesOperatorFullservicelife-cyclemanagement:install,update,rolling-upgrade,uninstall,re-installMonitoringwithPrometheusandGrafanaEasyofusebuilt-inGUIwithCRDWizard!RunsinEmbeddedenvironments:<1GBDRAM,2CPUcores!ConsumesLocallyconnectedrawdisksordirectoriesProvidesGloballyavailableDataprotocolsS3andS3X(NoSQLandPOSIX-likeextension)Scale-OutHigh-PerformanceNFSScale-OutiSCSIBlockDevicesRookEdgeFSDeployedasKuberne23EdgeFSConnectedDataGlobalDeduplicationCloudsConnectivityGeo-TransparencyGlobalNamespaceProtocolTransparencyS3,S3X,NFS,iSCSISegment1MySpace/WorkHDDNSSD0HDD0ISGWLinkNFSGWS3GWSegmentNMySpace/HomeHDDNSSD0HDD0ISGWLinkNFSGWS3GW*Block-levelGeo-Deduplication*Metadata-OnlyTransfers*LocalCaching*IntelligentPrefetchingUpto50xbandwidthsavings!EdgeFSConnectedDataGlobalDe24EdgeFSCloudConnectorsPresentsS3Everywhere,Transparentlysyncingregions!Metadata-OnlysynchronizationwithLocalCachingandPrefetching.Globallyde-duplicatescross-sitecalls.Operateswithunmodified,nativeobjectsSupportedconnectorsasofEdgeFSv1.2AWSS3:StableAlibabaOSS:BetaGCPGS:BetaAzureBlob:AlphaEdgeFSCloudConnectorsPresent25EdgeFSMulti-CloudLayerGeo-ScalabilitySpansanetworkofgeographicallydistributedsites,connectedasoneglobalnamespaceGit-likearchitecturewithfault-toleranceandimmutable,versionedmetadatadesignScalesequallywellforObject,File,Built-InNoSQLorBlockdevicesGeo-TransparencyAlwaysON,bi-directionalaccesstosameS3bucket,NFSexportAutomatic“Last-Writer-Wins”updatestrategyforS3,SnapviewGroupsforNFS/iSCSIGeo-ConsistencySnapviewgroups“floating”withinconnectedgeo-namespaceAnygranularityofprotection:Files,Directories,Buckets,LUNs,NoSQLDatabasesGeo-LocalityandActiveE-LRUCachingMetadataisalwaysreplicated,dataisprefetchedon-demandandcachedlocallyModificationssynchronizedasynchronously,thusgeographicallyeventualEdgeFSMulti-CloudLayerGeo-Sc26EdgeFSUseCasesMulti-CloudCDNWorkflowEfficientdistributionofcontentwithadvancedlocalcachingfeaturesAvoidfullreplication,withoptionalpin/unpin/cloneoflocallycachedcontentSynchronizationofprimarysourcecontentonAWS,Azure,Alibaba,GCPandothersCloudHigh-AvailabilityAutomaticfailoveroffailedcloudlinkstoredundantdatasetinadifferentregionOperateinofflinemodeforupto7days,synchronizingeventuallyEdge/IoTToorFromCloudCaptureedgedatainlocalcacheandprivatecloudsforAI/MLprocessingImprovelinkutilizationbysendingde-duplicateddataasynchronouslyAccessglobalnamespacetransparently,whileavoidingtheneedtodofullreplicationKubernetesPersistentVolumesacrosscloudsBi-directionalPVswithgeo-transparentsynchronizationacrossregionsCSImanagedFileorBlockPVs,ConsistencygroupsDatasegmentationandregionawarenessEdgeFSUseCasesMulti-CloudCD27RookNetworking1G,10G,25G,40G,100G…Great.But,itissharingsamePodnetworkwiththeconvergedApps?Notanymore!RookNetworking1G,10G,25G,428Multi-HomedNetworkSelectingMultus-CNIBackedbyIntel,leadingthespaceFlexibleselectionofSDNsEnablesNamespaceIsolationFuturealternativesontheRoadmapCNI-GenieKnitterMultusNetworkAttachmentDefinitionforBackend:Multi-HomedNetworkSelectingM29Multi-HomedEdgeFSPodSwitchNetwork,MTU=9000BackendSwitchNetwork,MTU=9000StoragePodStoragePodS3XStoragePodS3XStoragePodBackendIsolationFrontendIsolationAppPersistentVolumeAppIngressAppPersistentVolumeAppEgressPodSwitchNetwork,MTU=9000StoragePodStoragePodS3XStoragePodS3XStoragePodOneFlatPodNetworkAppPersistentVolumeAppIngressAppPersistentVolumeAppEgressBenefitsoftransitioningtoIsolatedMulti-HomedNetwork:ImprovedPerformance