2023龍蜥操作系統(tǒng)大會阿里云分論壇：釋放云算力 繁榮云生態(tài)

釋放云算力繁榮云生態(tài)AlibabaCloudLinux的發(fā)展和展望阿里云操作系統(tǒng)產(chǎn)品專家服務(wù)用戶數(shù)服務(wù)用戶數(shù)阿里云上超越CentOS占比第一AlibabaAlibabaCloudLinux2AlibabaAlibabaCloudLinux3AlibabaAlibabaCloudLinux4redisLanguage（阿里云沙箱容器)容器鏡像場景redisLanguage（阿里云沙箱容器)容器鏡像場景裸金屬鏡像裸金屬鏡像安全組織/機構(gòu)安全組織/機構(gòu)Openssl/BoringSSL/BabaSSLcoresight裸金屬Openssl/BoringSSL/BabaSSLcoresight裸金屬專家知識庫編譯器BaseOS裸金屬專家知識庫編譯器BaseOS裸金屬智能參數(shù)調(diào)優(yōu)南向硬件不兼容南向硬件不兼容AI軟件棧存在調(diào)優(yōu)空間北向軟件生態(tài)多樣性標準和生態(tài)標準和生態(tài)均原廠合作支持，并形成解決方案組件帶來的特性紅利無需繁瑣操作，開箱即用的獲取鏡像信息檢索鏡像分類管理鏡像參數(shù)定義dockerhub通用測試鏡像信息檢索鏡像分類管理鏡像參數(shù)定義dockerhub通用測試鏡像分發(fā)任務(wù)編排/任務(wù)編排/pipeline鏡像發(fā)布系統(tǒng)鏡像發(fā)布系統(tǒng)鏡像版本管理鏡像版本管理任務(wù)調(diào)度鏡像構(gòu)建低延遲高密度的云原生系統(tǒng)上海交通大學計算機系教授CCF青年科技獎，阿里青橙獎獲得者02問題分析02問題分析研究成果研究背景……02問題分析02問題分析研究成果研究背景云服務(wù)器…02問題分析02問題分析研究成果研究背景……… DataFlower:ExploitingtheData-flowParadigmforServerlessWorkflowOrchestration.ASPLOS2024等微服務(wù)D微服務(wù)D本地本地free微服務(wù)B微服務(wù)C本地free微服務(wù)C本地freeFaaStore=FaaStore(user_function,[cFaaStore.save(Output,conteFaaStore.save(File,conte（1）根據(jù)數(shù)據(jù)流圖調(diào)度結(jié)果，自適應(yīng)選擇本地空閑memory或者遠端存儲（2）動態(tài)收集微服務(wù)實例中的空閑內(nèi)存，作為自適應(yīng)memory存儲的限額FaaSFlow:EnableEfficientWorkflowExecutionforFunction-as-a-Service.ASPLOS2022等 RunD:ALightweightSecureContainerRuntimeforHigh-densityDeploymentandHigh-concurrencyStartupinServerlessComputing.ATC2022等HelpRatherThanRecycle:AlleviatingColdStartupinServerlessComputingThroughInter-FunctionContainerSharing.ATC2022等HelpRatherThanRecycle:AlleviatingColdStartupinServerlessComputingThroughInter-FunctionContainerSharing.ATC2022等能耗….能耗….間片….……核核Alita:ComprehensivePerformanceIsolationthroughBiasResourceManagementforPublicClouds.SC2020、ICS2023等 基于微服務(wù)阻塞圖的QoS快速恢復基于微服務(wù)阻塞圖的QoS快速恢復Nodens:EnablingResourceEfficientandFastQoSRecoveryofDynamicMicroserviceApplicationsinDatacenters.ATC2023等……AlibabaCloudLinux解鎖云算力軟硬協(xié)同構(gòu)建云上最佳操作系統(tǒng)體驗阿里云智能程序語言與編譯器技術(shù)總監(jiān)龍蜥社區(qū)Java語言和虛擬機SIG成員InclavareContainers?下游商業(yè)版：需要專業(yè)商業(yè)服務(wù)?企業(yè)定制版：面向自有業(yè)務(wù)研發(fā)和優(yōu)化:AlibabaCloudLinux【Source:computer-architecture-patterson-5th-editionpage:73】ApplicationApplication(Algorithm)ProgramingLanguageProgramingLanguageSystemSystemSoftwareApplication(Algorithm)Application(Algorithm)ProgramingLanguageProgramingLanguageSystemSystemSoftwareredis社區(qū)維護支持社區(qū)維護支持Linux-AplineWindows(Experimental)質(zhì)量體系8/11/17發(fā)行版ExtendedEdition：Dragonwell增強(RAS、協(xié)程…)基于AnolisOS/ALinux的構(gòu)建與發(fā)布開源與標準/p/p2.AlibabaCloudLinux釘釘交流群3.更多優(yōu)化特性介紹/zh/ecs/user-guide/kernel-features-and-interfaces【AlibabaCloudLinux交流AlibabaCloudLinux與倚天軟硬件結(jié)合，加速數(shù)據(jù)智能創(chuàng)新阿里云ECS首席架構(gòu)師軟硬協(xié)同，為企業(yè)級應(yīng)用提供高效算力+高穩(wěn)定，高彈性，高性能…軟硬協(xié)同，為企業(yè)級應(yīng)用提供高效算力+高穩(wěn)定，高彈性，高性能…阿里云-全面擁抱云原生與AI新浪潮*摘自IDC報告彈性計算彈性計算彈性計算彈性計算彈性計算彈性計算支持企業(yè)全面上云提效降本支持企業(yè)全面上云提效降本云原生算力，助力企業(yè)擁抱AI新趨勢云原生算力，助力企業(yè)擁抱AI新趨勢+穩(wěn)定，安全，彈性，性能，成本…為企業(yè)云上創(chuàng)新及智能化升級2009軟件定義虛擬化架構(gòu)2017軟硬一體神龍計算架構(gòu)2021云原生CIPU計算架構(gòu)直播/短視頻UGC指數(shù)級增長直播/短視頻UGC指數(shù)級增長基因/制藥精準推薦精準推薦挑戰(zhàn)Spark/HPC/Video算力需求高挑戰(zhàn)Spark/HPC/Video算力需求高存算分離/RPC/壓縮成本，穩(wěn)定性CPU-usage234傳統(tǒng)計算架構(gòu)面臨挑戰(zhàn)趨勢FlinkFlink訪存帶寬和時延無法滿足CPU算力11云原生處理器為解決算力挑戰(zhàn)提供新的思路芯片視角云時代云原生處理器垂直場景加速垂直場景加速通過CIPU提升產(chǎn)品穩(wěn)定性算力穩(wěn)定軟件協(xié)同AIAI物理資源+CIPU=飛天納管的云化計算資源池超高性能云盤企業(yè)級數(shù)據(jù)安全存儲和網(wǎng)絡(luò)的E2E數(shù)據(jù)加密能力虛擬化加密隔離環(huán)境EnclavevSGX機密計算能力云基礎(chǔ)設(shè)施處理器CIPU大規(guī)模應(yīng)用全新云基礎(chǔ)架構(gòu)全新云基礎(chǔ)架構(gòu)虛擬機、裸金屬及安全容器共池數(shù)據(jù)加速，保持算力澎湃輸出高性能網(wǎng)絡(luò)高性能網(wǎng)絡(luò)支持端到端多路徑傳輸5000萬pps，16μs時延2*100Gbps雙向線速20212022倚天ECS上線倚天ECS上線?NVMeEBS高性能云盤倚天710發(fā)布倚天生態(tài)?EasyYitian倚天云產(chǎn)品持續(xù)演進，規(guī)模應(yīng)用倚天倚天PaaS上線?DB：RDS、Redis、PolarDB基礎(chǔ)技術(shù)阿里巴巴集團規(guī)模落地阿里巴巴更多應(yīng)用落地客戶落地?AlibabaCloudLinux/Anolis倚天ECS產(chǎn)品高密計算神龍?zhí)摂M化Hypervisor倚天ECS產(chǎn)品高密計算神龍?zhí)摂M化Hypervisor數(shù)據(jù)搬移加速倚天ECS底層架構(gòu)?eRDMA：VPC支持RDMA，比TCP時延降低一半，吞吐提高?NVMe：采用NVMeESSD云盤，時延降低10%高可靠性;做到高密的同時穩(wěn)定性與x86持平挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)1算力密度挑戰(zhàn)4計算能耗200200GbpsNVMeESSDALU*4Hyperthread64MB/64vcpu64K/64KALU*4Hyperthread64MB/64vcpu64K/64KALU*464K/64KALU*4ALU分類性能測試項G7a百分比G8y百分比性能對比應(yīng)用性能FlinkQ046.9CachemissL1i_missL1d_missL2dmissL3miss86.498.76訪存頻率MemoryAccess48MB/64vcpuX86Yitian挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)1算力密度挑戰(zhàn)4挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)1算力密度挑戰(zhàn)4計算能耗ECS.G7.largeARMECS.G7.largeECS.G8y.large2vCPUALUcacheL3cacheFrequencyx861vcpu32K/48K1.28MB/248M/64vcpu變頻2.1-3.5GYitian1vcpu64MB/64c定頻3.0GhzCompare4x-2，IPC3倍（每個cycle執(zhí)行的指令）4500004000004500004000000技術(shù)收益：?Lantency20us8us?CPUusage↓20%40000 G7.2xlargeG8y.2xlarge挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)1算力密度挑戰(zhàn)4計算能耗ALU/CacheexclusiveALU/Cacheexclusive挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)2挑戰(zhàn)3數(shù)據(jù)搬移挑戰(zhàn)1算力密度挑戰(zhàn)4計算能耗,避免事故fps/core9.756.5 9.889.639.599.59.59.599.46 -45%8.57 7.357.227.177.023.25moreworkloadx86G8yfreq（Ghz）Yitian倚天ECS產(chǎn)品再進化，性能提升20%視頻編解碼DragonFlyDragonFly軟硬件結(jié)合，持續(xù)優(yōu)化倚天ECS性能APPsAlinuxAlinux3數(shù)據(jù)壓縮加速floating-pointinstructions硬件指令+軟件加速實現(xiàn)倚天算力再進化加速庫-Gzip/Zstd/Math/x264/x265/nativeengineNativeengineDragonwell加速Alinux系統(tǒng)優(yōu)化大容量CacheNativeengineDragonwell加速Alinux系統(tǒng)優(yōu)化大容量Cache大數(shù)據(jù)/Spark場景40000SnappyonYitianossZSTDonYitianoss↑2.4x↑2.4x快難同步X86Cascadelake存算一體↓27%↓30%倚天ECS實例助力小米科技大數(shù)據(jù)業(yè)務(wù)上云寬fps525.350.60fps525.350.60倚天ECS實例助力某在線教育客戶降本增效視頻編轉(zhuǎn)碼成本性能優(yōu)化開箱即用性能優(yōu)化開箱即用倚天云原生算力優(yōu)勢倚天云原生算力優(yōu)勢轉(zhuǎn)碼服務(wù)轉(zhuǎn)碼服務(wù)向量化加速向量化加速EncoderCache預取倚天實例倚天實例集群PortalPortalConferencewebrtcaudiostreaming 倚天編碼加速庫倚天編碼加速庫x264vod:32CinstanceAveragex264vod:24c8y-x264-opt24c8y-x264-opt轉(zhuǎn)碼任務(wù)數(shù)量x265live:ultrafast射擊游戲1c8y-x265-opt射擊游戲2射擊游戲1c8y-x265-opt視頻后處理Cache優(yōu)化Dragonwell11優(yōu)化Java場景應(yīng)用性能Java性能測試2xlarge0 72730G8y-2022G8y-2023?JDK：Dragonwell版本3.8倚天版數(shù)據(jù)庫-高性能低成本APPCacheDatabasePolarDBPolarDBDatabaseperformanceonYitianvsx86：：逐漸豐富的開源軟件生態(tài)ApplicationLibraryLanguageIaaSLZ4openAnolisRedHatApplicationPaaSDatabasePlatformIaaSApplicationPaaSDatabasePlatformIaaS倚天云產(chǎn)品生態(tài)不斷完善AlibabaAlibabaStep1.InstallkeentuneStep2.InstallapplicationStep3.optimizeapplicationkeentunedkeentuneStep1.InstallkeentuneStep2.InstallapplicationStep3.optimizeapplicationkeentunedkeentune-targetApplicationApplicationNginx/MySQL/Redis/Memcached/PgSQLHardware/ecs阿里云售賣頁YitianCreateInstanceDatabaseDatabaseCADT-快捷倚天ECS實例選型評估/zh/product/cadt●開箱即用方案創(chuàng)建：https/detail/346系統(tǒng)差異性評估Assembly系統(tǒng)差異性評估Assembly匯編GolangJava代碼兼容性掃描BaseOS團性能評估EasyYitan倚天遷移平臺，助力企業(yè)快速可靠遷移/zh/ecs/user-guide/easyyitian-migration-toolsEasyBuild兼容X86和arm64JavaJava操作系統(tǒng)倚天社區(qū)-一站式開發(fā)者支撐平臺EclipseJifaPerf(X)攜手阿里云釋放Intel平臺算力嚴力科Intel云解決方案架構(gòu)師Outline014thGenIntel?Xeon?ScalableProcessorkeyfeatures02FeaturesEnablingOverviewinOpenAnolis03BestpracticesonAlibabaCloud*Intelopen-sourcelibrary(notpartofstockSW).**DifferencebetweenIntelversionandstockversion.***Intel?QPLand*Intel?DMLinopen-sourcebeta,v1.0.0comingshortly.4thGenIntel?Xeon?ScalableProcessor-SapphireRapids(SPR)AcceleratorintegrityatthevirtualmachineClickhereformostresourcesonacceleratorenablementIntel?AdvancedMatrixExtensions(Intel?AMX)-ToImproveAI“Tiles”“Tiles”+TileMatrixMultiplyInstructionsthatcomputelargermatricesinasingleoperationStorebiggerchunksofdata“TMUL”Intel?DataStreamingAccelerator(Intel?DSA)-FasterDataMovementInandOutofStorageLatencyReduction*CustomerUsages:Virtualization,fastreplicationacrossnon-transparentbridge,ERP,In-MemoryDatabasesPerformancegainsvspriorgenerationPerformancegainsvspriorgenerationproductsEmbeddedDatabaseshigherRocksDBperformancewithlatencyreductionwithpriorgenerationPerformancegainsvsnotusingacceleratorsEmbeddedDatabases2.1xHigherRocksDBperformancewithbuilt-inIntel?IAAvs.ZstdsoftwareSee[D1]at/content/www/us/en/products/performance/benchmarks/4th-generation-intel-xeon-scalable-processors/Intel?In-MemoryAnalyticsAccelerator(Intel?IAA)-AdvanceDataAnalyticsCustomerCustomerUsages:In-MemoryDatabases,BigDataAnalytics,DatabasesIntel?QuickAssistTechnology(Intel?QAT)-HardwareAccelerationofDataCompressionCustomerUsages:NetworkSecureGateway,CDN,DataCompression(L1/L9)Intel?TrustDomainExtensions(Intel?TDX)-ImproveDataSecurityMoststraightforwardpathtogreatersecurity,compliance&controlforlegacyappsVMIsolationIntel?TDXVSAppIsolationIntel?SGXOutline014thGenIntel?Xeon?ScalableProcessorkeyfeatures02FeaturesEnablingOverviewinOpenAnolis03BestpracticesonAlibabaCloudANCK-5.10JulAugMarJanAprMayJun下一代英特爾?ANCK-5.10JulAugMarJanAprMayJun下一代英特爾?至強?可擴展處理器(EmeAnolisOS8.8第四英特爾?至強?可擴展處理器(SapphireRapids)JanJanFMarMarAprAprMJunJunJulJulAugAugSdriverfixes?Perfuncorefixes?In-FieldScanoptimization?In-FieldScanenhancefixesCopyfixes90+PRs70+features1260+patches150K+lines龍蜥助力英特爾?至強?平臺創(chuàng)新技術(shù)領(lǐng)先落地SapphireRapidsFeatureEnablinginOpenAnolisSapphireRapidsKeyFeatureVMSapphireRapidsKeyFeatureVMSapphireRapidsKeyFeatureVMISA:AdvancedMatrixExtensions(AMX)DataStreamAccelerator(DSA)OOTComputeExpressLink1.1ISA:AcceleratorInterfacingArchitectureENQ*OOTIn-memoryAnalytcsAccelerator(IAA)OOTISA:5GIAS(FP16)/HFNIScalableI/OVirtualization(SIOV)OOTOOTPCIeGen5ISA:SerializeInstructionsQuickAssistTechnology(QAT)OOTDriverOOTOOTTSXSuspendableloadregionISA:CLDEMOTE(legacy)DynamicLoadBalancer(DLB)OOTDriverOOTOOTPlatformMonitoringTechnology(PMT)HighBandwidthMemory(HBM)EmmitsburgPCHdeviceIDsBusLockDetectionTrustedDomainExtentions(TDX)OOT**RAS:EDACdriverROPControl-FlowEnforcementTechnology(CET)SoftwareGuardExtentions(SGX)SeamlessRPMNon-TransparentBridgePMUcoreeventsPerfMonPEBSEnh.RAPL,PlatformPsysRAPLPMUuncoreeventsFreerunningmemoryBWcountersGPIONotifyVM-exitArchitecturalLBRCrowPass(OptaneDCPMM2.0)IPIVirtualizationInFieldScan(single-blobimage)intel_idlesupportC1/C1EChassisPerMonFrameworkInFieldScan(multi-blobimages)*MostofWIPisnowsupportedviaOOT(Out-Of-Treemodules,i.e.,thesourcecodesthathavenotbeenofficiallyacceptedbytheupstream.)**TDXguestsupportisdoneinAnolistech-previewkernel6.x,enablementforAnolisproductionkernelv5.10isWIP.SupportedWIP(MostwillbesupportedviaOut-Of-Tree)NotsupportedOutline014thGenIntel?Xeon?ScalableProcessorkeyfeatures02FeaturesEnablingOverviewinOpenAnolis03BestpracticesonAlibabaCloud/sig/Intel-Kernel/doc/789612541713268739適配TensorFlow、PyTor開箱即用的用戶體驗，可進一步釋放硬件能力，助力AI計算性能基于QAT加速云原生網(wǎng)絡(luò)的實踐/sig/Intel-Kernel/doc/954063098528016201●為解決微服務(wù)中，網(wǎng)絡(luò)通信的EnvoyTLS性能和GZIP性能瓶頸問題，基于龍蜥社區(qū)Anolis系統(tǒng)，結(jié)合英特爾?QATCrypto和英特爾?QATZip構(gòu)建對應(yīng)方案?！馎nolis系統(tǒng)針對方案進行了全鏈路的優(yōu)化，并以RPM包的形式集成了相關(guān)的軟件，用戶只需通過yum命令及簡單的配置即可享用以上方案帶來的顯著性能提升。TDX實例中基于BigDLPPML構(gòu)建全鏈路安全的分布式Spark大數(shù)據(jù)分析應(yīng)用●BigDLPPML基于英特爾?TDX構(gòu)建了一整套解決方案，基于BigDLPPML解決方案，在阿里云ECSg8iTDX機密實例中運行標準的AI和大數(shù)據(jù)應(yīng)用，可以加強數(shù)據(jù)傳輸?shù)陌踩?、?shù)據(jù)使用的安全性和應(yīng)用程/help/zh/ecs/user-guide/build-a-distributed-end-to-end-secure-apache-spark-big-data-analytics-application-based-on-bigdl-ppml-on-tdx-instances/?spm=a2c63.p383cea5e51KdlQR2Thanks!阿里云倚天在時空智能服務(wù)上的規(guī)?；瘧?yīng)用千尋位置核心業(yè)務(wù)遷移實錄千尋位置網(wǎng)絡(luò)有限公司運維專家支撐系統(tǒng)準備支撐系統(tǒng)準備遷移策略業(yè)務(wù)系統(tǒng)準備業(yè)務(wù)系統(tǒng)準備X86服務(wù)器1X86服務(wù)器1X86服務(wù)器2X86處理器測試結(jié)果X86處理器測試結(jié)果4ms元/月88880.93場景化鏡像平臺技術(shù)解讀龍蜥社區(qū)基礎(chǔ)設(shè)施SIGMaintainer?平臺介紹??平臺介紹?系統(tǒng)架構(gòu)?構(gòu)建配置?系統(tǒng)優(yōu)勢?AI鏡像制作01鏡像平臺01鏡像平臺鏡像支持?ABS鏡像構(gòu)建?T-One鏡像測試?鏡像發(fā)布?簽名、安全掃描、SBOM制品向用戶開放社區(qū)已發(fā)布的鏡像，用戶在鏡像制品中可查看鏡像描述、鏡像下載等；制品中心展示鏡像CI/CD流程，在Pipeline流水線中可追溯構(gòu)建、測試、安全掃描、發(fā)布等每一步流程。鏡像平臺地址：.統(tǒng)一鏡像集成框架鏡像制作調(diào)度系統(tǒng)鏡像信息檢索鏡像分類管理鏡像參數(shù)定義dockerhub通用測試統(tǒng)一鏡像集成框架鏡像制作調(diào)度系統(tǒng)鏡像信息檢索鏡像分類管理鏡像參數(shù)定義dockerhub通用測試鏡像發(fā)布系統(tǒng)鏡像分發(fā)任務(wù)編排/任務(wù)編排/pipeline鏡像發(fā)布系統(tǒng)鏡像發(fā)布系統(tǒng)鏡像版本管理鏡像版本管理任務(wù)調(diào)度鏡像構(gòu)建#版本關(guān)系依賴表，默認繼承version-#版本關(guān)系依賴表，默認繼承version-base.yml配置version.ymlversion:&VERSION#可重寫覆蓋，versions:buildspec.ymlversion:&VERSION#鏡像倉庫配置dockerhub:&DOCKERHUB_PRODracr:&ACR_PROD-zhangjiakou.cr.aliyuncs.#構(gòu)建鏡像配置BuildGrafana7.5.11-8.6ECSApplicationDockerImage:test:true#定義是否測試platform:[linux/amd64,linux/a