大規(guī)模圖神經(jīng)網(wǎng)絡(luò)系統(tǒng)架構(gòu)剖析

1、 揚(yáng)帆起航AliGraph: 大規(guī)模圖神經(jīng)網(wǎng)絡(luò)系統(tǒng)架構(gòu)剖析Analysis of Large-scale GNN System Architecture Based on AliGraphContents 目錄01 AliGraph平臺簡介02 系統(tǒng)架構(gòu)與核心技術(shù)AliGraph平臺簡介AliGraph Overview01PAI：阿里巴巴機(jī)器學(xué)習(xí)平臺Platform of Artificial Intelligence in AlibabaPAI機(jī)器學(xué)習(xí)平臺特性Features of PAI/product/learn一站式機(jī)器學(xué)習(xí)平臺數(shù)據(jù)處理，特征加工 模型訓(xùn)練，在線預(yù)測SOTA機(jī)器學(xué)習(xí)算

2、法經(jīng)典機(jī)器學(xué)習(xí) 阿里自研算法 兼顧離線&實(shí)時(shí)精心優(yōu)化的深度學(xué)習(xí)引擎阿里內(nèi)部大規(guī)模任務(wù)打磨PAI-Tensorflow引擎彈性模型預(yù)測服務(wù)簡化模型部署負(fù)擔(dān) 支持?jǐn)U縮容，降低成本什么是圖神經(jīng)網(wǎng)絡(luò)Introduction of GNNGNN低維向量空間G = (V, E V=VertexE=EdgeNeura, Network實(shí)踐中的挑戰(zhàn)Challenges in Practice數(shù)據(jù)不規(guī)則稀疏性，非結(jié)構(gòu)化，屬性 同構(gòu)，異構(gòu)，有向，無向Data Cleaner規(guī)模巨大千億邊、百億點(diǎn) 樣本指數(shù)級膨脹百TB級萬CPU時(shí)計(jì)算難擴(kuò)展圖算子種類變化多 無法結(jié)合深度學(xué)習(xí)用戶期望：一體化解決方案Users Exp

3、ect Solutions from Data to Model for GNNAPPGNN AlgorithmsGraph & TensorEngineGraph DataLarge-scale ,Homogeneous ,Heterogeneous,AttributedAliGraph：云上的“圖+深度學(xué)+”平臺A GNN Platform on Alibaba Cloud支持PB級 源于實(shí)際 生產(chǎn)的復(fù)雜圖數(shù)據(jù)企業(yè)級Industry Level簡潔的IDEI便于從原始 數(shù)據(jù)構(gòu)建業(yè)務(wù)模型端到端End to End滿足決速發(fā)展的研究與 實(shí)際生產(chǎn)應(yīng)用的結(jié)合產(chǎn)與研For Research and

4、Production系統(tǒng)架構(gòu)與核心技術(shù)System Architecture and Key Technologies02GNN編程范式GNN Programming Paradigmhop=1hop=21. Sampling2. Vectorization3. Aggregate4. CombineVertex IdVertex AttributesEdge AttributesEdge IdAggregate outputVertex outputV1V2E1E2V0一體化系統(tǒng)實(shí)現(xiàn)An Integrated System Implementation for GNNServer 0Serv

5、er Server 2Server nTensor EngineGraph EngineData BridgePythonGraph QuerySamplerTensorFlow & PyTorchAggregatorCombinerLarge-scaleHeterogeneousAttributedGNNRPCFriendlyFlexibleRobustEffective簡潔的用戶接口Laconic User Interface點(diǎn)擊相似高效的圖構(gòu)建過程Effective Graph BuildingSERVER iData QueueData QueueData QueueLoca lPRO

6、CESSING THREADPROCESSING THREADPROCESSING THREADData QueueData QueueData QueuePROCESSING THREADPROCESSING THREADPROCESSING THREADLOADING THREADRPCRPCLoca lLOADING THREADLOADING THREADRPCRPCSERVER jLOADING THREADBatch ReadingBatch ReadingPartitioningPartitioningPartitioningPartitioningBatch ReadingBa

7、tch ReadingGraph ParsingGraph ParsingGraph ParsingGraph ParsingGraph ParsingGraph ParsingUpdate StorageUpdate StorageUpdate StorageUpdate StorageUpdate StorageUpdate Storage多跳采樣加速機(jī)制Cache to Empower Multi-Hop Graph Sampling可擴(kuò)展的算子類型Flexible and Pluggable OperatorsUser nterfaceDistribute RuntimeDistribute StorageProgramming nterfaceProgramming nterfaceOperatorOperatorOperatorOperator系統(tǒng)數(shù)據(jù)System Perfo