微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控

微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控技術(shù)創(chuàng)新，變革未來(lái)目錄Whymicro

services？微服務(wù)架構(gòu)下的應(yīng)用性能監(jiān)控聽(tīng)云微服務(wù)化及監(jiān)控復(fù)雜調(diào)用鏈性能監(jiān)控及追蹤WhyMicro

Services?從單體到微服務(wù)單體架構(gòu)適用于中小型產(chǎn)品前期快速迭代驗(yàn)證服務(wù)及數(shù)據(jù)體量的爆炸性增長(zhǎng)分布式環(huán)境下單體架構(gòu)的問(wèn)題中央集權(quán)

vs

領(lǐng)域自治WhyMicro

Services?微服務(wù)架構(gòu)的優(yōu)勢(shì)低耦內(nèi)聚輕量，快速迭代，CI/CD更簡(jiǎn)單更可靠容易監(jiān)控，發(fā)現(xiàn)/定位問(wèn)題更快捷？WhyMicro

Services?微服務(wù)架構(gòu)的幾種打開(kāi)姿勢(shì)按業(yè)務(wù)垂直拆分按模塊水平拆分垂直+水平拆分Whymicro

services？微服務(wù)架構(gòu)下的應(yīng)用性能監(jiān)控聽(tīng)云微服務(wù)化及監(jiān)控復(fù)雜調(diào)用鏈性能監(jiān)控及追蹤微服務(wù)架構(gòu)下的應(yīng)用監(jiān)控復(fù)雜微服務(wù)架構(gòu)面臨的問(wèn)題服務(wù)器體量激增，部署和管理問(wèn)題調(diào)用鏈復(fù)雜監(jiān)控復(fù)雜度大大增加，如何快速發(fā)現(xiàn)/定位問(wèn)題？微服務(wù)架構(gòu)下的應(yīng)用監(jiān)控復(fù)雜微服務(wù)架構(gòu)下的應(yīng)用監(jiān)控vsWhymicro

services？微服務(wù)架構(gòu)下的應(yīng)用性能監(jiān)控聽(tīng)云微服務(wù)化及監(jiān)控復(fù)雜調(diào)用鏈性能監(jiān)控及追蹤聽(tīng)云的微服務(wù)化歷程dc-app聽(tīng)云App探針聽(tīng)云Server探針聽(tīng)云Browser探針SLBdc-serverdc-browser賬號(hào)&配置庫(kù)Redis-cluster數(shù)據(jù)采集存儲(chǔ)層Metric

data庫(kù)（分片集群）ES報(bào)表UIOpen

API警報(bào)NBFS非結(jié)構(gòu)化存儲(chǔ)聽(tīng)云后端架構(gòu)1.0Kafka-cluster聽(tīng)云的微服務(wù)化歷程1.0單體架構(gòu)面臨的問(wèn)題組件依賴多，迭代效率低下升級(jí)=開(kāi)發(fā)*1d+功能測(cè)試*1d+回歸*3d+部署*1h核心組件升級(jí)周期長(zhǎng)單一配置庫(kù)，DB問(wèn)題影響多個(gè)系統(tǒng)，排查困難聽(tīng)云的微服務(wù)化歷程單體

->

微服務(wù)架構(gòu)：核心組件微服務(wù)化nbfs/IP Location/Metric service配置庫(kù)按業(yè)務(wù)線垂直拆分賬號(hào)及全局配置庫(kù)：conf_global業(yè)務(wù)線配置庫(kù)：conf_app/conf_svr/conf_brs等聽(tīng)云警報(bào)服務(wù)配置庫(kù)：conf_alarm* 跨業(yè)務(wù)線查詢通過(guò)API接口調(diào)用核心微服務(wù)按業(yè)務(wù)線資源隔離日志統(tǒng)一入EFK聽(tīng)云的微服務(wù)化歷程dc-app聽(tīng)云App探針聽(tīng)云Server探針SLBdc-serverdc-browserRedis-cluster存儲(chǔ)層Metric

data庫(kù)（分片集群）ES聽(tīng)云Browser探針聽(tīng)云后端架構(gòu)2.0Kafka-clusterApp配置庫(kù)Server配置庫(kù)Browser配置庫(kù)賬號(hào)及全局配置庫(kù)NBF服務(wù)IPLocation服務(wù)Geocoding服務(wù)Metric服務(wù)服務(wù)層數(shù)據(jù)采集聽(tīng)云的微服務(wù)化歷程微服務(wù)化后的效果：核心組件獨(dú)立為原子服務(wù)，升級(jí)對(duì)應(yīng)用幾乎0影響監(jiān)控由面向應(yīng)用調(diào)整為面向服務(wù)，粒度更細(xì)可靠性高，核心組件對(duì)應(yīng)用的性能影響更透明配置庫(kù)按業(yè)務(wù)線拆分，不同業(yè)務(wù)線數(shù)據(jù)庫(kù)資源隔離聽(tīng)云的微服務(wù)化歷程聽(tīng)云NBFS服務(wù)簡(jiǎn)介：功能：非結(jié)構(gòu)化數(shù)據(jù)存儲(chǔ)（類似于TFS或S3的功能）場(chǎng)景：海量小對(duì)象存儲(chǔ)(80% < 4KB)寫多讀少，寫入延時(shí)要求高S3/Ufile/OSS

(可插拔)聽(tīng)云的微服務(wù)化歷程nbfs-worknode-1nbfs-worknode-2服務(wù)層dubbo應(yīng)用層聽(tīng)云NBFS服務(wù)化架構(gòu)zookeeper… Nbfs-worknode-NLocalstorageLocalstorageLocalstorage云存儲(chǔ)層Sync聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控關(guān)注指標(biāo)：API響應(yīng)時(shí)長(zhǎng)吞吐率API響應(yīng)耗時(shí)分解網(wǎng)絡(luò)層耗時(shí)（TODO）API調(diào)用排隊(duì)時(shí)長(zhǎng)（框架相關(guān)，例如dubbo，TODO）慢請(qǐng)求堆棧及調(diào)用鏈聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控監(jiān)控工具：cAdvisor

（docker）Heapster

（k8s）聽(tīng)云Server

(應(yīng)用層)聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控自動(dòng)發(fā)現(xiàn)應(yīng)用拓?fù)渎?tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控Client端服務(wù)調(diào)用監(jiān)控聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控服務(wù)端監(jiān)控聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控案例分享：業(yè)務(wù)高峰NBFS偶發(fā)性響應(yīng)耗時(shí)突增，持續(xù)幾秒~幾分鐘聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控周期性尖刺，平均：5.007ms，最大：8129msAsynchronousFileChannel.open:調(diào)用：4次平均：51ms聽(tīng)云微服務(wù)架構(gòu)的應(yīng)用性能監(jiān)控慢事務(wù)追蹤java.nio.channels.AsynchronousFileChannel/openAsynchronousFileChannel.openWhymicro

services？微服務(wù)架構(gòu)下的應(yīng)用性能監(jiān)控聽(tīng)云微服務(wù)化及監(jiān)控復(fù)雜調(diào)用鏈性能監(jiān)控及追蹤復(fù)雜調(diào)用鏈的應(yīng)用性能監(jiān)控復(fù)雜調(diào)用鏈拓?fù)鋸?fù)雜調(diào)用鏈的應(yīng)用性能監(jiān)控org.apache.http.impl.client.CloseableHttpClient.executeClosableHttpClient/execute:50.539s,

99.98%CloseableHttpClient.execute:50539ms,

99.98%xxx.ExtSpiderCenterController.java:291復(fù)雜調(diào)用鏈