DevOps測(cè)試基礎(chǔ)架構(gòu)與工具鏈建設(shè)

1、DevOps測(cè)試基礎(chǔ)架構(gòu)與工具鏈建設(shè)技術(shù)創(chuàng)新，變革未來(lái)DevOps下的測(cè)試執(zhí)行環(huán)境的最佳實(shí)踐DevOps下的統(tǒng)一測(cè)試服務(wù)的最佳實(shí)踐測(cè)試數(shù)據(jù)服務(wù)的設(shè)計(jì)與最佳實(shí)踐DevOps下的測(cè)試報(bào)告平臺(tái)建設(shè)與創(chuàng)新3型全球化電商網(wǎng)站的測(cè)試基礎(chǔ)架構(gòu)設(shè)計(jì)DevOps下的測(cè)試執(zhí)行環(huán)境與 統(tǒng)一測(cè)試服務(wù)的最佳實(shí)踐測(cè)試執(zhí)行環(huán)境有哪些痛點(diǎn)？對(duì)使用者而言，測(cè)試執(zhí)行環(huán)境的“透明性”對(duì)維護(hù)者而言，測(cè)試執(zhí)行環(huán)境的“易維護(hù)性”對(duì)于大量測(cè)試用例的執(zhí)行而言，執(zhí)行能力的“可擴(kuò)展性”Mobile 移動(dòng)終端的多樣性與碎片化大型全球化電商網(wǎng)站對(duì)測(cè)試執(zhí)行平臺(tái)的挑戰(zhàn)什么是測(cè)試執(zhí)行環(huán)境？為什么需要測(cè)試執(zhí)行環(huán)境？大型全球化電商網(wǎng)站對(duì)測(cè)試執(zhí)行平臺(tái)的挑戰(zhàn)Gl

2、obal Site CoverageBrowser Coverage測(cè)試執(zhí)行時(shí)間*Mobile 測(cè)試平臺(tái)的挑戰(zhàn)Android 版本碎片化Device Coverage測(cè)試執(zhí)行時(shí)間基于Jenkins觸發(fā)測(cè)試執(zhí)行Test Case/RFDO 7HVW (HFXWLRQ (QYLURQPHQW6VWHP 8QGHU 7HVW (687)Test Case DesignBusiness RequirementFeature RequirementTest Requirement7HVW &DVH5HSRVLWRULocally develop/debug/runJenkinsPull BuildRun

3、5HPRWH 7HVW (HFXWLRQ (QYLURQPHQW (7HVW %HG)Push基于Test Runner / Test Execution SystemTest Case/RFDO 7HVW (HFXWLRQ (QYLURQPHQW6VWHP 8QGHU 7HVW (687)Test Case DesignBusiness RequirementFeature RequirementTest RequirementTest Requests7HVW &DVH5HSRVLWRULocally develop/debug/runTest RunnerTest Execution S

4、ystemJenkinsPull BuildRun5HPRWH 7HVW (HFXWLRQ (QYLURQPHQW (7HVW %HG)Push基于Selenium Grid提高測(cè)試井行執(zhí)行能力Test Case6VWHP 8QGHU 7HVW (687)Test Case DesignBusiness RequirementFeature RequirementTest RequirementTest Requests7HVW &DVH5HSRVLWRULocally develop/debug/run/RFDO 7HVW (HFXWLRQ (QYLURQPHQWTest RunnerTes

5、t Execution SystemJenkinsPull BuildRun6HOHQLXP +XEPush6HOHQLXP1RGH 16HOHQLXP1RGH 26HOHQLXP1RGH Q Test RequestsRundispatchRundispatchdispatchSelenium Grid簡(jiǎn)介Selenium Grid簡(jiǎn)介DEMO: 搭建你自己的Selenium Gridjava -jar selenium-server-standalone-3.11.0.jar -role hubjava -jar selenium-server-standalone-3.11.0.jar

6、-role node-hub http:/localhost:4444/grid/register基于Jenkins Cluster提高測(cè)試井行執(zhí)行能力Jenkins Slave nJenkins Slave 2Test Case6VWHP 8QGHU 7HVW (687)Test Case DesignBusiness RequirementFeature RequirementTest RequirementTest Requests7HVW &DVH5HSRVLWRULocally develop/debug/run/RFDO 7HVW (HFXWLRQ (QYLURQPHQWTest

7、RunnerTest Execution SystemJenkins MasterPull BuildRun6HOHQLXP +XEPush6HOHQLXP1RGH 16HOHQLXP1RGH 26HOHQLXP1RGH Q Test RequestsRundispatchRundispatchdispatchJenkins Slave 1dispatch基于測(cè)試負(fù)載，用Docker實(shí)現(xiàn)Selenium Grid的動(dòng)態(tài)擴(kuò)展與收縮Jenkins Slave nJenkins Slave 2Test Case6VWHP 8QGHU 7HVW (687)Test Case DesignBusines

8、s RequirementFeature RequirementTest RequirementTest Requests7HVW &DVH5HSRVLWRULocally develop/debug/run/RFDO 7HVW (HFXWLRQ (QYLURQPHQWTest RunnerTest Execution SystemJenkins MasterPull BuildRun6HOHQLXP +XEPush6HOHQLXP1RGH 16HOHQLXP1RGH 26HOHQLXP1RGH Q Test RequestsRundispatchRundispatchdispatchJenk

9、ins Slave 1dispatchDispatch and auto scale servicedispatchDynamicallty add/delete selenium node in Grid accoriding to test load6HOHQLXP 1RGHVE RFNHU6HOHQLXP 1RGHVE RFNHURunMobile 測(cè)試執(zhí)行私有云設(shè)計(jì)與實(shí)現(xiàn)Mobile 測(cè)試執(zhí)行私有云設(shè)計(jì)與實(shí)現(xiàn)Mobile私有云測(cè)試平臺(tái)Mobile私有云測(cè)試平臺(tái)Mobile私有云測(cè)試平臺(tái)Mobile私有云測(cè)試平臺(tái)測(cè)試數(shù)據(jù)服務(wù)的設(shè)計(jì)與最佳實(shí)踐測(cè)試數(shù)據(jù)的痛點(diǎn)On-the-fly測(cè)試數(shù)據(jù)準(zhǔn)備的

10、時(shí)間消耗Out-of-box測(cè)試數(shù)據(jù)的臟數(shù)據(jù)測(cè)試數(shù)據(jù)本身組合的復(fù)雜性和多樣性性能測(cè)試數(shù)據(jù)準(zhǔn)備的時(shí)間消耗微服務(wù)化后，Cross domain的數(shù)據(jù)準(zhǔn)備缺乏Knowledge微服務(wù)化后，測(cè)試數(shù)據(jù)準(zhǔn)備的環(huán)境依賴性測(cè)試數(shù)據(jù)準(zhǔn)備1.0時(shí)代 - 基于Java實(shí)現(xiàn)的Test Data Utility測(cè)試數(shù)據(jù)準(zhǔn)備2.0時(shí)代 - 基千Builder Pattern的實(shí)現(xiàn)測(cè)試數(shù)據(jù)準(zhǔn)備3.0時(shí)代 Test Data ServiceTest Data Service的雛形Use OOB/GDS test data Web Service(5(67IXO)Test Data Preparation Tool6VWHP

11、8QGHU 7HVW (687)Test Date AdapterEncapsulated utiliites which call API or directly DB access WR SUHSDUH WHVW GDWD2XW-RI-ER 7HVW DWD (*ROGHQ DWD 6HW)測(cè)試數(shù)據(jù)準(zhǔn)備3.0時(shí)代 Test Data Service Test Data Service的雛形引入內(nèi)部數(shù)據(jù)庫(kù)實(shí)現(xiàn)更多高級(jí)的功能Web Service(5(67IXO) Test Data Preparation Tool6VWHP 8QGHU 7HVW (687)Test Date Adapter

12、Encapsulated utiliites which call API or directly DB access WR SUHSDUH WHVW GDWDTest Data Core ServiceOffering dataMeta data management Recipe data managementTest Data Meta DBRecipe DefinitionMeta data for business objects Out-of-box test data測(cè)試數(shù)據(jù)準(zhǔn)備3.0時(shí)代 Test Data Service測(cè)試數(shù)據(jù)準(zhǔn)備3.0時(shí)代 Test Data Servic

13、e Test Data Service UI測(cè)試數(shù)據(jù)準(zhǔn)備3.0時(shí)代 Test Data Service Test Data Service UIDevOps下的測(cè)試報(bào)告平臺(tái)建設(shè)與創(chuàng)新Test Report ServiceGD的BIF試ECq GUI /ideo-based -est Report for PM POq StorA Board -est Report for PM POq Multi-Site StorA Board Comparison -est Report for LQAq Full -race -est Report for DE/ QEq -est SummarA Re

14、port for management teamq -est -rend Report for management teamStory Board Test eportMulti-Site Story oard Compari-on Te-t ReportStory Board Test Report Demofile:/Users/biru/TeamWork/lqa_login_logout/mauireport.html典型的Test Report Platform架構(gòu)Test Report ServiceGUI Story Board Test ReportFull Trace Tes

15、t ReportTest Summary ReportRequirement Management System (JIRA/DOORS/ALM)7HVW (HFXWLRQ5HSRUW 0HWD DWDGUI Video-based Test Report6HOHQLXP-HQNLQV6SOXQN引入Test Analysis Service提高Defect分類效率Test Report Trace Analysis ServiceHIHFW $QDOVLV 0DFKLQH /HDUQLQJ.QRZOHGJH DWDEDVHDefect Management System(JIRA/$/0)T

16、est Report ServiceGUI Story Board Test ReportFull Trace Test ReportTest Summary ReportRequirement Management System (JIRA/DOORS/ALM)7HVW (HFXWLRQ5HSRUW 0HWD DWDGUI Video-based Test Report6HOHQLXP-HQNLQVDefect Automatic Classificate and SubmitFailed Test CasesDefect close then send root cause back to

17、 Analysis Service, it will be used as machine learning sample setMulti-Site Story Board Comparison Report Generator ServiceMulti-Site Story Board Comparison ReportLQA submit translation and layer out defectTest Report Statistics ServiceTest Trend Report6SOXQN大型全球化電商網(wǎng)站的測(cè)試基礎(chǔ)架構(gòu)設(shè)計(jì)Test CasesTest Request from CI/CDGlobal Registry ServiceUnified Flow FrameworkSystem Under Test (SUT)Test Bed EnvironmentUnified Mock ServiceLaunch test executionTest executionBuild onCall TDS to pre