自動化測試與持續(xù)集成解決方案

1、自動化測試與持續(xù)集成解決方案技術(shù)創(chuàng)新，變革未來智慧ITAgendaIntroductionMobileTestingat WalmartLabsMobileTest AutomationSolutionsHow do weachieve scalepresent resultbattleflakinessTakeawaysQ&AIntroduction - Why talk at MTSC ?Introduction - WalmartLabsATechnology Company“ Were not a retailer competing in Silicon Valley. Were b

2、uilding an internet technology company inside the worlds largest retailer. ”Introduction - WalmartLabsIntroduction - WalmartLabsMultipleApps coveringdifferent business:WalmartSams ClubASDAGroceryVudu.Introduction - TeamDeveloperExperienceTools WalmartLabsProvideallthemobileautomationsolutions across

3、 multipledepartmentsLillian WangChaoyi ChenTechnical Focus/Interest : iOSFun Fact : Always ready for being challenged in foosball. Technical Focus/Interest : Mobile InfrastructureFun Fact : Actually funnier than he looksRenas RedaTechnical Focus/Interest : Android. Open source.Fun Fact : As a kid I

4、was addicted to Nutella. I still have a few relapses now and then :)Testing at WalmartLabs - HowandWhyTesting WalmartLabsUsedtohave dedicated/centralized QAteams incharge of all testingsacross different tracksNowonly SDET, nomanualQA.Developers responsiblefor contributing/maintainingtest.Testing Wal

5、martLabsscalable,robuts CI/CDeasyto adopt test automationsolutionsTesting WalmartLabs- OverviewAutomationat “Walmart Scale” is hardHowbigis theworkload?avg runtime #tests #env #browser/device #versionsNeedfor a fast feedback, bothlocally andonCI10minutePR verify requirementTesting WalmartLabs- Mobil

6、eOverviewTesting WalmartLabs - Appium SDKTesting WalmartLabs - Appium SDKTesting WalmartLabs- AppiumSDKWechoose javascript client binding(WD.js)Bigreason: React NativeNode.js is oneof themost popular/usedlanguages at WalmartLabsAligns withour choice of web/api automationCaveatsWD.js: badexperience,

7、lack of maintenanceTesting WalmartLabs- AppiumSDKKunlun (https:/package/kunlun) - awrapper of WD.jsEasy towritetest:Easier for debugloggingAutosynchronization, nohard codedsleep()AutogeneratePageObject test structureEasy toscale:Magellan, SauceLabs and TestObject supportsAutouploadtestingappConfigur

8、ableparallelsimulators/devices/versionsConfigurablefailure retriesKunlun overviewAuto generate automation tests structure:$ ./node_modules/.bin/kunlun initTesting WalmartLabs - Robotium SDKTesting WalmartLabs - Robotium SDKYouhave Appium that shouldwork for Androidtoo, why Robotium?Because dev team

9、loves RobotiumThe creatorof Robotium willtellyoumoreWhySolo?What isRobotium?FactsInstrumentationtest frameworkAdd-onjarOpenSource (Apache2)PurposeUtilize thepower of instrumentationSimplify makingtestsMinimize flakinessRobotiumBenefitsEasy towrite&understand, shorter codeAutomatic timinganddelaysAut

10、omatically follows current ActivityAutomatically makes owndecisionsWhentoscroll, hidekeyboard etc.Tests are bundledwithintheappRobotiumWalmartLabsAlltests integratedintheappsource codesAndroidStudioDevs use it for functionaltestsSDET for integrationtestsRobotium tests are runforPR-VerifyMaster-Verif

11、yUsedfor device compatibility testingAllsupportedAndroidversionsThemost popular devicesCodecoveragethrough gradle pluginWegot it, but - youmentioned10minPR?Testing WalmartLabs - Appium SDKWheresthe10minute PRMagellan: Arunner of runner, aparallel async queueWorker #1Worker #2Worker #3Worker #nTest #

12、1Test #2Test #3Test #nWheresthe10minute PRMagellan: Arunner of runner, aparallel async queueWheresthe10minute PRForkedprocesses, pipedstreamsWheresthe10minute PRInreality, take Walmart iOS appfor example:Use 103 simulators toruntests at onetime for each PRRuninserialusedtotake 4 hoursNowclose to 5 m

13、in(50 x faster) with2-times retryGood - now how do you provide the feedback?Testing WalmartLabs- ReportAdmiral: A dashboard for tracking cross-browser/cross-device end-to-end test results.Testing WalmartLabs- ReportTesting WalmartLabs- ReportSolution, Scalability, Visibility-howabout flakiness?How a

14、bout theflakinessMobileautomationtests are:FragileExpensiveNomaintenance =nouseDifferent companies, different solutionsWalmartLabs:Retry: Magellanbuilt-inMockingHow about theflakinessMocking:Shifu (tobeopensourcedsoon)Tailoredspecifically for AndroidRuns onAndroiddeviceBuilt intotest apkEasy tosetup

15、anduseRecording/refreshDemo - WalmartLabs test automationinactionDemo - WalmartLabs mock inactionTesting WalmartLabs- RecapSolution:Kunlun(Node.js customizedbinding)iOS:Android:Scalability:Visibility:Stability:Robotium (Java) Magellan +cloud Admiral report Shifu mockingTesting WalmartLabs- TakeawaysMocking MockingMockingIf your mobiletest makes anetwork call, it willfail, sooner or laterTesting WalmartLabs- TakeawaysUs