application mobile testing應用程序移動測試

PerfectoMobileOverview.Nov2013.ActualSituation.2Copyright?2013Accenture.Allrightsreserved.BigMarket3300,000Tablets/day800,000PC’s/day4,500,000phones/dayEnterpriseMobileApplications:Challenges4Copyright?2013Accenture.Allrightsreserved.OtherStrongProjectManagementskillsTeststrategyservices(includingtestautomationstrategy)Testexecutionservices(inanindustrializedway)ExpertiseacrossmultiplemobileplatformsandtechnologylayersSuccessfulreferenceaccountsDeepsystemintegrationskillsetsProtocoltestingexpertiseInternationalization/localizationcapabilitiesApplicationmiddlewaretesting(e.g.whitebox,blackboxtestingskills)StrongthirdpartyecosystemofpartnersMobilenetworktechnologyexpertisee.g.GSM,3G,HSPA,LTEBenchmarkingtomeasureapplication/deviceperformanceacrossgeos40.0%0.1%10.3%15.1%15.4%20.0%21.4%23.1%23.4%28.3%32.6%32.9%37.4%Capabilitiesexpectedfrom3rdpartyproviders2OtherInvestinginandmaintainingvariedmobileinfrastructuresExpertise/developingskillsetsacrossmultiplemobileOSplatformsRapidpaceofchangeinmobileOS/hardwarelandscapeManagingtorobustsecurityarchitectureandprotectionofenduserapplicationdataDesigningtodifferentformfactors(e.gsmartphoneversustablet)Abilitytooptimizeusageofdifferentplatformresources(CPU,memory,battery)ComplexityoftestscenariostodesignandexecuteReusabilityoftestartifactstoaddressrapidchangeinapplicationfunctionalitiesTestdata&testbedpreparationstoresemblelivescenariosunderhighvolumeChallengesinLaunchingMobileApplications1Sources:IDCFeb2013-EnterpriseMobileTestingServicesIntegratedSolution.5Copyright?2013Accenture.Allrightsreserved.SoftwareasaServiceCloudBasePlatform.PerfectoMobile.ProductIntegratedintoOne.Nosoftwareinstallation.BusinessModel.7PrivateCloud:DedicatedsetupatClientoratAccenturedatacentresecuredfortheclient.Copyright?2013Accenture.Allrightsreserved.PublicCloud:Devicesopentoallmadeavailablefortheprojectonneedbasis.HosteddedicatedCloud:DevicessecureforclientintheexistingAccentureorpartnerhostedcentre(s).MobileApplicationTestssuite.8

FunctionalTestingMobileApplicationTestingA.OSPlatform&HardwarePerspectiveCompatibilityInteroperability

B.DataPerspectiveSecurity

D.CommunicationPerspectiveDataexchangePerformanceNetworkconditionsC.EndUserPerspectiveFunctionalPerformanceLocalizationAutomationUserExperienceTestLifecycleScopeCopyright?2013Accenture.Allrightsreserved.Interactive9KeyCapabilities:ManualFunctionalTesting.Performinterruptiontesting,includingingcalls,textmessages,lowbattery.Capturedevicevitals(CPUutilization,memorystatus,batteryconsumption).Pre-definedtestingfunctions(e.g.,powercycle,cleanup,sendtext,openbrowser).Single-clickinstallation.Automation10KeyCapabilities:Supportsallmobileobjecttypes:image-based,text-based,DOM,andhybrid.Providesavisualdisplayandrecordtouchgesturesperformedonthedevicesuchasdrag,swipe,zoom,scrolls.Scriptingenvironmentprovidesfullsupportforloops,conditions,debuggingcapabilities,imageandtextcheckpointsHPUFTIntegration.Singlescriptexecutablewithinmanydevices.Performance11KeyCapabilities:Measureandoptimizeend-userexperiencetoachievebusinesssuccesscriteria.Sharedetailedrichmediareportsforefficientdebuggingandanalysisofthetestingcycle.Capturescomprehensiveinsightsinrichmediareportscontainingscreenshotsandvideo.HPVuGenIntegration.ShunraIntegration.TrafficEmulation.Setandmeasuremobileapplicationperformanceagainstmobile-specificbenchmarks.Monitoring 12KeyCapabilities:Continuouslymeasurecriticaltransactionsanddiscoverinsightsfromvariousmobiledevicesandplatformsreflectingtherealuserexperience.Measurekeybusinesstransactionsonrealdeviceslocatedinvariouslocations,connectedtodifferentnetworksasexperiencedbyyourusers.Easilyextendyouralready-developedmonitoringscriptstonewlydeployeddevicesandmobileoperatingsystems.RemoteMobileTestArchitecture.13InternetGlobalDeliveryCentersRemoteTestLabCopyright?2013Accenture.Allrightsreserved.MobileApplicationTestsLabTestTeamsTestManagementPerfectoMobileCentralNodeServerPerfectoMobileWebInterfacePerfectoMobileDDMsDeviceswithOperatorSIMsonnetworkGlobalDeliveryCentresEnterpriseClientLocationQualityCenterQTPEnterpriseServerNetworkVirtualizationNetworkTestingWiFi2.5G4G3GWiMaxCentralizedtestlabUnifiedQualityDashboardTargetTestEnvironmentPeriodicDeviceRefreshRemoteAppInstallNodeviceJailbreakLoadRunner14Copyright?2013Accenture.Allrightsreserved.LocationBasedTestingPerformanceTestingNetworkConditionTestingServices.

HowdoesitWorks?15Copyright?2013Accenture.Allrightsreserved.Automation/EndUserPerspective.16Smartphoneusersarenoexceptiontothe“fasterisbetter”rule,andtheyexpecttheirappstobequickSinceanapplicationmayneedtosupportalargerangeofscreensizes,itisimportanttovalidatethattheUIscaleswell.ValidatingmultiplelanguagesupportprovidedbytheapplicationsisanotherchallengeChallengesMobileAppMobileWebAppStores(Carrier,Platform,OEMandthird-partystores)LaunchAccentureRemote&AutomatedTesting(ROSAFramework)MobileAppsAccentureROSA&MATEframeworkensurebusinesslogicvalidation,applicationperformance,usability,localizationandthusoverallenduserimprovementsHPUnifiedFunctionalTesterRemoteTestDevicesPerformanceTestControllerApplicationServerResponseTimeAppnavigationLocalization..MobilecloudAdd-inDevice-OS-PlatformBuiltforSolutionCopyright?2013Accenture.Allrightsreserved.AndroidiPhoneWindowsPhoneBlackberryAppleAppStoreGooglePlayStoreBlackberryAppWorldWindowsPhoneStoreAutomationDisplay1718AutomationDisplay19Copyright?2013Accenture.Allrightsreserved.End-UserPerspectivePerformanceTestArea

KPIsTransitionTimeDatainsecondsApplicationLaunchTimeDatainsecondsLoadTimeDatainsecondsPagecomponentanalysisDatainsecondsResponsetimeDatainsecondsDevicePerspectivePowerManagementBatteryusageCPUPerformanceCPUkernel,CPUtotalandCPUuserMemoryMemorycached,freeandusedNetworkPerspectiveConnectivityStrength–LTE,3G,2GAppfeatureinlow,mediumandhighpowerconditionHandovers–LTEto3G,3Gto2GandviceversaAppfeaturetestingforeachhandoverscenariosingCallwhileusingAppAppfeaturetestingServerPerspectiveApplication

ServerLoadTransactionResponseTime(Min/Max/Avg)Throughput,HitspersecondBandwidth,LatencyKeyPerformanceIndicators(KPIs)PerformancePerspectiveDiagnosticsServerPerspectiveTransactionResponseTimeThroughputBandwidthLatencyNetworkPerspective

GSMWCDMAGPRS3Gto2GHandover&viceversaFeatureInteractionDevicePerspectiveCPUMemoryBatteryDatathroughputEnd-UserPerspectiveInstallLaunchNavigationUninstallPerformanceMeasurements(Gaugeperformanceforeachcomponents)PerformanceDisplay2021PerformanceDisplay–VirtualNetworkEmulation22PerformanceDisplay–HPControllerinteraction23PerformanceDisplay–LoadRunnerInteraction24PerformanceDisplay–TestResult25PerformanceDisplay–ShunraReportsCommunicationPerspective26SmoothfunctioningoftheapplicationindifferentnetworksituationsTheapplicationshouldbetestedunderdifferentnetworkconditionsinordertoensurethattheapplicationdoesnotcrashorhangbecauseofthevaryingsignalconditionsDataupdatesandcommunicationtotheserverforfetchingdata,etc.shouldbesmoothlycarriedoutunderthesechangingcircumstancesChallengesROSAenablesend-to-endapplicationtestingindifferentwirelessnetworksusingNetworkSimulationsolutions,recreatesfieldconditionstoanalyzeandvalidatefieldissuesAccentureNetworkSimulatorLabNetworkSimulationTestScriptsHandsetsfromacrosstheglobeRFinterfaceMobileApplicationsInternetSolutionReusabletestassetsfortestingvariousnetworkconditionsaspartofthesolutionandtheflexibilitytovalidateonactualdevicesoremulatorsApplicationServerCopyright?2013Accenture.Allrightsreserved.FunctionalDemo:27Credentials.28Copyright?2013Accenture.Allrightsreserved.TeamedwithNTTDOCOMOtoestablishandoperatearemotetestcenterattheUniversityofAizuinFukushimaThecenterallowstotestmultipledevicesacrossmultiplesmartphoneOSversionssimultaneouslyonacloudbasedsystemSetupanddeployedremotetestingservicesDeliveredsignificantcostsavingsandprovidingeasilyaccessibletestingenvironmentsforcontentprovidersContributedtodevelopmentofhigh-qualitycontentsandapplicationsforNTTDOCOMOhandsets,differentiatingfromothercarriersApplicationTestLab

EnablingCostEffectiveHighQualityContentsDevelopmentThroughRemoteTesting29AccentureRoleNTTDOCOMOisa#1Japanesemobileoperatorservingover59millioncustomersAnewsmartphoneecosystemwasneededtoenable3rdpartyindependentsoftwarevendorstodevelophigh-qualitycontentsandapplicationsquicklyandcosteffectivelyBusinessChallengesHighPerformanceDelivered“Theremotetestcenterwillallowcontentproviderstodevelopqualitydeliverablesfortheirend-users.We’reproudtoundertakethisimportantendeavorside-by-sidewithAccenture.”

–YoshikazuKumagai,ManagingDirectorofContent

PromotionOffice,SmartCommunicationServices

Department,NTTDOCOMOCopyright?2013Accenture.Allrightsreserved.AccenturemendedatestingfactorymodeltoperformUserrequirementsanalysis.Systemtestdesign.Testing.Automation.Accentureutilizeditscomprehensivetestingframework,calledROSA--remoteaccess,offshoretesting,testingonsimulatednetworksandautomation.Thisapproachincludespre-conformancetesting,usabilitytesting,functionaltesting,performancetestingandstabilitytestingfordevicesandnetworkcomponentsthatuseanytypeofaccesstechnologyoroperatingsystem.AccenturehelpslargeNorthAmericanbankdevelopamobileapplicationtestingfactorytodrivehighperformanceCopyright?2013AccentureAllrightsreserved.30HowAccentureHelpedThisNorthAmericanbankisoneoftheworld'slargestfinancialinstitutions,withmorethan200,000employeesandrevenueexceedingUS$100billionin2011.Itservesconsumersinmorethan35countrieswithbanking,investing,assetmanagementandotherfinancialandriskmanagementofferingsInanefforttoincreaseitscustomerbaseandadapttoevolvingcustomerexpectations,thebankbeganmakingitswidely-usedonlineservicesavailableonmobiledevices,includingiPhone?/iPad?,Windows?Mobile,AndroidTM,Blackberry?,PalmandNokiadevices.Makingapplicationsavailableontheseplatformswouldrequireextensivetesting.ThebankturnedtoAccenturetohelpStreamlinetheapplicationtestingprocessinafactorymodelacrossmultipleplatforms.Automatetestingtoreduceoveralltestingcosts.Increaseregressiontestingvolume.BusinessChallengesWithAccenture’shelp,thebankwasabletodeterminethebestsetoftoolsfornetworktestingandfunctionaltestingautomation

HighperformancedeliveredUSBasedBank:Testing&TestAutomationFactory

Morethan60%oftheregressiontestsuiteareautomatedonallplatforms31SetuptestfactorymodeltoperformactivitiesfromUserrequirementsanalysis,systemtestdesign,testingtoautomationAccentureteststrategybasedonROSAnotonlyincludedfunctionaltestingandautomation,butalsothefollowing:FeatureInteractionTesting/NetworktestingPerformanceTestingDeviceAnywhereforManualtestingandautomationJamosM-euxTestforautomation/Anritsu8470AforNetworktestingEngagementmodel:Programdelivery(Testfactorymodel)AccentureRoleClientisoneoftheTopNorthAmericanBankTheclientwantedalongtermpartnertotestitsapplicationsacrossmultiplemobileplatformsinatestfactorymodelThebusinessrequirementwastoincreasecustomerbasebyprovidingtheirwidelyusedonlinebankingservicesonpopularsmartphoneOSnamely:iPhone,iPad,Windowsmobile,Android,Blackberry,Palm,NokiadevicesBusinessChallengesMorethan60%oftheregressiontestsuiteareautomatedonallplatformsMobileapplicationtestlabwasleveragedtohaveincreasedsecuritytestscenariosforbankingrequirementsMobileApplicationtestlabprocessessavedoveralltestingcostsandincreasethevolumeofregressiontestingAccentureleveragedmobileapplicationtestinglibrariestotestthefeatureinteraction,networkscenariosandperformancestestsHighPerformanceDeliveredCopyright?2013Accenture.Allrightsreserved.HelpedSixNationsleadershipunderstandandadapttochangingfanbaseneedsConceived,designed,built,testedandsubsequentlydeployedtheapplicationviatheApple?AppStoreSMonlinestoreDevelopedtheofficialRBS6NationsiPhoneapplicationProvidedenhancedfanexperiencesandinteractionwiththechampionshipbefore,duringandaftereachgameNumberonesportsapplicationintheUKandIrelandwithinoneweekoflaunchAchieveda4.5starsaverageAppStoreratingDownloadedin84countries276,249downloadswithinfirstmonthAllowedfanstoexperiencethethrillofthegamewherevertheywerewhenthematchwasplayedApple,iPhone,andAppStoreareregisteredtrademarksofAppleInc.

CustomMobileApplicationDevelopment&Testing32AccentureRoleRBS6NationsRugbyChampionshipisapremiercompetitionfeaturing15individualmatchesovertwomonthsinvolvingsixEuropeansides:England,France,Ireland,Italy,ScotlandandWales.ThecompetitionissponsoredbytheRoyalBankofScotlandandadministeredbySixNationsRugbyLimited.TheSixNationsRugbyleadershipwantedtoprovideitsfanbasewithaniPhone?applicationthatallowedfasteraccesstoeachgamewithliveplay-by-playcommentary,news,statistics,videohighlightsandup-to-the-minutescoresAccentureistheOfficialTechnologyPartnerforthe2013and2013RBS6NationsRugbyChampionship,providingtechnologyexperiencethatdeliversanenhancedviewingexperienceforrugbyfanseverywhereBusinessChallengesHighPerformanceDeliveredCopyright?2013Accenture.Allrightsreserved.CreatedmobileapplicationuserinterfacestandardsandguidelinestodrivenewbrowserapplicationdesignDevelopedbrowser-basedmobilehandheldapplicationstoperforminventorymanagement,signageauditandprinting,andshippingandreceivingPerformancetestedhandheldapplicationsSelected,testedanddeployedthirdpartyhandheldbrowserapplicationSupporteddeploymentandprovidedchangemanagementinstoresUpgradedmobiledevicesandplatformtocreateaflexiblearchitecturefordeploymentofnewapplicationsLeveragedexistinginvestmentsbycreatingmobileuseinterfacethatexposesbusinesslogicfrombrowser-baseddesktopapplicationsCreateduserinterfaceguidelinesforfuturemobileapplicationsdeploymentsEnabledmultipleteamstoworkconcurrentlywithoutimpact,allowingbusinessvaluetoberealizedfaster

MobileApplicationDevelopment&TestingforRetailClient33AccentureRoleThislargeglobalretailerusedalegacyhandheldsolutiontomanageinventory,signage,andshippingandreceivingwithinitsstores.Eachfunctionwasdevelopedindependentlybasedonrequestorneeds.Legacyapplicationsresidedlocallyonstoreservers,soimplementingchangesrequireddeploymentstoeachstore,oftentaking8-10weekstocomplete.Thelegacyapplicationarchitecturereliedonasmallteamwithspecializedskillswhichpreventedtheretailerfromworkingonmultipleprojectsatthesametime.Thislimitedtheretailer’sabilitytomeetrapidlygrowingbusinessneedsBusinessChallengesHighPerformanceDeliveredCopyright?2013Accenture.Allrightsreserved.DevelopedanddeployedaserviceframeworkthatcouldbeutilizedonamobileplatformSetuptherequiredinfrastructureEstablishedaflexibleend-usersupportmodelHostedapplicationsontheAccenturemanagedinfrastructureManagedallapplicationmaintenanceandsupportservicesMaintainedallhostingsupportservicesasacompletepackageProvidedaflexibleend-usersupportmodelthatallowedforscalabilitybasedonusageFacilitatedthecompany’slong-termvisionofprovidingaccesstoapplicationsoutsidethefirm’snetworkDevelopedadashboardthatprovidedservicerepresentativeswithasnapshotofcurrentcallstatisticsversusmonthlytargetsProvideddistrictmanagersawaytoviewteammemberperformanceAllowedforfutureapplicationdevelopmentduetoaflexibleplatformMobileApplicationDevelopment&TestingforGlobalPharmaCompany34AccentureRoleThislargeglobalpharmaceuticalcompanywantedtoprovideitsservicerepresentativeswithtimelyaccesstocurrentsalesdataCompensationisbasedprima