2021-22年世界質(zhì)量報(bào)告（英）-72正式版

WORLDQUALIT

YREPORT2021-22thiRtEEnthEDitioninassociationwith:WORLDQUALIT

YREPORT2021-22RegionalandcountryreportsareavailableonlinefromorfromCapgemini,Sogeti,andMicroFocuslocalo?cescovering:NorthAmerica,UnitedKingdom,France,Germany,Benelux,SouthernEurope(coveringItaly,Spain,andPortugal)EasternEurope(coveringPoland,Romania,Hungary,andtheCzechRepublic)China,AustraliaandNewZealand,Japan,andtheNordicregion.2WorldQualityReportI2021-22CONTENTSINTRODUCTION040616EXECUTIVESUMMARYCURRENTTRENDSINQUALITYASSURANCE&TESTINGQAorchestrationinagileandDevOpsTestautomation1822263034ArtificialintelligenceandmachinelearningTestenvironmentmanagementandtestdatamanagementIntelligentindustrySECTORANALYSIS38Automotive4043464952555861Consumerproducts,retail,anddistributionEnergy,utilities,andchemicalsFinancialservicesHealthcareandlifesciencesHigh-techGovernmentandpublicsectorTelecom,media,andentertainmentABOUTTHESTUDY6468ABOUTTHESPONSORS3INTRODUCTIONWelcometothe13theditionoftheWorldQualityReport.It’sagreathonorforushereatCapgeminiandSogetitopublishthelatestannualassessmentofqualityengineering.Infact,theWorldQualityReportisnotjustanassessment.Inadditiontotheanalysisofcurrenttrends,andtheexaminationofdevelopmentsbysectorandbyregion,wealsomakerecommendations.It’souraimtoshowwhat’shappeninginthe?eld,whatthebestpracticesare,andhoworganizationsmighttakeadvantageofthem.CHANGINGTIMESOverthelastyearswehaveseenseveralmajortrendsthataredrivingchangesinqualityassurance(QA)operations.Eachyear,weadaptoursurveytothesechanges.WehaveseenthatITactivitiesovercametheCOVID-19crisiswithrelativeease,andthetransitiontoworkingindistributedvirtualteamshappenedalmoste?ortlessly.Sowedecidedtoaddresstheimpactofthepandemicinamoregenericwaythisyear,andnotinadedicatedchapter.Also,thetransformationtoagile/DevOpsiscontinuing.Withthat,QAandtestinghavebecomeaninclusiveactivitywithindevelopment,andthequestionsaroundbudget-allocationfortesthavebecomemoreandmoremeaningless.So,forthe?rsttime,youwillnot?ndadedicatedchapteronbudgetandcost-containmentfortest.MARKBUENENGlobalLeaderDigitalAssuranceandQualityEngineering,CapgeminiGroupWhat’snewtothereport?We’veintroducedasectiononintelligentindustry.Organizationsareincreasinglylookingathowtodigitizethekeyindustrialpartsoftheirbusiness.Theyareusingembeddedsoftware,data,5G,edgecomputing,andarti?cialintelligence(AI),andalthoughthisisstillanevolvingarea,qualityengineeringissuretohaveamajorroletoplay.ANINCREASINGLYIMPORTANTROLEMoreimportantly,weareseeingincreasedattentionbeinggiventoqualityassuranceasawhole.Inthepost-pandemicworld,asagilemindsetsrapidlybecomethenorm,asITismodernized,andasenvironmentsmovetothecloud,peoplearegrowingmoreawareoftheimportanceofqualityandqualityvalidation.Asaresult,wearewitnessingashifttowardsamoreorchestratedapproachtoquality,notjustacrossdi?erentindustries,butacrosstheboard.Qualityassurance,orratherqualityengineering,isadisciplinethatismaturing,andasyou’llreadinourexecutivesummary,theexcitementwehaveseeninrecentyearsaboutthebene?tpotentialofemergingQAapproachesisgivingwaytogreatercon?denceaboutimplementation,andtoanewandwelcomesenseofrealism.ATEAMEFFORTThisreportwouldn’tbepossiblewithoutthesigni?cantcontributionsofmanypeople.Inparticular,Wemustthanktheseniorindustry?gureswhoseinsightshavebeenusedtoillustrateourbroaderthemes.Ithankthe1,750peopleworldwidewhoaddressedthisyear’ssurveyquestions,andwhoseresponseshavehelpedusgaugeprevailingmoodsandtrends.IthankourpartnersatMicroFocus,andourownexpertsatCapgeminiandSogeti,whotogetherhaveexaminedthesurvey?ndingsandhelpedustointerpretthem.Wethankthereport’sproductionteam:muchworktakesplacebehindthescenestoensurethisannualexercisebearsfruit.SATHISHNATARAJANGroupVicePresident,HeadofDigitalAssuranceandQualityEngineering,CapgeminiNorthAmericaFinally,Wethankyou,ourreaders.It’syourownexperienceandinterestthatgivetheWorldQualityReportitsreasonforbeing.Asever,Wehopethisyear’seditionmakesarewardingcontributiontoyourcontinuinge?ortsinqualityassurance.4WorldQualityReportI2021-22ThispastyearintroducednewchallengestoQAandITstrategythata?ectednearlyeveryareaofbusiness.TheCOVID-19pandemicsawtheconvergenceofdigitaltransformationwiththeadoptionofDevOpsandAgilepracticesinreal-time.Achievingdigitaltransformationgoalsrequiredtheaccelerationofhybridworkandtheproliferationofapplicationdeploymentacrossenvironments.Geographicallydistributedteamsadoptedabusiness-orientedfocuswhileprovidinginternalandexternalstakeholdersbusiness-critical,real-timedataonanydevice,anytime,anywhere.Supportingtheseimperativesalsorequiredtestingapplicationsfasterandearlierinthesoftwaredevelopmentlifecycle(SDLC).Asourpriorreportshavenoted,thisyearsawQA’scontinuedadoptionofAgileandDevOpspractices.Drivingthistrendarearti?cialintelligence(AI)innovationsandagrowingcultureofresponsibilityforqualityacrossallteams.QAisbecomingthekeyenabler—eventhechampion—ofquality,notjustthecustodian.Byprovidingtherighttoolsandprocesses,QAcanfacilitatequalityacrossteamsandtheSDLC.Someorganizationsareevenstartingtoseedividendsfromthesepractices.Bene?tsincludeproductivityimprovements,highersoftwarequality,andreducedqualitycosts.However,gainingsuccessrequirespromotingaqualitymindset,securingexecutivesupport,andfosteringacultureofagilityandadaptability.ROHITDESOUZASeniorVicePresident,GeneralManager-ITOMProductGroup&ADMProductGroup,LeaderoftheCTOO?ceandProductSecurity,Duringtheyear,customerexperienceroseinpriority.Supportingpandemic-impactedrequirementsforcedorganizationstoquicklysupplynewapplicationsacrossnewdeploymentmethods.Achievingqualityatspeedwasanothertoppriority,whichgoeshandinhandwithmeetingbusinessoutcomes.Asbusinessprioritiesrapidlyevolved,QAandITteamsrequiredaquickande?ectiveresponsetotheseneeds.MicroFocusLookingtowardsapost-COVID-19environment,organizationssharedtheirfuturepriorities.ThedesireforremoteaccesstotestsystemsandenvironmentsillustratesthegrowingimportanceofSaaSandthecloud.Increasingly,organizationsplantousemoreAIintestexecutionactivities,andalmosthalfarewillingtoactontheintelligenceoftheirAIandmachinelearning(ML)platforms.Nolongerafutureinitiative,leveragingAIandMLtoolsandprocessesisgainingsteamwithproventransformativebene?ts.AsQAtrendsevolve,MicroFocushelpscustomersadvancetheirmodernizationinitiatives.OurAI-poweredcontinuoustestingandqualitymanagementtoolsaugmentAgileandDevOpspractices.Customerscanspeedupsoftwareproductionanddelivery,allwhileenhancingsoftwarequalityandsecurity.Withourtoolsandtherighttechniques,AgilelifecyclesandDevOpspipelinescancontributetosoftwarequality.Organizationscanimprovequality,velocity,productivity,andtheoverallcustomerexperience,acrossarangeofwebandmobiledevicesandenvironments.One?nalnote,I’dliketoexpressmyappreciationandthankstoourfriendsandpartnersatCapgeminiandSogeti,aswellastoeveryonewhoworkeddiligentlytocreatethisyear’sWorldQualityReport.5EXECUTIVESUMMARYWorldQualityReport2021-22ANDREWFULLENHeadofInnovationandTechnology,Sogeti,UnitedKingdomKIRTHYCHENNAIANVicePresident,Capgemini,NorthAmericaSHIVAKUMARBALASUBRAMANIYANVicePresident,FinancialServices,DigitalAssuranceandQualityEngineering,NorthAmericaANEWREALISMLastyear’sWorldQualityReportre?ectedtheseismicshiftsbroughtbythepandemic,asorganizationsadaptedtooperatingcompletelyremotelywhilestillachievinge?ectivebusinessoutcomes.Someofthechallengesfacingorganizationswerenew.Otherswerefamiliar,buttheywerehappeningatanunprecedentedpaceandscale.Itwasthereforegoodtobeabletosaythattherewereclearsignsofenergy,enthusiasm,anddeterminationintheresponseofthequalityassurance(QA)communitytothecrisis.Astheworldemergesfromwhatwemusthopeistheworstofthepandemic,wesenseachangeofmood.It’snotthattheoptimismandthedrivehavediminished–becausetheyhaven’t.It’sratherthattheyhavematuredwithexperience.Wemightcallitanewsenseofrealism.Lastyear,weaskedifwecandoit.Thisyear,weknowwecan.It’samostencouragingthing6WorldQualityReportI2021-22Executivesummarytosee.Infact,wemightsaythatwhatwe’rewitnessinghereisthecomebackofqualityassurance.MostCIOsnowvaluetestingmorethaneverbefore,andtheonwardmarchtowardsdigitizationisensuringthatcustomerexperienceandqualityareofutmostimportanceThereisasimilarlysmallpointspreadinpeople’sassessmentsoftheimportanceoftheirtestingandQAobjectives,inparticular(seeFig01).Custodiansofquality,qualityatspeed,qualityenablementacrosstheteam,businessfocus,customerexperience,andmore–allthesegoalsareregardedinprettymuchthesameway.Theoverallsensethatemergesisapositiveone:thatQAteamsarefocusingonvalue,andonavoidingthepossibilityofdefectsinthe?rstplace.Weseethisevidencedinmuchofthisyear’ssurveydata.Someofthehighscoreswe’veseeninpreviousyears,especiallyinrelationtoemergingtechnologiesandapproaches,have?attenedouttowhatseemtoustobemoreachievableorrepresentativelevels.Ifanything,andbecauseofthis,we’dsuggestthatQAteamsaremorethanthecustodiansofquality,andareitsenablersandchampions.Enablingorfacilitatingqualityisdynamic;custodianshipispassive.WhatrespondentsdeemedtobethemostimportantfactorsintheirITstrategyhavealldroppedbyseveralpercentagepointsinthelasttwoorthreeyears;butbetweenthetopfourresponses,therewasonlyatwo-pointspread.Thesewere:enhancingcustomerexperience(ratedhighlyby63%ofrespondents);enhancingsecurity(62%);ahigherresponsivenesstobusinessdemands(61%);andhigherqualityofsoftwaresolutions(also61%).Itmakessensethatcriteriasuchasthesearesoevenlyweighted.Fig01ObjectivesofQualityAssuranceandTestingintheorganizationTop2boxsummary:7Essential+62021202020192018CustodianofQuality:Detectsoftwaredefectsbeforego-live62%72%72%70%QualityatSpeed:Speedupsoftwarereleaseswithgoodquality62%63%QualityEnablement:Supporteverybodyintheteamtoachievehigherquality62%60%BusinessAssurance:Contributetobusinessgrowthandbusinessoutcomes61%61%74%74%68%DigitalHappiness:Ensureend-usersatisfactionandcustomerexperience70%68%69%Automate:MakeQAandTestingasmarterautomatedprocess61%62%BrandAmbassador:Protectthecorporateimageandbranding58%64%65%64%7Organizationshadmixedfeelingsthisyearabouttheirabilitytoachievetheirtargetsforapplicationsdevelopment(seeFig02).Nearlytwo-thirdsofrespondents(61%)felttheirtestingcoverseverythingthat’sneeded,andalmosthalf(49%)saidthatend-to-endautomationwasalwaysoralmostalwaysinplace–butahigherproportionthanlastyearfelttheirrequirementsareclearlyde?ned,and,asyoucanseefromthegraphic,therewasasubstantialincreaseinnumberswhofeltthattestingisoptimizedintermsofspeedandcost.Thesehigher?guressuggesttousthatpeopleareseekingnewwaysofworking.They’relookingforgreaterandmoree?ective?exibility,andmoreoptimizationonthe?y.Lookingacrosstheresponsesasawhole,thereisaclearsensethattestingisnolongerseenasabottleneck.Fig02HowoftendoyourQAteamsachievethefollowingtargetswhentestingkeyapplications?Top2boxsummary:7AlwaysAchieve+62021202066%61%61%60%59%59%56%53%50%50%49%37%Ourtestingiscomplete(wecoverallthatisneeded)ActivitiesacrossdistributedteamsarewellorchestratedandintegratedToolsandmethodsrequiredfortestactivitiesareRequirementsareclearlyde?nedOurtestingisoptimizedintermsofEndtoendautomationfrombuildtodeploymentisinplacesu?cientandavailablespeedandcostThereweremixedfeelings,too,abouttheabilityofteamstoachievetheirtestingtargetsforkeyapplications.Theyweremuchlesscon?dentthisyearthattheyachievetheirqualitygoals(59%),andtheywerelesscon?dent,too,thattheyhavetherightQAandtestexpertise(61%).However,substantiallymoreofthemfelttheyhadtherighttestingstrategy,process,ormethodology:the?gureof59%whosaidthiswasthesecond-highestresponse,anditwassigni?cantlyupfromthe45%whosaidthesamelastyear.Forthe?rsttimethisyear,weaskedpeopletolookahead,andtelluswheretheythoughttheywouldbefocusingtheirqualitye?ortsintwoyears’time,comparedtonow.Therewasanupwardtrendinbothacceptancetestingandlivein-productiontesting,collectivelyindicatinganappreciationofthebene?tsofshiftright.It’sapushforpromptdeliverythatmakesthisshifthappen,andaswecanseeintheFig01,qualityatspeedisconsistentwithothertestingandQAobjectivesintermsofitsperceivedimportance.Perhapshere,too,weareseeingsignsofthenewrealism.Lastyear,responsestothisquestionwereinaverynarrowpointsspread,possiblyindicatingtheyweremorefocusedontheirimmediatepandemicproblems.Thisyear,perhaps,theyaretakingstockmorejudiciously,andthinkingagainaboutthefuture,andnotthehereandnow.Testinge?ciencyisalwaystopofpeoples’minds,andweaskedrespondentstoratethefactorsthatarecriticalforitsachievement(seeFig03).What’sbothinterestingandstrikingisthatthemostimportantfactorwasdeemedtobehavingenoughsta?withtherightskills.Inourview,itcontributessigni?cantlytothesuccessofalltheotheroptionslisted.Wemighthaveexpectedtestautomationtohaveattractedhigherratings,butthetalentelementisrightlythekey.8WorldQualityReportI2021-22ExecutivesummaryFig03Importanceofthefollowingaspectstowardsmakingtestingmoree?cientTop2boxsummary:7Essential+62021total65%59%56%55%53%53%48%46%Havingadequatesta?withBettercommuni-cationsandcollaborationacrossthelifecycleEnhancetestdatageneration&provisioningsolutionsShifttestleft(testearlierinShifttestright(testlessduringdevelopment&focusmoreonqualityImprovetestdesignEnhancetestenvironmentprovisioningsolutionsIncreasetheleveloftestautomationtherightskillstheprocess)forteamsforteamsmonitoring)Toroundo?thetop-linesectionofthisyear’ssurvey,weaskedorganizationstotakestock,andtorankthefactorstheyfeltwouldneedmostfocusinthepost-COVIDenvironment.Aswemightexpectinaworldthathasgrownaccustomedtoworkingfromhome,thehighest-ratedoptionwasremoteaccesstotestsystemsandtestenvironments,andrelatedfactorssuchasimprovedproductivitymonitoringforremoteteamsandbettercollaborationtoolsalsofeaturedprominently.Thesecurityvalidationofapplicationsanddisasterrecoveryandresiliencetestingeachreceivedlessattention,butwesuspectthiswasbecauseorganizationsfeeltheseareasareprettywelladdressedalready.Theyareelementsthatarebuiltintothesystem–andit’sasystemthathasbeenthroughthe?re,andisonlynowbeginningtoemergefromit.We’llseehowwellthetestingandQAcommunityfeelsit’sdoinginmorespeci?crespectsintherestofthisexecutivesummary,andinthemainreportthatfollowsit.9KEYFINDINGSWorldQualityReport2021-22QAorchestrationinagileandDevOpsIntelligenttestautomationTheadoptionofagileandDevOpsinQAandtestingisacontinuingtrend,andnowthattheworldisbeginningtoemergefromlockdown,weseeagreatersenseofurgencytomakeprogress,aswellasagreaterappetiteforinnovation.Thatsaid,though,organizationsareatdi?erentstagesofevolution,andsomeofthemarenotasfaraheadevenastheirownmanagersthinktheyare.Organizationsareaskeenaseverontestautomation.Theywanttoautomatefaster,withgreaterquality,andwithmoreagility–allofwhichmeanstheapproachneedstobesmarter.This,inturn,meansthatthetoolsneedtoincorporatemoreintelligence,andalsothatmoreteammembersthaneverneedautomationskills,oftenrequiringanincreaseinrecruitmenttocopewiththeneed.Thegreatestchallengeremainsalackofprofessionaltestexpertiseinagileteams,whichispartlytheresultoftheblurringofboundariesacrosssoftwaredevelopmentandtestteams:wheneveryonesharesresponsibilitiesforquality,everyone’sskillsinthatareaneedtolevelup,andcollaborationbetweenteamsneedstoimprove.Asinpreviousyears,thisyearweseearoundtwo-thirdsofrespondentsidentifyingoneofthekeybene?tsoftestautomationasbeingthebettercontrolandtransparencyoftheirtestactivities.Itseemspeoplefeelitimprovestheprocessoftestingratherthanitsoutcomes.Elsewhere,wenotedalackofcon?denceinsomeareasthattherightautomationstrategywasinplace.Ingeneral,areagileandDevOpspayingdividends?Theshortanswerisyes:aroundtwo-thirdsofrespondentssaidtheyhadachievedexcellentorverygoodimprovementsinproductivity,qualityofsoftware,andcostofquality.Speedtomarketwasratedhighlybyfewerpeople.Aswenoteinthemainsectionforthistopic,wemaybeseeinghereanewtesttriangleofproductivity,quality,andcost,inwhichproductivityhasreplacedtimeinonecorner.Despitethesechallenges,respondentsdemonstratedacommitmenttouseautomationtechniquesinanumberofdi?erentwaysinthecomingyear.Indeed,?guresforplannedusewereupsigni?cantlycomparedtolastyear.Organizationsfeelthat,whilebene?tsintermsofoutcomesmaynotyethavebeenfullyrealized,theyarewithinreach,andthatthisisanareainwhichitisworthbuildingasolid,strategic,skills-basedfoundation.ThemoststrikingshiftwenotedintheagileandDevOpsareawasasubstantialdropfromlastyearintheperceivedimportanceofthetechnologystackofunderlyingapplications.Bycontrast,thebigriserswerecommercialpriorities,theskillset,andthecultureoftheorganization.Whatwe’reseeinghereistheconsolidationofthestatusofthebusinessmindsetandthegrowthofanindustry-widematurityintechnicalo?erings.10WorldQualityReportI2021-22ExecutivesummaryArti?cialintelligenceandmachinelearningWe’vealsoseenthewelcomegrowthintheabilityoforganizationstospinuptestdataandtestenvironmentsondemand.We’veseenincreasesindatamaskingandrationalizationinitiatives;we’veseengrowthinsecurityinitiatives,probablybecauseofthenumbersofpeopleworkingremotely;andwe’vealsoseentestenvironments?extore?ectthenewnormal:forexample,peoplewanttolookatdataindi?erentwaysnow.Arti?cialintelligenceintestinghasmovedfromsomethinginthefuturetosomethingwe’rewitnessingcurrentlyinpractice.It’sgraduallybeinginfusedintotheQAprocess.Forinstance,it’schangingthewaytestautomationroutinesarebuilt,andhencehowtestingasawholeisconducted.Ingeneral,peoplearehappywiththeprogressthey’remaking,bothwithtestenvironments,andwithtestdata.There’snorealcauseforexcitementhere,butthereareplentyofgoodreasonstobeoptimistic.It’snotthattheuseofAIinqualityengineeringhasfullymaturedjustyet.There’sstillalongjourneyahead.Butwhathaschangedisattitude:thereseemstobeagreaterdesiretoputplansintoaction.Organizationsseemkeenertostarttheirjourney,eventhoughchangeandmaturitymaystillberequiredintermsofprocess,tooling,andgeneraldataintegrity.Indeed,almosthalfofthisyear’srespondentssaidthattheirorganizationswerewillingtoactontheintelligencetheirAIandMLplatformsprovide.IntelligentIndustryIntelligentIndustryisthetermCapgeminiusesfordigitaltransformationthatislargelyinthephysicalworld.Itexploreshoworganizationsuseembeddedsoftware,data,5G,edgecomputing,arti?cialintelligence(AI),automation,andtheInternetofThings(IoT)torethinkwhattheydo,andhowtheydoit.Wenotedasigni?cantincreaseamongthosedeclaringaneedforteststrategyandtestdesignskills.WefeelthiscouldbeasignthatorganizationsarebeginningtounderstandtheintricacyofAI,andthechallengesintakingadvantageofit–aswellasthedi?cultiesoftestingAIitself.Peoplearestillfeelingtheirwayinthisarea,whichiswhy,wethink,theygaveroughlyequalweightingtoawiderangeoffactorstheyregardedasdriversfordigitaltransformation.Thegreatestemphasiswasplacedonthebene?tsforwhichdigitaltransformationiswellknown,includinge?ciency,quality,?exibility,andimprovedcustomerexperience.Toachievethesebene?ts,they’repreparedtoinvestinteamskills(ratedhighlyby55%ofrespondents)andintesttools(53%).Thecriticalsuccessfactorswereunsurprisinglydeemedtobeleadershipsupportandfunding(61%),anddevelopmentofproofsofconcept/pilots(also61%).Aswenoteinthemainchapteronthistopic,thesearetheprioritiesoforganizationstakingtheir?rststepsonapath:it’sallaboutgettingbuy-inanddemonstratingfeasibility.Finally,thisyearweseemorerespondentssayingtheyplantouseAIintestinginmoreways.Thebreadthoftheseplans,combinedwithpeople’scon?dence,mayindicatethematurityofavailablesolutions,andagrowingcon?denceintheiruse.Testenvironmentmanagement(TEM)andtestdatamanagement(TDM)Wecontinuetoseeslowbutsteadyprogressinthedevelopmentoftestenvironmentmanagement(TEM)andtestdatamanagement(TDM)thisyear.Therehasbeenagradualshiftofenvironmentsintothecloud,andthishasintroducednewchallenges,suchasensuringthatcloud-basedappsremaininsyncwithlegacyapps,andrealizingthatmovingintothecloudcanexposelegacydecisionstofreshscrutiny.Asmanyas42%ofsurveyrespondentsfelttheywouldbeupgradingtheirexistingtestlabswithcapabilitiesin5G,IoT,AI,andautonomoussystems.Itseemstheyarecon?denttheycanaccommodatethesenewtechnologies,butwe’renotsurehowmanyofthemappreciatethelevelofinvestmenttheymayneedtomake.Thisisthe?rstyearinwhichtheWorldQualityReporthasdevotedasectiontotheIntelligentIndustry,andsotheonlyframeofreferencewehaveforpeople’sresponseshasbeenourownexperienceinthe?eld.Nextyear,though,wewillhavethiscurrentanalysisasabenchmarkagainstwhichtoassess2022responsesandtoidentifytrends.Whyhasthisshiftbeensogradual?ItcouldpartlybebecauseinthemovetowardsDevOps,thereisalotmorefocusoncontinuousdeploymentaspectsthanoncontinuousintegration,wherealotoftheenvironmentvirtualizationorinfrastructure-as-codeskillsandcapabilitiesreside.Itcouldalsopartlybebecausemovingtothecloudisabiginvestmentdecision.11KEYRECOMMENDATIONSWorldQualityReport2021-22QAorchestrationinagileandDevOpsIntelligenttestautomationInvestininsights.StandardizetheuseoftestautomationinQA…Real-timeinsightacrossthewholeQAandtestfunctionhelpsbothwithshort-termtacticalissuesandlonger-termplanningofstrategicdirection.Smartdashboardsarejustonecaseinpoint.Anautomation-?rstapproachinsoftwarequalitydeliveryshouldnowbethenorm.Embracemulti-skillingandupskilling.…anduseitfromendtoend.SoftwareDevelopmentEngineersinTest(S-DET)isbecominganewnormal,andisgainingwidespreadadoption.Thepathtothattransformationisslow,butit’ssteadilyincreasingacrossallenterprises.Expandend-to-endlifecycletestautomationacrossallQAactivities.Adoptanengineeringmindset.Anengineeringmindsetthatissharedacrossyourteamswillpaydividends,includingfasterdelivery.Focusonwhatmatters.Theemphasisshouldbeonthecustomerexperienceandonbusinessobjectives,andonmeetingneedsintheseareaswithe?ciencyandspeed.ThefocusisshiftingfromITqualitytoproductionquality.12WorldQualityReportI2021-22ExecutivesummaryArti?cialintelligenceandmachinelearningIntelligentindustryInvestinthefuture…DrivetheuseofAI.Don’tbedrivenbyit.Investininnovationlabstobuildminimumviableproducts(MVPs)andtoderivevalueswiftly.AI/MLisexpectedtodeliverexponentialimprovementsinoveralltestproductivity–butyouneedtoensureyou’reusingtheinformationitprovidesasasupportinyourowndecisionmaking.It’snotrelievingyouofthatresponsibility,norshouldit.…andinyourteamsYourQEteamswillsoonbethesourceofrapidgrowthinIntelligentIndustry.It’sworthexpendingtime,energyandbudgethere.FocusAIe?ortsonwhatmatters.InvestinAIsolutionswithusecasesthataretargetedtothemostchallengingaspectsofqualitydelivery.Increasethefocusonsecurity.GreaterremoteconnectivitycreatesaneedforgreatersecurityStoptalking,andstartdoing.andresilience.This,inturn,hasimplicationsfortestingandQA.AIandMLareexpectedtotransformqualityengineering,soit’simperativetostartthejourneynow.Getmanagementbuy-in.It’sagiventhatleadershipbackingfacilitateschange–sodemonstratefeasibilityandquantifypotentialoutcomes.ConsiderusingAIaspartofoverallQAmanagement.AIneedstobetheretosupportthemanagementanddecisionmakingaroundQA.Tactically,itcanhelptomakesenseofwhattodo,whentodoit,andsometimeswhennotto.Strategically,itcanhelporganizationstounderstandwhyfailuresarehappening,andnotjusttoidentifythem.Testenvironmentmanagement(TEM)andtestdatamanagement(TDM)Emphasizeavailability.Investmentinreal-time