ShakeCast Features and Architecture - Welcome to …：shakecast特點和結(jié)構(gòu)-歡迎…

USGSShakeCastDeliveringEarthquakeShakingData

ToThePeopleWhoNeedItPhilipA.Naecker

ChiefScientist

GatekeeperSystemspan@ShakeCastFeaturesandArchitectureProjectOriginsProjectTeamIssueswithCurrentDeliveryofShakeMapsProjectGoalsandShakeCastSystemGoalsShakeCastTerminologyShakeCastFeaturesandFunctionsPrototypeV1.0FuturesShakeCastArchitectureProtocolsandTransportDatabaseDevelopmentEnvironmentProjectOriginsSuccessofShakeMapProjectShakeMapsaredatarichRecurrentdifficultiesutilizingShakeMapsConsumershavehaddifficultywithnetworkconfiguration,firewalls,anddataprocessingEachconsumerwantsadifferentconfigurationoffeed,requiring“handholding”andcreatingamaintenancemorassMissedopportunitiesfordatautilizationSignificantriskthatinformationsystemfragilitymightimpactsuccessfulapplicationofShakeMapsinamajoreventShakeCastProjectTeamWhateventuallybecametheShakeCastTeamhasbeeninconversationabouttheseissuessince1998USGS:DaveWaldandBruceWordenPeterGermanConsultinggeologist,seismicdataprocessingexpertCreatoroftheCUBEsystemRobertNigborUSCProfessorLonginvolvementinpracticalapplicationsofshakingdata(e.g.,Intel)SoftwareDevelopmentExpertiseGatekeeperSystemsInbusinesssince1993sellingsoftwareforutilitiesSpecializeinhighperformance,highavailabilitysystemsforlargedatabase,GIS,andInternetapplicationsCustomersincludelargeutilitiesandmunicipalitiesCityofLA,SantaBarbara,PacifiCorp,LasVegasValleyWaterDistrict,GeorgiaPower,ContraCostaCounty,etc.ShakeCastSoftwareDevelopmentTeamBruceWorden–ShakeMapSoftwareDevelopmentPhilNaeckerCivilEngineer,10yearsasengineeringconsultantfocusedonwaterandwastewaterutilitiesBuiltlargehighperformancedatamanagementsystemsforbusinessandengineeringapplicationssince1971SteveCaine45yearsexperiencebuildingsoftwareFoundedfirmthatsoldcriticalsoftwaresystemstoDODandrelatedagenciesforoverthirtyyearsInternetandOpenSystemsExpertDaveBurke25yearsexperiencebuildingsoftwareExceptionalcompetenceatbuildingcomplexsystemsShakeCastProblemandSolutionCurrentProblemsShakeCastSolutionCurrentDeliveryofShakeMapsCustomsolutionforeachorganizationUnknownfailuremodesNotbuiltbyexpertsNotbuiltusinglatestInternettechnologiesDifficulttoimplementandmaintainSignificantworkforUSGSandconsumerNotconducivetoaddingnewdataproductsortechnologiesEachorganizationhashome-grownnotificationsystem(ornoneatall)EQSystems2002SeismicProcessingShakeMapProcessingInstrumentNetworkPublic/

Private

NetworksPrivate

NetworksArchivesUsersAkamaiServersPublicNetworksConsumerInformation

SystemPrivateNetworksFTPoverPublicNetworksGoals:ShakeCastProjectProviderapidandreliabledeliveryofinformationaboutearthquakeshakingtothepeoplewhoneeditInitialaudiencefocusesonutilities,largefacilityowners,municipalities,andnewsoutlets“ShakingInformation”isbroadlydefinedSatisfysomeoftheneedsforpost-eventactivitiessuchasrefinementofresponseplansandafter-the-factresponseassessmentbyaccuratelyrecordingwhoknewwhatwhenDeliveranopentechnologyplatformforearthquakeinformationdeliverythatfacilitymanagersandtheUSGScandependonandfeelcomfortableinbuildinguponEQSystems2003SeismicProcessingShakeMapProcessingInstrumentNetworkPublic/

Private

NetworksPrivate

NetworksArchivesUsersDistributionSystemEventNotificationSystemAkamaiServersProcessingandNotificationPublicNetworksConsumerInformation

SystemPrivateNetworksShakeCastGoals:DataDeliveryandNotificationDeliveryandNotificationMustBeExtremelyReliableMultipledatasourcesMultipledatapathsRobusttestingprotocolsSetandForgetDesignFastUnderAllLoadConditionsEssentiallynotrainingrequiredforproperinstallationandmaintenanceGoals:OtherSystemAttributesFirewallFriendlySystemMustBeCompleteFunctional“OutoftheBox”inafewhoursDeliverdataandmostcommonly-usedtoolsExtensibleandFlexibleAbletointegratewithmoreadvancedtoolsCustomizablebyorganizationsandindividualusersTraceableandAuditableSystemandusageauditlogs,consistenttimestampsObjectiveandreproduciblenotificationactionsShakeCastFeaturesandFunctionsPhasedrolloutoffeaturesFunctionsprovideinfrastructure,notenforcepolicyonhowShakeMapsareusedReliabilityandrobustnessaredesignedinfromthebeginningShakeCastTechnologyPlanOpensourceusingwidelyusedtoolsApache,Perl,Oracle,Windows,InternetExplorerHeavilydocumentedcodeanddatabasesBasedoncommoditytechnologies:InternetandWebEmailandSMSpagersRelationaldatabasesSecurityandreliabilitydesignedinfromthestartShakeCastProjectPhasesPhase1-PrototypePhase2–ReferenceSystemPhase2–OpenSourceShakeCastPhase1-PrototypeFundedbyUSGSPurposesareproofofconcept,demonstrationImplementedbyGatekeeperSystemsandBruceWordenDueSummer2003CalTranswillbefirsttestbedorganizationSBC/PacBellanxioustobenexttestbedBasicfunctionality,noeasyinstallationorcustomization,singlehardware/softwareplatformShakeCastPhase2–ReferenceSystemShoppingforfundingnowFullyinstallable(goalisonehouriftheserveralreadyhasawebserveranddatabase)EasilyconfigurableMultiplehardware/softwareplatformsLookingforearlyadoptersExpectnetworkofdozenstohundredsofsystemsandtensofthousandsofendusersShakeCastPhase3–OpenSourceShareddevelopmentbetweenuserorganizationsEnhancementstocoresystemParticipationbyuniversitiesCommercializationandExtensionIntegrationwithinternalsystemsImproveddataforshakingestimatesReadilyavailablesourcesforfragilityestimatesHopingforthousandsofsystemsandmillionsofendusersShakeCastTerminologyServer:everyShakeCastmachineisaserverUpstream/Downstream:directionofdataflow,althoughcomplexnetworktopologiesareallowedParameters:measuresofshakinggeneratedbyShakeMapsystemProducts:datafiles,invariousformatsandmultipleparameters,movedbetweenShakeCastmachinesGridFile:ShakeMapgridscontainingtherawparameterdataNotification:Detailedelectronicmessageaboutaspecificevent,systemactivity,orshakingleveltoaspecificuserorgroupofusersShakeCastSoftwareFeaturesReliablyandautomaticallyreceiveandprocessshakingdatafromShakeMapLetorganizationsandusersdefinelocationsofinterest(facilities)andsetshakingthresholds(green,yellow,red)inmultipleshakingmetrics(acceleration,instrumentalintensity,etc.)Reliablydelivertoenduserselectronicnotificationoffacilitydamageestimatesinaprioritized,customized,easy-to-useformMakemapsandreportsfromlocalserversavailableviatheWebEasilyintegratewithconsumer’sotherITsystemsProvideforend-to-endtestingandupgradesPrototypeFeaturesReceive,storeandforwardShakeMapsandassociatedmetadatainareliablemannerUnpackShakeMapgridsintoarelationalstructureNotifyusersofshakingandShakeCastactivityEmailandpagerSystemadministrator,ShakeCastdeveloper,andendusereventsProducedetailedlogfilesofShakeCastanduseractivityPrototypeFeatures-TransportReceivefrommultipleupstreamShakeCastandShakeMapserversVersionedproductsHTTPpushorHTTPpolling/pullCantransportnotonlyshakingdatabutsystemmetadata:i.e.producttypes,messagetypes,etc.BasicfilteringforShakeMapfeedBoundingrectanglePeakgridvaluesRetryandbasicerrorhandlingBasictestsuitesPrototypeFeatures–NotificationOnevents:mapgenerated,errors,recall/cancel,productdeliveryOnShakeMapparameters:magnitude,acceleration,etc.Onlocation-specificshakingforanyShakeMapparameterOnexceedenceoffacilityfragilityforanyShakeMapparameter(green,yellow,red)Messageformatdrivenbyeasilycustomizedtemplates,includesdirectWeblinksPrototypeFeatures-DatabaseMostconfigurationinformation,allShakeMapdata,andalluserdataisstoredinthedatabaseSupportforbothAccessandOracleSiteadministratorcanaccessdatabaseusingstandardSQLandotherstandardtoolssuchasMSAccess,VisualBasic,Perl,etc.AdditionalV1.0FeaturesConsolidatednotificationProfessionaldocumentationCompleteinstallationprocedurewithupstreamregistrationUserconfigurationwebpagesFullsupportforbothUnixandNTDeliverShakeMapwebpageslocallyEnhancederrorhandlingEnhancedtestproceduresCalloutfromShakeCasttoprivatescriptstoinvokesite-specificfunctionsAutomatedend-to-endtestingFeaturesFuturesRichernotificationoptionsSupportformultiplerelatedeventsMoreintelligentprioritizationofmessagesMorecomplicatednotificationlogicSupportforpositiveresponse(confirmation)RicherweblinkswithactivewebpagestohelpusersmanagelargelistsoffacilitiesMoredatabaseplatformscertifiedOpensourceshareddevelopmentenvironmentUpstreamreportingofShakeCastusage,serverhealthandstatus,andtestresultsShakeCastImplementationImplementationPrinciplesUseopenandfamiliartoolsandprotocolsFollowpathofleastresistancefornetworkandsecuritymanagersOpen,readable,understandablesourcecodeHTTPandHTTPStransportRelationaldatabaseforalldatastorageNTService/UnixDaemonforeventloopprocessingSoftwareDevelopmentEnvironmentNTandUnix(butcouldbeanything)PerlforCGI(butcouldbeanything)StandardSQL(andoptionalSQL-basedtools)SourcecodemanagementinCVS(Web-basedsourcemanagementsystemdesignedforshareddevelopment)NoC,VB,Javaorcompiledlanguagesrequired,providingshortdevelopmentcycles,transparency,portabilityShakeCastSystemDataFlowShakeCastServerShakeCastServ