數(shù)據(jù)倉庫及應(yīng)用-數(shù)據(jù)倉庫課件

數(shù)據(jù)倉庫杭誠方教授數(shù)據(jù)倉庫杭誠方教授WhatisDataWarehouseWhatisDataWarehouseDatawarehouseisaverylargedatabasethatstoresintegrateddataofoneormorebusinesssubjectareasDatawarehouseisbuilttosupportdataanalysisfordecisionmakingIntegratedcustomerdatawarehouseisanecessarysteptothesuccessofthebusinessintelligencestrategyDatawarehousesarealsousedformanyotherpurposessuchasproductmanufacturingdatawarehousesDatawarehousesbecomethefocalpointintheenterprise-wideITinfrastructureWhatisDataWarehouse?DatawarehouseisaverylarWhatisDataWarehouse

Adatawarehouseissimplyasingle,complete,andconsistentstoreofdataobtainedfromavarietyofsourcesandmadeavailabletoendusersinawaytheycanunderstandanduseinabusinesscontext.

WhatisDataWarehouse AdataWhatisDataWarehouseWhatisDataWarehouseDataWarehouseDefinitionsThekeyelementsinthedefinitions:

Subject-Oriented: Presentationasbusinesssubjects,notas computerfiles. Integrated: Asinglesourceofinformationforand aboutthebusiness. Non-Volatile: Stableinformationthatdoesn’tchangeeach timeanoperationalprocessisexecuted. Time-Variant: Containingahistoryofthebusiness,as wellascurrentbusinessinformation. Accessible: Theprimarypurposeofadatawarehouseis toprovidereadilyaccessibleinformationto businesspeople.DataWarehouseDefinitionsTheSubject-OrientedSubject-OrientedIntegratedIntegratedIntegrated網(wǎng)管系統(tǒng)財務(wù)管理系統(tǒng)市場分析決策系統(tǒng)TelcomDWSystem分析型大客戶CRM系統(tǒng)信用度管理客服系統(tǒng)(CallCenter

1000/180/112/170）系統(tǒng)其它電信專業(yè)網(wǎng)業(yè)務(wù)系統(tǒng)“九七工程”之營業(yè)管理生產(chǎn)調(diào)度系統(tǒng)（配線/配號/開通）112故障查修系統(tǒng)資源管理系統(tǒng)170/催繳系統(tǒng)營業(yè)系統(tǒng)本地公司/IC卡/磁卡管理系統(tǒng)網(wǎng)上營業(yè)系統(tǒng)商務(wù)管理層省級計費結(jié)算計費帳務(wù)系統(tǒng)中心業(yè)務(wù)管理層網(wǎng)絡(luò)及網(wǎng)元管理層電信網(wǎng)網(wǎng)元Integrated網(wǎng)管系統(tǒng)財務(wù)管理系統(tǒng)分析型大客戶CRM系Non-VolatileNon-VolatileTimeVariantTimeVariantAccessibleAccessibleDataWarehouseCharacteristicsDatawarehouseseparatesfunctionsfromoperationalsystems.PropertyOperationalDataWarehouseResponseTimeSub-secondtosecondsSecondstohoursDataOperationDMLPrimarilyreadonlyNatureofData30-60daysSnapshotsovertimeDataOrganizationApplicationSubject,TimeSizeSmalltolargeLargetoverylargeDataSourcesOperational,InternalOperational,Internal,ExternalActivitiesProcessesAnalysisDataWarehouseCharacteristicsDataWarehouseCharacteristics

Datawarehouseservesasacentralrepositoryforrecordingeverythingaboutthebusinessforinformationretrieval.Dataisloadedfrominternalbusinessoperationalsystem,andexternalsystems.DataWarehouseCharacteristicsDataWarehouseCharacteristics

Adatawarehousehasafundamentaleffectonhowtheusersseethedataavailableabouttheorganization,whattodowithitandhowtouseitfordecisionmaking.DataWarehouseCharacteristicsDataWarehouseCharacteristicsDataWarehouseCharacteristicsDataWarehouseCharacteristics

Adatawarehouseisnotasinglesoftwareorhardwareproductyoupurchasetostrategic.Itisacomputingenvironmentwhereuserscanfindstrategicinformationtomakebetterdecisions.Itisauser-centricenvironment.DataWarehouseCharacteristicsDataWarehouseCharacteristics

Datawarehouseisablendofmanydifferenttechnologiesneededforsupportingthevariousfunctionsofadatawarehouseenvironment.Thesedifferenttechnologiesallworktogetherinadatawarehouseenvironment.ApplicationAdministrationStorageManagementAnalysisDataManagementDataModelingDataAcquisitionDataWarehouseDataWarehouseCharacteristicsEnterpriseDataWarehouse

Enterprisedatawarehousesarefundedonacorporatebasis.Enterprisedatawarehousecoverstheentirebusiness(corporation),incorporatingdatafromalloperationalsystems.Informationisextractedfromtheoperationalenvironment,cleansed,andtransformedintoacentral,integratedenterprise-widedatawarehouseenvironment,sothatallthedepartmentsandotherinternalorganizationsofthecorporationcanbenefitfromaconsistent,integratedsourceofdecisionsupportinformation.

EnterpriseDataWarehouse EnteDataMart

Datamartsareoftenfundedonadepartmentalbasis.DatamartisacollectionofdatatailoredtotheDSSprocessingneedsofaparticulardepartment.Itisasubsetofaenterprisedatawarehousethathasbeencustomizedtofittheneedsofadepartment.Datamartsserveusersataspecificlevel,orforaspecificdepartment.

DataMart DatamartsareoftenDataWarehouseversusDataMart

PropertyDataWarehouseDataMartScopeEnterpriseDepartmentSubjectsMultipleSingle-subjectDataSourceManyFewSize(Typical)>TB<TBImplementTimeMonthstoyearsMonthsDataWarehouseversusDataMarDataMartDataMartDataMartControl:Adepartmentcancompletelycontrolthedataandprocessingthatoccursinsideadatamart.Cost:Thecostofstorageandprocessingisless,becausethedatamart’smachineissmallerthanDW’sCustomization:Thedatamart’sdataiscustomizedtosuitthepeculiarneedsofthedepartment.DataMartControl:AdepartmentDataMartDataMartDataMartDataMartDataMartDependentDataMart:

Thesourceisthedatawarehouse.Theextraction,transformation,andloadingprocessiseasy.Thedatamartispartoftheenterpriseplan.IndependentDataMart:

Thesourceareoperationalsystemexternalsource.Theextraction,transformation,andloadingprocessisdifficult.Thedatamartisbuilttosatisfyanalyticalneeds.DataMartDependentDataMart:OperationalDataStore(ODS)Integrateinformationfromtheproductionsystem.Relievetheproductionsystemsreportingandanalysisdemands.Provideaccesstocurrentdata.OperationalDataStore(ODS)InODSODSODS

ODSlooksverymuchlikeadatawarehouse,suchassubject-oriented,andintegration.However,theremainingcharacteristicsofanODSarequitedifferentfromadatawarehouse:Volatile:AnODScanbeupdatedasanormalpartof processing.Current-Values:AnODStypicallycontainsdaily,weekly, orevenmonthlydata,butthedataages veryquickly.DetailedData:AnODScontainsdetaileddataonly.ODS ODSlooksverymuchlikeaDifferentClassesoftheODSClassI:

Asynchronousinterfaceinwhichavery,verysmallamountoftimelapsesbetweenanapplication’stransactionandthereflectionofthetransactionintheODS.ClassII:

IfanhourortwopassesfromthetimeatransactioniscreatedandinteractedintheapplicationenvironmentuntilthattransactionisreflectedintheODS.ClassIII:

Theremaybeatimelagbetween12hoursandadayastransactiondataiscollectedintheI&Tinterface.ClassIV:

ThedataisfedintotheODSdirectlyfromthedatawarehouse.DifferentClassesoftheODSClDeterminingtheClassSpeedofmovementofdataintotheODSVolumeofdatathatmustbemovedVolumeofdatathatmustbestoredinintermediatelocationduringI&TprocessingUpdateofdataandintegrityoftransactionprocessingThetimeofdaythemovementneedstooccurDeterminingtheClassSpeedofDataArchitectureDataWarehouseOperationalDataStoreODSOperationalDataStoreODSLegacySystemLegacySystemLegacySystemLegacySystemCallCenterWebEmailATMSFASupportOperationalCRMSupportAnalyticalCRMDataArchitectureDataWarehousExample:TheContentofaCustomerODSIdentificationNameAddressPhoneE-mailPreferencesOptin/outMediumDatasharingTransactionsPurchasesCancellationsReturnsHH/CompanyAffiliationEventsComplaintsPre-approvalsInquiriesSalescallsCustomerODSCorporateHierarchyHouseholdlinkExample:TheContentofaCust數(shù)據(jù)倉庫系統(tǒng)的體系結(jié)構(gòu)兩層架構(gòu)

（GenericTwo-LevelArchitecture）獨立型數(shù)據(jù)集市

（IndependentDataMart）依賴型數(shù)據(jù)集市和操作型數(shù)據(jù)存儲

（DependentDataMartandOperationalDataStore）數(shù)據(jù)倉庫系統(tǒng)的體系結(jié)構(gòu)兩層架構(gòu)兩層數(shù)據(jù)倉庫體系結(jié)構(gòu)兩層數(shù)據(jù)倉庫體系結(jié)構(gòu)基于獨立數(shù)據(jù)集市的數(shù)據(jù)倉庫體系結(jié)構(gòu)基于獨立數(shù)據(jù)集市的數(shù)據(jù)倉庫體系結(jié)構(gòu)基于依賴型數(shù)據(jù)集市和操作型數(shù)據(jù)存儲(ODS)的數(shù)據(jù)倉庫體系結(jié)構(gòu)基于依賴型數(shù)據(jù)集市和操作型數(shù)據(jù)存儲(ODS)的數(shù)據(jù)倉庫體系結(jié)數(shù)據(jù)倉庫及應(yīng)用-數(shù)據(jù)倉庫課件數(shù)據(jù)倉庫杭誠方教授數(shù)據(jù)倉庫杭誠方教授WhatisDataWarehouseWhatisDataWarehouseDatawarehouseisaverylargedatabasethatstoresintegrateddataofoneormorebusinesssubjectareasDatawarehouseisbuilttosupportdataanalysisfordecisionmakingIntegratedcustomerdatawarehouseisanecessarysteptothesuccessofthebusinessintelligencestrategyDatawarehousesarealsousedformanyotherpurposessuchasproductmanufacturingdatawarehousesDatawarehousesbecomethefocalpointintheenterprise-wideITinfrastructureWhatisDataWarehouse?DatawarehouseisaverylarWhatisDataWarehouse

Adatawarehouseissimplyasingle,complete,andconsistentstoreofdataobtainedfromavarietyofsourcesandmadeavailabletoendusersinawaytheycanunderstandanduseinabusinesscontext.

WhatisDataWarehouse AdataWhatisDataWarehouseWhatisDataWarehouseDataWarehouseDefinitionsThekeyelementsinthedefinitions:

Subject-Oriented: Presentationasbusinesssubjects,notas computerfiles. Integrated: Asinglesourceofinformationforand aboutthebusiness. Non-Volatile: Stableinformationthatdoesn’tchangeeach timeanoperationalprocessisexecuted. Time-Variant: Containingahistoryofthebusiness,as wellascurrentbusinessinformation. Accessible: Theprimarypurposeofadatawarehouseis toprovidereadilyaccessibleinformationto businesspeople.DataWarehouseDefinitionsTheSubject-OrientedSubject-OrientedIntegratedIntegratedIntegrated網(wǎng)管系統(tǒng)財務(wù)管理系統(tǒng)市場分析決策系統(tǒng)TelcomDWSystem分析型大客戶CRM系統(tǒng)信用度管理客服系統(tǒng)(CallCenter

1000/180/112/170）系統(tǒng)其它電信專業(yè)網(wǎng)業(yè)務(wù)系統(tǒng)“九七工程”之營業(yè)管理生產(chǎn)調(diào)度系統(tǒng)（配線/配號/開通）112故障查修系統(tǒng)資源管理系統(tǒng)170/催繳系統(tǒng)營業(yè)系統(tǒng)本地公司/IC卡/磁卡管理系統(tǒng)網(wǎng)上營業(yè)系統(tǒng)商務(wù)管理層省級計費結(jié)算計費帳務(wù)系統(tǒng)中心業(yè)務(wù)管理層網(wǎng)絡(luò)及網(wǎng)元管理層電信網(wǎng)網(wǎng)元Integrated網(wǎng)管系統(tǒng)財務(wù)管理系統(tǒng)分析型大客戶CRM系Non-VolatileNon-VolatileTimeVariantTimeVariantAccessibleAccessibleDataWarehouseCharacteristicsDatawarehouseseparatesfunctionsfromoperationalsystems.PropertyOperationalDataWarehouseResponseTimeSub-secondtosecondsSecondstohoursDataOperationDMLPrimarilyreadonlyNatureofData30-60daysSnapshotsovertimeDataOrganizationApplicationSubject,TimeSizeSmalltolargeLargetoverylargeDataSourcesOperational,InternalOperational,Internal,ExternalActivitiesProcessesAnalysisDataWarehouseCharacteristicsDataWarehouseCharacteristics

Datawarehouseservesasacentralrepositoryforrecordingeverythingaboutthebusinessforinformationretrieval.Dataisloadedfrominternalbusinessoperationalsystem,andexternalsystems.DataWarehouseCharacteristicsDataWarehouseCharacteristics

Adatawarehousehasafundamentaleffectonhowtheusersseethedataavailableabouttheorganization,whattodowithitandhowtouseitfordecisionmaking.DataWarehouseCharacteristicsDataWarehouseCharacteristicsDataWarehouseCharacteristicsDataWarehouseCharacteristics

Adatawarehouseisnotasinglesoftwareorhardwareproductyoupurchasetostrategic.Itisacomputingenvironmentwhereuserscanfindstrategicinformationtomakebetterdecisions.Itisauser-centricenvironment.DataWarehouseCharacteristicsDataWarehouseCharacteristics

Datawarehouseisablendofmanydifferenttechnologiesneededforsupportingthevariousfunctionsofadatawarehouseenvironment.Thesedifferenttechnologiesallworktogetherinadatawarehouseenvironment.ApplicationAdministrationStorageManagementAnalysisDataManagementDataModelingDataAcquisitionDataWarehouseDataWarehouseCharacteristicsEnterpriseDataWarehouse

Enterprisedatawarehousesarefundedonacorporatebasis.Enterprisedatawarehousecoverstheentirebusiness(corporation),incorporatingdatafromalloperationalsystems.Informationisextractedfromtheoperationalenvironment,cleansed,andtransformedintoacentral,integratedenterprise-widedatawarehouseenvironment,sothatallthedepartmentsandotherinternalorganizationsofthecorporationcanbenefitfromaconsistent,integratedsourceofdecisionsupportinformation.

EnterpriseDataWarehouse EnteDataMart

Datamartsareoftenfundedonadepartmentalbasis.DatamartisacollectionofdatatailoredtotheDSSprocessingneedsofaparticulardepartment.Itisasubsetofaenterprisedatawarehousethathasbeencustomizedtofittheneedsofadepartment.Datamartsserveusersataspecificlevel,orforaspecificdepartment.

DataMart DatamartsareoftenDataWarehouseversusDataMart

PropertyDataWarehouseDataMartScopeEnterpriseDepartmentSubjectsMultipleSingle-subjectDataSourceManyFewSize(Typical)>TB<TBImplementTimeMonthstoyearsMonthsDataWarehouseversusDataMarDataMartDataMartDataMartControl:Adepartmentcancompletelycontrolthedataandprocessingthatoccursinsideadatamart.Cost:Thecostofstorageandprocessingisless,becausethedatamart’smachineissmallerthanDW’sCustomization:Thedatamart’sdataiscustomizedtosuitthepeculiarneedsofthedepartment.DataMartControl:AdepartmentDataMartDataMartDataMartDataMartDataMartDependentDataMart:

Thesourceisthedatawarehouse.Theextraction,transformation,andloadingprocessiseasy.Thedatamartispartoftheenterpriseplan.IndependentDataMart:

Thesourceareoperationalsystemexternalsource.Theextraction,transformation,andloadingprocessisdifficult.Thedatamartisbuilttosatisfyanalyticalneeds.DataMartDependentDataMart:OperationalDataStore(ODS)Integrateinformationfromtheproductionsystem.Relievetheproductionsystemsreportingandanalysisdemands.Provideaccesstocurrentdata.OperationalDataStore(ODS)InODSODSODS

ODSlooksverymuchlikeadatawarehouse,suchassubject-oriented,andintegration.However,theremainingcharacteristicsofanODSarequitedifferentfromadatawarehouse:Volatile:AnODScanbeupdatedasanormalpartof processing.Current-Values:AnODStypicallycontainsdaily,weekly, orevenmonthlydata,butthedataages veryquickly.DetailedData:AnODScontainsdetaileddataonly.ODS ODSlooksverymuchlikeaDifferentClassesoftheODSClassI:

Asynchronousinterfaceinwhichavery,verysmallamountoftimelapsesbetweenanapplication’stransactionandthereflectionofthetr