Power-虛擬化(高級(jí)篇)上_第1頁(yè)
Power-虛擬化(高級(jí)篇)上_第2頁(yè)
Power-虛擬化(高級(jí)篇)上_第3頁(yè)
Power-虛擬化(高級(jí)篇)上_第4頁(yè)
Power-虛擬化(高級(jí)篇)上_第5頁(yè)
已閱讀5頁(yè),還剩43頁(yè)未讀, 繼續(xù)免費(fèi)閱讀

下載本文檔

版權(quán)說明:本文檔由用戶提供并上傳,收益歸屬內(nèi)容提供方,若內(nèi)容存在侵權(quán),請(qǐng)進(jìn)行舉報(bào)或認(rèn)領(lǐng)

文檔簡(jiǎn)介

Power虛擬化〔高級(jí)篇〕

Power虛擬化方案專家級(jí)課程課程內(nèi)容說明內(nèi)容概述(PM)IBMPowerVM虛擬化新技術(shù)(NPIV/AMS)虛擬化高可用解決方案設(shè)計(jì)實(shí)時(shí)遷移解決方案設(shè)計(jì)IBM虛擬化優(yōu)勢(shì)IBM虛擬化案例分享日程IBMPower6虛擬化新技術(shù)(NPIV/AMS)NPIVAMS虛擬化高可用解決方案設(shè)計(jì)實(shí)時(shí)遷移解決方案設(shè)計(jì)IBM虛擬化優(yōu)勢(shì)IBM虛擬化案例分享N_PortIDVirtualizationN_PortIDVirtualization(NPIV)providesdirectFibreChannelconnectionsfromclientpartitionstoSANresources,simplifyingSANmanagementFibreChannelHostBusAdapterisownedbyVIOSpartitionEachFibreChannelHostBusAdapterport(2portspercard)canbeusedbymanyclientpartitionsSupportedwithPowerVMExpress,Standard,andEnterpriseEditionSupportsAIX5.3andAIX6.1partitionsPower520,550,560,570and595,withan8GBPCIeFibreChannelAdapter.

EnablesuseofexistingstoragemanagementtoolsSimplifiesstorageprovisioning(i.e.zoning,LUNmasking)EnablesaccesstoSANdevicesincludingtapelibrariesPowerHypervisorVIOSVirtualFCAdapterFCAdapterVirtualFCAdapterNPIV的支持VIOSV2.1(PowerVMExpress,Standard,andEnterprise)Power6平臺(tái)以上LPAROSsupport:AIX(5.3and6.1),Linux(SUSEEnterprise11,orlater)只支持520,550,560,570,595,目前也支持blade支持8GbPCIeHBA卡(#5735)(這塊HBA自適應(yīng)8G,4G,2G,不支持更低的帶寬),只支持對(duì)switch的連接方式惟一識(shí)別的WWPN產(chǎn)生(成對(duì)分配,一個(gè)在本機(jī)使用,另一個(gè)在分區(qū)遷移后使用)每一個(gè)虛擬FCHBA都有一個(gè)惟一的,永久的識(shí)別碼支持分區(qū)動(dòng)態(tài)遷移。VIOS可以同時(shí)支持NPIV和虛擬SCSI每個(gè)支持NPIV的物理HBA最多支持64個(gè)虛擬端口。支持HMC和IVM管理的效勞器HypervisorvSCSIFunctionalFlowLVMAIXLVMVSCSI

VSCSItargetVIOS1SANmultipathingDiskDriverLVMVSCSItargetVIOS2multipathingDiskDriverVSCSI

multipathingDiskDriver

fibrechannelHBAs

fibrechannelHBAsHypervisorNPIVFunctionalFlowAIXLVMVFCHBApassthrumoduleVIOS1SANpassthrumoduleVIOS2VFCHBAmultipathingDiskDriver

fibrechannelHBAs

fibrechannelHBAsEMC5000IBMDS8000VIOClientVIOSFCVirtualSCSIFCAdaptersGenericSCSIDiskGenericSCSIDiskCurrentvSCSImodel

VirtualizedDisksVirtualizedDisksVirtualFCN-PortIDVirtualizationVirtualizedFCAdapterPOWER5orPOWER6*AllstatementsregardingIBM'sfuturedirectionandintentaresubjecttochangeorwithdrawalwithoutnotice,andrepresentgoalsandobjectivesonly.SANVIOSFCAdaptersFCEMC5000IBMDS8000FCSANFCVIOClientIBMDS8000EMC5000POWER6DisksNPIV簡(jiǎn)化SAN管理NPIV–DualVIOSVIOSSVCNPIV

NPIVenabledSANvioclientvSCSIadapterpairDS4000,DS6000,DS8000tapelibraryWWPNHDSEMCNetAppVIOSNPIV

vioclientvioclientvioclientWWPNWWPNWWPNWWPNWWPNLivePartitionMobility(LPM)andNPIVVIOSNPIV

vioclient

WWPNVIOSNPIV

vioclient

vioclientvioclient

WWPNWWPNWWPNWWPNWWPNVIOSNPIV

vioclient

WWPNVIOSNPIV

vioclient

vioclient

vioclient

WWPNWWPNWWPNWWPNWWPNNPIVenabledSANWWPNsareallocatedinpairs1.Hardware–Power6效勞器,微碼有要求InstallaminimumSystemFirmwarelevelofEL340_036fortheIBMPower520andPower550,andEM340_036fortheIBMPower560andIBMPower570.–至少一塊8GB的PCIe雙端口HBA卡(FeatureCode5735)–支持NPIV的SAN交換機(jī)只有直接連接在該HBA上的交換機(jī)需要支持NPIV,其他交換不需要支持。2.Software–HMCV7.3.4,orlater–VirtualI/OServerVersion2.1withFixPack20.1,orlater–AIX5.3TL9,orlater–AIX6.1TL2,orlaterNPIV的要求HMC7.3.4configureVirtualFCAdapterJustlikevirtualSCSIOnbothClientandServerVirtualI/OServer創(chuàng)立NPIV簡(jiǎn)單步驟NPIV

Whatyoudo?NPIV

Whatyoudo?OnceCreated:

LPARConfig

ManageProfiles

EditclickFCAdapter

Properties

andtheWWPNisavailable

NPIVcapableswitchisrequired2G,4Gor8G–NPIVconfiguredport

AdapterMUSTbeassignedtoVIOSPort-0Port-1Physical8gbHBAadapterinPower6server日程IBMPower6虛擬化新技術(shù)(NPIV/AMS)NPIVAMS虛擬化高可用解決方案實(shí)時(shí)遷移解決方案IBM虛擬化優(yōu)勢(shì)IBM虛擬化案例分享ActiveMemorySharing是什么?ActiveMemorySharingintelligentlyflowsmemoryfromonepartitiontoanotherforincreasedutilizationandflexibilityofmemoryusage

AllstatementsregardingIBM'sfuturedirectionandintentaresubjecttochangeorwithdrawalwithoutnotice,andrepresentgoalsandobjectivesonly.MemoryUsage(GB)TimeWorkloads分區(qū)錯(cuò)時(shí)頂峰負(fù)載MemoryvirtualizationenhancementforPowerSystems和微分區(qū)提升CPU的利用率類似,AMS能提升內(nèi)存的利用率共享池內(nèi)的物理內(nèi)存,基于各LPAR的需求,動(dòng)態(tài)的在LPAR之間分配,以優(yōu)化共享池內(nèi)的內(nèi)存的整體利用率支持logicalmemory的over-commitment,超過物理內(nèi)存的局部會(huì)寫到pagingdevice上面。適合于多變的內(nèi)存需求的分區(qū)能夠更小粒度的來共享物理內(nèi)存,自動(dòng)擴(kuò)展和縮小各分區(qū)的物理內(nèi)存支持OScollaborativememorymanagement,減少hypervisorpagingActiveMemorySharingenhancedthecapabilitiesofPowerVMActiveMemorySharing對(duì)系統(tǒng)的要求MemoryUsage(GB)TimeWorkloads系統(tǒng)要求:IBMPowerSystemsserverorbladewithPOWER6processorsEnterprisePowerVMactivationHMCv7.342

servicepack2(V7R3.4.0M2)所有I/O必須通過VIOS來虛擬支持的操作系統(tǒng):AIX6.1TL3

NoAIX5.3support

SUSELinuxEnterpriseServer11IBMi6.1plusPTF

SI32798ActiveMemorySharingEnablesHigherMemoryUtilizationPartitionswithdedicatedmemoryMemoryisallocatedtopartitionsAsworkloaddemandschange,memoryremainsdedicatedMemoryallocationisnotoptimizedtoworkloadTimeTimeMemory(GB)MemoryUsage(GB)PartitionswithsharedmemoryMemoryisallocatedtosharedpoolMemoryisusedbypartitionthatneedsit,enablinganadditionalpartitiontobeaddedwithinsamememoryfootprintHighermemoryutilizationAllstatementsregardingIBM'sfuturedirectionandintentaresubjecttochangeorwithdrawalwithoutnotice,andrepresentgoalsandobjectivesonly.ActiveMemorySharing應(yīng)用場(chǎng)景對(duì)多種場(chǎng)景,能夠基于工作負(fù)載級(jí)別,對(duì)物理系統(tǒng)上可用的內(nèi)存,進(jìn)行動(dòng)態(tài)調(diào)整:不同的時(shí)區(qū)〔地域〕,不同的工作負(fù)載峰值一天中不同時(shí)間的混合負(fù)載(e.g.白天跑CRM,晚上跑BATCH)對(duì)高整合的工作負(fù)載,對(duì)內(nèi)存要求低或者不太有規(guī)律的場(chǎng)景,是個(gè)理想選擇整合PowerSystemshardware,firmwareandsoftwareenhancements來優(yōu)化資源支持over-commitmentoflogicalmemory支持VIOSmanagedpagingdevices的Overflow用兩個(gè)VIOS保證冗余支持LivePartitionMobility通過自動(dòng)調(diào)整的方式來提高內(nèi)存利用率內(nèi)存在各參與分區(qū)間自動(dòng)重分配啟動(dòng)后就不再需要用戶干預(yù)比在分區(qū)間使用DLPAR來分配內(nèi)存節(jié)省時(shí)間MemoryUsage(GB)TimeMemoryUsage(GB)TimeMemoryUsage(GB)Time多LPAR間優(yōu)化內(nèi)存方案8GBLoanused8GBLoanused8GBused10GBusedHypervisor–LoaningPagesEachLPARLoansSome(More)MemoryHypervisorasksforhelp多LPAR間均衡內(nèi)存方案8GBLoanused8GBLoanused8GBused10GBusedHypervisor–StealingPagesVIOSLPARsgetbusysoHypervisortakespagesanywayviaVIOSpaging多LPAR間均衡內(nèi)存方案8GBLoanused8GBLoanused8GBused10GBusedHypervisor–StealingPagesVIOSEventuallyreachasteadystatewithmemory“flowingbetweenLPARsPowerVMEditionsExpressStandardEnterpriseMaximumLPARs1+2/Server10/Core10/CoreManagementIVMIVM,HMCIVM,HMCVirtualI/OServer

PowerVMLx86

MultipleSharedProcessorPools

LivePartitionMobility

ActiveMemorySharing

讓客戶更愿意升級(jí)到PowerVMEnterpriseEditionContinuestobuildupon40yearsofIBMvirtualizationinnovationandleadershipExtendsPowerVMleadovercompetingvirtualization/consolidationsolutionsActiveMemorySharingaddsvaluetoPowerVMofferingPowerVMper-core價(jià)格保持不變?yōu)榭蛻籼岣邇r(jià)值A(chǔ)ctiveMemorySharing主要概念SMPartition1

PagingVIOS(1GB)PageIn/OutVASIVirtualizationControlPoint(VCP)SharedMemoryPool:16GBPagingVIOSPagingDevicesSMP1:CurrentMem=12GBEntitledMem:4GBSMP2:CurrentMem=8GBEntitledMem:3GBSMP3:CurrentMem=4GBEntitledMem:1GBSharedMemoryPool(16GB)FreeMemoryPool(5.5GB)HypervisorMemory(1.5GB)DedicatedMemory(9GB)PhysicalMemory(32GB)FCSMPartition2SMPartition3DedicatedMemoryPartition4(8GB)PagingDevicesvSCSIServerCMMCMMCMMSharedMemoryManager(SMM)HypervisorPageLoaningSharedMemoryPool:

存儲(chǔ)共享內(nèi)存分區(qū)的內(nèi)存頁(yè)的物理內(nèi)存塊集合。PagingDevice:

關(guān)聯(lián)于一個(gè)sharedmemorypool的物理或邏輯設(shè)備,來為共享內(nèi)存分區(qū)提供pagingspace。SharedMemoryPartition:

關(guān)聯(lián)于一個(gè)sharedmemorypool上的分區(qū).I/OEntitledMemory(akaI/Oentitlement):

任一時(shí)間,可供sharedmemorypartition來映射I/O使用的物理內(nèi)存的最大值。MemoryWeight:

0到255之間的一個(gè)代表分配給一個(gè)分區(qū)的物理內(nèi)存頁(yè)的優(yōu)先級(jí)的系數(shù)。SMPartition1

PagingVIOS(1GB)PageIn/OutVASIVirtualizationControlPoint(VCP)SharedMemoryPool:16GBPagingVIOSPagingDevicesSMP1:CurrentMem=12GBEntitledMem:4GBSMP2:CurrentMem=8GBEntitledMem:3GBSMP3:CurrentMem=4GBEntitledMem:1GBSharedMemoryPool(16GB)FreeMemoryPool(5.5GB)HypervisorMemory(1.5GB)DedicatedMemory(9GB)PhysicalMemory(32GB)FCSMPartition2SMPartition3DedicatedMemoryPartition4(8GB)PagingDevicesvSCSIServerCMMCMMCMMSharedMemoryManager(SMM)HypervisorPageLoaningVirtualizationControlPoint(HMC,IVM,IBMDirector):為用戶提供啟用sharedmemoryenvironment的界面.

SharedMemoryManager(SMM):hypervisor的一個(gè)組件:

動(dòng)態(tài)的在各共享內(nèi)存分區(qū)間分配物理內(nèi)存。PagingVIOS:一個(gè)

VIOS分區(qū),響應(yīng)SMM的請(qǐng)求,提供對(duì)pagingdevice的訪問。OperatingSystem:managesI/Oentitlementandprovideshintstohypervisoraboutpageusage.CollaborativeMemoryManager(CMM):響應(yīng)hypervisor的請(qǐng)求,動(dòng)態(tài)更改分區(qū)內(nèi)存的大小。ActiveMemorySharing主要概念(續(xù))DedicatedProcessorLPARFinance70GBLPAR#3LPAR#1LPARVIOSLPAR#2DedicatedProcessorLPARPlanning105GB105GB105GB5GB60GBPowerHypervisorMicro-PartitionProcessorPoolAIXIBMiLinuxAIXAIXMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMemoryPool:210GBMMMMMMMMMMMMMMMMMMMMMMMMMMMTotalDefinedMemory450GBPhysicalMemory350GBSharedMemoryPool210GB350GBMemoryMAIXActiveMemorySharingConfigurationSharedMemoryPoolPagingDevicesDisk4Disk3Disk2Disk1ActiveMemorySharingConfiguration(cont.)DedicatedProcessorLPARFinance75GBLPAR#3LPAR#1LPARVIOSLPAR#2DedicatedProcessorLPARPlanning105GB105GB105GB5GB60GBPowerHypervisorMicro-PartitionProcessorPoolAIXIBMiLinuxAIXAIXMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMemoryPool:210GBMMMMMMMMMMMMMMMMMMMMMM70GB45GB75GBMMMMMMMMMMMMMMMMMMMMMMMMMMM85GBMMMMMM60GBAIXTotalDefinedMemory450GBSharedMemoryPoolPagingDevicesMMM部署本卷須知Performance基于不同的類型的共享內(nèi)存的工作負(fù)載,性能會(huì)不同切換延遲依賴于共享內(nèi)存分區(qū)的使用率,配置的內(nèi)存和pagingdevice當(dāng)大量?jī)?nèi)存在分區(qū)間移動(dòng)的時(shí)候,在目標(biāo)分區(qū)會(huì)有一個(gè)大的延遲當(dāng)內(nèi)存需求增長(zhǎng)的時(shí)候,sharedmemorypool可以動(dòng)態(tài)增加,來防止paging,提高性能。需要監(jiān)控延遲情況,通過DLPAR來增加內(nèi)存到sharedpool里面高性能pagingdevices能提高性能建議SolidStateDevices和FASTt節(jié)省本錢特定workload和性能要求的系統(tǒng),對(duì)物理內(nèi)存的需求的降低,可以降低本錢AMS能夠比傳統(tǒng)方式創(chuàng)立更多的分區(qū)只有活潑的在用的內(nèi)存需要駐守物理內(nèi)存AMS不再需要管理員手工重新分配內(nèi)存,可以節(jié)省時(shí)間和本錢部署本卷須知(續(xù))用途AMS當(dāng)所有分區(qū)同時(shí)運(yùn)行的整體內(nèi)存集合能夠被pool的物理內(nèi)存支持的情況下,能提供最好的效果分區(qū)在錯(cuò)時(shí)頂峰負(fù)載Variabilityshouldnotleadtoping-pongmemorybetweenpartitions平均內(nèi)存駐留要求低的WorkloadsOnlyactivelyreferencedpagesareresidentinAMSenvironmentActive/Inactive分區(qū)場(chǎng)景一個(gè)時(shí)間只需要一個(gè)分區(qū)主備分區(qū)(Highavailability)AMS對(duì)以下場(chǎng)景不建議使用:對(duì)內(nèi)存駐留有著高的,穩(wěn)定的需求的workloadAlltheallocatedmemoryisactivelyreferencedFrequentlychangingreferencedmemoryregions對(duì)響應(yīng)時(shí)間和性能敏感的workloads有著高度可變性的Workload如果上面所說的workload場(chǎng)景部署的AMS,一定要確保事前多訂購(gòu)一些內(nèi)存??蛻魬?yīng)該在測(cè)試環(huán)境中測(cè)試,理解了AMS的用途之后,才能在生產(chǎn)環(huán)境中部署會(huì)有白皮書來協(xié)助客戶的配置啟動(dòng)和優(yōu)化AMS部署本卷須知(續(xù))OS本卷須知優(yōu)化OSPagingdevicesActiveMemorySharing只支持4Kpage使用大page的Workload遷移到AMS上會(huì)影響性能VIOS本卷須知建議使用獨(dú)享處理器假設(shè)使用微分區(qū),使用比原來規(guī)劃的更多的處理器授權(quán)數(shù)量。優(yōu)化分配給sharedmemorypool的pagingdeviceReducingCostswithActiveMemorySharingIntelligentlyflowmemoryamongpartitionswithvariableworkloadsdemandsReducesmemoryrequirements4PartitionswithDedicatedMemory4PartitionswithSharedMemoryAllstatementsregardingIBM'sfuturedirectionandintentaresubjecttochangeorwithdrawalwithoutnotice,andrepresentgoalsandobjectivesonly.Active/InactivePartitionsRequiredPhysicalMemoryDedicatedMemory36GBSharedMemory14GBDedicatedMemoryCost*40GBx$16K/8GB=$80KSharedMemoryCost*16GBx$16K/8GB=$32KSharedMemorySavings*24GBx$16K/8GB=$48K*Basedoncostof8GBMemoryDimmsCreatingLPARwithSharedMemoryCreatingaMemoryPoolbyHMCCreatingaMemoryPoolConfigurationExampleExample:64GBMachineHypervisor 3GB3x8GBdedicated 24GBVIOSLPAR 2GBKeepspare 3GBMemoryPool

32GBHypervisorVIOSDedicated1Dedicated2Dedicated3MemoryPool32GBConfigurationExampleSharedMemoryLPARsCreate6x8GBmemorypoolLPARs48GBofLogicalMemory32GBofPhysicalMemoryHypervisorVIOSDedicated1Dedicated2Dedicated3MemoryPool32GBSharedMemoryLPARsConfigurationExampleDoesthatwork?States:If4LPARsstarted=itfitsIfResidentSize~32GBitworksIfResidentSize>32GB

pagingIfResidentSize>>32GB

paging++HypervisorVIOSDedicated1Dedicated2Dedicated3MemoryPool32GBSharedMemoryLPARs日程IBMPower6虛擬化新技術(shù)(NPIV/AMS)虛擬化高可用解決方案實(shí)時(shí)遷移解決方案IBM虛擬化優(yōu)勢(shì)IBM虛擬化案例分享DualVirtualI/OServerVirtualI/OArchitectureMixofvirtualizedand/orphysicaldevicesMultipleVIOServers*supported

VirtualSCSIVirtualSCSI,FibreChannel,andDVDLogicalandphysicalvolumevirtualdisksMulti-pathandredundancyoptionsBenefitsReducesadapters,I/Odrawers,andportsImprovesspeedtodeployment

VirtualEthernetVLANandlinkaggregationsupportLPARtoLPARvirtualLANsHighavailabilityoptionsAvailableonSystempviatheAdvancedPOWERvirtualizationfeatures.IVMsupportsasingleVirtualI/OServer.AIX5.3,AIX6.1orLinuxPowerVMEthernetBAIX5.3,AIX6.1,orLinuxBB’EthernetB’VirtualI/OServer*VirtualI/OServer*EthernetVirtualEthernetFunctionVirtualEthernetFunctionEthernetVirtualSCSIFunctionVirtualSCSIFunctionFCADynamicHeterogeneousMulti-PathI/ODeliversflexibilityforLivePartitionMobilityenvironmentsProvidesefficientpathredundancytoSANresourcesSupportedbetweenvirtualNPIVandphysicalFibreChannelAdaptersAIX5.3and6.1partitionsPOWER6processor-basedserversPowerHypervisorVIOSFCAdapterVirtualFCAdapterFCAdapterPowerHypervisorVIOSFCAdapterVirtualFCAdapterFCAdapter1)Realadapter2)Virtualadaptertoprepareformobility3)Partitionmovesviavirtualadapter4)RealadapterNPIVNPIVHighAvailabilityVIOSOptionsNetworkInterfaceBackupMustbesetupineachclient.NeedstopingoutsidehostfromeachclienttoinitiateNIBfailover.CanloadshareclientsacrossSEAsbutLPARtoLPARcommunicationswillhappenthroughexternalswitchesVLAN-taggedtrafficisnotsupported.SupportedonlyonAIX.SharedEthernetAdapterFailoverSetupintheVIOS’sonly.OptionalpingisdoneinVIOSonbehalfofallclients.Cannotload-shareclientsbetweentheprimaryandbackupSEA.VLAN-taggedtrafficissupported.SupportedonAIXandLinuxonPOWER.POWER6ServerVIOS1EnetPCIVIOS2EnetPCIPrimaryClientBackupVirtEnetSEASEAPOWER6ServerAIXClientNIBVIOS1EnetPCIVIOS2EnetPCIVirtEnetVirtEnetSEASEAHighAvailability–VirtualEthernetOptions(VIOS)VIOClientLAVIOSNICNICVIOClientNICVIOSLANICNICNICSwitch(s)Switch(s)VIOClientLAVIOSNICSwitch(s)VIOSNICNICNICVIOClientLAVIOSLANICNICSwitch(s)VIOSLANICNICNICNICNIBNIBNote:SomedetailshavebeenomittedtosimplifythediagramsVIOClientNICVIOSNICSwitch(s)VIOSNICSEASEAVIOClientNICVIOSNICSwitch(s)VIOSNICSEASEANICNICNetworkInterfaceBa

溫馨提示

  • 1. 本站所有資源如無特殊說明,都需要本地電腦安裝OFFICE2007和PDF閱讀器。圖紙軟件為CAD,CAXA,PROE,UG,SolidWorks等.壓縮文件請(qǐng)下載最新的WinRAR軟件解壓。
  • 2. 本站的文檔不包含任何第三方提供的附件圖紙等,如果需要附件,請(qǐng)聯(lián)系上傳者。文件的所有權(quán)益歸上傳用戶所有。
  • 3. 本站RAR壓縮包中若帶圖紙,網(wǎng)頁(yè)內(nèi)容里面會(huì)有圖紙預(yù)覽,若沒有圖紙預(yù)覽就沒有圖紙。
  • 4. 未經(jīng)權(quán)益所有人同意不得將文件中的內(nèi)容挪作商業(yè)或盈利用途。
  • 5. 人人文庫(kù)網(wǎng)僅提供信息存儲(chǔ)空間,僅對(duì)用戶上傳內(nèi)容的表現(xiàn)方式做保護(hù)處理,對(duì)用戶上傳分享的文檔內(nèi)容本身不做任何修改或編輯,并不能對(duì)任何下載內(nèi)容負(fù)責(zé)。
  • 6. 下載文件中如有侵權(quán)或不適當(dāng)內(nèi)容,請(qǐng)與我們聯(lián)系,我們立即糾正。
  • 7. 本站不保證下載資源的準(zhǔn)確性、安全性和完整性, 同時(shí)也不承擔(dān)用戶因使用這些下載資源對(duì)自己和他人造成任何形式的傷害或損失。

評(píng)論

0/150

提交評(píng)論