Lustre文件系統(tǒng)

1、基于對象存儲(chǔ)的基于對象存儲(chǔ)的并行文件系統(tǒng)并行文件系統(tǒng)Lustre 2021-10-304國防科技大學(xué)Client File System(CFS)VFSLustre lliteLOV (logical object volume)OSC LMV(logic metadata volume)PortalsPortalsOSC OSC MDS ServerOBD ServerLOVOST ServerMDS Backend（OBD） File System Ext3, Reiserfs，xFS OBD serverObject based Device (OBD) File System Ext3

2、, Reiserfs, xFS, JFS Ext2 Ext3MDSOSC Fig Overview of mudular LusterMDC MDC MDC MDC Lock serverOSC OSC OSC Lock ServerOSTLustre ClientMeta-data ServerMDSOST 1OST 2OST 3OSC 3File meta-dataInode A (obj1, obj2)File open requestWrite (obj 1)Write (obj 2)OSC1MDCLinux VFSLustre client FSLOVOdd blocks, even

3、 blocksAchieve parallelBandwidth to allOSTs數(shù)據(jù)數(shù)據(jù).塊號塊號數(shù)據(jù)數(shù)據(jù)數(shù)據(jù)數(shù)據(jù).塊號、長度塊號、長度塊分配塊分配分配器嘗試分配順序塊分配器嘗試分配順序塊如如Ext2Ext2一級索引一級索引二級索引二級索引三級索引三級索引范圍范圍(extent)(extent)分配分配基于連續(xù)快分配基于連續(xù)快分配, ,描述描述: : 邏輯偏移邏輯偏移/ /長度長度/ /物理偏移三元物理偏移三元組組 B+B+樹樹如：如：VxFS, JFS, reiserfs, xFSVxFS, JFS, reiserfs, xFS多數(shù)據(jù)塊多數(shù)據(jù)塊。OST1。Obj AObj BObj C

4、OST2OST0File Datastripesize: 1MStripecount: 3size create timeextent attribute: .Object id: ALocation infoObject id:BLocation infoObject AObject BMDS:File metadataOST0OST1File data.基于對象分配基于對象分配LAO1EALAO2LAO3.OST1OST2OST3objectLAOiLayout Object鎖模式的兼容性鎖模式的兼容性 Lock1 CRGranted QueueResourceConverting Que

5、ueWaiting QueueGranted QueueResourceConverting QueueWaiting QueueGranted QueueResourceConverting QueueWaiting QueueLock2 CRLock1 CRLock2 CWLock3 PWLock1 CRLock3 CWLock2CR-EXFile ServerLustre ClientLustre ClientlookupLustre_createMDSlock moduleMds_create exercisethe intentlookup intent createlookupcreatea) Lustre create with intent locklookupcreatelock modulecreate