Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


osu1313493741.pdf (497.96 KB)

ETD Abstract Container

Abstract Header

Distributed Metadata Management for Parallel FileSystems

MESHRAM, VILOBH MAHADEO
http://rave.ohiolink.edu/etdc/view?acc_num=osu1313493741

Abstract Details

2011, Master of Science, Ohio State University, Computer Science and Engineering.
Much of the research in storage systems has been focused on improving the scale and performance of the data-access throughput that read and write large amounts of file data. Parallel file systems do a good job of scaling large file access bandwidth by striping or sharing I/O resources across many servers or disks. However, the same cannot be said about scaling file metadata operation rates. Most existing parallel filesystems choose to concentrate all the metadata processing load on a single server. This centralized processing can guarantee correctness, but it severely hampers scalability. This downside is becoming more and more unacceptable as metadata throughput is critical for large scale applications. Distributing metadata processing load is critical to improve metadata scalability when handling huge number of client nodes. However, in such a distributed scenario, a solution to speed up metadata operations has to address two challenges simultaneously, namely scalability and reliability. We propose two approaches to solve the challenges mentioned above for metadata management in parallel filesystems with a focus towards reliability and scalability aspects. As demonstrated by experiments, the approach to solve the problem of distributed metadata management achieves significant improvements over native parallel filesystems by large margin for all the major metadata operations. With 256 client processes, our approach to solve the problem of distributed metadata management outperforms Lustre and PVFS2 by a factor of 1.9 and 23, respectively, to create directories. With respect to stat() operation on files, our approach is 1.3 and 3.0 times faster than Lustre and PVFS.
DHABALESWAR PANDA, Dr. (Advisor)
P SADAYAPPAN, Dr. (Committee Member)
82 p.
Computer Engineering; Computer Science
Filesystems; Metadata Management

Recommended Citations

Citations

  • MESHRAM, V. M. (2011). Distributed Metadata Management for Parallel FileSystems [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1313493741

    APA Style (7th edition)

  • MESHRAM, VILOBH. Distributed Metadata Management for Parallel FileSystems. 2011. Ohio State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1313493741.

    MLA Style (8th edition)

  • MESHRAM, VILOBH. "Distributed Metadata Management for Parallel FileSystems." Master's thesis, Ohio State University, 2011. http://rave.ohiolink.edu/etdc/view?acc_num=osu1313493741

    Chicago Manual of Style (17th edition)

osu1313493741
1,972
© 2011, all rights reserved.
This open access ETD is published by The Ohio State University and OhioLINK.