Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


osu1095696917.pdf (883.32 KB)

ETD Abstract Container

Abstract Header

Communication and memory management in networked storage systems

Wu, Jiesheng
http://rave.ohiolink.edu/etdc/view?acc_num=osu1095696917

Abstract Details

2004, Doctor of Philosophy, Ohio State University, Computer and Information Science.
The advent in both storage architectures and networking technologies has facilitated storage services using networked storage systems. Often, as many researchers and developers are acutely aware of, hardware and architecture developments that purport to improve performance lack synergy with the software systems they were intended to enhance. New developments in both storage architectures and networking technologies have a profound impact on the design and implementation of networked storage software. In this dissertation, we explore the effects of these advances on the development of networked storage software systems. In particular, how these advances influence communication and memory management and how to design new communication and memory management schemes to take advantage of these advances are investigated. This dissertation first focuses on communication and memory management in the transport layer of a cluster file system over InfiniBand to make the most out of InfiniBand benefits. This dissertation then presents an integrated communication buffer and cache management. This integrated management not only eliminates redundant memory copying and multiple buffering which are considered as main performance bottlenecks of networked storage systems in the general-purpose operating systems, but also enables networked storage software to take full advantage of RDMA benefits in emerging network technologies. This dissertation also introduces a buffering scheme to achieve efficient exclusive caching in multi-level cache hierarchy which is often formed in networked storage systems, which makes better use of memory resources in different cache levels. The main conclusion of this dissertation is that using innovative methods to manage communication and memory can significantly improve performance and scalability of a networked storage system. To achieve this requires studying and taking advantage of the new features in the emerging networking technologies and storage architectures, understanding new issues and performance bottlenecks, investigating different approaches, and evaluating various tradeoffs.
Dhabaleswar Panda (Advisor)
Computer Science
storage system; file system; cluster system; InfniBand Architecture; high performance interconnects; high performance computing

Recommended Citations

Citations

  • Wu, J. (2004). Communication and memory management in networked storage systems [Doctoral dissertation, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1095696917

    APA Style (7th edition)

  • Wu, Jiesheng. Communication and memory management in networked storage systems. 2004. Ohio State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1095696917.

    MLA Style (8th edition)

  • Wu, Jiesheng. "Communication and memory management in networked storage systems." Doctoral dissertation, Ohio State University, 2004. http://rave.ohiolink.edu/etdc/view?acc_num=osu1095696917

    Chicago Manual of Style (17th edition)

osu1095696917
813
© 2004, all rights reserved.
This open access ETD is published by The Ohio State University and OhioLINK.