On the design and implementation of a simulator for parallel file system research

Yonggang Liu, Renato Figueiredo, Yiqi Xu, Ming Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Due to the popularity and importance of Parallel File Systems (PFSs) in modern High Performance Computing (HPC) centers, PFS designs and I/O optimizations are active research topics. However, the research process is often time-consuming and faces cost and complexity challenges in deploying experiments in real HPC systems. This paper describes PFSsim, a trace-driven simulator of distributed storage systems that allows the evaluation of PFS designs, I/O schedulers, network structures, and workloads. PFSsim differentiates itself from related work in that it provides a powerful platform featuring a modular design with high flexibility in the modeling of subsystems including the network, clients, data servers and I/O schedulers. It does so by designing the simulator to capture abstractions found in common PFSs. PFSsim also exposes script-based interfaces for detailed configurations. Experiments and validation against real systems considering sub-modules and the entire simulator show that PFSsim is capable of simulating a representative PFS (PVFS2) and of modeling different I/O scheduler algorithms with good fidelity. In addition, the simulation speed is also shown to be acceptable.

Original languageEnglish (US)
Title of host publication2013 IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013
DOIs
StatePublished - Sep 2 2013
Event2013 IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013 - Long Beach, CA, United States
Duration: May 6 2013May 10 2013

Publication series

NameIEEE Symposium on Mass Storage Systems and Technologies
ISSN (Print)2160-1968

Other

Other2013 IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013
CountryUnited States
CityLong Beach, CA
Period5/6/135/10/13

    Fingerprint

Keywords

  • I/O scheduling
  • parallel file system
  • simulation

ASJC Scopus subject areas

  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this

Liu, Y., Figueiredo, R., Xu, Y., & Zhao, M. (2013). On the design and implementation of a simulator for parallel file system research. In 2013 IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013 [6558438] (IEEE Symposium on Mass Storage Systems and Technologies). https://doi.org/10.1109/MSST.2013.6558438