Towards simulation of parallel file system scheduling algorithms with PFSsim

Yonggang Liu, Renato Figueiredo, Dulcardo Clavijo, Yiqi Xu, Ming Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

Many high-end computing (HEC) centers and commercial data centers adopt parallel file systems (PFSs) as their storage solutions. As the number of applications concurrently accessing a PFS grows in both quantity and variety, it is expected that scheduling algorithms for data access will play an increasingly important role in PFS service quality. However, it is costly and disruptive to thoroughly research scheduling mechanisms in deployed peta- or exascale systems, compounded by the complexity in scheduling policy implementation and experimental data gathering. While a few parallel file system simulation frameworks have been proposed (e.g., [1,2]), their goals have not been in the scheduling algorithm evaluation. In this paper, we propose PFSsim, a simulator designed for the purpose of evaluating I/O scheduling algorithms in PFS. PFSsim is a trace-driven simulator based on the network simulation framework OMNeT++ [23] and the disk system simulator DiskSim [21]. A flexible scheduler module is provided for scheduling algorithm deployment, and the system characteristics are highly configurable. We have simulated PVFS2 on PFSsim, and the experimental results show that PFSsim is capable of simulating the system characteristics and showing the performance of the scheduling algorithms.

Original languageEnglish (US)
Title of host publication2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011
StatePublished - 2011
Externally publishedYes
Event2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011 - Denver, CO, United States
Duration: May 25 2011May 25 2011

Other

Other2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011
CountryUnited States
CityDenver, CO
Period5/25/115/25/11

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Towards simulation of parallel file system scheduling algorithms with PFSsim'. Together they form a unique fingerprint.

  • Cite this

    Liu, Y., Figueiredo, R., Clavijo, D., Xu, Y., & Zhao, M. (2011). Towards simulation of parallel file system scheduling algorithms with PFSsim. In 2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011