Abstract
Many high-end computing (HEC) centers and commercial data centers adopt parallel file systems (PFSs) as their storage solutions. As the number of applications concurrently accessing a PFS grows in both quantity and variety, it is expected that scheduling algorithms for data access will play an increasingly important role in PFS service quality. However, it is costly and disruptive to thoroughly research scheduling mechanisms in deployed peta- or exascale systems, compounded by the complexity in scheduling policy implementation and experimental data gathering. While a few parallel file system simulation frameworks have been proposed (e.g., [1,2]), their goals have not been in the scheduling algorithm evaluation. In this paper, we propose PFSsim, a simulator designed for the purpose of evaluating I/O scheduling algorithms in PFS. PFSsim is a trace-driven simulator based on the network simulation framework OMNeT++ [23] and the disk system simulator DiskSim [21]. A flexible scheduler module is provided for scheduling algorithm deployment, and the system characteristics are highly configurable. We have simulated PVFS2 on PFSsim, and the experimental results show that PFSsim is capable of simulating the system characteristics and showing the performance of the scheduling algorithms.
Original language | English (US) |
---|---|
Title of host publication | 2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011 |
State | Published - 2011 |
Externally published | Yes |
Event | 2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011 - Denver, CO, United States Duration: May 25 2011 → May 25 2011 |
Other
Other | 2011 IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI 2011 |
---|---|
Country/Territory | United States |
City | Denver, CO |
Period | 5/25/11 → 5/25/11 |
ASJC Scopus subject areas
- Hardware and Architecture