Supporting application-tailored grid file system sessions with WSRF-based services

Ming Zhao, Vineet Chadha, Renato J. Figueiredo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

This paper presents novel service-based Grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic Grid file system sessions. A unique aspect of the service is that the sessions it creates can be customised to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service are mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyses the use of the service to support virtual machine based Grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE International Symposium on High Performance Distributed Computing
Pages24-33
Number of pages10
StatePublished - 2005
Externally publishedYes
Event14th IEEE International Symposium on High Performance Distributed Computing, HPDC-14 - Research Triangle Park, NC, United States
Duration: Jul 24 2005Jul 27 2005

Other

Other14th IEEE International Symposium on High Performance Distributed Computing, HPDC-14
CountryUnited States
CityResearch Triangle Park, NC
Period7/24/057/27/05

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Supporting application-tailored grid file system sessions with WSRF-based services'. Together they form a unique fingerprint.

Cite this