Supporting application-tailored grid file system sessions with WSRF-based services

Ming Zhao, Vineet Chadha, Renato J. Figueiredo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

This paper presents novel service-based Grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic Grid file system sessions. A unique aspect of the service is that the sessions it creates can be customised to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service are mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyses the use of the service to support virtual machine based Grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE International Symposium on High Performance Distributed Computing
Pages24-33
Number of pages10
StatePublished - 2005
Externally publishedYes
Event14th IEEE International Symposium on High Performance Distributed Computing, HPDC-14 - Research Triangle Park, NC, United States
Duration: Jul 24 2005Jul 27 2005

Other

Other14th IEEE International Symposium on High Performance Distributed Computing, HPDC-14
CountryUnited States
CityResearch Triangle Park, NC
Period7/24/057/27/05

Fingerprint

Data transfer
Middleware
Information management
Servers
Specifications
Recovery
Communication
Experiments
Virtual machine

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Zhao, M., Chadha, V., & Figueiredo, R. J. (2005). Supporting application-tailored grid file system sessions with WSRF-based services. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (pp. 24-33)

Supporting application-tailored grid file system sessions with WSRF-based services. / Zhao, Ming; Chadha, Vineet; Figueiredo, Renato J.

Proceedings of the IEEE International Symposium on High Performance Distributed Computing. 2005. p. 24-33.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhao, M, Chadha, V & Figueiredo, RJ 2005, Supporting application-tailored grid file system sessions with WSRF-based services. in Proceedings of the IEEE International Symposium on High Performance Distributed Computing. pp. 24-33, 14th IEEE International Symposium on High Performance Distributed Computing, HPDC-14, Research Triangle Park, NC, United States, 7/24/05.
Zhao M, Chadha V, Figueiredo RJ. Supporting application-tailored grid file system sessions with WSRF-based services. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing. 2005. p. 24-33
Zhao, Ming ; Chadha, Vineet ; Figueiredo, Renato J. / Supporting application-tailored grid file system sessions with WSRF-based services. Proceedings of the IEEE International Symposium on High Performance Distributed Computing. 2005. pp. 24-33
@inproceedings{1812fc60118b45439ed4fae099bbbcf8,
title = "Supporting application-tailored grid file system sessions with WSRF-based services",
abstract = "This paper presents novel service-based Grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic Grid file system sessions. A unique aspect of the service is that the sessions it creates can be customised to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service are mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyses the use of the service to support virtual machine based Grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).",
author = "Ming Zhao and Vineet Chadha and Figueiredo, {Renato J.}",
year = "2005",
language = "English (US)",
pages = "24--33",
booktitle = "Proceedings of the IEEE International Symposium on High Performance Distributed Computing",

}

TY - GEN

T1 - Supporting application-tailored grid file system sessions with WSRF-based services

AU - Zhao, Ming

AU - Chadha, Vineet

AU - Figueiredo, Renato J.

PY - 2005

Y1 - 2005

N2 - This paper presents novel service-based Grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic Grid file system sessions. A unique aspect of the service is that the sessions it creates can be customised to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service are mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyses the use of the service to support virtual machine based Grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).

AB - This paper presents novel service-based Grid data management middleware that leverages standards defined by WSRF specifications to create and manage dynamic Grid file system sessions. A unique aspect of the service is that the sessions it creates can be customised to address application data transfer needs. Application-tailored configurations enable selection of both performance-related features (block-based partial file transfers and/or whole-file transfers, cache parameters and consistency models) and reliability features (file system copy-on-write checkpointing to aid recovery of client-side failures; replication, autonomous failure detection and data access redirection for server-side failures). These enhancements, in addition to cross-domain user identity mapping and encrypted communication, are implemented via user level proxies managed by the service, requiring no changes to existing kernels. Sessions established using the service are mounted as distributed file systems and can be used transparently by unmodified binary applications. The paper analyses the use of the service to support virtual machine based Grid systems and workflow execution, and also reports on the performance and reliability of service managed wide-area file system sessions with experiments based on scientific applications (NanoMOS/Matlab, CHID, GAUSS and SPECseis).

UR - http://www.scopus.com/inward/record.url?scp=27544513838&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27544513838&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:27544513838

SP - 24

EP - 33

BT - Proceedings of the IEEE International Symposium on High Performance Distributed Computing

ER -