Using lightweight virtual machines to run high performance computing applications: The case of the weather research and forecasting model

Hector A. Duran-Limon, Luis A. Silva-Bañuelos, Victor H. Tellez-Valdez, Nikos Parlavantzas, Ming Zhao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

There are many scientific applications that have high performance computing demands. Such demands are traditionally supported by cluster-or Grid-based systems. Cloud computing, which has experienced a tremendous growth, emerged as an approach to provide on-demand access to computing resources. The cloud computing paradigm offers a number of advantages over other distributed platforms. For example, the access to resources is flexible and cost-effective since it is not necessary to invest a large amount of money on a computing infrastructure nor pay salaries for maintenance functions. Therefore, the possibility of using cloud computing for running high performance computing applications is attractive. However, it has been shown elsewhere that current cloud computing platforms are not suitable for running this kind of applications since the performance offered is very poor. The reason is mainly the overhead from virtualisation which is extensively used by most cloud computing platforms as a means to optimise resource usage. In this paper, we present a lightweight virtualisation approach applied to WRF, a challenging communication-intensive, high performance computing application. Our experimental results show that lightweight virtualisation imposes about 5% overhead and it substantially outperforms traditional heavy-weight virtualisation such as VMware.

Original languageEnglish (US)
Title of host publicationProceedings - 2011 4th IEEE International Conference on Utility and Cloud Computing, UCC 2011
Pages146-153
Number of pages8
DOIs
StatePublished - 2011
Externally publishedYes
Event4th IEEE/ACM International Conference on Cloud and Utility Computing, UCC 2011 - Melbourne, VIC, Australia
Duration: Dec 5 2011Dec 8 2011

Publication series

NameProceedings - 2011 4th IEEE International Conference on Utility and Cloud Computing, UCC 2011

Other

Other4th IEEE/ACM International Conference on Cloud and Utility Computing, UCC 2011
CountryAustralia
CityMelbourne, VIC
Period12/5/1112/8/11

Keywords

  • cloud computing
  • high performance computing
  • lightweight virtual machines
  • virtualisation

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Using lightweight virtual machines to run high performance computing applications: The case of the weather research and forecasting model'. Together they form a unique fingerprint.

  • Cite this

    Duran-Limon, H. A., Silva-Bañuelos, L. A., Tellez-Valdez, V. H., Parlavantzas, N., & Zhao, M. (2011). Using lightweight virtual machines to run high performance computing applications: The case of the weather research and forecasting model. In Proceedings - 2011 4th IEEE International Conference on Utility and Cloud Computing, UCC 2011 (pp. 146-153). [6123492] (Proceedings - 2011 4th IEEE International Conference on Utility and Cloud Computing, UCC 2011). https://doi.org/10.1109/UCC.2011.29