Cross-layer optimization for virtual machine resource management

Ming Zhao, Lixi Wang, Yun Lv, Jing Xu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Virtualized systems (e.g., public and private clouds) are playing an increasingly vital role to support the computing of applications from different domains. Existing resource management solutions in such systems typically treat virtual machines (VMs) as black boxes, which presents a hurdle to achieving application-desired Quality of Service (QoS). This paper advocates the cooperation between VM host- and guest-layer schedulers for optimizing the resource management and application performance. It presents an approach to such cross-layer optimization by enabling the host-layer scheduler to feedback resource allocation decisions and adapt guest-layer application configurations. As case studies, the proposed approach is applied to virtualized databases and map services which have challenging dynamic and complex resource demands as well as sophisticated configurations. Specifically, for databases, the proposed approach adapts query executions by tuning the cost model parameters according to the available storage bandwidth and memory capacity. For map services, it adapts the quality of returned map imagery in order to meet the response time target as the workload intensity and available network bandwidth change over time. A prototype of the proposed approach is implemented on Xen and Hyper-V VMs, and evaluated using a TPC-H based database workload and a TerraFly-based map service workload. The results show that with the proposed host-to-guest application adaptation, the TPC-H workload improves its performance by 33.5%, and the TerraFly workload improves the map imagery quality by 40% and always meets its response time target, compared to the schemes without adaptation.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages90-98
Number of pages9
ISBN (Electronic)9781538650080
DOIs
StatePublished - May 16 2018
Event2018 IEEE International Conference on Cloud Engineering, IC2E 2018 - Orlando, United States
Duration: Apr 17 2018Apr 20 2018

Other

Other2018 IEEE International Conference on Cloud Engineering, IC2E 2018
CountryUnited States
CityOrlando
Period4/17/184/20/18

Fingerprint

Bandwidth
Resource allocation
Quality of service
Tuning
Virtual machine
Feedback
Data storage equipment
Costs

Keywords

  • Cross-layer optimization
  • Resource management
  • Virtual machine

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture

Cite this

Zhao, M., Wang, L., Lv, Y., & Xu, J. (2018). Cross-layer optimization for virtual machine resource management. In Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018 (pp. 90-98). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IC2E.2018.00031

Cross-layer optimization for virtual machine resource management. / Zhao, Ming; Wang, Lixi; Lv, Yun; Xu, Jing.

Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 90-98.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhao, M, Wang, L, Lv, Y & Xu, J 2018, Cross-layer optimization for virtual machine resource management. in Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018. Institute of Electrical and Electronics Engineers Inc., pp. 90-98, 2018 IEEE International Conference on Cloud Engineering, IC2E 2018, Orlando, United States, 4/17/18. https://doi.org/10.1109/IC2E.2018.00031
Zhao M, Wang L, Lv Y, Xu J. Cross-layer optimization for virtual machine resource management. In Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 90-98 https://doi.org/10.1109/IC2E.2018.00031
Zhao, Ming ; Wang, Lixi ; Lv, Yun ; Xu, Jing. / Cross-layer optimization for virtual machine resource management. Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 90-98
@inproceedings{62ff01899f8c463697e13f226852557c,
title = "Cross-layer optimization for virtual machine resource management",
abstract = "Virtualized systems (e.g., public and private clouds) are playing an increasingly vital role to support the computing of applications from different domains. Existing resource management solutions in such systems typically treat virtual machines (VMs) as black boxes, which presents a hurdle to achieving application-desired Quality of Service (QoS). This paper advocates the cooperation between VM host- and guest-layer schedulers for optimizing the resource management and application performance. It presents an approach to such cross-layer optimization by enabling the host-layer scheduler to feedback resource allocation decisions and adapt guest-layer application configurations. As case studies, the proposed approach is applied to virtualized databases and map services which have challenging dynamic and complex resource demands as well as sophisticated configurations. Specifically, for databases, the proposed approach adapts query executions by tuning the cost model parameters according to the available storage bandwidth and memory capacity. For map services, it adapts the quality of returned map imagery in order to meet the response time target as the workload intensity and available network bandwidth change over time. A prototype of the proposed approach is implemented on Xen and Hyper-V VMs, and evaluated using a TPC-H based database workload and a TerraFly-based map service workload. The results show that with the proposed host-to-guest application adaptation, the TPC-H workload improves its performance by 33.5{\%}, and the TerraFly workload improves the map imagery quality by 40{\%} and always meets its response time target, compared to the schemes without adaptation.",
keywords = "Cross-layer optimization, Resource management, Virtual machine",
author = "Ming Zhao and Lixi Wang and Yun Lv and Jing Xu",
year = "2018",
month = "5",
day = "16",
doi = "10.1109/IC2E.2018.00031",
language = "English (US)",
pages = "90--98",
booktitle = "Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Cross-layer optimization for virtual machine resource management

AU - Zhao, Ming

AU - Wang, Lixi

AU - Lv, Yun

AU - Xu, Jing

PY - 2018/5/16

Y1 - 2018/5/16

N2 - Virtualized systems (e.g., public and private clouds) are playing an increasingly vital role to support the computing of applications from different domains. Existing resource management solutions in such systems typically treat virtual machines (VMs) as black boxes, which presents a hurdle to achieving application-desired Quality of Service (QoS). This paper advocates the cooperation between VM host- and guest-layer schedulers for optimizing the resource management and application performance. It presents an approach to such cross-layer optimization by enabling the host-layer scheduler to feedback resource allocation decisions and adapt guest-layer application configurations. As case studies, the proposed approach is applied to virtualized databases and map services which have challenging dynamic and complex resource demands as well as sophisticated configurations. Specifically, for databases, the proposed approach adapts query executions by tuning the cost model parameters according to the available storage bandwidth and memory capacity. For map services, it adapts the quality of returned map imagery in order to meet the response time target as the workload intensity and available network bandwidth change over time. A prototype of the proposed approach is implemented on Xen and Hyper-V VMs, and evaluated using a TPC-H based database workload and a TerraFly-based map service workload. The results show that with the proposed host-to-guest application adaptation, the TPC-H workload improves its performance by 33.5%, and the TerraFly workload improves the map imagery quality by 40% and always meets its response time target, compared to the schemes without adaptation.

AB - Virtualized systems (e.g., public and private clouds) are playing an increasingly vital role to support the computing of applications from different domains. Existing resource management solutions in such systems typically treat virtual machines (VMs) as black boxes, which presents a hurdle to achieving application-desired Quality of Service (QoS). This paper advocates the cooperation between VM host- and guest-layer schedulers for optimizing the resource management and application performance. It presents an approach to such cross-layer optimization by enabling the host-layer scheduler to feedback resource allocation decisions and adapt guest-layer application configurations. As case studies, the proposed approach is applied to virtualized databases and map services which have challenging dynamic and complex resource demands as well as sophisticated configurations. Specifically, for databases, the proposed approach adapts query executions by tuning the cost model parameters according to the available storage bandwidth and memory capacity. For map services, it adapts the quality of returned map imagery in order to meet the response time target as the workload intensity and available network bandwidth change over time. A prototype of the proposed approach is implemented on Xen and Hyper-V VMs, and evaluated using a TPC-H based database workload and a TerraFly-based map service workload. The results show that with the proposed host-to-guest application adaptation, the TPC-H workload improves its performance by 33.5%, and the TerraFly workload improves the map imagery quality by 40% and always meets its response time target, compared to the schemes without adaptation.

KW - Cross-layer optimization

KW - Resource management

KW - Virtual machine

UR - http://www.scopus.com/inward/record.url?scp=85048338955&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048338955&partnerID=8YFLogxK

U2 - 10.1109/IC2E.2018.00031

DO - 10.1109/IC2E.2018.00031

M3 - Conference contribution

AN - SCOPUS:85048338955

SP - 90

EP - 98

BT - Proceedings - 2018 IEEE International Conference on Cloud Engineering, IC2E 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -