RTVirt

Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling

Ming Zhao, Jorge Cabrera

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Virtualization enables flexible application delivery and efficient resource consolidation, and is pervasively used to build various virtualized systems including public and private cloud computing systems. Many applications can benefit from computing on virtualized systems, including those that are time sensitive, but it is still challenging for existing virtualized systems to deliver application-desired timeliness. In particular, the lack of awareness between VM host- and guest-level schedulers presents a serious hurdle to achieving strong timeliness guarantees on virtualized systems. This paper presents RTVirt, a new solution to time-sensitive computing on virtualized systems through cross-layer scheduling. It allows the two levels of schedulers on a virtualized system to communicate key scheduling information and coordinate on the scheduling decisions. It enables optimal multiprocessor schedulers to support virtualized time-sensitive applications with strong timeliness guarantees and efficient resource utilization. RTVirt is prototyped on a widely used virtualization framework (Xen) and evaluated with diverse workloads. The results show that it can meet application deadlines (99%) or tail latency requirements (99.9th percentile) nearly perfectly; it can handle large numbers of applications and dynamic changes in their timeliness requirements; and it substantially outperforms the existing solutions in both timeliness and resource utilization.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th EuroSys Conference, EuroSys 2018
PublisherAssociation for Computing Machinery, Inc
Volume2018-January
ISBN (Electronic)9781450355841
DOIs
StatePublished - Apr 23 2018
Event13th EuroSys Conference, EuroSys 2018 - Porto, Portugal
Duration: Apr 23 2018Apr 26 2018

Other

Other13th EuroSys Conference, EuroSys 2018
CountryPortugal
CityPorto
Period4/23/184/26/18

Fingerprint

Program processors
Computer systems
Scheduling
Cloud computing
Consolidation
Virtualization

Keywords

  • Cloud computing
  • Time-sensitive computing
  • Virtualization

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Zhao, M., & Cabrera, J. (2018). RTVirt: Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling. In Proceedings of the 13th EuroSys Conference, EuroSys 2018 (Vol. 2018-January). Association for Computing Machinery, Inc. https://doi.org/10.1145/3190508.3190527

RTVirt : Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling. / Zhao, Ming; Cabrera, Jorge.

Proceedings of the 13th EuroSys Conference, EuroSys 2018. Vol. 2018-January Association for Computing Machinery, Inc, 2018.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Zhao, M & Cabrera, J 2018, RTVirt: Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling. in Proceedings of the 13th EuroSys Conference, EuroSys 2018. vol. 2018-January, Association for Computing Machinery, Inc, 13th EuroSys Conference, EuroSys 2018, Porto, Portugal, 4/23/18. https://doi.org/10.1145/3190508.3190527
Zhao M, Cabrera J. RTVirt: Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling. In Proceedings of the 13th EuroSys Conference, EuroSys 2018. Vol. 2018-January. Association for Computing Machinery, Inc. 2018 https://doi.org/10.1145/3190508.3190527
Zhao, Ming ; Cabrera, Jorge. / RTVirt : Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling. Proceedings of the 13th EuroSys Conference, EuroSys 2018. Vol. 2018-January Association for Computing Machinery, Inc, 2018.
@inproceedings{565264e7d003477ab4ac1d03a2118f17,
title = "RTVirt: Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling",
abstract = "Virtualization enables flexible application delivery and efficient resource consolidation, and is pervasively used to build various virtualized systems including public and private cloud computing systems. Many applications can benefit from computing on virtualized systems, including those that are time sensitive, but it is still challenging for existing virtualized systems to deliver application-desired timeliness. In particular, the lack of awareness between VM host- and guest-level schedulers presents a serious hurdle to achieving strong timeliness guarantees on virtualized systems. This paper presents RTVirt, a new solution to time-sensitive computing on virtualized systems through cross-layer scheduling. It allows the two levels of schedulers on a virtualized system to communicate key scheduling information and coordinate on the scheduling decisions. It enables optimal multiprocessor schedulers to support virtualized time-sensitive applications with strong timeliness guarantees and efficient resource utilization. RTVirt is prototyped on a widely used virtualization framework (Xen) and evaluated with diverse workloads. The results show that it can meet application deadlines (99{\%}) or tail latency requirements (99.9th percentile) nearly perfectly; it can handle large numbers of applications and dynamic changes in their timeliness requirements; and it substantially outperforms the existing solutions in both timeliness and resource utilization.",
keywords = "Cloud computing, Time-sensitive computing, Virtualization",
author = "Ming Zhao and Jorge Cabrera",
year = "2018",
month = "4",
day = "23",
doi = "10.1145/3190508.3190527",
language = "English (US)",
volume = "2018-January",
booktitle = "Proceedings of the 13th EuroSys Conference, EuroSys 2018",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - RTVirt

T2 - Enabling Time-sensitive Computing on Virtualized Systems through Cross-layer CPU Scheduling

AU - Zhao, Ming

AU - Cabrera, Jorge

PY - 2018/4/23

Y1 - 2018/4/23

N2 - Virtualization enables flexible application delivery and efficient resource consolidation, and is pervasively used to build various virtualized systems including public and private cloud computing systems. Many applications can benefit from computing on virtualized systems, including those that are time sensitive, but it is still challenging for existing virtualized systems to deliver application-desired timeliness. In particular, the lack of awareness between VM host- and guest-level schedulers presents a serious hurdle to achieving strong timeliness guarantees on virtualized systems. This paper presents RTVirt, a new solution to time-sensitive computing on virtualized systems through cross-layer scheduling. It allows the two levels of schedulers on a virtualized system to communicate key scheduling information and coordinate on the scheduling decisions. It enables optimal multiprocessor schedulers to support virtualized time-sensitive applications with strong timeliness guarantees and efficient resource utilization. RTVirt is prototyped on a widely used virtualization framework (Xen) and evaluated with diverse workloads. The results show that it can meet application deadlines (99%) or tail latency requirements (99.9th percentile) nearly perfectly; it can handle large numbers of applications and dynamic changes in their timeliness requirements; and it substantially outperforms the existing solutions in both timeliness and resource utilization.

AB - Virtualization enables flexible application delivery and efficient resource consolidation, and is pervasively used to build various virtualized systems including public and private cloud computing systems. Many applications can benefit from computing on virtualized systems, including those that are time sensitive, but it is still challenging for existing virtualized systems to deliver application-desired timeliness. In particular, the lack of awareness between VM host- and guest-level schedulers presents a serious hurdle to achieving strong timeliness guarantees on virtualized systems. This paper presents RTVirt, a new solution to time-sensitive computing on virtualized systems through cross-layer scheduling. It allows the two levels of schedulers on a virtualized system to communicate key scheduling information and coordinate on the scheduling decisions. It enables optimal multiprocessor schedulers to support virtualized time-sensitive applications with strong timeliness guarantees and efficient resource utilization. RTVirt is prototyped on a widely used virtualization framework (Xen) and evaluated with diverse workloads. The results show that it can meet application deadlines (99%) or tail latency requirements (99.9th percentile) nearly perfectly; it can handle large numbers of applications and dynamic changes in their timeliness requirements; and it substantially outperforms the existing solutions in both timeliness and resource utilization.

KW - Cloud computing

KW - Time-sensitive computing

KW - Virtualization

UR - http://www.scopus.com/inward/record.url?scp=85052019794&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85052019794&partnerID=8YFLogxK

U2 - 10.1145/3190508.3190527

DO - 10.1145/3190508.3190527

M3 - Conference contribution

VL - 2018-January

BT - Proceedings of the 13th EuroSys Conference, EuroSys 2018

PB - Association for Computing Machinery, Inc

ER -