Load Balancing for Interdependent IoT Microservices

Ruozhou Yu, Vishnu Teja Kilari, Guoliang Xue, Dejun Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Advances in virtualization technologies and edge computing have inspired a new paradigm for Internet-of-Things (IoT) application development. By breaking a monolithic application into loosely coupled microservices, great gain can be achieved in performance, flexibility and robustness. In this paper, we study the important problem of load balancing across IoT microservice instances. A key difficulty in this problem is the interdependencies among microservices: the load on a successor microservice instance directly depends on the load distributed from its predecessor microservice instances. We propose a graph-based model for describing the load dependencies among microservices. Based on the model, we first propose a basic formulation for load balancing, which can be solved optimally in polynomial time. The basic model neglects the quality-of-service (QoS) of the IoT application. We then propose a QoS-aware load balancing model, based on a novel abstraction that captures a realization of the application's internal logic. The QoS-aware load balancing problem is NP-hard. We propose a fully polynomial-time approximation scheme for the QoS-aware problem. We show through simulation experiments that our proposed algorithm achieves enhanced QoS compared to heuristic solutions.

Original languageEnglish (US)
Title of host publicationINFOCOM 2019 - IEEE Conference on Computer Communications
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages298-306
Number of pages9
ISBN (Electronic)9781728105154
DOIs
StatePublished - Apr 1 2019
Externally publishedYes
Event2019 IEEE Conference on Computer Communications, INFOCOM 2019 - Paris, France
Duration: Apr 29 2019May 2 2019

Publication series

NameProceedings - IEEE INFOCOM
Volume2019-April
ISSN (Print)0743-166X

Conference

Conference2019 IEEE Conference on Computer Communications, INFOCOM 2019
CountryFrance
CityParis
Period4/29/195/2/19

Fingerprint

Resource allocation
Quality of service
Polynomials
Computational complexity
Internet of things
Experiments

Keywords

  • application graph
  • fully polynomial-time approximation scheme
  • IoT
  • load balancing
  • microservice

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this

Yu, R., Kilari, V. T., Xue, G., & Yang, D. (2019). Load Balancing for Interdependent IoT Microservices. In INFOCOM 2019 - IEEE Conference on Computer Communications (pp. 298-306). [8737450] (Proceedings - IEEE INFOCOM; Vol. 2019-April). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFOCOM.2019.8737450

Load Balancing for Interdependent IoT Microservices. / Yu, Ruozhou; Kilari, Vishnu Teja; Xue, Guoliang; Yang, Dejun.

INFOCOM 2019 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2019. p. 298-306 8737450 (Proceedings - IEEE INFOCOM; Vol. 2019-April).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yu, R, Kilari, VT, Xue, G & Yang, D 2019, Load Balancing for Interdependent IoT Microservices. in INFOCOM 2019 - IEEE Conference on Computer Communications., 8737450, Proceedings - IEEE INFOCOM, vol. 2019-April, Institute of Electrical and Electronics Engineers Inc., pp. 298-306, 2019 IEEE Conference on Computer Communications, INFOCOM 2019, Paris, France, 4/29/19. https://doi.org/10.1109/INFOCOM.2019.8737450
Yu R, Kilari VT, Xue G, Yang D. Load Balancing for Interdependent IoT Microservices. In INFOCOM 2019 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc. 2019. p. 298-306. 8737450. (Proceedings - IEEE INFOCOM). https://doi.org/10.1109/INFOCOM.2019.8737450
Yu, Ruozhou ; Kilari, Vishnu Teja ; Xue, Guoliang ; Yang, Dejun. / Load Balancing for Interdependent IoT Microservices. INFOCOM 2019 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 298-306 (Proceedings - IEEE INFOCOM).
@inproceedings{3f65d2bfc91747f098e12c2b4220a1ef,
title = "Load Balancing for Interdependent IoT Microservices",
abstract = "Advances in virtualization technologies and edge computing have inspired a new paradigm for Internet-of-Things (IoT) application development. By breaking a monolithic application into loosely coupled microservices, great gain can be achieved in performance, flexibility and robustness. In this paper, we study the important problem of load balancing across IoT microservice instances. A key difficulty in this problem is the interdependencies among microservices: the load on a successor microservice instance directly depends on the load distributed from its predecessor microservice instances. We propose a graph-based model for describing the load dependencies among microservices. Based on the model, we first propose a basic formulation for load balancing, which can be solved optimally in polynomial time. The basic model neglects the quality-of-service (QoS) of the IoT application. We then propose a QoS-aware load balancing model, based on a novel abstraction that captures a realization of the application's internal logic. The QoS-aware load balancing problem is NP-hard. We propose a fully polynomial-time approximation scheme for the QoS-aware problem. We show through simulation experiments that our proposed algorithm achieves enhanced QoS compared to heuristic solutions.",
keywords = "application graph, fully polynomial-time approximation scheme, IoT, load balancing, microservice",
author = "Ruozhou Yu and Kilari, {Vishnu Teja} and Guoliang Xue and Dejun Yang",
year = "2019",
month = "4",
day = "1",
doi = "10.1109/INFOCOM.2019.8737450",
language = "English (US)",
series = "Proceedings - IEEE INFOCOM",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "298--306",
booktitle = "INFOCOM 2019 - IEEE Conference on Computer Communications",

}

TY - GEN

T1 - Load Balancing for Interdependent IoT Microservices

AU - Yu, Ruozhou

AU - Kilari, Vishnu Teja

AU - Xue, Guoliang

AU - Yang, Dejun

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Advances in virtualization technologies and edge computing have inspired a new paradigm for Internet-of-Things (IoT) application development. By breaking a monolithic application into loosely coupled microservices, great gain can be achieved in performance, flexibility and robustness. In this paper, we study the important problem of load balancing across IoT microservice instances. A key difficulty in this problem is the interdependencies among microservices: the load on a successor microservice instance directly depends on the load distributed from its predecessor microservice instances. We propose a graph-based model for describing the load dependencies among microservices. Based on the model, we first propose a basic formulation for load balancing, which can be solved optimally in polynomial time. The basic model neglects the quality-of-service (QoS) of the IoT application. We then propose a QoS-aware load balancing model, based on a novel abstraction that captures a realization of the application's internal logic. The QoS-aware load balancing problem is NP-hard. We propose a fully polynomial-time approximation scheme for the QoS-aware problem. We show through simulation experiments that our proposed algorithm achieves enhanced QoS compared to heuristic solutions.

AB - Advances in virtualization technologies and edge computing have inspired a new paradigm for Internet-of-Things (IoT) application development. By breaking a monolithic application into loosely coupled microservices, great gain can be achieved in performance, flexibility and robustness. In this paper, we study the important problem of load balancing across IoT microservice instances. A key difficulty in this problem is the interdependencies among microservices: the load on a successor microservice instance directly depends on the load distributed from its predecessor microservice instances. We propose a graph-based model for describing the load dependencies among microservices. Based on the model, we first propose a basic formulation for load balancing, which can be solved optimally in polynomial time. The basic model neglects the quality-of-service (QoS) of the IoT application. We then propose a QoS-aware load balancing model, based on a novel abstraction that captures a realization of the application's internal logic. The QoS-aware load balancing problem is NP-hard. We propose a fully polynomial-time approximation scheme for the QoS-aware problem. We show through simulation experiments that our proposed algorithm achieves enhanced QoS compared to heuristic solutions.

KW - application graph

KW - fully polynomial-time approximation scheme

KW - IoT

KW - load balancing

KW - microservice

UR - http://www.scopus.com/inward/record.url?scp=85068225941&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068225941&partnerID=8YFLogxK

U2 - 10.1109/INFOCOM.2019.8737450

DO - 10.1109/INFOCOM.2019.8737450

M3 - Conference contribution

T3 - Proceedings - IEEE INFOCOM

SP - 298

EP - 306

BT - INFOCOM 2019 - IEEE Conference on Computer Communications

PB - Institute of Electrical and Electronics Engineers Inc.

ER -