Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds

Venkatraman Balasubramanian, Faisal Zaman, Moayad Aloqaily, Saed Alrabaee, Maria Gorlatova, Martin Reisslein

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10% gain in the rewards earned compared to state-of-the-art strategies.

Original languageEnglish (US)
Title of host publicationINFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages44-49
Number of pages6
ISBN (Electronic)9781728118789
DOIs
StatePublished - Apr 2019
Externally publishedYes
Event2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019 - Paris, France
Duration: Apr 29 2019May 2 2019

Publication series

NameINFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019

Conference

Conference2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019
CountryFrance
CityParis
Period4/29/195/2/19

Fingerprint

Energy management
Reinforcement learning
Mobile devices
Learning algorithms
Energy utilization
Statistics
Reward

Keywords

  • Device Clouds
  • Internet of Things
  • Mobile Edge Computing
  • Reinforcement Learning

ASJC Scopus subject areas

  • Hardware and Architecture
  • Signal Processing
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications

Cite this

Balasubramanian, V., Zaman, F., Aloqaily, M., Alrabaee, S., Gorlatova, M., & Reisslein, M. (2019). Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds. In INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019 (pp. 44-49). [8845263] (INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFCOMW.2019.8845263

Reinforcing the Edge : Autonomous Energy Management for Mobile Device Clouds. / Balasubramanian, Venkatraman; Zaman, Faisal; Aloqaily, Moayad; Alrabaee, Saed; Gorlatova, Maria; Reisslein, Martin.

INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 44-49 8845263 (INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Balasubramanian, V, Zaman, F, Aloqaily, M, Alrabaee, S, Gorlatova, M & Reisslein, M 2019, Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds. in INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019., 8845263, INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019, Institute of Electrical and Electronics Engineers Inc., pp. 44-49, 2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019, Paris, France, 4/29/19. https://doi.org/10.1109/INFCOMW.2019.8845263
Balasubramanian V, Zaman F, Aloqaily M, Alrabaee S, Gorlatova M, Reisslein M. Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds. In INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 44-49. 8845263. (INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019). https://doi.org/10.1109/INFCOMW.2019.8845263
Balasubramanian, Venkatraman ; Zaman, Faisal ; Aloqaily, Moayad ; Alrabaee, Saed ; Gorlatova, Maria ; Reisslein, Martin. / Reinforcing the Edge : Autonomous Energy Management for Mobile Device Clouds. INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 44-49 (INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019).
@inproceedings{f6cee3bb1349459db2f4a1109c85ab39,
title = "Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds",
abstract = "The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10{\%} gain in the rewards earned compared to state-of-the-art strategies.",
keywords = "Device Clouds, Internet of Things, Mobile Edge Computing, Reinforcement Learning",
author = "Venkatraman Balasubramanian and Faisal Zaman and Moayad Aloqaily and Saed Alrabaee and Maria Gorlatova and Martin Reisslein",
year = "2019",
month = "4",
doi = "10.1109/INFCOMW.2019.8845263",
language = "English (US)",
series = "INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "44--49",
booktitle = "INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019",

}

TY - GEN

T1 - Reinforcing the Edge

T2 - Autonomous Energy Management for Mobile Device Clouds

AU - Balasubramanian, Venkatraman

AU - Zaman, Faisal

AU - Aloqaily, Moayad

AU - Alrabaee, Saed

AU - Gorlatova, Maria

AU - Reisslein, Martin

PY - 2019/4

Y1 - 2019/4

N2 - The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10% gain in the rewards earned compared to state-of-the-art strategies.

AB - The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10% gain in the rewards earned compared to state-of-the-art strategies.

KW - Device Clouds

KW - Internet of Things

KW - Mobile Edge Computing

KW - Reinforcement Learning

UR - http://www.scopus.com/inward/record.url?scp=85073253580&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073253580&partnerID=8YFLogxK

U2 - 10.1109/INFCOMW.2019.8845263

DO - 10.1109/INFCOMW.2019.8845263

M3 - Conference contribution

AN - SCOPUS:85073253580

T3 - INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019

SP - 44

EP - 49

BT - INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -