Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

Kobi Cohen, Qing Zhao, Anna Scaglione

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

Original languageEnglish (US)
Title of host publicationConference Record - Asilomar Conference on Signals, Systems and Computers
PublisherIEEE Computer Society
Pages1575-1578
Number of pages4
Volume2015-April
ISBN (Print)9781479982974
DOIs
StatePublished - Apr 24 2015
Externally publishedYes
Event48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015 - Pacific Grove, United States
Duration: Nov 2 2014Nov 5 2014

Other

Other48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015
CountryUnited States
CityPacific Grove
Period11/2/1411/5/14

Fingerprint

Chemical activation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing

Cite this

Cohen, K., Zhao, Q., & Scaglione, A. (2015). Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. In Conference Record - Asilomar Conference on Signals, Systems and Computers (Vol. 2015-April, pp. 1575-1578). [7094730] IEEE Computer Society. https://doi.org/10.1109/ACSSC.2014.7094730

Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. / Cohen, Kobi; Zhao, Qing; Scaglione, Anna.

Conference Record - Asilomar Conference on Signals, Systems and Computers. Vol. 2015-April IEEE Computer Society, 2015. p. 1575-1578 7094730.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Cohen, K, Zhao, Q & Scaglione, A 2015, Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. in Conference Record - Asilomar Conference on Signals, Systems and Computers. vol. 2015-April, 7094730, IEEE Computer Society, pp. 1575-1578, 48th Asilomar Conference on Signals, Systems and Computers, ACSSC 2015, Pacific Grove, United States, 11/2/14. https://doi.org/10.1109/ACSSC.2014.7094730
Cohen K, Zhao Q, Scaglione A. Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. In Conference Record - Asilomar Conference on Signals, Systems and Computers. Vol. 2015-April. IEEE Computer Society. 2015. p. 1575-1578. 7094730 https://doi.org/10.1109/ACSSC.2014.7094730
Cohen, Kobi ; Zhao, Qing ; Scaglione, Anna. / Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access. Conference Record - Asilomar Conference on Signals, Systems and Computers. Vol. 2015-April IEEE Computer Society, 2015. pp. 1575-1578
@inproceedings{e41a82f2bb2e4f3bb41a132db01c7682,
title = "Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access",
abstract = "We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.",
author = "Kobi Cohen and Qing Zhao and Anna Scaglione",
year = "2015",
month = "4",
day = "24",
doi = "10.1109/ACSSC.2014.7094730",
language = "English (US)",
isbn = "9781479982974",
volume = "2015-April",
pages = "1575--1578",
booktitle = "Conference Record - Asilomar Conference on Signals, Systems and Computers",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Restless multi-armed bandits under time-varying activation constraints for dynamic spectrum access

AU - Cohen, Kobi

AU - Zhao, Qing

AU - Scaglione, Anna

PY - 2015/4/24

Y1 - 2015/4/24

N2 - We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

AB - We consider the dynamic spectrum access problem where a cognitive user searches for transmission opportunities over a wide spectrum. We formulate the problem as a restless multi-armed bandit (RMAB) problem with a time varying constraint on the set of arms that can be activated at each given time. We consider the case where the channel occupancy dynamics are known, and we focus on establishing sufficient conditions on the optimality of the myopic policy.

UR - http://www.scopus.com/inward/record.url?scp=84940564139&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940564139&partnerID=8YFLogxK

U2 - 10.1109/ACSSC.2014.7094730

DO - 10.1109/ACSSC.2014.7094730

M3 - Conference contribution

SN - 9781479982974

VL - 2015-April

SP - 1575

EP - 1578

BT - Conference Record - Asilomar Conference on Signals, Systems and Computers

PB - IEEE Computer Society

ER -