Learning Parallel Markov Chains over Unreliable Wireless Channels

Weichang Wang, Lei Ying

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper studies the problem of communications between aircraft and a control tower for aviation risk monitoring over wireless channels. The control tower needs to monitor the state of each aircraft in real time by receiving reports from the aircraft. Due to limited bandwidth, only a subset of aircraft can communicate with the control tower at the same time. This paper focuses on the problem of optimal scheduling of data transmissions to minimize the risk. We formulate the problem as learning states of parallel Markov chains where each Markov chain represents an aircraft, and the objective is to minimize the information entropy of all the aircraft. We propose an algorithm based on Whittle's index and study the indexability of the problem for both single-state wireless channels and multi-state wireless channels. Our numerical evaluations show that our algorithm improves the accuracy of the estimations compared with the heuristic scheduling methods such as greedy and Round Robin.

Original languageEnglish (US)
Title of host publication2020 54th Annual Conference on Information Sciences and Systems, CISS 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728140841
DOIs
StatePublished - Mar 2020
Event54th Annual Conference on Information Sciences and Systems, CISS 2020 - Princeton, United States
Duration: Mar 18 2020Mar 20 2020

Publication series

Name2020 54th Annual Conference on Information Sciences and Systems, CISS 2020

Conference

Conference54th Annual Conference on Information Sciences and Systems, CISS 2020
CountryUnited States
CityPrinceton
Period3/18/203/20/20

Keywords

  • Multi-state channel
  • Restless Multi-Armed Bandit Problem
  • Whittle's Index

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Learning Parallel Markov Chains over Unreliable Wireless Channels'. Together they form a unique fingerprint.

  • Cite this

    Wang, W., & Ying, L. (2020). Learning Parallel Markov Chains over Unreliable Wireless Channels. In 2020 54th Annual Conference on Information Sciences and Systems, CISS 2020 [9086246] (2020 54th Annual Conference on Information Sciences and Systems, CISS 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CISS48834.2020.1570614323