Distributed Policy Synthesis of Multiagent Systems with Graph Temporal Logic Specifications

Murat Cubuktepe, Zhe Xu, Ufuk Topcu

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

We study the distributed synthesis of policies for multiagent systems to perform spatial-temporal tasks. We formalize the synthesis problem as a factored Markov decision process subject to graph temporal logic specifications. The transition function and the task of each agent are functions of the agent itself and its neighboring agents. In this work, we develop another distributed synthesis method, which improves the scalability and runtime by two orders of magnitude compared to our prior work. The synthesis method decomposes the problem into a set of smaller problems, one for each agent by leveraging the structure in the model, and the specifications. We show that the running time of the method is linear in the number of agents. The size of the problem for each agent is exponential only in the number of neighboring agents, which is typically much smaller than the number of agents. We demonstrate the applicability of the method in case studies on disease control, urban security, and search and rescue. The numerical examples show that the method scales to hundreds of agents with hundreds of states per agent and can also handle significantly larger state spaces than our prior work.

Original languageEnglish (US)
Pages (from-to)1799-1810
Number of pages12
JournalIEEE Transactions on Control of Network Systems
Volume8
Issue number4
DOIs
StatePublished - Dec 1 2021
Externally publishedYes

Keywords

  • Cyber-physical systems
  • multi-agent systems
  • networked control systems
  • optimization

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Computer Networks and Communications
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Distributed Policy Synthesis of Multiagent Systems with Graph Temporal Logic Specifications'. Together they form a unique fingerprint.

Cite this