A tutorial on distributed (non-Bayesian) learning

Problem, algorithms and results

Angelia Nedich, Alex Olshevsky, Cesar A. Uribe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic solutions for the case of finitely many hypotheses. The original centralized problem is discussed at first, and then followed by a generalization to the distributed setting. The results on convergence and convergence rate are presented for both asymptotic and finite time regimes. Various extensions are discussed such as those dealing with directed time-varying networks, Nesterov's acceleration technique and a continuum sets of hypothesis.

Original languageEnglish (US)
Title of host publication2016 IEEE 55th Conference on Decision and Control, CDC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6795-6801
Number of pages7
ISBN (Electronic)9781509018376
DOIs
StatePublished - Dec 27 2016
Event55th IEEE Conference on Decision and Control, CDC 2016 - Las Vegas, United States
Duration: Dec 12 2016Dec 14 2016

Other

Other55th IEEE Conference on Decision and Control, CDC 2016
CountryUnited States
CityLas Vegas
Period12/12/1612/14/16

Fingerprint

Time varying networks
Social Learning
Convergence Rate
Time-varying
Continuum
Learning
Tutorial

ASJC Scopus subject areas

  • Artificial Intelligence
  • Decision Sciences (miscellaneous)
  • Control and Optimization

Cite this

Nedich, A., Olshevsky, A., & Uribe, C. A. (2016). A tutorial on distributed (non-Bayesian) learning: Problem, algorithms and results. In 2016 IEEE 55th Conference on Decision and Control, CDC 2016 (pp. 6795-6801). [7799315] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CDC.2016.7799315

A tutorial on distributed (non-Bayesian) learning : Problem, algorithms and results. / Nedich, Angelia; Olshevsky, Alex; Uribe, Cesar A.

2016 IEEE 55th Conference on Decision and Control, CDC 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 6795-6801 7799315.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nedich, A, Olshevsky, A & Uribe, CA 2016, A tutorial on distributed (non-Bayesian) learning: Problem, algorithms and results. in 2016 IEEE 55th Conference on Decision and Control, CDC 2016., 7799315, Institute of Electrical and Electronics Engineers Inc., pp. 6795-6801, 55th IEEE Conference on Decision and Control, CDC 2016, Las Vegas, United States, 12/12/16. https://doi.org/10.1109/CDC.2016.7799315
Nedich A, Olshevsky A, Uribe CA. A tutorial on distributed (non-Bayesian) learning: Problem, algorithms and results. In 2016 IEEE 55th Conference on Decision and Control, CDC 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 6795-6801. 7799315 https://doi.org/10.1109/CDC.2016.7799315
Nedich, Angelia ; Olshevsky, Alex ; Uribe, Cesar A. / A tutorial on distributed (non-Bayesian) learning : Problem, algorithms and results. 2016 IEEE 55th Conference on Decision and Control, CDC 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 6795-6801
@inproceedings{4ad835a5370e40a6a2f9759d00f478dd,
title = "A tutorial on distributed (non-Bayesian) learning: Problem, algorithms and results",
abstract = "We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic solutions for the case of finitely many hypotheses. The original centralized problem is discussed at first, and then followed by a generalization to the distributed setting. The results on convergence and convergence rate are presented for both asymptotic and finite time regimes. Various extensions are discussed such as those dealing with directed time-varying networks, Nesterov's acceleration technique and a continuum sets of hypothesis.",
author = "Angelia Nedich and Alex Olshevsky and Uribe, {Cesar A.}",
year = "2016",
month = "12",
day = "27",
doi = "10.1109/CDC.2016.7799315",
language = "English (US)",
pages = "6795--6801",
booktitle = "2016 IEEE 55th Conference on Decision and Control, CDC 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

TY - GEN

T1 - A tutorial on distributed (non-Bayesian) learning

T2 - Problem, algorithms and results

AU - Nedich, Angelia

AU - Olshevsky, Alex

AU - Uribe, Cesar A.

PY - 2016/12/27

Y1 - 2016/12/27

N2 - We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic solutions for the case of finitely many hypotheses. The original centralized problem is discussed at first, and then followed by a generalization to the distributed setting. The results on convergence and convergence rate are presented for both asymptotic and finite time regimes. Various extensions are discussed such as those dealing with directed time-varying networks, Nesterov's acceleration technique and a continuum sets of hypothesis.

AB - We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic solutions for the case of finitely many hypotheses. The original centralized problem is discussed at first, and then followed by a generalization to the distributed setting. The results on convergence and convergence rate are presented for both asymptotic and finite time regimes. Various extensions are discussed such as those dealing with directed time-varying networks, Nesterov's acceleration technique and a continuum sets of hypothesis.

UR - http://www.scopus.com/inward/record.url?scp=85010815562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85010815562&partnerID=8YFLogxK

U2 - 10.1109/CDC.2016.7799315

DO - 10.1109/CDC.2016.7799315

M3 - Conference contribution

SP - 6795

EP - 6801

BT - 2016 IEEE 55th Conference on Decision and Control, CDC 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -