Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games

Farzad Yousefian, Angelia Nedich, Uday V. Shanbhag

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

We consider multi-user optimization problems and Nash games with stochastic convex objectives, instances of which arise in decentralized control problems. The associated equilibrium conditions of both problems can be cast as Cartesian stochastic variational inequality problems with mappings that are strongly monotone but not necessarily Lipschitz continuous. Consequently, most of the currently available stochastic approximation schemes cannot address such problems. First, through a user-specific local smoothing, we derive an approximate map that is shown to be Lipschitz continuous with a prescribed constant. Second, motivated by the need for a robust scheme that can be implemented in a distributed fashion, we develop a distributed self-tuned stochastic approximation scheme (DSSA) that adapts to problem parameters. Importantly, this scheme is provably convergent in an almost-sure sense and displays the optimal rate of convergence in mean squared error, i.e., O(1/k). A locally randomized variant is also provided to ensure that the scheme can contend with stochastic non-Lipschitzian multi-user problems. We conclude with numerics derived from a stochastic Nash-Cournot game.

Original languageEnglish (US)
Article number7258341
Pages (from-to)1753-1766
Number of pages14
JournalIEEE Transactions on Automatic Control
Volume61
Issue number7
DOIs
StatePublished - Jul 1 2016
Externally publishedYes

Fingerprint

Decentralized control

Keywords

  • Self-tuned stepsizes
  • stochastic approximation methods
  • stochastic multi-agent optimization
  • stochastic Nash games

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games. / Yousefian, Farzad; Nedich, Angelia; Shanbhag, Uday V.

In: IEEE Transactions on Automatic Control, Vol. 61, No. 7, 7258341, 01.07.2016, p. 1753-1766.

Research output: Contribution to journalArticle

@article{525c7d3a2bc94b22b9a70a34939e2154,
title = "Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games",
abstract = "We consider multi-user optimization problems and Nash games with stochastic convex objectives, instances of which arise in decentralized control problems. The associated equilibrium conditions of both problems can be cast as Cartesian stochastic variational inequality problems with mappings that are strongly monotone but not necessarily Lipschitz continuous. Consequently, most of the currently available stochastic approximation schemes cannot address such problems. First, through a user-specific local smoothing, we derive an approximate map that is shown to be Lipschitz continuous with a prescribed constant. Second, motivated by the need for a robust scheme that can be implemented in a distributed fashion, we develop a distributed self-tuned stochastic approximation scheme (DSSA) that adapts to problem parameters. Importantly, this scheme is provably convergent in an almost-sure sense and displays the optimal rate of convergence in mean squared error, i.e., O(1/k). A locally randomized variant is also provided to ensure that the scheme can contend with stochastic non-Lipschitzian multi-user problems. We conclude with numerics derived from a stochastic Nash-Cournot game.",
keywords = "Self-tuned stepsizes, stochastic approximation methods, stochastic multi-agent optimization, stochastic Nash games",
author = "Farzad Yousefian and Angelia Nedich and Shanbhag, {Uday V.}",
year = "2016",
month = "7",
day = "1",
doi = "10.1109/TAC.2015.2478124",
language = "English (US)",
volume = "61",
pages = "1753--1766",
journal = "IEEE Transactions on Automatic Control",
issn = "0018-9286",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "7",

}

TY - JOUR

T1 - Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games

AU - Yousefian, Farzad

AU - Nedich, Angelia

AU - Shanbhag, Uday V.

PY - 2016/7/1

Y1 - 2016/7/1

N2 - We consider multi-user optimization problems and Nash games with stochastic convex objectives, instances of which arise in decentralized control problems. The associated equilibrium conditions of both problems can be cast as Cartesian stochastic variational inequality problems with mappings that are strongly monotone but not necessarily Lipschitz continuous. Consequently, most of the currently available stochastic approximation schemes cannot address such problems. First, through a user-specific local smoothing, we derive an approximate map that is shown to be Lipschitz continuous with a prescribed constant. Second, motivated by the need for a robust scheme that can be implemented in a distributed fashion, we develop a distributed self-tuned stochastic approximation scheme (DSSA) that adapts to problem parameters. Importantly, this scheme is provably convergent in an almost-sure sense and displays the optimal rate of convergence in mean squared error, i.e., O(1/k). A locally randomized variant is also provided to ensure that the scheme can contend with stochastic non-Lipschitzian multi-user problems. We conclude with numerics derived from a stochastic Nash-Cournot game.

AB - We consider multi-user optimization problems and Nash games with stochastic convex objectives, instances of which arise in decentralized control problems. The associated equilibrium conditions of both problems can be cast as Cartesian stochastic variational inequality problems with mappings that are strongly monotone but not necessarily Lipschitz continuous. Consequently, most of the currently available stochastic approximation schemes cannot address such problems. First, through a user-specific local smoothing, we derive an approximate map that is shown to be Lipschitz continuous with a prescribed constant. Second, motivated by the need for a robust scheme that can be implemented in a distributed fashion, we develop a distributed self-tuned stochastic approximation scheme (DSSA) that adapts to problem parameters. Importantly, this scheme is provably convergent in an almost-sure sense and displays the optimal rate of convergence in mean squared error, i.e., O(1/k). A locally randomized variant is also provided to ensure that the scheme can contend with stochastic non-Lipschitzian multi-user problems. We conclude with numerics derived from a stochastic Nash-Cournot game.

KW - Self-tuned stepsizes

KW - stochastic approximation methods

KW - stochastic multi-agent optimization

KW - stochastic Nash games

UR - http://www.scopus.com/inward/record.url?scp=84977126633&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84977126633&partnerID=8YFLogxK

U2 - 10.1109/TAC.2015.2478124

DO - 10.1109/TAC.2015.2478124

M3 - Article

AN - SCOPUS:84977126633

VL - 61

SP - 1753

EP - 1766

JO - IEEE Transactions on Automatic Control

JF - IEEE Transactions on Automatic Control

SN - 0018-9286

IS - 7

M1 - 7258341

ER -