DrSVM: Distributed random projection algorithms for SVMs

Soomin Lee, Angelia Nedic

Research output: Contribution to journalConference article

4 Scopus citations

Abstract

We present distributed random projected gradient algorithms for Support Vector Machines (SVMs) that can be used by multiple agents connected over a time-varying network. The goal is for the agents to cooperatively find the same maximum margin hyperplane. In the primal SVM formulation, the objective function can be represented as a sum of convex functions and the constraint set is an intersection of multiple halfspaces. Each agent minimizes a local objective subject to a local constraint set. It maintains its own estimate sequence and communicates with its neighbors. More specifically, each agent calculates weighted averages of the received estimates and its own estimate, adjust the estimate by using gradient information of its local objective function and project onto a subset of its local constraint set. At each iteration, an agent considers only one halfspace since projection onto a single halfspace is easy. We also consider the convergence behavior of the algorithms and prove that all the estimates of agents converge to the same limit point in the optimal set.

Original languageEnglish (US)
Article number6425875
Pages (from-to)5286-5291
Number of pages6
JournalProceedings of the IEEE Conference on Decision and Control
DOIs
StatePublished - Dec 1 2012
Externally publishedYes
Event51st IEEE Conference on Decision and Control, CDC 2012 - Maui, HI, United States
Duration: Dec 10 2012Dec 13 2012

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Modeling and Simulation
  • Control and Optimization

Fingerprint Dive into the research topics of 'DrSVM: Distributed random projection algorithms for SVMs'. Together they form a unique fingerprint.

  • Cite this