TY - GEN
T1 - Fastest Mixing Markov Chain on a Compact Manifold
AU - Biswal, Shiba
AU - Elamvazhuthi, Karthik
AU - Berman, Spring
N1 - Funding Information:
This work was supported by ONR Young Investigator Award N00014-16-1-2605.
Publisher Copyright:
© 2019 IEEE.
PY - 2019/12
Y1 - 2019/12
N2 - In this paper, we address the problem of optimizing the convergence rate of a discrete-time Markov chain (DTMC), which evolves on a compact smooth connected manifold without boundary, to a specified target stationary distribution. This problem has been previously solved for a DTMC on a finite graph that converges to the uniform distribution. We consider arbitrary positive target measures that are supported on the entire state space of the system and are absolutely continuous with respect to the Riemannian volume. Similar to the previous work that addressed DTMCs on finite graphs, we pose the optimization problem in terms of maximizing the spectral gap of the operator that pushes forward measures, also known as the forward operator. Prior to formulating the optimization problem, we prove the existence of a forward operator that can stabilize the class of measures that we consider. In addition, we prove the existence of an optimal solution to our problem. The optimization problem admits an exact solution in the case where the manifold is a Lie group and the target measure is uniform. Lastly, we develop a numerical scheme for solving the optimization problem and validate our approach on a simulated system that evolves on a torus in{\mathbb{R}^3}
AB - In this paper, we address the problem of optimizing the convergence rate of a discrete-time Markov chain (DTMC), which evolves on a compact smooth connected manifold without boundary, to a specified target stationary distribution. This problem has been previously solved for a DTMC on a finite graph that converges to the uniform distribution. We consider arbitrary positive target measures that are supported on the entire state space of the system and are absolutely continuous with respect to the Riemannian volume. Similar to the previous work that addressed DTMCs on finite graphs, we pose the optimization problem in terms of maximizing the spectral gap of the operator that pushes forward measures, also known as the forward operator. Prior to formulating the optimization problem, we prove the existence of a forward operator that can stabilize the class of measures that we consider. In addition, we prove the existence of an optimal solution to our problem. The optimization problem admits an exact solution in the case where the manifold is a Lie group and the target measure is uniform. Lastly, we develop a numerical scheme for solving the optimization problem and validate our approach on a simulated system that evolves on a torus in{\mathbb{R}^3}
UR - http://www.scopus.com/inward/record.url?scp=85082459923&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85082459923&partnerID=8YFLogxK
U2 - 10.1109/CDC40024.2019.9029224
DO - 10.1109/CDC40024.2019.9029224
M3 - Conference contribution
AN - SCOPUS:85082459923
T3 - Proceedings of the IEEE Conference on Decision and Control
SP - 547
EP - 554
BT - 2019 IEEE 58th Conference on Decision and Control, CDC 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 58th IEEE Conference on Decision and Control, CDC 2019
Y2 - 11 December 2019 through 13 December 2019
ER -