Online adaptation of controller parameters based on approximate dynamic programming

Wentao Guo, Feng Liu, Jennie Si, Shengwei Mei

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Controller parameter tuning is an integral part of control engineering practice. Existing tuning methods usually start with an accurate mathematical model of the controlled system, which may pose some challenges for practicing engineers dealing with real systems. As such, parameter optimization and adaptation are treated as two independent steps during tuning. To address these issues, we propose a new, online parameterized controller tuning method for a general nonlinear dynamic system. This tuning method is based on direct heuristic dynamic programming (direct HDP), a model-free algorithm in the approximated dynamic programming (ADP) family. By using a Lyapunov stability approach, we provide uniformly ultimately bounded (UUB) results under some mild conditions for controller parameters, the critic neural network weights, and the action neural network weights. Simulation studies based on the benchmark cart-pole system demonstrate adaptability and optimization capabilities of the proposed controller parameter tuning method.

Original languageEnglish (US)
Title of host publicationProceedings of the International Joint Conference on Neural Networks
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages256-262
Number of pages7
ISBN (Print)9781479914845
DOIs
StatePublished - Sep 3 2014
Event2014 International Joint Conference on Neural Networks, IJCNN 2014 - Beijing, China
Duration: Jul 6 2014Jul 11 2014

Other

Other2014 International Joint Conference on Neural Networks, IJCNN 2014
CountryChina
CityBeijing
Period7/6/147/11/14

Fingerprint

Dynamic programming
Tuning
Controllers
Neural networks
Poles
Dynamical systems
Mathematical models
Engineers

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Guo, W., Liu, F., Si, J., & Mei, S. (2014). Online adaptation of controller parameters based on approximate dynamic programming. In Proceedings of the International Joint Conference on Neural Networks (pp. 256-262). [6889869] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IJCNN.2014.6889869

Online adaptation of controller parameters based on approximate dynamic programming. / Guo, Wentao; Liu, Feng; Si, Jennie; Mei, Shengwei.

Proceedings of the International Joint Conference on Neural Networks. Institute of Electrical and Electronics Engineers Inc., 2014. p. 256-262 6889869.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Guo, W, Liu, F, Si, J & Mei, S 2014, Online adaptation of controller parameters based on approximate dynamic programming. in Proceedings of the International Joint Conference on Neural Networks., 6889869, Institute of Electrical and Electronics Engineers Inc., pp. 256-262, 2014 International Joint Conference on Neural Networks, IJCNN 2014, Beijing, China, 7/6/14. https://doi.org/10.1109/IJCNN.2014.6889869
Guo W, Liu F, Si J, Mei S. Online adaptation of controller parameters based on approximate dynamic programming. In Proceedings of the International Joint Conference on Neural Networks. Institute of Electrical and Electronics Engineers Inc. 2014. p. 256-262. 6889869 https://doi.org/10.1109/IJCNN.2014.6889869
Guo, Wentao ; Liu, Feng ; Si, Jennie ; Mei, Shengwei. / Online adaptation of controller parameters based on approximate dynamic programming. Proceedings of the International Joint Conference on Neural Networks. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 256-262
@inproceedings{3a690b55451442c69dc8ad060f9850ca,
title = "Online adaptation of controller parameters based on approximate dynamic programming",
abstract = "Controller parameter tuning is an integral part of control engineering practice. Existing tuning methods usually start with an accurate mathematical model of the controlled system, which may pose some challenges for practicing engineers dealing with real systems. As such, parameter optimization and adaptation are treated as two independent steps during tuning. To address these issues, we propose a new, online parameterized controller tuning method for a general nonlinear dynamic system. This tuning method is based on direct heuristic dynamic programming (direct HDP), a model-free algorithm in the approximated dynamic programming (ADP) family. By using a Lyapunov stability approach, we provide uniformly ultimately bounded (UUB) results under some mild conditions for controller parameters, the critic neural network weights, and the action neural network weights. Simulation studies based on the benchmark cart-pole system demonstrate adaptability and optimization capabilities of the proposed controller parameter tuning method.",
author = "Wentao Guo and Feng Liu and Jennie Si and Shengwei Mei",
year = "2014",
month = "9",
day = "3",
doi = "10.1109/IJCNN.2014.6889869",
language = "English (US)",
isbn = "9781479914845",
pages = "256--262",
booktitle = "Proceedings of the International Joint Conference on Neural Networks",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Online adaptation of controller parameters based on approximate dynamic programming

AU - Guo, Wentao

AU - Liu, Feng

AU - Si, Jennie

AU - Mei, Shengwei

PY - 2014/9/3

Y1 - 2014/9/3

N2 - Controller parameter tuning is an integral part of control engineering practice. Existing tuning methods usually start with an accurate mathematical model of the controlled system, which may pose some challenges for practicing engineers dealing with real systems. As such, parameter optimization and adaptation are treated as two independent steps during tuning. To address these issues, we propose a new, online parameterized controller tuning method for a general nonlinear dynamic system. This tuning method is based on direct heuristic dynamic programming (direct HDP), a model-free algorithm in the approximated dynamic programming (ADP) family. By using a Lyapunov stability approach, we provide uniformly ultimately bounded (UUB) results under some mild conditions for controller parameters, the critic neural network weights, and the action neural network weights. Simulation studies based on the benchmark cart-pole system demonstrate adaptability and optimization capabilities of the proposed controller parameter tuning method.

AB - Controller parameter tuning is an integral part of control engineering practice. Existing tuning methods usually start with an accurate mathematical model of the controlled system, which may pose some challenges for practicing engineers dealing with real systems. As such, parameter optimization and adaptation are treated as two independent steps during tuning. To address these issues, we propose a new, online parameterized controller tuning method for a general nonlinear dynamic system. This tuning method is based on direct heuristic dynamic programming (direct HDP), a model-free algorithm in the approximated dynamic programming (ADP) family. By using a Lyapunov stability approach, we provide uniformly ultimately bounded (UUB) results under some mild conditions for controller parameters, the critic neural network weights, and the action neural network weights. Simulation studies based on the benchmark cart-pole system demonstrate adaptability and optimization capabilities of the proposed controller parameter tuning method.

UR - http://www.scopus.com/inward/record.url?scp=84908494506&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908494506&partnerID=8YFLogxK

U2 - 10.1109/IJCNN.2014.6889869

DO - 10.1109/IJCNN.2014.6889869

M3 - Conference contribution

AN - SCOPUS:84908494506

SN - 9781479914845

SP - 256

EP - 262

BT - Proceedings of the International Joint Conference on Neural Networks

PB - Institute of Electrical and Electronics Engineers Inc.

ER -