arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Guohan Tang

2 papers · 2024–2025

2024: 12025: 1
2024peak 1 in 20242025

Frequent co-authors

Papers

showing 1–2 of 2 RSS

Reinforcement Learning With Adjustable Convergence Rate for Data-Based Nonlinear Control

Guohan Tang, Ding Wang, Xin Li +2 more

Computational Theory and Mathematics · · cited 1× · DOI ↗ · more like this ·

In this paper, a value-iteration-based off-policy Q-learning algorithm is developed. The proposed algorithm solves the optimal regulation problem of nonlinear systems with unknown dynamics. Under the off-policy mechanism, the algorithm utilizes the behavioral policy for full exploration, which is beneficial to avoid the target policy from falling into the local optimal solution. In addition, a relaxation factor is introduced to adjust the convergence rate of the cost function sequence. To implement the algorithm, the critic network and the action network are used to approximate the optimal Q-function and the optimal control policy, respectively. Finally, a simulation example is presented to demonstrate the effectiveness of the proposed algorithm.

Model-Free Nonlinear Optimal Control With Utility Reshaping via Iterative Q-Learning

Guohan Tang, Ding Wang, Junfei Qiao

Computational Theory and Mathematics · IFAC-PapersOnLine · · cited 0× · DOI ↗ · more like this ·

This article investigates a deterministic off-policy value iteration Q-learning (VIQL) algorithm with utility reshaping and validates its application to the model-free nonlinear tracking control problem of non-affine systems. The utility reshaping mechanism is incorporated to accelerate convergence and reduce the required iterations, in turn alleviating computational demands. To implement the data-driven VIQL scheme, historical input-output data of system states and reference trajectories are gathered to compute the tracking error, the reference control, and the tracking control, which are employed to update the parameters of the critic network through an of-policy learning framework. In addition, a model network is developed to solve the steady-state control for addressing optimal trajectory tracking problems. Rigorous analysis demonstrates the convergence of the proposed algorithm…