arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Hanquan Lin

6 papers · 2015–2016

2015: 42016: 2
2015peak 4 in 20152016

Frequent co-authors

Papers

showing 1–6 of 6 RSS

Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems

Qinglai Wei, Derong Liu, Hanquan Lin

Computational Theory and Mathematics · IEEE Transactions on Cybernetics · · cited 452× · DOI ↗ · more like this ·

In this paper, a value iteration adaptive dynamic programming (ADP) algorithm is developed to solve infinite horizon undiscounted optimal control problems for discrete-time nonlinear systems. The present value iteration ADP algorithm permits an arbitrary positive semi-definite function to initialize the algorithm. A novel convergence analysis is developed to guarantee that the iterative value function converges to the optimal performance index function. Initialized by different initial functions, it is proven that the iterative value function will be monotonically nonincreasing, monotonically nondecreasing, or nonmonotonic and will converge to the optimum. In this paper, for the first time, the admissibility properties of the iterative control laws are developed for value iteration algorithms. It is emphasized that new termination criteria are established to guarantee the effectiveness…

Discrete-Time Local Value Iteration Adaptive Dynamic Programming: Convergence Analysis

Qinglai Wei, Frank L. Lewis, Derong Liu +2 more

Computational Theory and Mathematics · IEEE Transactions on Systems Man and Cybernetics Systems · · cited 171× · DOI ↗ · more like this ·

In this paper, convergence properties are established for the newly developed discrete-time local value iteration adaptive dynamic programming (ADP) algorithm. The present local iterative ADP algorithm permits an arbitrary positive semidefinite function to initialize the algorithm. Employing a state-dependent learning rate function, for the first time, the iterative value function and iterative control law can be updated in a subset of the state space instead of the whole state space, which effectively relaxes the computational burden. A new analysis method for the convergence property is developed to prove that the iterative value functions will converge to the optimum under some mild constraints. Monotonicity of the local value iteration ADP algorithm is presented, which shows that under some special conditions of the initial value function and the learning rate function, the…

Online identifier–actor–critic algorithm for optimal control of nonlinear systems

Hanquan Lin, Qinglai Wei, Derong Liu

Computational Theory and Mathematics · Optimal Control Applications and Methods · · cited 20× · DOI ↗ · more like this ·

Summary In this paper, a novel identifier–actor–critic optimal control scheme is developed for discrete‐time affine nonlinear systems with uncertainties. In contrast to traditional adaptive dynamic programming methodology, which requires at least partial knowledge of the system dynamics, a neural‐network identifier is employed to learn the unknown control coefficient matrix working together with actor–critic‐based scheme to solve the optimal control online. The critic network learns the approximate value function at each step. The actor network attempts to improve the current policy based on the approximate value function. The weights of all neural networks are updated at each sampling instant. Lyapunov theory is utilized to prove the stability of closed‐loop system. It shows that system states and neural network weights are uniformly ultimately bounded. Finally, simulations are…

Adaptive tracking control of leader-following linear multi-agent systems with external disturbances

Hanquan Lin, Qinglai Wei, Derong Liu +1 more

Computer Networks and Communications · International Journal of Systems Science · · cited 18× · DOI ↗ · more like this ·

In this paper, the consensus problem for leader-following linear multi-agent systems with external disturbances is investigated. Brownian motions are used to describe exogenous disturbances. A distributed tracking controller based on Riccati inequalities with an adaptive law for adjusting coupling weights between neighbouring agents is designed for leader-following multi-agent systems under fixed and switching topologies. In traditional distributed static controllers, the coupling weights depend on the communication graph. However, coupling weights associated with the feedback gain matrix in our method are updated by state errors between neighbouring agents. We further present the stability analysis of leader-following multi-agent systems with stochastic disturbances under switching topology. Most traditional literature requires the graph to be connected all the time, while the…

Adaptive tracking control of leader-following multi-agent systems

Hanquan Lin, Qinglai Wei, Derong Liu

Computer Networks and Communications · · cited 3× · DOI ↗ · more like this ·

In this paper, a distributed tracking controller with an adaptive law for adjusting coupling weights between neighboring agents is designed for leader-following multi-agent systems under fixed and switching topologies. In contrast to most existing literature where agents are integrators or double integrators, the dynamics of each agent is a general linear system in this paper. To handle this problem, the controller is based on Riccati inequalities. In traditional distributed static controllers, the coupling weight depends on the communication graph. However, coupling weights associated with the feedback gain matrix in our method are updated by state errors between neighboring agents. We further present the stability analysis of leader-following multi-agent systems under switching topology. Most traditional literature requires the graph to be connected anytime, while the communication…

Online critic-identifier-actor algorithm for optimal control of nonlinear systems

Hanquan Lin, Qinglai Wei, Derong Liu

Computational Theory and Mathematics · · cited 1× · DOI ↗ · more like this ·

In this paper, a novel critic-identifier-actor optimal control scheme is designed for discrete-time affine nonlinear systems with uncertainties. A neural identifier is established to learn the unknown control coefficient matrix for affine nonlinear system working together with an actor-critic-based scheme to solve the optimal control in online and forward-in-time manner without value or policy iterations. A critic network learns approximate value function at each step. Another actor network attempts to improve the current policy based on the approximate value function. The weights of all neural networks (NNs) are updated at each sampling instant. Lyapunov theory is utilized to prove the stability of the closed-loop system. A simulation example is provided to illustrate the effectiveness of the developed method.