arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Artificial Intelligence

REINFORCEMENT LEARNING NEUROCONTROLLER APPLIED TO A 2-DOF MANIPULATOR. Marco A. Prez Cisneros Ral Leal Ascencio

Mchujmp Fs Umist, Marco A. Pérez, Cisneros Raúl, Leal Ascencio

See on the map

Abstract

This paper describes the capabilities of a reinforcement learning (RL) algorithm which uses two neural network structures to produce a direct inverse neurocontrol scheme. In this work, the Pendubot^TM a double inverted pendulum which is a inherently unstable non-linear dynamic system, is used as a benchmark plant because it could be attractive for testing control schemes. The RL neuro-controller is a learning system which consists of two connectionist networks called the Action Network (AN) and the Evaluation Network (EN). The action network generates the system's behavior and the evaluation network learns an evaluation function of the Pendubot's states. A zero magnitude force is not permitted and the neurocontroller is always supplying a control signal for Pendubot^TM. Likewise, this paper describes a new neurocontroller feature which consists in a non-linear function added to the control signal when the second link is approaching critical states. Results from the training and operation stages are summarized for both neurocontrollers. Finally, the mass of link 2 of the Pendubot^TM is altered by increasing and decreasing its magnitude in order to observe the generalization capabilities of the neurocontroller. This last experiment is also documented.

More like this