arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Networks and Communications

Learning automata with continuous inputs and their application for multimodal functions optimization

Alexander S. Poznyak, Kaddour Najim, Mohamed Chtourou

· International Journal of Systems Science

See on the map

Abstract

This paper deals with the design and the analysis of a new reinforcement scheme for learning automata and its application for multimodal functions optimization. This reinforcement scheme generalizes the well known Bush-Mosteller scheme with decreasing gain for learning automata with continuous inputs. The theoretical analysis is based on martingale theory. The conditions associated with the convergence of this scheme to the optimal pure strategy are stated, and the order of convergence rate is estimated. The variation domains of the variables of the function to be optimized are discretized into subsets which are associated to the outputs of the learning automaton. The values of the function on these subsets are used to construct the continuous automaton inputs. Simulation results show the feasibility and the good performance of this optimization technique.

More like this