Reinforcement learning from demonstration through shaping
Tim Brys, Anna Harutyunyan, Halit Bener Suay +3 more
Reinforcement learning describes how a learning agent can achieve optimal behaviour based on in-teractions with its environment and reward feed-back. A limiting factor in reinforcement learning as employed in artificial intelligence is the need for an often prohibitively large number of environ-ment samples before the agent reaches a desirable level of performance. Learning from demonstra-tion is an approach that provides the agent with demonstrations by a supposed expert, from which it should derive suitable behaviour. Yet, one of the challenges of learning from demonstration is that no guarantees can be provided for the qual-ity of the demonstrations, and thus the learned be-havior. In this paper, we investigate the intersec-tion of these two approaches, leveraging the theo-retical guarantees provided by reinforcement learn-ing, and using expert demonstrations to speed up this…