Learning of non-parametric control policies with high-dimensional state features

Abstract

Learning complex control policies from highdimensional sensory input is a challenge for
\nreinforcement learning algorithms. Kernel methods that approximate values functions
\nor transition models can address this problem. Yet, many current approaches rely on
\ninstable greedy maximization. In this paper, we develop a policy search algorithm that
\nintegrates robust policy updates and kernel embeddings. Our method can learn nonparametric
\ncontrol policies for infinite horizon continuous MDPs with high-dimensional
\nsensory representations. We show that our method outperforms related approaches, and
\nthat our algorithm can learn an underpowered swing-up task task directly from highdimensional
\nimage data.