Computer Science · cs.LG
Soft-Robust Actor-Critic Policy-Gradient
Esther Derman, Daniel J. Mankowitz, Timothy A. Mann, Shie Mannor
See on the mapAbstract
Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly conservative. Our soft-robust framework is an attempt to overcome this issue. In this paper, we present a novel Soft-Robust Actor-Critic algorithm (SR-AC). It learns an optimal policy with respect to a distribution over an uncertainty set and stays robust to model uncertainty but avoids the conservativeness of robust strategies. We show the convergence of SR-AC and test the efficiency of our approach on different domains by comparing it against regular learning methods and their robust formulations.
References
The reference list for this paper has not been collected yet.
Cited by
No paper in the index cites this yet (Semantic Scholar counts 72 in total).
The cited-by list is still filling in while reference lists are collected.