Mathematics · Statistics and Probability
hamiltorch: A PyTorch-based library for Hamiltonian Monte Carlo
See on the mapAbstract
This paper summarizes the recent developments of hamiltorch,1 which is a PyTorch-based library for Hamiltonian Monte Carlo (HMC). HMC is a gradient-based Markov chain Monte Carlo technique that has favorable scaling properties to high-dimensional parameter spaces, leading to it often becoming the sampling method of choice when derivatives are available. HMC is therefore especially suited to performing Bayesian inference over neural networks (NN). As a result hamiltorch has been specifically developed to sample from PyTorch NN models. The development of hamiltorch has also led to new sampling schemes that are part of the library. In this paper I will highlight such novelties as well as provide a brief introduction to the features of hamiltorch and highlight its use-cases in recently referenced work.