Spherical Hamiltonian Monte Carlo for constrained target distributions
- Author(s): Lan, S
- Zhou, B
- Shahbaba, B
- et al.
Copyright © (2014) by the International Machine Learning Society (IMLS) All rights reserved. Statistical models with constrained probability distributions are abundant in machine learning. Some examples include regression models with norm constraints (e.g., Lasso), probit models, many copula models, and Latent Dirichlet Allocation (LDA) models. Bayesian inference involving probability distributions confined to constrained domains could be quite challenging for commonly used sampling algorithms. For such problems, we propose a novel Markov Chain Monte Carlo (MCMC) method that provides a general and computationally efficient framework for handling boundary conditions. Our method first maps the -D-dimensional constrained domain of parameters to the unit ball BD0(1), then augments it to a D-dimensional sphere SDsuch that the original boundary corresponds to the equator of SD. This way, our method handles the constraints implicitly by moving freely on the sphere generating proposals that remain within boundaries when mapped back to the original space.
Many UC-authored scholarly publications are freely available on this site because of the UC Academic Senate's Open Access Policy. Let us know how this access is important for you.