4.6 Article

Magnetic Hamiltonian Monte Carlo With Partial Momentum Refreshment

Journal

IEEE ACCESS
Volume 9, Issue -, Pages 108009-108016

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/ACCESS.2021.3101810

Keywords

Monte Carlo methods; Heuristic algorithms; Mathematical model; Measurement; Markov processes; Manifolds; Machine learning; Hamiltonian Monte Carlo; partial momentum refreshment; Magnetic Hamiltonian Monte Carlo; Markov Chain Monte Carlo

Funding

  1. National Research Foundation of South Africa

Ask authors/readers for more resources

Magnetic Hamiltonian Monte Carlo (MHMC) provides efficient sampling of the target posterior by utilizing non-canonical Hamiltonian dynamics, while partial momentum refreshment can improve sampling behavior.
Magnetic Hamiltonian Monte Carlo (MHMC) has been shown to provide more efficient sampling of the target posterior compared to Hamiltonian Monte Carlo (HMC). It achieves this by utilising a user specified magnetic field and the resultant non-canonical Hamiltonian dynamics. This is important for multi-modal distributions which are common in machine learning. In generating each sample in MHMC and HMC, the auxiliary momentum variable is fully regenerated from a Gaussian distribution. Partially updating the momentum has previously been employed in HMC to improve sampling behaviour. It has also been used in the context of sampling using integrator dependent shadow Hamiltonian Monte Carlo methods. In this work, we combine the sampling benefits of non-canonical Hamiltonian dynamics offered by MHMC with partial momentum refreshment to create the Magnetic Hamiltonian Monte Carlo with Partial Momentum Refreshment (PMHMC) algorithm. Numerical experiments across various target posterior distributions show that the proposed method outperforms HMC, MHMC and HMC with partial momentum refreshment across all the metrics considered.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available