Reducing rejection exponentially improves Markov chain Monte Carlo sampling

The choice of transition kernel critically influences the performance of the Markov chain Monte Carlo method. Despite the importance of kernel choice, guiding principles for optimal kernels have not been established. Here, we propose a one-parameter rejection control transition kernel that can be applied to various Monte Carlo samplings and demonstrate that the rejection process plays a major role in determining the sampling efficiency. Varying the rejection probability, we examine the autocorrelation time of the order parameter in the two-and three-dimensional ferromagnetic Potts models. Our results reveal that reducing the rejection rate leads to an exponential decrease in autocorrelation time in sequential spin updates and an algebraic reduction in random spin updates. The autocorrelation times of conventional algorithms almost fall on a single curve as a function of the rejection rate. The present transition kernel with an optimal parameter provides one of the most efficient samplers for general cases of discrete variables.

Automated summary

The choice of transition kernel is crucial for the performance of the Markov chain Monte Carlo method. A one-parameter rejection control transition kernel is proposed, and it is shown that the rejection process plays a significant role in determining the sampling efficiency.