4.6 Article

SCALABLE OPTIMIZATION-BASED SAMPLING ON FUNCTION SPACE

Journal

SIAM JOURNAL ON SCIENTIFIC COMPUTING
Volume 42, Issue 2, Pages A1317-A1347

Publisher

SIAM PUBLICATIONS
DOI: 10.1137/19M1245220

Keywords

Markov chain Monte Carlo; Metropolis independence sampling; Bayesian inference; infinite-dimensional inverse problems; transport maps

Funding

  1. Gordon Preston Fellowship by the School of Mathematics at Monash University
  2. Australian Research Council [CE140100049]
  3. United States Department of Energy, Office of Advanced Scientific Computing Research, AEOLUS Mathematical Multifaceted Integrated Capability Center
  4. Australian Research Council [CE140100049] Funding Source: Australian Research Council

Ask authors/readers for more resources

Optimization-based samplers such as randomize-then-optimize (RTO) [J. M. Bardsley et al., SIAM J. Sci. Comput., 36 (2014), pp. A1895-A1910] provide an efficient and parallellizable approach to solving large-scale Bayesian inverse problems. These methods solve randomly perturbed optimization problems to draw samples from an approximate posterior distribution. Correcting these samples, either by Metropolization or importance sampling, enables characterization of the original posterior distribution. This paper focuses on the scalability of RTO to problems with high- or infinite-dimensional parameters. In particular, we introduce a new subspace strategy to reformulate RTO. For problems with intrinsic low-rank structures, this subspace acceleration makes the computational complexity of RTO scale linearly with the parameter dimension. Furthermore, this subspace perspective suggests a natural extension of RTO to a function space setting. We thus formalize a function space version of RTO and establish sufficient conditions for it to produce a valid Metropolis-Hastings proposal, yielding dimension-independent sampling performance. Numerical examples corroborate the dimension independence of RTO and demonstrate sampling performance that is also robust to small observational noise.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available