Journal
JOURNAL OF MACHINE LEARNING RESEARCH
Volume 23, Issue -, Pages -Publisher
MICROTOME PUBL
Keywords
Bayesian inference; categorical data; classification; multinomial probit model; unified skew-normal distribution; variational Bayes
Funding
- MIUR-PRIN
Ask authors/readers for more resources
This article discusses the challenges of Bayesian inference in multinomial probit models and proposes a method using unified skew-normal distributions as conjugate priors. By leveraging this method, improvements in posterior inference and classification results can be achieved, especially in high-dimensional studies.
Multinomial probit models are routinely-implemented representations for learning how the class probabilities of categorical response data change with p observed predictors. Although several frequentist methods have been developed for estimation, inference and classification within such a class of models, Bayesian inference is still lagging behind. This is due to the apparent absence of a tractable class of conjugate priors, that may facilitate posterior infer-ence on the multinomial probit coefficients. Such an issue has motivated increasing efforts toward the development of effective Markov chain Monte Carlo methods, but state-of-the -art solutions still face severe computational bottlenecks, especially in high dimensions. In this article, we show that the entire class of unified skew-normal (SUN) distributions is con-jugate to several multinomial probit models. Leveraging this result and the SUN properties, we improve upon state-of-the-art solutions for posterior inference and classification both in terms of closed-form results for several functionals of interest, and also by developing novel computational methods relying either on independent and identically distributed samples from the exact posterior or on scalable and accurate variational approximations based on blocked partially-factorized representations. As illustrated in simulations and in a gastroin-testinal lesions application, the magnitude of the improvements relative to current methods is particularly evident, in practice, when the focus is on high-dimensional studies.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available