4.6 Article

Asymptotic behavior of free energy when optimal probability distribution is not unique

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

The exact asymptotic form of Bayesian generalization error in latent Dirichlet allocation

Naoki Hayashi

Summary: This paper provides the exact asymptotic form of generalization error and marginal likelihood of LDA model through theoretical analysis of learning coefficient using algebraic geometry. The theoretical result shows that the Bayesian generalization error in LDA is related to the generalization error in matrix factorization and a penalty from the simplex restriction of LDA's parameter region. Numerical experiments are consistent with the theoretical results.

NEURAL NETWORKS (2021)

Article Physics, Multidisciplinary

Hidden Node Detection between Observable Nodes Based on Bayesian Clustering

Keisuke Yamazaki et al.

ENTROPY (2019)

Article Statistics & Probability

A Bayesian information criterion for singular models

Mathias Drton et al.

JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY (2017)

Article Statistics & Probability

The tube method for the moment index in projection pursuit

Satoshi Kuriki et al.

JOURNAL OF STATISTICAL PLANNING AND INFERENCE (2008)

Article Computer Science, Artificial Intelligence

Stochastic complexities of reduced rank regression in Bayesian estimation

M Aoyagi et al.

NEURAL NETWORKS (2005)

Article Computer Science, Artificial Intelligence

Singularities in mixture models and upper bounds of stochastic complexity

K Yamazaki et al.

NEURAL NETWORKS (2003)

Article Statistics & Probability

Bayesian measures of model complexity and fit

DJ Spiegelhalter et al.

JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY (2002)

Article Computer Science, Artificial Intelligence

Algebraic geometrical methods for hierarchical learning machines

S Watanabe

NEURAL NETWORKS (2001)

Letter Computer Science, Artificial Intelligence

Algebraic analysis for nonidentifiable learning machines

S Watanabe

NEURAL COMPUTATION (2001)