4.7 Article

Statistical Estimation of the Kullback-Leibler Divergence

Related references

Note: Only part of the references are listed.
Article Automation & Control Systems

Kullback-Leibler Divergence Metric Learning

Shuyi Ji et al.

Summary: This article addresses the task of metric learning for Kullback-Leibler divergence (KLD), aiming to optimize KLD in order to better express the similarity of data distributions. The researchers developed an intrinsic steepest descent method that preserves the manifold structure during iteration. Experimental results demonstrate that the proposed method outperforms other approaches.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Biotechnology & Applied Microbiology

Identifying critical state of complex diseases by single-sample Kullback-Leibler divergence

Jiayuan Zhong et al.

BMC GENOMICS (2020)

Article Computer Science, Theory & Methods

Detecting anomalies in fibre systems using 3-dimensional image data

Denis Dresvyanskiy et al.

STATISTICS AND COMPUTING (2020)

Article Radiology, Nuclear Medicine & Medical Imaging

Individual brain metabolic connectome indicator based on Kullback-Leibler Divergence Similarity Estimation predicts progression from mild cognitive impairment to Alzheimer's dementia

Min Wang et al.

EUROPEAN JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING (2020)

Article Statistics & Probability

EFFICIENT MULTIVARIATE ENTROPY ESTIMATION VIA k-NEAREST NEIGHBOUR DISTANCES

Thomas B. Berrett et al.

ANNALS OF STATISTICS (2019)

Editorial Material Physics, Multidisciplinary

New Developments in Statistical Information Theory Based on Entropy and Divergence Measures

Leandro Pardo

ENTROPY (2019)

Article Statistics & Probability

STATISTICAL ESTIMATION OF CONDITIONAL SHANNON ENTROPY

Alexander Bulinske et al.

ESAIM-PROBABILITY AND STATISTICS (2019)

Article Mathematics, Applied

Statistical Estimation of the Shannon Entropy

Alexander Bulinski et al.

ACTA MATHEMATICA SINICA-ENGLISH SERIES (2019)

Article Statistics & Probability

Entropy-based Inhomogeneity Detection in Fiber Materials

Patricia Alonso Ruiz et al.

METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY (2018)

Article Mathematics, Applied

Geometric k-nearest neighbor estimation of entropy and mutual information

Warren M. Lord et al.

CHAOS (2018)

Article Computer Science, Artificial Intelligence

Bias Reduction and Metric Learning for Nearest-Neighbor Estimation of Kullback-Leibler Divergence

Yung-Kyun Noh et al.

NEURAL COMPUTATION (2018)

Article Physics, Multidisciplinary

Time irreversibility of financial time series based on higher moments and multiscale Kullback-Leibler divergence

Jinyang Li et al.

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS (2018)

Article Physics, Multidisciplinary

Ensemble Estimation of Information Divergence

Kevin R. Moon et al.

ENTROPY (2018)

Article Physics, Fluids & Plasmas

Kullback-Leibler divergence measure of intermittency: Application to turbulence

Carlos Granero-Belinchon et al.

PHYSICAL REVIEW E (2018)

Article Computer Science, Theory & Methods

Feature Selection: A Data Perspective

Jundong Li et al.

ACM COMPUTING SURVEYS (2018)

Article Statistics & Probability

On the Kozachenko-Leonenko entropy estimator

Sylvain Delattre et al.

JOURNAL OF STATISTICAL PLANNING AND INFERENCE (2017)

Article Statistics & Probability

Estimation of Kullback-Leibler losses for noisy recovery problems within the exponential family

Charles-Alban Deledalle

ELECTRONIC JOURNAL OF STATISTICS (2017)

Article Physics, Multidisciplinary

Improvement of the k-NN Entropy Estimator with Applications in Systems Biology

Agata Charzynska et al.

ENTROPY (2016)

Article Computer Science, Information Systems

f-Divergence Inequalities

Igal Sason et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2016)

Article Computer Science, Artificial Intelligence

A Mutual Information estimator for continuous and discrete variables applied to Feature Selection and Classification problems

Frederico Coelho et al.

INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS (2016)

Article Computer Science, Artificial Intelligence

A Mutual Information estimator for continuous and discrete variables applied to Feature Selection and Classification problems

Frederico Coelho et al.

INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS (2016)

Review Computer Science, Artificial Intelligence

A review of feature selection methods based on mutual information

Jorge R. Vergara et al.

NEURAL COMPUTING & APPLICATIONS (2014)

Article Statistics & Probability

LIMIT THEORY FOR POINT PROCESSES IN MANIFOLDS

Mathew D. Penrose et al.

ANNALS OF APPLIED PROBABILITY (2013)

Article Statistics & Probability

OPTIMAL AND FAST DETECTION OF SPATIAL CLUSTERS WITH SCAN STATISTICS

Guenther Walther

ANNALS OF STATISTICS (2010)

Article Computer Science, Information Systems

Divergence Estimation for Multidimensional Densities Via k-Nearest-Neighbor Distances

Qing Wang et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2009)

Article Statistics & Probability

A CLASS OF RENYI INFORMATION ESTIMATORS FOR MULTIDIMENSIONAL DENSITIES

Nikolai Leonenko et al.

ANNALS OF STATISTICS (2008)

Article Multidisciplinary Sciences

A computationally efficient estimator for mutual information

Dafydd Evans

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2008)

Article Computer Science, Artificial Intelligence

Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy

HC Peng et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2005)

Article Statistics & Probability

A new class of random vector entropy estimators and its applications in testing statistical hypotheses

MN Goria et al.

JOURNAL OF NONPARAMETRIC STATISTICS (2005)

Article Physics, Fluids & Plasmas

Estimating mutual information -: art. no. 066138

A Kraskov et al.

PHYSICAL REVIEW E (2004)

Article Multidisciplinary Sciences

Asymptotic moments of near-neighbour distance distributions

D Evans et al.

PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2002)