4.6 Article

Information Bottleneck Theory Based Exploration of Cascade Learning

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Review Computer Science, Artificial Intelligence

On Information Plane Analyses of Neural Network Classifiers--A Review

Bernhard C. Geiger

Summary: This article reviews the literature on information plane analysis of neural network classifiers, discussing the causal relationship between information bottleneck theory and generalization. The research found conflicting empirical evidence in IP analysis and emphasized the importance of detailed estimation of information quantities. It suggests that compression visualized in IPs may not necessarily be information-theoretic, but often compatible with geometric compression of latent representations.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Hardware & Architecture

Understanding Deep Learning (Still) Requires Rethinking Generalization

Chiyuan Zhang et al.

Summary: Despite traditional explanations falling short in justifying the excellent generalization of large neural networks, experiments show that state-of-the-art convolutional networks can easily adapt to random labeling during training, indicating a different mechanism contributing to their strong performance in practice.

COMMUNICATIONS OF THE ACM (2021)

Article Computer Science, Artificial Intelligence

On Kernel Method-Based Connectionist Models and Supervised Deep Learning Without Backpropagation

Shiyu Duan et al.

NEURAL COMPUTATION (2020)

Article Physics, Multidisciplinary

Convergence Behavior of DNNs with Mutual-Information-Based Regularization

Hlynur Jonsson et al.

ENTROPY (2020)

Article Computer Science, Artificial Intelligence

Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle

Rana Ali Amjad et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Editorial Material Physics, Multidisciplinary

Information Bottleneck: Theory and Applications in Deep Learning

Bernhard C. Geiger et al.

ENTROPY (2020)

Article Physics, Multidisciplinary

Markov Information Bottleneck to Improve Information Flow in Stochastic Neural Networks

Thanh Tang Nguyen et al.

ENTROPY (2019)

Article Computer Science, Artificial Intelligence

Deep Cascade Learning

Enrique S. Marquez et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2018)

Article Physics, Multidisciplinary

Estimating Mixture Entropy with Pairwise Distances

Artemy Kolchinsky et al.

ENTROPY (2017)

Article Computer Science, Artificial Intelligence

ImageNet Large Scale Visual Recognition Challenge

Olga Russakovsky et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2015)

Article Computer Science, Information Systems

Bayesian bin distribution inference and mutual information

D Endres et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2005)