4.6 Article

Information Bottleneck Signal Processing and Learning to Maximize Relevant Information for Communication Receivers

Related references

Note: Only part of the references are listed.
Article Engineering, Electrical & Electronic

Reconstruction-Computation-Quantization (RCQ): A Paradigm for Low Bit Width LDPC Decoding

Linfang Wang et al.

Summary: This paper uses the RCQ paradigm to decode LDPC codes and introduces new methods such as layer-specific RCQ and layered discrete density evolution. Simulation results show that these methods can improve decoding performance while reducing storage and resource consumption.

IEEE TRANSACTIONS ON COMMUNICATIONS (2022)

Article Physics, Multidisciplinary

Distributed Quantization for Partially Cooperating Sensors Using the Information Bottleneck Method

Steffen Steiner et al.

Summary: This paper addresses the optimization of distributed compression in a sensor network with partial cooperation among sensors. Three different inter-sensor communication protocols are investigated, and the results show that partial communication among sensors improves performance significantly and exchanging instantaneous side-information increases robustness against bad coding strategies.

ENTROPY (2022)

Article Engineering, Electrical & Electronic

Forward-Aware Information Bottleneck-Based Vector Quantization: Multiterminal Extensions for Parallel and Successive Retrieval

Shayan Hassanpour et al.

Summary: This article introduces a generic iterative algorithm, M-FAVIB, for the multiterminal Joint Source-Channel Coding problem, and demonstrates the effectiveness of purely statistical design approaches obtained through the Information Bottleneck method.

IEEE TRANSACTIONS ON COMMUNICATIONS (2021)

Article Computer Science, Information Systems

Genetic Algorithms to Maximize the Relevant Mutual Information in Communication Receivers

Jan Lewandowsky et al.

Summary: The information bottleneck method aims to preserve as much relevant mutual information as possible under compression, with applications in various fields like communication and machine learning. By considering parameterized systems, the efficiency of preserving relevant information in communication receivers can be further improved.

ELECTRONICS (2021)

Proceedings Paper Engineering, Electrical & Electronic

REDUCED-COMPLEXITY GREEDY DISTRIBUTED INFORMATION BOTTLENECK ALGORITHM

Steffen Steiner et al.

Summary: This paper discusses a distributed sensing scenario known as the Chief Executive Officer (CEO) problem, proposing a distributed scalar compression algorithm optimized using the information bottleneck method. By jointly optimizing the scalar quantizers, significant performance improvement is achieved, and a sequential compression scheme is introduced to address the bottleneck of processing side-information.

2021 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP) (2021)

Article Engineering, Electrical & Electronic

Reduced-Complexity Optimization of Distributed Quantization Using the Information Bottleneck Principle

Steffen Steiner et al.

Summary: This paper discusses the optimization of distributed compression in a sensor network, proposing a feasible solution to the Chief Executive Officer (CEO) problem using the information bottleneck method. By sequentially designing quantizers and introducing a sequential compression scheme, a compact representation of side-information and optimized internal compression are achieved.

IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY (2021)

Article Computer Science, Artificial Intelligence

Distributed Variational Representation Learning

Inaki Estella-Aguerri et al.

Summary: The problem of distributed representation learning is investigated from information-theoretic grounds, focusing on a generalization of Tishby's Information Bottleneck method. Both discrete and vector Gaussian data models are studied, with the development of a variational bound and two algorithms for computing the optimal complexity-relevance tradeoff. Numerical results support the efficiency of the approaches and algorithms proposed.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Editorial Material Physics, Multidisciplinary

On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Views

Abdellatif Zaidi et al.

ENTROPY (2020)

Article Engineering, Electrical & Electronic

Design and Decoding of Irregular LDPC Codes Based on Discrete Message Passing

Michael Meidlinger et al.

IEEE TRANSACTIONS ON COMMUNICATIONS (2020)

Article Engineering, Electrical & Electronic

Forward-Aware Information Bottleneck-Based Vector Quantization for Noisy Channels

Shayan Hassanpour et al.

IEEE TRANSACTIONS ON COMMUNICATIONS (2020)

Article Engineering, Electrical & Electronic

Decoding Rate-Compatible 5G-LDPC Codes With Coarse Quantization Using the Information Bottleneck Method

Maximilian Stark et al.

IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY (2020)

Article Engineering, Electrical & Electronic

Design and Evaluation of Information Bottleneck LDPC Decoders for Digital Signal Processors

Jan Lewandowsky et al.

IEICE TRANSACTIONS ON COMMUNICATIONS (2019)

Article Computer Science, Artificial Intelligence

Coarsely Quantized Decoding and Construction of Polar Codes Using the Information Bottleneck Method

Syed Aizaz Ali Shah et al.

ALGORITHMS (2019)

Article Computer Science, Information Systems

Information-Optimum LDPC Decoders Based on the Information Bottleneck Method

Jan Lewandowsky et al.

IEEE ACCESS (2018)

Article Chemistry, Multidisciplinary

Information-Bottleneck Decoding of High-Rate Irregular LDPC Codes for Optical Communication Using Message Alignment

Maximilian Stark et al.

APPLIED SCIENCES-BASEL (2018)

Article Engineering, Electrical & Electronic

LDPC Decoding Mappings That Maximize Mutual Information

Francisco Javier Cuadros Romero et al.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2016)

Article Computer Science, Information Systems

Quantization of Binary-Input Discrete Memoryless Channels

Brian M. Kurkoski et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2014)

Article Physics, Multidisciplinary

Function Identification in Neuron Populations via Information Bottleneck

S. Kartik Buddha et al.

ENTROPY (2013)

Article Engineering, Electrical & Electronic

Low-Precision A/D Conversion for Maximum Information Rate in Channels with Memory

Georg Zeitler et al.

IEEE TRANSACTIONS ON COMMUNICATIONS (2012)

Article Computer Science, Artificial Intelligence

Image Segmentation Using Information Bottleneck Method

Anton Bardera et al.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2009)

Article Astronomy & Astrophysics

Objective classification of galaxy spectra using the information bottleneck method

N Slonim et al.

MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY (2001)