4.6 Article

High-Dimensional Separability for One- and Few-Shot Learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Hardware & Architecture

Understanding Deep Learning (Still) Requires Rethinking Generalization

Chiyuan Zhang et al.

Summary: Despite traditional explanations falling short in justifying the excellent generalization of large neural networks, experiments show that state-of-the-art convolutional networks can easily adapt to random labeling during training, indicating a different mechanism contributing to their strong performance in practice.

COMMUNICATIONS OF THE ACM (2021)

Review Physics, Multidisciplinary

Limit Theorems as Blessing of Dimensionality: Neural-Oriented Overview

Vladik Kreinovich et al.

Summary: As a system becomes more complex, the description and analysis initially become more complicated, but further increase in complexity can lead to simpler analysis, known as the blessing of dimensionality phenomenon.

ENTROPY (2021)

Article Computer Science, Information Systems

Blessing of dimensionality at the edge and geometry of few-shot learning

Ivan Y. Tyukin et al.

Summary: This paper introduces a theory and algorithms that enable Artificial Intelligence systems to continuously improve with quantifiable guarantees by reducing classification errors. It is capable of building few-shot AI correction algorithms with linear training complexity and lower computational complexity, making it suitable for resource-constrained environments.

INFORMATION SCIENCES (2021)

Article Computer Science, Artificial Intelligence

General stochastic separation theorems with optimal bounds

Bogdan Grechuk et al.

Summary: The phenomenon of stochastic separability has been used in machine learning to correct errors in AI systems and analyze their instabilities, allowing for identification of errors or clusters in high-dimensional datasets. Probability evaluation of Fisher separability in different dimensionalities and distributions is crucial for understanding vulnerabilities in high-dimensional data-driven AI systems.

NEURAL NETWORKS (2021)

Article Computer Science, Theory & Methods

Unsupervised outlier detection in multidimensional data

Atiq Ur Rehman et al.

Summary: The paper proposes novel statistical techniques for detecting outliers in a dataset, which are shown to be efficient in terms of performance, ease of implementation, and computational complexity. Additionally, the use of transforming data to a unidimensional distance space for outlier detection allows for computational efficiency and feasibility even in high-dimensional datasets.

JOURNAL OF BIG DATA (2021)

Article Computer Science, Artificial Intelligence

How Deep Should be the Depth of Convolutional Neural Networks: a Backyard Dog Case Study

Alexander N. Gorban et al.

COGNITIVE COMPUTATION (2020)

Review Physics, Multidisciplinary

High-Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

Alexander N. Gorban et al.

ENTROPY (2020)

Article Physics, Multidisciplinary

Robust and Scalable Learning of Complex Intrinsic Dataset Geometry via ElPiGraph

Luca Albergante et al.

ENTROPY (2020)

Review Computer Science, Artificial Intelligence

Lizard Brain: Tackling Locally Low-Dimensional Yet Globally Complex Organization of Multi-Dimensional Datasets

Jonathan Bac et al.

FRONTIERS IN NEUROROBOTICS (2020)

Article Computer Science, Theory & Methods

Generalizing from a Few Examples: A Survey on Few-shot Learning

Yaqing Wang et al.

ACM COMPUTING SURVEYS (2020)

Article Physics, Multidisciplinary

Fractional Norms and Quasinorms Do Not Help to Overcome the Curse of Dimensionality

Evgeny M. Mirkes et al.

ENTROPY (2020)

Proceedings Paper Computer Science, Artificial Intelligence

On Adversarial Examples and Stealth Attacks in Artificial Intelligence Systems

Ivan Y. Tyukin et al.

2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) (2020)

Article Engineering, Electrical & Electronic

IBM Watson, Heal Thyself

Eliza Strickland

IEEE SPECTRUM (2019)

Review Biochemistry & Molecular Biology

Independent Component Analysis for Unraveling the Complexity of Cancer Omics Datasets

Nicolas Sompairac et al.

INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES (2019)

Review Biology

The unreasonable effectiveness of small neural ensembles in high-dimensional brain

Alexander N. Gorban et al.

PHYSICS OF LIFE REVIEWS (2019)

Proceedings Paper Computer Science, Information Systems

CECI: Compact Embedding Cluster Index for Scalable Subgraph Matching

Bibek Bhattarai et al.

SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA (2019)

Review Multidisciplinary Sciences

Blessing of dimensionality: mathematical foundations of the statistical physics of data

A. N. Gorban et al.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2018)

Article Computer Science, Information Systems

Correction of AI systems by linear discriminants: Probabilistic foundations

A. N. Gorban et al.

INFORMATION SCIENCES (2018)

Article Computer Science, Artificial Intelligence

Knowledge Transfer Between Artificial Intelligence Systems

Ivan Y. Tyukin et al.

FRONTIERS IN NEUROROBOTICS (2018)

Article Mathematical & Computational Biology

Missing data and technical variability in single-cell RNA-sequencing experiments

Stephanie C. Hicks et al.

BIOSTATISTICS (2018)

Article Computer Science, Artificial Intelligence

Stochastic separation theorems

A. N. Gorban et al.

NEURAL NETWORKS (2017)

Article Computer Science, Information Systems

Approximation with random bases: Pro et Contra

Alexander N. Gorban et al.

INFORMATION SCIENCES (2016)

Article Multidisciplinary Sciences

Fluorescence-based assay as a new screening tool for toxic chemicals

Ewa Moczko et al.

SCIENTIFIC REPORTS (2016)

Proceedings Paper Automation & Control Systems

The Blessing of Dimensionality: Separation Theorems in the Thermodynamic Limit

Alexander N. Gorban et al.

IFAC PAPERSONLINE (2016)

Article Computer Science, Artificial Intelligence

A survey of multi-source domain adaptation

Shiliang Sun et al.

INFORMATION FUSION (2015)

Article Computer Science, Information Systems

Evolutionary compact embedding for large-scale image classification

Li Liu et al.

INFORMATION SCIENCES (2015)

Article Computer Science, Artificial Intelligence

The errors, insights and lessons of famous AI predictions - and what they mean for the future

Stuart Armstrong et al.

JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE (2014)

Article Mathematics, Applied

Is the k-NN classifier in high dimensions affected by the curse of dimensionality?

Vladimir Pestov

COMPUTERS & MATHEMATICS WITH APPLICATIONS (2013)

Article Computer Science, Theory & Methods

N-Widths and ε-Dimensions for High-Dimensional Approximations

Dinh Dung et al.

FOUNDATIONS OF COMPUTATIONAL MATHEMATICS (2013)

Article Computer Science, Interdisciplinary Applications

Good practice in Bayesian network modelling

Serena H. Chen et al.

ENVIRONMENTAL MODELLING & SOFTWARE (2012)

Article Biochemistry & Molecular Biology

Copy number variation detection and genotyping from exome sequence data

Niklas Krumm et al.

GENOME RESEARCH (2012)

Editorial Material Critical Care Medicine

Correction for Multiple Testing Is There a Resolution?

David L. Streiner et al.

CHEST (2011)

Article Mathematics

Interpolating Thin-Shell and Sharp Large-Deviation Estimates for Lsotropic Log-Concave Measures

Olivier Guedon et al.

GEOMETRIC AND FUNCTIONAL ANALYSIS (2011)

Article Computer Science, Artificial Intelligence

PRINCIPAL MANIFOLDS AND GRAPHS IN PRACTICE: FROM MOLECULAR BIOLOGY TO DYNAMICAL SYSTEMS

Alexander N. Gorban et al.

INTERNATIONAL JOURNAL OF NEURAL SYSTEMS (2010)

Article Computer Science, Artificial Intelligence

A theory of learning from different domains

Shai Ben-David et al.

MACHINE LEARNING (2010)

Article Biotechnology & Applied Microbiology

How does multiple testing correction work?

William S. Noble

NATURE BIOTECHNOLOGY (2009)

Article Computer Science, Artificial Intelligence

Avoiding Another AI Winter

James Hendler

IEEE INTELLIGENT SYSTEMS (2008)

Article Computer Science, Artificial Intelligence

A unified framework for semi-supervised dimensionality reduction

Yangqiu Song et al.

PATTERN RECOGNITION (2008)

Article Mathematical & Computational Biology

Selection Theorem for Systems with Inheritance

A. N. Gorban

MATHEMATICAL MODELLING OF NATURAL PHENOMENA (2007)

Article Multidisciplinary Sciences

Reducing the dimensionality of data with neural networks

G. E. Hinton et al.

SCIENCE (2006)

Article Computer Science, Software Engineering

Robust linear dimensionality reduction

Y Koren et al.

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS (2004)

Article Automation & Control Systems

Replacing points by compacta in neural network approximation

PC Kainen

JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS (2004)

Article Computer Science, Artificial Intelligence

Data dimensionality estimation methods: a survey

F Camastra

PATTERN RECOGNITION (2003)

Article Mathematics

Isoperimetry of waists and concentration of maps

M Gromov

GEOMETRIC AND FUNCTIONAL ANALYSIS (2003)

Article Computer Science, Theory & Methods

Unsupervised fuzzy clustering with multi-center clusters

CW Tao

FUZZY SETS AND SYSTEMS (2002)

Article Mathematics

Concentration property on probability spaces

AA Giannopoulos et al.

ADVANCES IN MATHEMATICS (2000)