4.7 Article

Synaptic Scaling--An Artificial Neural Network Regularization Inspired by Nature

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

Understanding Convolutional Neural Networks With Information Theory: An Initial Exploration

Shujian Yu et al.

Summary: A novel functional estimator for Renyi's alpha-entropy and its multivariate extension has been proposed recently, which allows for direct measurement of information flow in convolutional neural networks (CNNs). Additionally, three quantities were developed to analyze synergy and redundancy in convolutional layer representations, validating two fundamental data processing inequalities and revealing more inner properties regarding CNN training.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Computer Science, Artificial Intelligence

HJB-Equation-Based Optimal Learning Scheme for Neural Networks With Applications in Brain-Computer Interface

Tharun Kumar Reddy et al.

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE (2020)

Article Computer Science, Artificial Intelligence

Efficiently Annotating Object Images with Absolute Size Information Using Mobile Devices

Martin Hofmann et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2019)

Article Multidisciplinary Sciences

Optimal errors and phase transitions in high-dimensional generalized linear models

Jean Barbier et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2019)

Article Computer Science, Artificial Intelligence

Deep Neural Network Initialization With Decision Trees

Kelli D. Humbird et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2019)

Article Biochemical Research Methods

Flowers, leaves or both? How to obtain suitable images for automated plant identification

Michael Rzanny et al.

PLANT METHODS (2019)

Article Mechanics

On the information bottleneck theory of deep learning

Andrew M. Saxe et al.

JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT (2019)

Article Computer Science, Artificial Intelligence

Learnability can be undecidable

Shai Ben-David et al.

NATURE MACHINE INTELLIGENCE (2019)

Article Biochemistry & Molecular Biology

Neuronal Firing Rate Homeostasis Is Inhibited by Sleep and Promoted by Wake

Keith B. Hengen et al.

Article Engineering, Electrical & Electronic

Convergence Analysis of Two Loss Functions in Soft-Max Regression

Arash Sangari et al.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2016)

Review Neurosciences

The log-dynamic brain: how skewed distributions affect network operations

Gyoergy Buzsaki et al.

NATURE REVIEWS NEUROSCIENCE (2014)

Article Engineering, Electrical & Electronic

Computational Implications of Lognormally Distributed Synaptic Weights

Jun-nosuke Teramae et al.

PROCEEDINGS OF THE IEEE (2014)

Article Multidisciplinary Sciences

Sleep promotes branch-specific formation of dendritic spines after learning

Guang Yang et al.

SCIENCE (2014)

Article Computer Science, Hardware & Architecture

An approach based on probabilistic neural network for diagnosis of Mesothelioma's disease

Orhan Er et al.

COMPUTERS & ELECTRICAL ENGINEERING (2012)

Review Neurosciences

Synaptic plasticity in sleep: learning, homeostasis and disease

Gordon Wang et al.

TRENDS IN NEUROSCIENCES (2011)

Article Mathematical & Computational Biology

Synaptic scaling in combination with many generic plasticity mechanisms stabilizes circuit connectivity

Christian Tetzlaff et al.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2011)

Article Engineering, Biomedical

Accurate Telemonitoring of Parkinsons Disease Progression by Noninvasive Speech Tests

Athanasios Tsanas et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2010)

Article Multidisciplinary Sciences

Sex, mixability, and modularity

Adi Livnat et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2010)

Article Computer Science, Theory & Methods

Learning and generalization with the information bottleneck

Ohad Shamir et al.

THEORETICAL COMPUTER SCIENCE (2010)

Article Computer Science, Interdisciplinary Applications

Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap

Ji-Hyun Kim

COMPUTATIONAL STATISTICS & DATA ANALYSIS (2009)

Article Computer Science, Artificial Intelligence

Modeling wine preferences by data mining from physicochemical properties

Paulo Cortez et al.

DECISION SUPPORT SYSTEMS (2009)

Article Computer Science, Information Systems

Epileptic Seizure Detection in EEGs Using Time-Frequency Analysis

Alexandros T. Tzallas et al.

IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE (2009)

Article Computer Science, Artificial Intelligence

80 million tiny images: A large data set for nonparametric object and scene recognition

Antonio Torralba et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2008)

Article Multidisciplinary Sciences

Sleep transforms the cerebral trace of declarative memories

Steffen Gais et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2007)

Article Multidisciplinary Sciences

Odor cues during slow-wave sleep prompt declarative memory consolidation

Bjoern Rasch et al.

SCIENCE (2007)

Article Multidisciplinary Sciences

Synaptic scaling mediated by glial TNF-α

D Stellwagen et al.

NATURE (2006)

Article Automation & Control Systems

Variance reduction in estimating classification error using sparse datasets

C Beleites et al.

CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS (2005)

Article Multidisciplinary Sciences

Spike-timing-dependent synaptic plasticity depends on dendritic location

RC Froemke et al.

NATURE (2005)

Article Biochemistry & Molecular Biology

Highly nonrandom features of synaptic connectivity in local cortical circuits

S Song et al.

PLOS BIOLOGY (2005)

Article Statistics & Probability

Least angle regression

B Efron et al.

ANNALS OF STATISTICS (2004)

Review Neurosciences

Homeostatic plasticity in the developing nervous system

GG Turrigiano et al.

NATURE REVIEWS NEUROSCIENCE (2004)

Article Computer Science, Artificial Intelligence

Instance-based regression by partitioning feature projections

I Uysal et al.

APPLIED INTELLIGENCE (2004)

Article Multidisciplinary Sciences

The role of neuronal identity in synaptic competition

N Kasthuri et al.

NATURE (2003)

Article Computer Science, Artificial Intelligence

Estimation of entropy and mutual information

L Paninski

NEURAL COMPUTATION (2003)

Article Biochemistry & Molecular Biology

Cytoscape: A software environment for integrated models of biomolecular interaction networks

P Shannon et al.

GENOME RESEARCH (2003)

Article Multidisciplinary Sciences

Functional improvement of dystrophic muscle by myostatin blockade

S Bogdanovich et al.

NATURE (2002)

Review Neurosciences

Synaptic plasticity: taming the beast

L. F. Abbott et al.

NATURE NEUROSCIENCE (2000)

Review Neurosciences

Hebb and homeostasis in neuronal plasticity

GG Turrigiano et al.

CURRENT OPINION IN NEUROBIOLOGY (2000)