4.7 Article

A Survey on Dropout Methods and Experimental Verification in Recommendation

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

Multi-Modal Discrete Collaborative Filtering for Efficient Cold-Start Recommendation

Yang Xu et al.

Summary: This article proposes a Multi-modal Discrete Collaborative Filtering (MDCF) method for efficient cold-start recommendation. The method maps the multi-modal features of users and items to a consensus Hamming space and adaptively fuses them into binary hash codes using a low-rank self-weighted multi-modal fusion module. Additionally, a fast discrete optimization method based on augmented Lagrangian multiplier is developed to directly compute the binary hash codes with simple operations.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

Sparse Graph Attention Networks

Yang Ye et al.

Summary: Graph Neural Networks (GNNs) are effective for representation learning on graph-structured data and have achieved state-of-the-art performance on various predictive tasks. Graph Attention Networks (GATs) improve the performance of graph learning tasks by assigning dense attention coefficients to node neighbors. However, GATs are prone to overfitting on large and noisy graphs, and may fail on disassortative graphs. Sparse Graph Attention Networks (SGATs) learn sparse attention coefficients using $L_0$-norm regularization, allowing feature aggregation on informative neighbors. SGATs outperform GATs on assortative and disassortative graphs and can remove noisy edges from assortative graphs while maintaining classification accuracies. This is the first graph learning algorithm that demonstrates redundancies in graphs and shows that edge-sparsified graphs can achieve similar or higher predictive performances than original graphs.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

Attribute Graph Neural Networks for Strict Cold Start Recommendation

Tieyun Qian et al.

Summary: Rating prediction is a classic problem addressed by matrix factorization, but recent advancements in deep learning, particularly graph neural networks, have shown impressive progress. This study introduces a new AGNN framework that utilizes attribute graphs to learn preference embeddings for strict cold start users/items.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2022)

Article Computer Science, Artificial Intelligence

GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning Over Large-Scale Graphs

Yunpeng Weng et al.

Summary: Graph Neural Networks (GNNs) have achieved state-of-the-art performance on various machine learning tasks. Existing models have limitations in aggregating information and updating node embeddings, as well as neglecting graph structure information. This paper proposes a novel GNN architecture, GAIN, which addresses these issues by using multiple types of aggregators, attention mechanisms, a graph regularized loss, and a graph feature interaction mechanism. Experimental results show that GAIN outperforms current state-of-the-art models on all tasks.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2022)

Article Computer Science, Artificial Intelligence

EDropout: Energy-Based Dropout and Pruning of Deep Neural Networks

Hojjat Salehinejad et al.

Summary: EDropout is a energy-based framework for pruning neural networks in classification tasks, which stochastically evolves a population to find states with lower energy loss and applies the best pruning state to the original network. This method allows for dynamic pruning of neural networks while maintaining high classification performance in classification tasks.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Random-based networks with dropout for embedded systems

Edoardo Ragusa et al.

Summary: The paper introduces a novel training procedure for random-based neural networks that combines ensemble techniques and dropout regularization, effectively limiting computational complexity. Experimental results demonstrated that the proposed approach improved accuracy overall, with a minor degradation in performance in some cases. When compared to traditional architectures, the proposed method achieved up to a 20x speedup in IoT devices.

NEURAL COMPUTING & APPLICATIONS (2021)

Article Computer Science, Artificial Intelligence

On Both Cold-Start and Long-Tail Recommendation with Social Data

Jingjing Li et al.

Summary: The paper discusses the importance of hits in web systems and the critical role of recommender systems in discovering and displaying interesting items to users. The authors propose a novel approach that addresses both cold-start and long-tail recommendation, tackling the challenges of new users and surprising users.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2021)

Article Computer Science, Artificial Intelligence

Dropout regularization in hierarchical mixture of experts

Ozan Irsoy et al.

Summary: Dropout is an effective method for preventing overfitting in neural networks, and the variant of Dropout in hierarchical mixture of experts can effectively prevent overfitting in tree structures, improve generalization, and provide smoother fits.

NEUROCOMPUTING (2021)

Article Computer Science, Artificial Intelligence

Correlation-based structural dropout for convolutional neural networks

Yuyuan Zeng et al.

Summary: This paper proposes a novel structural dropout method CorrDrop to regularize CNNs by dropping feature units based on feature correlation, which can focus on discriminative information and improve the performance of CNNs.

PATTERN RECOGNITION (2021)

Article Computer Science, Artificial Intelligence

Adaptive sparse dropout: Learning the certainty and uncertainty in deep neural networks

Yuanyuan Chen et al.

Summary: AS-Dropout is a new adaptive sparse dropout method that can learn both certainty and uncertainty in neural network training, increasing network sparsity. Experimental results show that AS-Dropout substantially outperforms traditional dropout and some improved methods on MNIST, COIL-100, and Caltech-101 datasets.

NEUROCOMPUTING (2021)

Proceedings Paper Computer Science, Information Systems

Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer

Zhiwei Liu et al.

Summary: The study introduces a new approach ASReP to enhance short sequences in sequential recommendation by introducing pseudo-prior items to address the cold-start issue in Transformer models. Experimental results confirm the effectiveness of ASReP.

SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (2021)

Proceedings Paper Computer Science, Information Systems

Forecasting Ambulance Demand with Profiled Human Mobility via Heterogeneous Multi-Graph Neural Networks

Zhaonan Wang et al.

Summary: This study aims to predict regional ambulance demand by mining collective daily routines in human mobility, modeling profiled mobility groups as multiple random walkers and proposing a novel neural network structure. Experimental results validate the effectiveness of this approach.

2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021) (2021)

Article Computer Science, Artificial Intelligence

Addressing the Item Cold-Start Problem by Attribute-Driven Active Learning

Yu Zhu et al.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2020)

Proceedings Paper Computer Science, Information Systems

LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation

Xiangnan He et al.

PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20) (2020)

Article Computer Science, Artificial Intelligence

Deep Collaborative Embedding for Social Image Understanding

Zechao Li et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2019)

Article Computer Science, Artificial Intelligence

Regularization of deep neural networks with spectral dropout

Salman H. Khan et al.

NEURAL NETWORKS (2019)

Article Business

Research commentary on recommendations with side information: A survey and research directions

Zhu Sun et al.

ELECTRONIC COMMERCE RESEARCH AND APPLICATIONS (2019)

Proceedings Paper Computer Science, Theory & Methods

Adaptive Feature Sampling for Recommendation with Missing Content Feature Values

Shaoyun Shi et al.

PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19) (2019)

Proceedings Paper Computer Science, Theory & Methods

Knowledge Graph Convolutional Networks for Recommender Systems

Hongwei Wang et al.

WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019) (2019)

Proceedings Paper Computer Science, Information Systems

Neural Graph Collaborative Filtering

Xiang Wang et al.

PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19) (2019)

Article Computer Science, Information Systems

Shakedrop Regularization for Deep Residual Learning

Yoshihiro Yamada et al.

IEEE ACCESS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Exploiting the Sentimental Bias between Ratings and Reviews for Enhancing Recommendation

Yuanbo Xu et al.

2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM) (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Self-Attentive Sequential Recommendation

Wang-Cheng Kang et al.

2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM) (2018)

Proceedings Paper Computer Science, Information Systems

Attention-based Adaptive Model to Unify Warm and Cold Starts Recommendation

Shaoyun Shi et al.

CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Leveraging Meta-path based Context for Top-N Recommendation with A Neural Co-Attention Model

Binbin Hu et al.

KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING (2018)

Proceedings Paper Computer Science, Information Systems

Deep and Confident Prediction for Time Series at Uber

Lingxue Zhu et al.

2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2017) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

CAD: Scale Invariant Framework for Real-Time Object Detection

Huajun Zhou et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017) (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization

Krishna Kumar Singh et al.

2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2017)

Proceedings Paper Computer Science, Information Systems

Neural Factorization Machines for Sparse Predictive Analytics

Xiangnan He et al.

SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (2017)

Article Computer Science, Artificial Intelligence

The MovieLens Datasets: History and Context

F. Maxwell Harper et al.

ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS (2016)

Proceedings Paper Computer Science, Artificial Intelligence

Gradual DropIn of Layers to Train Very Deep Neural Networks

Leslie N. Smith et al.

2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2016)

Proceedings Paper Computer Science, Artificial Intelligence

Hierarchically Gated Deep Networks for Semantic Segmentation

Guo-Jun Qi

2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2016)

Article Computer Science, Artificial Intelligence

Towards dropout training for convolutional neural networks

Haibing Wu et al.

NEURAL NETWORKS (2015)

Proceedings Paper Computer Science, Theory & Methods

Image-based Recommendations on Styles and Substitutes

Julian McAuley et al.

SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (2015)

Review Computer Science, Artificial Intelligence

Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions

G Adomavicius et al.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2005)

Article Computer Science, Artificial Intelligence

Mixture of experts classification using a hierarchical mixture model

MK Titsias et al.

NEURAL COMPUTATION (2002)