4.7 Article

GridMix: Strong regularization through local context mapping

Journal

PATTERN RECOGNITION
Volume 109, Issue -, Pages -

Publisher

ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2020.107594

Keywords

Deep learning; Network regularization; Data augmentation

Funding

  1. Basic Science Research Program through the National Research Foundation of Korea (NRF) - MSIP [NRF-2019R1A2C2006123, 2020R1A4A1016619]
  2. Institute of Information & Communications Technology Planning & Evaluation (IITP) - Korea government (MSIT) [2020-0-01361]
  3. MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program [IITP-2020-2016-0-00288]
  4. IITP - Korea government (MSIP) [2018-000198]

Ask authors/readers for more resources

This paper introduces a method called GridMix for improving network generalization by predicting patch-level labels and utilizing grid-based mixing for local data augmentation. Experimental results show that GridMix outperforms state-of-the-art techniques in classification and adversarial robustness, achieving comparable performance in weakly supervised object localization.
Recently developed regularization techniques improve the networks generalization by only considering the global context. Therefore, the network tends to focus on a few most discriminative subregions of an image for prediction accuracy, leading the network being sensitive to unseen or noisy data. To address this disadvantage, we introduce the concept of local context mapping by predicting patch-level labels and combine it with a method of local data augmentation by grid-based mixing, called GridMix. Through our analysis of intermediate representations, we show that our GridMix can effectively regularize the network model. Finally, our evaluation results indicate that GridMix outperforms state-of-the-art techniques in classification and adversarial robustness, and it achieves a comparable performance in weakly supervised object localization. (C) 2020 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available