4.7 Article

Theme-Aware Semi-Supervised Image Aesthetic Quality Assessment

期刊

MATHEMATICS
卷 10, 期 15, 页码 -

出版社

MDPI
DOI: 10.3390/math10152609

关键词

image aesthetic assessment; semi-supervised learning; label propagation; deep learning; computer vision

资金

  1. National Natural Science Foundation of China [62001385,62002290]
  2. Key RD Program of Shaanxi [2021ZDLGY15-03]
  3. China Postdoctoral Science Foundation [2021MD703883]

向作者/读者索取更多资源

Image aesthetic quality assessment is widely used in various applications, but existing methods require excessive labeled data. This study proposes a theme-aware semi-supervised method to address this issue, achieving comparable performance with fully supervised learning. This method consists of a representation learning step and a label propagation step.
Image aesthetic quality assessment (IAQA) has aroused considerable interest in recent years and is widely used in various applications, such as image retrieval, album management, chat robot and social media. However, existing methods need an excessive amount of labeled data to train the model. Collecting the enormous quantity of human scored training data is not always feasible due to a number of factors, such as the expensiveness of the labeling process and the difficulty in correctly classifying data. Previous studies have evaluated the aesthetic of a photo based only on image features, but have ignored the criterion bias associated with the themes. In this work, we present a new theme-aware semi-supervised image quality assessment method to address these difficulties. Specifically, the proposed method consists of two steps: a representation learning step and a label propagation step. In the representation learning step, we propose a robust theme-aware attention network (TAAN) to cope with the theme criterion bias problem. In the label propagation step, we use preliminary trained TAAN by step one to extract features and utilize the label propagation with a cumulative confidence (LPCC) algorithm to assign pseudo-labels to the unlabeled data. This enables use of both labeled and unlabeled data to train the TAAN model. To the best of our knowledge, this is the first time that a semi-supervised learning method to address image aesthetic assessment problems has been studied. We evaluate our approach on three benchmark datasets and show that it can achieve almost the same performance as a fully supervised learning method for a small number of samples. Furthermore, we show that our semi-supervised approach is robust to using varying quantities of labeled data.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据