Novel groundtruth transformations for the aesthetic assessment problem

Aesthetic assessment evaluates the quality of a given image using subjective annotations, commonly user ratings, as a knowledge base. Rating complexity is usually relaxed in state-of-the-art works by employing a binary high/low quality label computed from the mean value of rating votes. Nevertheless, this approach introduces uncertainty to average-quality images, which may affect the performance of machine learning models trained from annotated data.In this work, we present a novel approach to aesthetic assessment based on redefining the rating-based groundtruths present in most datasets. Our intent is twofold: to reduce the rating uncertainty and to automatically group them into clusters reflecting high and low quality patterns, thus avoiding an arbitrary threshold like 5 in 1-10 ratings. The experimentation uses the well-known AVA dataset, which consists of more than 255,000 images, and we train several CNN models to test our new groundtruths against the baseline ones. The results show that our approach achieves significant performance gains, between 3% and 9% more balanced accuracy than the baseline groundtruths.

Automated summary

Aesthetic assessment evaluates image quality using subjective annotations. This study presents a new approach based on redefining the rating-based groundtruths to reduce uncertainty and automatically group images into high and low quality patterns. Experimental results on the AVA dataset show significant performance gains, achieving 3% to 9% more balanced accuracy than baseline groundtruths.