期刊
EXPERT SYSTEMS WITH APPLICATIONS
卷 215, 期 -, 页码 -出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.eswa.2022.119268
关键词
Image quality assessment; Self-attention; Adaptive spatial and channel merging; Image to patch weights sharing
This paper investigates the feasibility of incorporating channel-wise attention mechanism in blind image quality assessment (BIQA). An adaptive spatial and channel attention merging Transformer (ASCAM-Former) is proposed to aggregate both spatial-wise and channel-wise attention information. Experimental results show that channel-wise attention mechanism is as competitive as spatial-wise, and the ASCAM-Former yields accurate predictions on image quality datasets.
Blind Image Quality Assessment (BIQA) is a challenging, unsolved research topic which is crucial for analyzing, understanding, and improving visual experience. Recently, transformer-based BIQA models are drawing increasing attention due to their powerful capacity in modeling global dependencies amongst tokens. However, existing works tend to apply self-attention mechanism for exploring the spatial dependencies whilst neglecting the impact of channel-wise self-attention. In this paper, we explore the feasibility of incorporating attention mechanism in a channel-wise manner for BIQA. By systematically studying the interactions between channel-wise and spatial-wise attention, an adaptive spatial and channel attention merging Transformer (ASCAM-Former) is then proposed for aggregating both the spatial-wise and channel-wise attention informa-tion. In addition, to accommodate IQA datasets containing both image and patch quality labels, an image to patch weights sharing (I2PWS) scheme is designed to take advantage of local quality learning tasks for reinforcing the learning of global quality, and vice versa. The experimental results indicate that channel-wise attention mechanism is as competitive as spatial-wise for IQA tasks, and the proposed ASCAM-Former yield accurate prediction on both authentically and synthetically distorted image quality datasets.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据