4.6 Article

Face super resolution based on attention upsampling and gradient

期刊

出版社

SPRINGER
DOI: 10.1007/s11042-023-15502-x

关键词

Face super-resolution; Convolutional neural network; Upsampling with attention; Gradient information

向作者/读者索取更多资源

This study proposes a face super-resolution method guided by the gradient structure, which uses a sub-network to generate gradient information from low-resolution images and incorporates it as additional information for the entire network. Additionally, a novel upsampling module based on channel attention and pixel attention is designed. Experimental results demonstrate that the network achieves state-of-the-art performance on various evaluation metrics and effectively restores the detailed structure of the images.
Face Super-Resolution(SR) is a specific domain SR task, which is to reconstruct low-resolution(LR) face images. Recently, many face super-resolution methods based on deep neural networks have sprung up, yet many methods ignore the gradient information of the face image, which is related closely to the restoration of image detail features. At the same time, many super-resolution methods directly use linear interpolation or pixel shuffle and several convolution layers to up-sample the feature maps, caussing some irrelevant pixels will make subsequent detail reconstruction difficult. Considering these issues, in this paper, we propose a face super-resolution method guided by the gradient structure. In particular, we designed a sub-network to generate gradient information from low-resolution images and up-sample the gradient as additional information for the entire network. Unlike other methods based on prior information, such as facial landmarks, facial parsing, face alignment, the gradient information is generated from low-resolution images. At the same time, relying on pixel shuffle, we also designed a novel upsampling module based on channel attention and pixel attention. The results of the experiment show that our network can achieve the sota on several public datasets on PSNR, SSIM, and VIF. The visual result also proves the feasibility and advancement of our network in restoring the detailed structure.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据