期刊
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
卷 33, 期 3, 页码 1335-1348出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCSVT.2022.3210602
关键词
Image matching; Convolutional neural networks; Task analysis; large scale changes; scale difference reduction; scale ratio estimation; covisibility-attention-reinforced matching module
Most image matching methods fail to handle large scale changes in images. To address this issue, we propose a Scale-Difference-Aware Image Matching method (SDAIM) that reduces image scale differences before local feature extraction. Our proposed Covisibility-Attention-Reinforced Matching module (CVARM) accurately estimates the scale ratio for SDAIM, and the Scale-Net improves upon existing scale ratio estimation methods. Quantitative and qualitative experiments demonstrate that Scale-Net has higher accuracy and better generalization ability. Moreover, SDAIM and Scale-Net significantly enhance the performance of local feature matching methods.
Most image matching methods perform poorly when encountering large scale changes in images. To solve this problem, we propose a Scale-Difference-Aware Image Matching method (SDAIM) that reduces image scale differences before local feature extraction, via resizing both images of an image pair according to an estimated scale ratio. In order to accurately estimate the scale ratio for the proposed SDAIM, we propose a Covisibility-Attention-Reinforced Matching module (CVARM) and then design a novel neural network, termed as Scale-Net, based on CVARM. The proposed CVARM can lay more stress on covisible areas within the image pair and suppress the distraction from those areas visible in only one image. Quantitative and qualitative experiments confirm that the proposed Scale-Net has higher scale ratio estimation accuracy and much better generalization ability compared with all the existing scale ratio estimation methods. Further experiments on image matching and relative pose estimation tasks demonstrate that our SDAIM and Scale-Net are able to greatly boost the performance of representative local features and state-of-the-art local feature matching methods.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据