Journal
NEUROCOMPUTING
Volume 296, Issue -, Pages 23-32Publisher
ELSEVIER
DOI: 10.1016/j.neucom.2018.03.031
Keywords
Cross-domain retrieval; Multi-layer modeling; Deep feature fusion
Categories
Funding
- Shandong Provincial Natural Science Foundation [ZR2015FM011, ZR2013FM036]
- National Natural Science Foundation of China [61379106, 61379082, 61227802]
Ask authors/readers for more resources
The purpose of this paper is to introduce a new approach for the free-hand sketch representation in the sketch based image retrieval (SBIR), where the sketches are treated as the queries to search for the natural photos in the natural image dataset. This task is known as an extremely challenging work for 3 main reasons: (i) sketches show a highly abstract visual appearance versus natural photos, fewer context can be extracted as descriptors using the existing methods, (ii) for the same object, different people provide widely different sketches, making sketch-photo matching harder, (iii) mapping the sketches and photos into a common domain is also a challenging task. In this paper, we address the cross-domain question using a strategy of mapping sketches and natural photos in multiple layers. For the first time, we introduce a multi-layer deep CNNs framework to train the multi-layer representation of free hand sketches and natural photos. We use Flickr15k dataset as benchmark for the retrieval and show that our learned representation significantly outperformances both hand-crafted features as well as deep features trained by sketches or photos. (C) 2018 Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available