Journal
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING
Volume 145, Issue -, Pages 96-107Publisher
ELSEVIER
DOI: 10.1016/j.isprsjprs.2018.01.021
Keywords
Semantic labeling; Deep learning; Rotation invariance; Sub-decimeter resolution
Categories
Funding
- Swiss National Science Foundation [PZ00P2-136827]
- Swiss National Science Foundation (SNF) [PZ00P2_136827] Funding Source: Swiss National Science Foundation (SNF)
Ask authors/readers for more resources
In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations in the same image. Equivariance to rotation, in this context understood as responding with a rotated semantic label map when subject to a rotation of the input image, is therefore a very desirable feature, in particular for high capacity models, such as Convolutional Neural Networks (CNNs). If rotation equivariance is encoded in the network, the model is confronted with a simpler task and does not need to learn specific (and redundant) weights to address rotated versions of the same object class. In this work we propose a CNN architecture called Rotation Equivariant Vector Field Network (RotEgNet) to encode rotation equivariance in the network itself. By using rotating convolutions as building blocks and passing only the values corresponding to the maximally activating orientation throughout the network in the form of orientation encoding vector fields, RotEciNet treats rotated versions of the same object with the same filter bank and therefore achieves state-of-the-art performances even when using very small architectures trained from scratch. We test RotaiNet in two challenging sub-decimeter resolution semantic labeling problems, and show that we can perform better than a standard CNN while requiring one order of magnitude less parameters. (C) 2018 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS). Published by Elsevier B.V. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available