Optimal fusion of optical and SAR high-resolution images for semiautomatic building detection

Building detection from different high-resolution aerial and satellite images has been a notable research topic in recent decades. The primary challenges are occlusions, shadows, different roof types, and similar spectral behavior of urban covers. Integration of different data sources is a solution to supplement the input feature space and improve the existing algorithms. Regarding the different nature and unique characteristics of optical and radar images, there are motivations for their fusion. This paper is aimed to identify an optimal fusion of radar and optical images to overcome their individual shortcomings and weaknesses. For this reason, panchromatic, multispectral, and radar images were first classified individually, and their strengths and weaknesses were evaluated. Different feature-level fusions of these data sets were then assessed followed by a decision-level fusion of their results. In both the feature and decision levels of integration, artificial neural networks were applied as the classifiers. Several post-processing methods using normalized different vegetation index, majority filter, and area filter were finally applied to the results. Overall accuracy of 92.8% and building detection accuracy of 89.1% confirmed the ability of the proposed fusion strategy of optical and radar images for building detection purposes.