Weighted LIC-Based Structure Tensor With Application to Image Content Perception and Processing

As a famous visual content perception and processing tool, structure tensor has been widely studied in the past decades. Among them, the anisotropic nonlocal structure tensor (ANLST) has received much attention, recently. However, the existing ANLST calculation methods fail to fully utilize the anisotropic characteristic of the tensor field, thus resulting in limited performance. For this problem, in this article, we present a novel ANLST construction method, by means of combining tensor decomposition with weighted line integral convolution (LIC) with the aim at deeply discovering and exploiting the spatial direction relevancy of the tensors for their regularization. At first, the tensors decomposition, computed by direction projection, yields multiple atomic vector fields, from which, for each point in the tensor field we obtain a family of integral curves that are associated with spatial direction related tensors. Then, LIC is employed with the nonlocal means filtering to smooth the tensors relevant to each integral curve, giving rise to curve-level structure tensor (CLST). At last, a weighted average scheme is carried out on the multiple CLSTs, leading to our proposed weighted anisotropic nonlocal structure tensor (WANST). Experimental results demonstrate that the proposed WANST is superior to the current representative nonlinear structure tensors. The proposed WANST can be applied to industrial surveillance system to enable it perceive image contents, such as flat regions, corners, textures, and edges. In addition, WANST can also help monitoring system improve its image quality.

Automated summary

In this article, a novel ANLST construction method is proposed by combining tensor decomposition with weighted line integral convolution, aiming at deeply exploring and exploiting the spatial direction relevancy of the tensors for their regularization. The experimental results demonstrate that the proposed method outperforms current representative nonlinear structure tensors, and it can be applied in industrial surveillance systems to enhance image perception and quality.