Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion

In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion.

Automated summary

An efficient night vision anti-halation method based on video fusion is proposed in this paper to address the discontinuity issue caused by directly applying the infrared and visible image fusion anti-halation method to a video. The method utilizes frame selection based on inter-frame difference and time-mark-based adaptive motion compensation to improve the processing efficiency of video fusion and ensure the continuity and consistency of the video content. Experimental results demonstrate the effectiveness of the proposed method in various halation scenes.