期刊
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING
卷 14, 期 -, 页码 2817-2832出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSTARS.2021.3059054
关键词
Cameras; Image registration; Video sequences; Monitoring; Annotations; Unmanned aerial vehicles; Temperature measurement; Fire behavior; image registration; KAZE; remote sensing; unmanned aerial systems (UAS); video stabilization; wildland fire
类别
资金
- Spanish Ministry of Education, Culture, and Sport [FPU13/05876]
- Spanish Ministry of Economy and Competitiveness [CTM2014-57448-R, CTQ2017-85990-R]
- FEDER funds
- Autonomous Government of Catalonia [2017-SGR-392]
- Erasmus+ Traineeship Program
- Obra Social La Caixa Research Mobility Grants
Measuring wildland fire behavior using aerial thermal infrared imaging is essential, but requires stabilization and georeferencing. A software-based video stabilization algorithm specifically designed for forest fire TIR imagery has been developed, showing high accuracy and robustness. This algorithm addresses the instability issues caused by sensor movement and fire-generated turbulence, enabling meaningful feature matches and robust performance in the presence of faulty video frames.
Measuring wildland fire behavior is essential for fire science and fire management. Aerial thermal infrared (TIR) imaging provides outstanding opportunities to acquire such information remotely. Variables such as fire rate of spread (ROS), fire radiative power (FRP), and fireline intensity may be measured explicitly both in time and space, providing the necessary data to study the response of fire behavior to weather, vegetation, topography, and firefighting efforts. However, raw TIR imagery acquired by unmanned aerial vehicles (UAVs) requires stabilization and georeferencing before any other processing can be performed. Aerial video usually suffers from instabilities produced by sensor movement. This problem is especially acute near an active wildfire due to fire-generated turbulence. Furthermore, the nature of fire TIR video presents some specific challenges that hinder robust interframe registration. Therefore, this article presents a software-based video stabilization algorithm specifically designed for TIR imagery of forest fires. After a comparative analysis of existing image registration algorithms, the KAZE feature-matching method was selected and accompanied by pre- and postprocessing modules. These included foreground histogram equalization and a multireference framework designed to increase the algorithm's robustness in the presence of missing or faulty frames. The performance of the proposed algorithm was validated in a total of nine video sequences acquired during field fire experiments. The proposed algorithm yielded a registration accuracy between 10 and 1000x higher than other tested methods, returned 10x more meaningful feature matches, and proved robust in the presence of faulty video frames. The ability to automatically cancel camera movement for every frame in a video sequence solves a key limitation in data processing pipelines and opens the door to a number of systematic fire behavior experimental analyses. Moreover, a completely automated process supports the development of decision support tools that can operate in real time during an emergency.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据