A Multimodal Data Fusion and Deep Learning Framework for Large-Scale Wildfire Surface Fuel Mapping

Accurate estimation of fuels is essential for wildland fire simulations as well as decision-making related to land management. Numerous research efforts have leveraged remote sensing and machine learning for classifying land cover and mapping forest vegetation species. In most cases that focused on surface fuel mapping, the spatial scale of interest was smaller than a few hundred square kilometers; thus, many small-scale site-specific models had to be created to cover the landscape at the national scale. The present work aims to develop a large-scale surface fuel identification model using a custom deep learning framework that can ingest multimodal data. Specifically, we use deep learning to extract information from multispectral signatures, high-resolution imagery, and biophysical climate and terrain data in a way that facilitates their end-to-end training on labeled data. A multi-layer neural network is used with spectral and biophysical data, and a convolutional neural network backbone is used to extract the visual features from high-resolution imagery. A Monte Carlo dropout mechanism was also devised to create a stochastic ensemble of models that can capture classification uncertainties while boosting the prediction performance. To train the system as a proof-of-concept, fuel pseudo-labels were created by a random geospatial sampling of existing fuel maps across California. Application results on independent test sets showed promising fuel identification performance with an overall accuracy ranging from 55% to 75%, depending on the level of granularity of the included fuel types. As expected, including the rare-and possibly less consequential-fuel types reduced the accuracy. On the other hand, the addition of high-resolution imagery improved classification performance at all levels.

Automated summary

Accurate estimation of fuels is crucial for wildland fire simulations and land management decision-making. A large-scale surface fuel identification model using a custom deep learning framework was developed, which can combine multimodal data. Deep learning was used to extract information from multispectral signatures, high-resolution imagery, and biophysical climate and terrain data for end-to-end training on labeled data. The system was trained using fuel pseudo-labels created through random geospatial sampling of existing fuel maps in California. Promising results were obtained on independent test sets, with an overall accuracy ranging from 55% to 75%, depending on the granularity of the included fuel types. High-resolution imagery improved the classification performance at all levels.