Issues with Large Area Thematic Accuracy Assessment for Mapping Cropland Extent: A Tale of Three Continents

Accurate, consistent and timely cropland information over large areas is critical to solve food security issues. To predict and respond to food insecurity, global cropland products are readily available from coarse and medium spatial resolution earth observation data. However, while the use of satellite imagery has great potential to identify cropland areas and their specific types, the full potential of this imagery has yet to be realized due to variability of croplands in different regions. Despite recent calls for statistically robust and transparent accuracy assessment, more attention regarding the accuracy assessment of large area cropland maps is still needed. To conduct a valid assessment of cropland maps, different strategies, issues and constraints need to be addressed depending upon various conditions present in each continent. This study specifically focused on dealing with some specific issues encountered when assessing the cropland extent of North America (confined to the United States), Africa and Australia. The process of accuracy assessment was performed using a simple random sampling design employed within defined strata (i.e., Agro-Ecological Zones (AEZ's) for the US and Africa and a buffer zone approach around the cropland areas of Australia. Continent-specific sample analysis was performed to ensure that an appropriate reference data set was used to generate a valid error matrix indicative of the actual cropland proportion. Each accuracy assessment was performed within the homogenous regions (i.e., strata) of different continents using different sources of reference data to produce rigorous and valid accuracy results. The results indicate that continent-specific modified assessments performed for the three selected continents demonstrate that the accuracy assessment can be easily accomplished for a large area such as the US that has extensive availability of reference data while more modifications were needed in the sampling design for other continents that had little to no reference data and other constraints. Each continent provided its own unique challenges and opportunities. Therefore, this paper describes a tale of these three continents providing recommendations to adapt accuracy assessment strategies and methodologies for validating global cropland extent maps.