Quantifying the accuracies of six 30-m cropland datasets over China: A comparison and evaluation analysis

With the development of remote sensing technology, more and more fine-resolution cropland datasets have emerged as powerful tools for agriculture planning and food security evaluation. But questions about their accuracy and reliability must be answered before using them, making evaluations necessary. So far, little attention has been paid to the performance of fine-resolution (e.g., 30 m) and cropland-specific products at continental or regional scales. This study implemented a comparison analysis and accuracy assessment for six cropland products with a 30-m resolution in China circa 2015, including FROM-GLC, GLC_FCS, CLCD, AGLC, GFSAD, GLAD. Their similarities and disparities were delineated at national, provincial, meridional, and zonal scales. 33,713 ground truth points were then collected through visual interpretation of Google Earth images and from existing available validation datasets, to evaluate the pixel-wise accuracy of them across China. In terms of spatial consistency, high agreement among the six products could be found in North China Plain and Northeast China, and low agreement was found in Southern, Southwest, and Northwest China. Topography including elevation and slope were important factors influencing spatial consistency. As for provincial area accuracy, CLCD and AGLC were most correlated with statistical data (r(2) > 0.9), followed by GLAD (0.88) and AGLC (0.87). FROM-GLC had the lowest correlation (r(2) = 0.37) with statistics. The relative area differences between each product and statistics also demonstrated that CLCD had the best area accuracies in most provinces. By contrast, GLC_FCS had a severe overestimation and FROM-GLC suffered from a large underestimation of cropland area. Last, the pixel-wise validation results indicated that CLCD and GLAD had the highest overall accuracy (OA) of 0.88, followed by AGLC (0.85) and GFSAD (0.84). FROM-GLC and GLC_FCS had the lowest OAs of less than 0.70. The comparison and evaluation results in this study can provide insights into the national and provincial performances of these fine-resolution cropland products and give valuable references for guiding data usage and help to improve future land use/cover mapping.

Automated summary

With the development of remote sensing technology, fine-resolution cropland datasets have become powerful tools for agriculture planning and food security evaluation. This study compared and evaluated six crop-land products in China in 2015, finding differences in spatial consistency, provincial area accuracy, and pixel-wise accuracy.