Investigator accuracy: A center-weighted metric for evaluating the location accuracy of image segments in land cover classification

Accuracy evaluation is an essential step in validating image segmentation results. Existing metrics, such as overall accuracy and F1-score, mainly concern the range and consistency of the semantic labels of image seg-ments, which may not be sufficiently sensitive to detect missing or segmentation errors in small patches. To address this issue, this study proposes the investigator accuracy (IA) metric, which focuses on the location ac-curacy of single patches by evaluating the capture accuracy of their near-center subregions and category weight to determine the image segmentation quality. Before evaluating the IA metric, we optimize the grayscale dilation algorithm to separate each identified patch from the image without converting the data format and then distinguish each patch as embedded or nonembedded. Next, we use an iterative grayscale erosion approach to assess the distance-to-center weight, which is a crucial parameter for evaluating the IA of each pixel in a single patch. In addition, we apply a parallel analysis scheme to improve the efficiency of the IA evaluation. The results indicate that the capture accuracy of near-center subregions and the category weight of a single patch affect its IA. Unlike commonly used metrics, the IA is independent of the area ratio and the number of patches belonging to multiple landcover types. The output of the intermediate analysis steps can be used to produce thematic maps showing the distribution density of target patches.

Automated summary

This study proposes the investigator accuracy (IA) metric for image segmentation validation, focusing on the location accuracy of single patches. It evaluates the capture accuracy of near-center subregions and category weight to determine segmentation quality. Grayscale dilation and erosion algorithms are optimized, and a parallel analysis scheme is applied for efficient IA evaluation. Results show that the capture accuracy and category weight of a patch affect its IA.