Towards a continent-wide ecological site condition database using calibrated expert evaluations

A cost-effective way of undertaking comprehensive, continental-scale, assessments of ecological condition is needed to support large-scale conservation planning, monitoring, reporting, and decision-making. Currently, cross-jurisdictional inconsistency in assessment methods limits the capacity to scale-up monitoring. Here we present a novel way to build a coherent continent-wide site-level ecological condition dataset, using cross-calibration methods to integrate assessments from many observers. We focus on the use of condition assessments from individual expert observers, a currently untapped resource. Our approach has two components: (1) a simple online tool that captures expert assessments at specific locations; (2) a process of calibrating and rescaling disparate expert evaluations that can be applied to the data to provide a consistent dataset for use in conservation assessments. We describe a pilot study, involving 28 experts, who contributed 314 individual site condition assessments across a wide range of ecosystems and regions throughout continental Australia. A correction factor for each expert was used to rescale the contributed site condition assessment scores, based on a set of 77 photographic images, each scored for their condition by multiple experts, using a linear mixed model. Our approach shows strong promise for delivering the volumes of data required to develop continental-scale reference libraries of site condition assessments. Although developed from expert elicitation, the approach could also be used to harmonize the collation of existing condition datasets. The process we demonstrate can also facilitate online citizen scientists to make site condition assessments that can be cross-calibrated using contributed images.

Automated summary

A cost-effective method is needed for conducting comprehensive assessments of ecological condition at a continental scale. Cross-jurisdictional inconsistency in assessment methods currently limits the expansion of monitoring efforts. This study presents a novel approach that integrates assessments from multiple observers to build a coherent continent-wide dataset for conservation assessments.