Assessing the performance of open-source, semi-automated pattern recognition software for harbour seal (P. v. vitulina) photo ID

Photographic identification (photo ID) is a well-established, non-invasive, and relatively cost-effective technique to collect longitudinal data from species that can be individually recognised based on natural markings. This method has been improved by computer-assisted pattern recognition software which speed up the processing of large numbers of images. Freely available algorithms exist for a wide range of species, but the choice of software can have significant effects on the accuracy of individual capture histories and derived demographic parameter estimates. We tested the performance of three open source, semi-automated pattern recognition software algorithms for harbour seal (Phoca vitulina vitulina) photo ID: ExtractCompare, (IS)-S-3 Pattern and Wild-ID. Performance was measured as the ability of the software to successfully score matching images higher than non-matching images using the cumulative density function (CDF). The CDF for the top ranked potential match was highest for Wild-ID (CDF1 = 0.34-0.58), followed by ExtractCompare (CDF1 = 0.24-0.36) and (IS)-S-3 pattern (CDF1 = 0.02-0.3). This trend emerged regardless of how many potential matches were inspected. The highest performing aspects in ExtractCompare were left heads, whereas in (IS)-S-3 Pattern and Wild-ID these were front heads. Within each aspect, images collected using a camera and lens performed higher than images taken by a camera and scope. Data processing within ExtractCompare took > 4 x longer than Wild-ID, and > 3 x longer than (IS)-S-3 Pattern. We found that overall, Wild-ID outperformed both ExtractCompare and (IS)-S-3 Pattern under tested scenarios, and we therefore recommend its assistance in harbour seal photo ID.

Automated summary

Photographic identification is a reliable and efficient method for collecting data from individually recognisable species based on natural markings. In the case of harbour seal photo ID, Wild-ID outperformed ExtractCompare and (IS)-S-3 Pattern, making it a recommended choice for researchers.