期刊
ECOLOGICAL INFORMATICS
卷 71, 期 -, 页码 -出版社
ELSEVIER
DOI: 10.1016/j.ecoinf.2022.101782
关键词
User-generated content; Volunteered geographic information; Data integration; Image content analysis; Convolutional neural networks
类别
资金
- Swiss National Science Foundation project EVA- VGI 2 [186389]
- German Research Foundation [424985896, 424966858, 314671965]
There is an urgent need to develop new methods for monitoring the environment, and using new data sources such as User-Generated Content can improve existing approaches. Our study focuses on using citizen science records to train a Convolutional Neural Network (CNN) that can identify images of red kites, and integrating this CNN into a workflow with bird classifiers and text metadata. By combining image and text classifiers, we achieve almost perfect precision.
There is an urgent need to develop new methods to monitor the state of the environment. One potential approach is to use new data sources, such as User-Generated Content, to augment existing approaches. However, to date, studies typically focus on a single date source and modality. We take a new approach, using citizen science records recording sightings of red kites (Milvus milvus) to train and validate a Convolutional Neural Network (CNN) capable of identifying images containing red kites. This CNN is integrated in a sequential workflow which also uses an off-the-shelf bird classifier and text metadata to retrieve observations of red kites in the Chilterns, England. Our workflow reduces an initial set of more than 600,000 images to just 3065 candidate images. Manual inspection of these images shows that our approach has a precision of 0.658. A workflow using only text identifies 14% less images than that including image content analysis, and by combining image and text classifiers we achieve almost perfect precision of 0.992. Images retrieved from social media records complement those recorded by citizen scientists spatially and temporally, and our workflow is sufficiently generic that it can easily be transferred to other species.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据