期刊
PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17)
卷 -, 期 -, 页码 217-225出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3123266.3123445
关键词
Visual sentiment; social multimedia; neural network
资金
- National Research Foundation, Prime Ministers Office, Singapore under its International Research Centre in Singapore Funding Initiative
- University of Minnesota Department of Computer Science and Engineering Start-up Fund
Automated assessment of visual sentiment has many applications, such as monitoring social media and facilitating online advertising. In current research on automated visual sentiment assessment, images are mainly input and processed as a whole. However, human attention is biased, and a focal region with high acuity can disproportionately influence visual sentiment. To investigate how attention influences visual sentiment, we conducted experiments that reveal critical insights into human perception. We discover that negative sentiments are elicited by the focal region without a notable influence of contextual information, whereas positive sentiments are influenced by both focal and contextual information. Building on these insights, we create new deep convolutional neural networks for sentiment prediction that have additional channels devoted to encoding focal information. On two benchmark datasets, the proposed models demonstrate superior performance compared with the state-of-the-art methods. Extensive visualizations and statistical analyses indicate that the focal channels are more effective on images with focal objects, especially for images that also elicit negative sentiments.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据