Effects of #coronavirus content moderation on misinformation and anti-Asian hate on Instagram

This study evaluated the intended and unintended effects of Instagram's content moderation on #coronavirus for both the short- and long-term effects on misinformation and anti-Asian sentiment. We performed manual coding of images (N = 9648), and a series of supervised machine learning methods to classify three waves of comments (N = 22,676) published in 2020 on Instagram. Welch's F tests were used to compare misinformation, emotions, toxicity, and identity attack across three time periods. The results showed that hashtag moderation had an intended effect in reducing misinformation, and an unintended effect in reducing anger, fear, toxicity, and identity attack. Images with people of East Asian descent were associated with more anger, fear, toxicity, and identity attack than images with people of other races. Prior to content moderation, misinformation was associated with identity attack. Stigmatization on social media, and content moderation of misinformation and hate speech are discussed.

Automated summary

This study examined the effects of Instagram's content moderation on #coronavirus, specifically focusing on the reduction of misinformation and anti-Asian sentiment. The researchers manually analyzed images and used supervised machine learning to classify comments published in 2020. The results showed that moderation had positive effects in reducing misinformation and negative effects in reducing negative emotions and attacks on identity. Images featuring people of East Asian descent were found to elicit more negative reactions. This study emphasizes the importance of addressing stigmatization and implementing effective content moderation strategies.