Journal
CRIME & DELINQUENCY
Volume 67, Issue 12, Pages 1962-1981Publisher
SAGE PUBLICATIONS INC
DOI: 10.1177/0011128720977439
Keywords
web survey; public opinion; Amazon Mechanical Turk; sample matching
Categories
Ask authors/readers for more resources
Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Matched opt-in samples are more likely to provide relational inferences that generalize compared to unmatched samples.
Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Not all opt-in samples are alike, however, and matching may improve data quality. Replicating and extending prior work, we compare the generalizability of relational inferences from unmatched and matched opt-in samples. Estimating identical models for four criminal justice outcomes, we compare multivariate regression results from national matched (YouGov) and unmatched (MTurk) opt-in samples to those from the General Social Survey (GSS). YouGov coefficients are almost always in the same direction as GSS coefficients, especially when statistically significant, and are mostly of a similar magnitude; less than 10% of the YouGov and GSS coefficients differ significantly. By contrast, MTurk coefficients are more likely to be in the wrong direction, more likely to be much larger or smaller, and are about three times as likely to differ significantly from GSS coefficients. Matched opt-in samples provide a relatively inexpensive data source for criminal justice researchers, compared to probability samples, and also appear to carry a smaller generalizability penalty than unmatched samples. Our study suggests relational inferences from matched opt-in samples are more likely to generalize than those from unmatched samples.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available