ICPS

2021 APS Virtual Convention · 2021

Concerns about Quality of Data Gathered on Mturk: Inexperienced Researchers Are Partially to Blame

Virtual · May 2021

Posters · Methodology

  • Brendan Shanahan
    The University of Texas at Austin
  • Michael Mackay
    Ball State University

Abstract

When conducting research via Amazon Turk (MTurk), researchers set restrictions on which MTurk workers can participate in their study. We compared how more-experienced (vs. less-experienced) MTurk researchers use these restrictions across 406 studies, and found that more-experienced researchers set restrictions which help mitigate reported concerns regarding poor-quality MTurk data.

Other