ICPS

2021 APS Virtual Convention · 2021

Researchers’ Sampling Choices When Using Mturk Exacerbate Concerns about Data Quality

Virtual · May 2021

Posters · Methodology

  • Sydney Hughes
    University of Charleston
  • Michael Mackay
    Ball State University

Abstract

We show that concerns raised about data collection on MTurk (e.g., many workers are non-English-speaking, frequent careless responding, presence of impostors) are partly due to researchers’ incorrect use of study entry restrictions (e.g., limiting study access to only experienced workers) and researchers’ unwillingness to report workers who submit poor-quality work.

Other