APS
2023 APS Annual Convention · 2023
Collecting Data from Mturk? Descriptive Findings, Reliability Estimates, and Validity Coefficients Can be Distorted Unless You Detect and Remove Low Quality Data
- Alexis Webster
- Xuyan Tang
University of British Columbia - Anita Hubley
University of British Columbia
Abstract
We collected mental health data in an online survey using MTurk. Prevention strategies excluded ineligible respondents and rigorous detection strategies identified ~15% of our remaining data as low quality. We found significant differences (with moderate-to-large effect sizes) between high and low quality data in descriptives, reliability estimates, and validity coefficients.
Other
