APS
2026 APS Annual Convention · 2026
Replication Crisis Update: Convenient Samples Vary More Than Random Samples
- Carl Scott
CS Statistics
Abstract
The replication crisis in psychology unsettled many but lacked resolution. I examined the possible role of nonrandom samples. I drew 134 convenient and random samples from a large dataset. Results from convenient samples tracked population values, were more variable, and less likely to find statistical significance, relative to random samples.