Active Learning Exercise to Teach Undergraduate Students the Dangers of Researcher Degrees of Freedom

Students completed a coin-flipping activity to demonstrate the dangers of basing data collection stop-rules on interim data analysis. Students understanding of proper sampling stop-rules significantly improved from before to after the activity, t (23) = 3.6507, p = .0013, d =.75.