APS

APS Virtual Poster Showcase · 2020

Sequential Testing Methods and the Replication Crisis

Virtual · June 2020

Poster Sessions · Methodology

  • Kathryn Hoisington-Shaw
    The Ohio State University
  • Jacob Coutts
    University of Maryland at College Park
  • Jolynn Pek
    The Ohio State University

Abstract

Conducting significance tests at multiple times during data collection (i.e., sequential testing) holds the promise of obtaining reliable findings with smaller sample size, but this remains a controversial method. We review and evaluate methods of sequential testing with computer simulations and report on their potential strengths and limitations.

Statistics and Methodology