APS

APS Virtual Poster Showcase

Unrelated or Unreliable? Sources of—and Solutions to—the Mismeasurement Pervasive across Psychological Science

Friday, May 22, 2020 · Virtual

Oral · Methodology

Here, we will: (1) describe measurement issues, including low test-retest reliability, that arise across a wide range of behavioral tasks; (2) use simulations to show how such measurement problems bias inference; and (3) show that Bayesian methods including hierarchical Bayesian analysis and adaptive design optimization can improve upon
traditional approaches.

Chairs & Discussants

  • Nathaniel HainesChair
    The Ohio State University

Presentations

  1. On the (in)Validity of Behavioral Self-Regulation TasksKevin King
  2. Reliable, Precise, and Efficient Measurement of Latent Decision-Making Processes Using Bayesian Adaptive Design OptimizationJaeyeong Yang
  3. Hierarchies Improve Individual Assessment of Temporal Discounting BehaviorM. Fiona Molloy
  4. Revisiting the Reliability Paradox: Generative Models Infer High Test-Retest Reliability across a Broad Range of Otherwise “Unreliable” Behavioral TasksNathaniel Haines