APS

2026 APS Annual Convention

Potential Bias In Psychological Research

Saturday, May 30, 2026 · Barcelona, Spain

Oral · How We Know: Methods, Measurement & Open Science

We address bias in psychological research by evaluating methods for assessing replication success in 300 study-pairs, examining analytic-choice effects in multilab replications, surveying simulation-study reporting, and testing how analytic flexibility influences the accuracy of LLM-based estimates of human responses.

Chairs & Discussants

  • Miłosz KalinowskiChair
    Institute of Psychology, Polish Academy of Sciences

Presentations

  1. Evaluation of Replication Success: A Statistical Perspective and Extended Analysis of the Score Data.Marcel Van Assen
  2. The Unseen Noise In Replication Studies: A Multiverse Investigation.Miłosz Kalinowski
  3. Reporting Practices and Trustworthiness of Simulation Studies In Psychology.Anouk Bouma
  4. Analytical Flexibility In Llms.Jamie Cummins