From: Science

A solution to psychology’s reproducibility problem just failed its first test

Behavior change is difficult—just ask any psychologist. A new study shows behavior change among psychologists is no different. Efforts to improve the robustness of research by asking psychologists to state their methods and goals ahead of time, a process called preregistration, have stumbled at the first hurdle.

“Preregistration is not as easy as it may seem,” says Aline Claesen, a psychologist at the Catholic University of Leuven (KU Leuven) in Belgium. She and her colleagues examined 27 preregistration plans filed by psychologists from February 2015, when the journal Psychological Science started to offer badges for preregistered studies, to November 2017. In every case, her team reports this month in a preprint on the PsyArXiv server, the researchers deviated from their plan—and in every paper but one, they did not fully disclose these deviations.

“I was totally surprised by how many of these [changes] were undisclosed,” says Wolf Vanpaemel, a psychologist on the KU Leuven team. “There’s no good excuse for not transparently indicating all changes you made.”

Read the whole story (subscription may be required): Science


APS regularly opens certain online articles for discussion on our website. Effective February 2021, you must be a logged-in APS member to post comments. By posting a comment, you agree to our Community Guidelines and the display of your profile information, including your name and affiliation. Any opinions, findings, conclusions, or recommendations present in article comments are those of the writers and do not necessarily reflect the views of APS or the article’s author. For more information, please see our Community Guidelines.

Please login with your APS account to comment.