PRECONFERENCE EVENT
Building a Better

Psychological Science

Good Data Practices and Replicability
28 August 2013
14:30 to 18:30 | Room 0.83 | ELTE University Congress Center | Pázmány Péter sétány 1/A | H-1117 Budapest, Hungary

PROGRAM

Psychological science has come of age. But the rights of a mature discipline carry with it responsibilities: to maximize confidence in our findings through good data practice and replication while simultaneously ensuring that funding sources and publication outlets support best practice.

Leading experts will explore the causes and extent of bias and error problems in science as well as potential solutions to these and other complex problems affecting replicability, in a halfday pre-conference symposium co-sponsored by ESCoP and the Association for Psychological Science (APS).

For more on APS’s replication efforts please read: APS Journal Seeks Labs to Participate in First Registered Replication Report Project

14.30-14.40

C. Cacciari (University of Modena, Italy; ESCoP)

Welcome

 

14.40-15.10

Axel Cleeremans (Université Libre de Bruxelles, Belgium)

Truth or Hype? Shifting Values and Norms in (Psychological) Science

As Diederick Stapel himself explains in the book he recently published about his travails, both fraud as well as questionable research practices may stem from the progressive and ongoing transformation of academia into a business of sorts. When publication can yield monetary rewards, when the media ask for simplistic headlines, when your entire career appears to hinge on that paper in Science, there is indeed tremendous pressure to change the norm ever so slightly. But so begins a slippery slope in which the very ideal of science — finding what is true and what is false — begins to fade away.

15.10-15.20 Discussion

 

15.20-15.50

Erik-Jan Wagenmakers (University of Amsterdam, The Netherlands)

The Excitement of Conducting a Replication Study

Replication studies have a bad rep. According to popular opinion, conducting a replication study is the academic equivalent of doing the laundry: an activity that is perhaps necessary, but intrinsically boring, and certainly nobody’s hobby. Popular opinion, however, is dead wrong here. Replication studies are exciting, and in fact more so than “regular” or “innovative” research. In the first part of this presentation I will demonstrate by means of concrete examples how replication studies generate ample quantities of knowledge, hope, surprise, debate, media attention, anger, and fear. In the second part of this presentation I will explain how the impact of a replication study can be maximized by proper design and analysis.

15.50-16 Discussion

 

16-16.20 Coffee break

 

16.20-16.50

Hal E. Pashler (University of California, San Diego, USA)

Incentives and Practices to Promote Replicability

There is widespread agreement that to improve our science, we need less hyping of preliminary results, more efforts at replication, and better dissemination of replication results. I argue that exhortation is unlikely to make much difference here, and that we should look honestly at the grave mismatch between current incentives (what people are actually rewarded for) and the behaviors that we want to see promoted. Only by changing incentives can we achieve major reform.  

16.50-17 Discussion

 

17-17.30

Brian Nosek (University of Virginia, USA)

Scientific Utopia

How can existing scientific practices be improved to increase efficiency in the accumulation of knowledge, and the alignment between daily practices and the values of the academic community? I will discuss some present and possible futures of scientific communication and practices.

17.30-17.40 Discussion

 

17.40-18.10

Discussant:

Barbara A. Spellman (University of Virginia, USA)

Editor, Perspectives on Psychological Science

 

18.10-18.30 General Discussion

For more on APS’s replication efforts please read: APS Journal Seeks Labs to Participate in First Registered Replication Report Project

The program is offered free of charge, but due to space limitations, we ask that you register