AMPPS Call for Papers on Replicability and Reproducibility in Methodological Research
Methodological reform has shaped the last decade of psychological research. Researchers have undertaken replication studies, journals and funders have emphasized registration and data sharing, and authors have worked to make their studies transparent and reproducible. However, the researchers who develop and study the methodologies we use in psychology have not taken up these reforms (e.g., those developing and evaluating methods via simulation studies). Recent work demonstrates that methodological studies are difficult to replicate or reproduce (Luijken et al., 2024), fail to meet basic standards of transparency (Siepe et al., 2024), and can be cherry picked in a similar fashion to applied research (Pawel et al., 2024). Though researchers in biological and computational statistics have begun to sound the alarm about issues of replicability, reproducibility, and generalizability in methods research (Boulesteix, 2015; Boulesteix et al., 2020), there’s been much less discussion and development from methodologists working in psychology. To address these concerns, Advances in Methods and Practices in Psychological Science is calling for proposals for manuscripts that discuss, demonstrate, and work to enhance replicability and reproducibility of methods research in psychology.
We seek manuscripts that provide theories and tools methodologists can use to understand and improve their research. Papers that mostly provide opinions and commentary will not be considered. Papers must provide methodological and substantive researchers with theories, ideas, and tools that are accessible and implementable from reading the manuscript.
Potential topics could include but are not limited to:
1. Defining and demonstrating concepts of and related to replicability and reproducibility specifically for methods research. Theory focused papers should provide in-depth analysis, case study, and/or concrete examples, papers that are mostly opinion or commentary will not be considered,
2. Developing practices and/or tools to support replicability and reproducibility of methods research. This could be the modification or adaptation of existing practices from substantive research such as registration, computational reproducibility, multiverse analysis, large-scale replication, big team science, or new methods and practices that haven’t yet been proposed,
3. Meta-scientific studies on methods research in psychology that relate to the understanding and development of practices for methods research that will enhance replicability and reproducibility.
Click here to submit a proposal or express interest. Proposals are due by September 15th, 2025 (but welcome sooner), strong proposals will be invited to submit by October 1st, 2025. Final manuscripts will be due on February 1st, 2026. All invited papers will receive in-depth peer review and may be declined after invitation if they do not meet AMPPS’s standards for publication. AMPPS’s is an open access journal that charges a $1,000 USD Article Processing Charge (APC); APC waivers will be available for invited papers. Dr. JK Flake, Associate Editor at AMPPS’s, will serve as the handling editor for this group of invited papers. Inquiries prior to proposal submission can be sent to her directly at: [email protected] .
If you are interested in this topic, but will not be able to submit a proposal, please consider filling in the form to express your interest in reviewing the manuscripts and/or for follow up in the future as the community of scholars working in this area grows.
