The year 2011 introduced first signs that something is very wrong about the way we’ve been doing science, but it took till about 2016 with failures of mass replication projects for us to begin to understand just how bad things are.
I have since committed to trying to better understand the situation (coined “replication/reproducibility crisis”) and to try and promote solutions to overcome inherent problems (coined “credibility revolution”).
In this page is a collection of easy-to-understand videos summarizing the main issues, and that appears below some of the open-science initiatives and education that I am personally involved in.
Open science education and initiatives
Yet issues go far deeper, and to learn more you can see some of the following resources I developed over time:
Open-science initiatives that I’m involved in or track closely:
For more initiatives, see PSA Meta-research hub
Replication / reproducibility crisis
I support the Open Science movement, and recommend any scholar in any discipline to educate themselves about the advances in science, problems and solutions. Here are some quick simplified videos to get you up to date on the problems as of 2016. I try to keep track of articles on my WIKI. You are welcome to read more about my related work on pre-registered replications and meta-analyses.
Issues with stats
To better understand how we test things in science (and psychology) using statistics, PBS has a good intro “Prediction by the Numbers” that discusses statistics, what Null Hypothesis Significance Testing (NHST) p-values are (some term as the “significance threshold”), possible biases in inferences, and the associated issues with NHST and p-values that have contributed to the current ongoing crisis.
Credibility Revolution: Moving forward
For a more scientific in-depth lecture, Brian Nosek of the Center of Open Science does a great job with this talk:
Promoting open-access science
This movie is a good summary of the issue – Paywall: The Business of Scholarship
Podcasts on open-science and replication crisis
Recommended online courses about statistics and science
- Improving Your Statistical Inferences | Coursera, by Daniel Lakens
- Improving Your Statistical Questions | Coursera, by Daniel Lakens
- Calling Bullshit: Data Reasoning for the Digital Age
- Transparent and Open Social Science Research