Open Science and Science Reform

Open Science Initiatives / Science replication crisis / Credibility revolution/Science Reform: Moving forward / Promoting open-access science / Books / Podcasts / Podcast episodes / Courses / Videos

 

The year 2011 introduced first signs that something is very wrong about the way we’ve been doing science, but it took till about 2016 with failures of mass replication projects for us to begin to understand just how bad things are.

I have since committed to trying to better understand the situation (coined “replication/reproducibility crisis”) and to try and promote solutions to overcome inherent problems (coined “credibility revolution”).

 

In this page is a collection of easy-to-understand videos summarizing the main issues, and that appears below some of the open-science initiatives and education that I am personally involved in.

 

My Journey to Open Science

I wrote a post for Psychology Today explaining my journey and why I’m doing this project – “Promoting the Credibility Revolution: The Journey to Open-Science“.

 

In 2021 I gave the following talk to the Asian Association for Social Psychology on the science crisis and reform movement:

Endorsing open-science & supporting science reform: Status, issues, challenges, & initial solutions

 

In December 2020 I gave the following remote talk at Kent university:

 

Collaborative “credibility revolution” open & meta science | Kent University seminar | Gilad Feldman

 

 

Earlier in March 2020 I gave a similar recorded talk about open-science (slides) which also includes some Q&A at the end:

 

Journey to open science: Mass mobilizing for credibility revolution (& replications) [Gilad Feldman]

 

 

 

In 2019 the students in my PSYC2020 Fundamentals of Social Psychology course  joined me in writing the first book covering the science crisis: “Taking stock of the credibility revolution: Scientific reform 2011-now“. We hope to keep improving on this in the future (though there are now more professional books, see list below), but for now [download link]:

Loader Loading...
EAD Logo Taking too long?

Reload Reload document
| Open Open in new tab

Download [3.31 MB]

 

Open science education and initiatives

Yet issues go far deeper, and to learn more you can see some of the following resources I developed over time:

 

Open-science initiatives that I’m involved in or track closely:

 

For more initiatives, see PSA Meta-research hub

 

 

Replication / reproducibility crisis

I support the Open Science movement, and recommend any scholar in any discipline to educate themselves about the advances in science, problems and solutions. Here are some quick simplified videos to get you up to date on the problems as of 2016. I try to keep track of articles on my WIKI. You are welcome to read more about my related work on pre-registered replications and meta-analyses.

 

The Replication Crisis: Crash Course Statistics #31

 

Is there a reproducibility crisis in science? - Matt Anticole

 

Is Most Published Research Wrong?

 

Scientific Studies: Last Week Tonight with John Oliver (HBO)

 

The Problem with Willpower and Self-Control | A Psychology Experiment

 

The Perfect TED Talk That Never Happened

 

The Reproducibility Crisis in Science - An Animated Review by Dan CBJ

 

 

Issues with stats

To better understand how we test things in science (and psychology) using statistics, PBS has a good intro “Prediction by the Numbers” that discusses statistics, what Null Hypothesis Significance Testing (NHST) p-values are (some term as the “significance threshold”), possible biases in inferences, and the associated issues with NHST and p-values that have contributed to the current ongoing crisis.

 

 

Credibility Revolution: Moving forward

For a more scientific in-depth lecture, Brian Nosek of the Center of Open Science does a great job with this talk:

Brian Nosek - Shifting incentives from getting it published to getting it right

 

And, no, it’s not just psychology. Here’s from Prof. John P.A. Ioannidis in 2019 on “Scientific evidence: reproducible and useful”:

Lecture of Prof. John P.A. Ioannidis "Scientific evidence: reproducible and useful"

 

Promoting open-access science

This movie is a good summary of the issue – Paywall: The Business of Scholarship

 

Books: Psychology as a Science (and the replication crisis)

  1. Science Fictions, by Stuart J. Ritchie
  2. The Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice, by Chris Chambers
  3. Calling Bullshit: The Art of Skepticism in a Data-Driven World, by Carl T. Bergstrom and Jevin D. West
  4. Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference, by Zoltan Dienes

 

Podcasts on open-science, academia, & credibility revolution

 


Podcast episodes on open-science and replication crisis

 

Recommended online courses about statistics and science


Videos about the science crisis and open-science