We’ve recently completed the first manuscript from the ongoing mass pre-registered replication project with a replication of the bias blind spot and an extension connecting the bias to agency. We’ve made it available on Research, and it soon received a lot of attention on Twitter, most recently resulting in some coverage in the media (like the BPS research digest). We’ve since been receiving all kinds of requests and questions, so I thought I’ll start this FAQ and update this as questions keep coming in.
Questions sent in:
- How does bias blind spot differ from better-than-average effect?
- What are the manifestations of bias blind spot in politics, common life or elsewhere?
- How do you explain your finding that relationship between free will beliefs and bias blind spot is “indistinguishable from zero“?
- Do you think psychology (and other fields) are in so-called replication crisis?
- In which magazine do you plan to publish the article?
To which I responded the following:
Thank you for reaching out and taking an interest in our research.
We appreciate media attention, yet as you’ve noticed, this is a pre-print posted before any official peer review so I personally think it is far too early for this to be communicated to the general public who are not familiar with the nuances of academic work and journal article peer-review process.
Also, questions about generalizability of the effect to real life, when we’re still trying to establish whether we can replicate things in the lab, my/our personal unimportant views on the question of whether there is a crisis, and our choice of the target journal shifts focus from our main goals with this project – to revisit the classics in the field of judgment and decision making with a number of pre-registered replications that would add to cumulative scientific understanding of a documented phenomenon.
It is now more important than ever that we are all humble and careful about articulating scientific findings and that science writers truly reflect the scientific process to the general public, focusing on disseminating findings from peer-reviewed large scale multi-lab (pre)registered replication reports.
I hope that makes sense.
The manuscript is doing the rounds in peer review, so let’s come back to this after we get some expert feedback.