Meta-analysis Registered Reports

In the last few years I’ve been aiming to try and quantitatively summarize the literatures of the domains I care about, by conducting pre-registered meta-analysis systematic reviews.

Through this process it became clear that we need better tools and templates to promote open reproducible meta-analyses, and that it is important to try and conduct those through Registered Reports.

I am currently involved in several initiatives and lead several others all aimed to improve best practices in meta-analyses.

 

I recently presented my journey on that in a workshop on conducting open and reproducible meta analyses:

 

Practical open-science meta-analysis workshop: Conducting open and reproducible meta-analyses
Watch this video on YouTube.

 

In October 2021, Adrien Fillon, who is leading the correlational template, gave a talk on the templates:

Reproducible Meta analysis Registered Report templates | Adrien Fillon @ Birmingham ReproducibiliTea
Watch this video on YouTube.

 

We’ve developed the following resources to support doing meta analyses as Registered Reports:

Experimental Meta-analysis Registered Report template:

 

Correlational Meta-analysis Registered Report template:

 

See this list (column 6 – “offered for meta-analysis) for the journals willing to accept meta-analysis registered reports.

 

Meta-analysis Registered Report submissions that are using these templates:

  1. Yeung, S., & Feldman. G. Action-Inaction Asymmetries in Emotions and Counterfactual ‎Thoughts: Meta-Analysis of the Action Effect‎.
    [Registered Report Stage 1 in-principle acceptance from PCI-RR]
    [In-principle acceptance] [Preprint] [Open materials/data/code]

 

Our meta-analysis Registered Report publications:

  1. Lim, V., & Feldman, G. (2022). Values and the dark side: Meta-analysis of links between Dark Triad traits and personal values.
    [Registered Report Stage 1 in-principle acceptance]
    [Preprint] [Open materials/data/code]
  2. Nanakdewa, K., et al., Savani, K., & Feldman, G. (2022). Outcomes associated with believing in free will: Meta-analysis.
    [Registered Report Stage 1 in-principle acceptance]
    [Preprint] [Open materials/data/code]

 

Our pre-registered meta-analysis publications:

  1. Fillon, A., Kutscher, L., & Feldman, G. (2021). Impact of past behavior normality on regret: Meta-analysis of exceptionality effect. Cognition and Emotion, 35(1), 129-149.
    DOI: 10.1080/02699931.2020.1816910
    [Article] [Preprint] [Open materials/data/code]
  2. ‎Yeung, S., Yay, T., & Feldman, G. (2022). Action and inaction in moral judgments and decisions: ‎Meta-analysis of Omission-Bias omission-commission asymmetries. Personality and Social Psychology Bulletin, 48(10), 1499-1515
    DOI: 10.1177/01461672211042315
    [Article] [Preprint] [Open materials/data/code]
  3. Bialek, M., Gao, Y., Yao, D., & Feldman, G. (2023). Owning leads to valuing: Meta-analysis of the Mere Ownership Effect. European Journal of Social Psychology.
    DOI: 10.1002/ejsp.2889
    [Article] [Preprint] [Open materials/data/code]

 

Other related initiatives on pre-registered, open, and reproducible systematic reviews and meta-analyses:

  1. Collaborative Meta analysis syllabus (also see my meta-analysis workshop materials)
  2. Non-Interventional, Reproducible, and Open Evidence Synthesis (NIROES): Preprint / OSF project page
    1. Topor, M., Pickering, J. S., Barbosa Mendes, A., Bishop, D. V. M., Büttner, F. C., Henderson, E. L., … Westwood, S. J. (2020, November 15). NIRO-SR: Non-Interventional, Reproducible, and Open Systematic Review guidelines. https://doi.org/10.17605/OSF.IO/F3BRW
  3. Inclusive Systematic Review Registration Form: Preprint / OSF project page / Google Doc
    1. Van den Akker, O., Peters, G. Y., Bakker, C., Carlsson, R., Coles, N. A., Corker, K. S., Feldman, G., Mellor, D., Nordström, T., Pfeiffer, N., Pickering, J. S., Riegelman, A., Topor, M., van Veggel, N., & Yeung, S. K. (2020, September 25). Inclusive systematic review registration form. https://doi.org/10.31222/osf.io/3nbea
    2. Form was officially added to the Open Science Framework: Integration in OSF | Form | Projects using template
  4. Moreau, D., & Gamble, B. (2020). Conducting a meta-analysis in the age of open science: Tools, tips, and practical recommendations. Psychological Methods. https://psyarxiv.com/t5dwg/
    1. OSF: https://osf.io/q8stz/