We mentioned lots of resources this week, brace yourselves!
Books that changed our worlds
How To Read a Paper: The Basics of Evidence-Based Medicine by Trisha Greenhalgh
https://www.amazon.co.uk/How-Read-Paper-Evidence-Based-Medicine/dp/1444334360

How to Win Campaigns by Chris Rose
https://www.amazon.co.uk/How-Win-Campaigns-Steps-Success/dp/1853839620
Pollution is Colonialism by Max Liboiron
https://www.dukeupress.edu/pollution-is-colonialism
A Student’s Guide to Open Science by Charlotte Pennington
https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
The Art of Statistics: Learning from Data by David Spiegelhalter
https://www.penguin.co.uk/books/294857/the-art-of-statistics-by-spiegelhalter-david/9780241258767

Tools we mention:
FORRT Academic Wheel of Privilege: https://www.youtube.com/watch?v=mzEdTyA06cU&ab_channel=FORRTproject
Ioannidis et al. (2019): https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3000384 who provide a means to adjust research impact for self-citations using a newly developed tool
Baccini et al. (2019): https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0221212 calculate an “inwardness” metric which shows bias to researchers’ own country
Citation Diversity Statement: tools that can help authors assess the citation diversity statistics of their papers (see, for example, https://github.com/dalejn/cleanBib#instructions)
Jane Lawrence Sumner’s Gender Balance Assessment Tool (GBAT) https://jlsumner.shinyapps.io/syllabustool/
Groups/projects working on highlighting under-cited work: ABRIR (https://abrirpsy.org/), Marginalia (https://www.marginaliascience.com/) and FORRT (https://forrt.org/neurodiversity/) 

Other relevant links/resources:
Evidence-Based Toxicology
https://www.tandfonline.com/journals/tebt20

Evidence-Based Toxicology Collaboration
https://www.ebtox.org/
Living a Feminist Life by Sara Ahmed
Peer review episodes of Secret Feminist Agenda: https://secretfeministagenda.com/2020/04/07/bonus-episode-season-3-peer-review-of-secret-feminist-agenda/ and https://secretfeministagenda.com/2020/04/07/bonus-episode-response-to-review-of-season-3/
Algorithms are racist & sexist: Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. nyu Press.
#MHAWS: Mirya Holman's Aggressive Winning Scholars Newsletter: https://miryaholman.substack.com/
MetaDocencia - https://www.metadocencia.org/

S3E02: Citational politics in open science: don't be a d*ck about it

Today, Will sits down with Max Korbmacher, Thomas Rhys Evans, and Flavio Azevedo, some of the authors of the paper "The replication crisis has led to positive structural, procedural, and community changes" to talk about the paper, FORRT, and Open Science communities.

Show notes:
The paper we discuss for this episode: Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Nature Communications Psychology, 1(1), 3. https://www.nature.com/articles/s44271-023-00003-2
FORRT – The Framework for Open and Reproducible Research Training: https://forrt.org
Getting involved with FORRT: https://forrt.org/about/get-involved/
Charlotte Pennington’s new book: A Student's Guide to Open Science: Using the Replication Crisis to Reform Psychology https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
UK Reproducibility Network: https://www.ukrn.org/
Project Teaching Integrity in Empirical Research (TIER): https://www.projecttier.org/
Reproducibility Wiki: https://replication.uni-goettingen.de/
Paper Trail: https://thepapertrailjc.squarespace.com/
Brain Imaging Data Structure (BIDS): https://bids.neuroimaging.io/
Collaborative Replication Education Project (CREP): https://www.crep-psych.org/
The Center for Open Science: https://www.cos.io/
Nowhere Lab: http://nowherelab.com/
Advancing Big-team Reproducible Science through Increased Representation (ABRIR): https://abrirpsy.org/
Open Life Science: https://openlifesci.org/
Turing Way: https://the-turing-way.netlify.app/index.html

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E13: From Crisis To FORRTsitive Change

Today, Sarah, Will and Jan sit down to discuss the last season of ReproducibiliTea. We talk about Will's terrible terrible taste in puns, Jan's terrible taste in pizza, and Sarah's fall into FORRT(.org).

While we are wrapping up Season 3, stay tuned for a few more fun & exciting episodes we have planned for this year!

Not many footnotes this time:
Sarah mentioned sysmus: https://sites.google.com/view/sysmus/home

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks, and praise use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E14: Season 3 Closer

We welcome back the ReproducibiliTea Podcast with Will and Helena chatting to Nafisa Jadavji and Nele Haelterman about Reproducibility for Everyone (R4E), a community-led initiative to run reproducibility workshops.

Show notes:
Repro4Everyone - https://repro4everyone.org

S4E1: Reproducibility Training with Repro4Everyone with Nafisa Jadavji and Nele Haelterman

In this episode, we welcome Queen Saikia as a host of the podcast! She and Will Ngiam are joined by Jonny Coates, Associate Director of ASAPBio, a non-profit organisation seeking to Accelerate Science and Publication in Biology. The topic of conversation is preprint review and peer review. Enjoy!

Show notes:
ASAPBio: https://asapbio.org/
PREreview: https://prereview.org/

S4E2 – Preprint Review with Jonny Coates from ASAPBio

In this episode, Will and Helena are joined by Emmanuel Boakye and Lamis Elkheir to share their experiences as scientists and Open Science advocates in the Global South and how they started the African Reproducibility Network (AREN).

African Reproducibility Network
Website: https://africanrn.org/
Twitter: https://twitter.com/africanrepro

Lamis Elkheir
LinkedIn: https://sd.linkedin.com/in/lamis-elkheir-b5844092
Twitter: https://twitter.com/lamiselkheir?lang=en

Emmanuel Boakye
LinkedIn: https://gh.linkedin.com/in/emmaboakye
Twitter: https://twitter.com/thescientistgh

S4E3 African Reproducibility Network (AREN) with Lamis Elkheir and Emmanuel Boakye

In this episode, Will is joined by Jamie Moffa, a doctoral student in systems neuroscience at Washington University in St. Louis. Jamie has been thinking and working in the science communication space, especially via the In Plain English podcast, which is aimed at bringing scientific knowledge and understanding to the general public.

Show Notes:
We think about this paper:
Volk, S. C. (2024). Assessing the Outputs, Outcomes, and Impacts of Science Communication: A Quantitative Content Analysis of 128 Science Communication Projects. Science Communication, 10755470241253858. https://journals.sagepub.com/doi/10.1177/10755470241253858

Will mentions this paper by C Thi. Nguyen:
Nguyen, C. T. (2021). The seductions of clarity. Royal Institute of Philosophy Supplements, 89, 227-255. https://philarchive.org/rec/NGUTSO-2 

Will mentions this paper about color constancy and Crocs randomly...:
Wallisch, P., & Karlovich, M. (2019). Disagreeing about Crocs and socks: Creating profoundly ambiguous color displays. arXiv preprint arXiv:1908.05736.

Follow and reach out to Jamie, especially if you'd like to contribute to the In Plain English podcast!
Jamie Moffa – https://copitslab.wustl.edu/people/jamie-moffa/
In Plain English Podcast – https://inplainenglishpod.org/

Our science communicator highlights:
Nature and Nurture Podcast by Adam Omary –https://podcasters.spotify.com/pod/show/NatureNurture
Cass Eris – https://www.youtube.com/casseris
Dr Neurofourier – https://www.youtube.com/c/Neurofourier
SciShow by Complexly (Hank and John Green): https://www.youtube.com/@SciShow
Science Night Podcast – https://www.scinight.com/episodes
Ed Yong (no longer at the Atlantic!) – https://edyong.me/
The Violinist's Thumb by Sam Kean – https://samkean.com/books/the-violinists-thumb/

You can find Will on BlueSky: https://bsky.app/profile/willngiam.bsky.social

If you'd like to find out more about ReproducibiliTea, our grassroots initiative to build community in Open Science across institutions, check out https://reproducibilitea.org.

S4E4 Science Communication (with Jamie Moffa, In Plain English Podcast)

Why is Indigenous health research so crucial, especially for adolescents? What are the
systemic challenges researchers face, and how can we push for openness, transparency,
and equity in health research? In this conversation, hosts Queen Saikia and Sarah Sauvé
speak with leading experts from New Zealand - Prof. Sue Crengle (University of Otago),
Prof. Terryann Clarke (University of Auckland), and Dr. Andrew Sise (University of
Otago) - to explore the current landscape of Indigenous health research and the
methodologies used in these investigations. They also discuss key issues around
reproducibility, openness, and transparency, the discrepancies in research systems, and
how we can drive meaningful change. This episode is a must-listen for anyone passionate
about health equity, open research, and improving research culture. Listen now and join the conversation in the comments!

S4E5 Indigenous Research Methods: Valuing Knowledge, Community, and Impact

In this episode, Sarah and Will chat to Josh de Leeuw from Vassar College and the creator of jsPsych. We chat about the history of jsPsych, the unseen process behind creating open-access scientific software, and the current challenges facing software developers in the open scholarship movement.

jsPsych is a javaScript framework for creating online experiments, and is always looking for people to contribute to the codebase: https://jspsych.org.

Follow Josh de Leeuw on Bluesky: https://bsky.app/profile/joshdeleeuw.bsky.social

S4E6 Creating Open-Access Scientific Software with Josh de Leeuw (jsPsych)

Show notes:

OSF Preprints | Let's talk about it: positivism and critical theory in dialogue https://osf.io/preprints/osf/t2ywh_v1 
Caliban & the Witch by Silvia Federici
Pollution is Colonialism by Max Liboiron
Against Method by Paul Feyerabend
Lecture on Against Method by Tomas Petricek, University of Cambridge : https://youtu.be/jzD1O_gastA
S2E10: Limits of ReproducibiliTea for discussion and resources of a feminist lens on open science https://soundcloud.com/reproducibilitea/s1e10-limits 
The battle for your brain by Nita Farahany
Quokka app: https://palm-lab.github.io/QualCA
Quokka video guide: https://www.youtube.com/watch?v=9jJK70W0hAI

S4E7 Critical theory vs positivism

In this episode, Will is joined by Lianne Wolsink, PhD candidate at Ruhr University Bochum and current steering committee member of ReproducibiliTea. Will and Lianne discuss the ReproducibiliTea reading lists, created to help journal clubs do deep dives on metascience topics. Lianne created reading lists on replication and science communication; Will created an introductory reading list on Open Science, preregistration, and theory in psychology.

Reading lists: https://rpt-rl.netlify.app

Books mentioned:
Science Fictions by Stuart J Ritchie
Against Method by Paul Feyerabend
Nobody's Fool by Daniel Simons and Christopher Chabris

S4E8 ReproducibiliTea Reading Lists

Serving mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science. Brewed by the @ReproducibiliT Team

S3E02: Citational politics in open science: don't be a d*ck about it

ReproducibiliTea Podcast

Related tracks