Today, Will sits down with Max Korbmacher, Thomas Rhys Evans, and Flavio Azevedo, some of the authors of the paper "The replication crisis has led to positive structural, procedural, and community changes" to talk about the paper, FORRT, and Open Science communities.

Show notes:
The paper we discuss for this episode: Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Nature Communications Psychology, 1(1), 3. https://www.nature.com/articles/s44271-023-00003-2
FORRT – The Framework for Open and Reproducible Research Training: https://forrt.org
Getting involved with FORRT: https://forrt.org/about/get-involved/
Charlotte Pennington’s new book: A Student's Guide to Open Science: Using the Replication Crisis to Reform Psychology https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
UK Reproducibility Network: https://www.ukrn.org/
Project Teaching Integrity in Empirical Research (TIER): https://www.projecttier.org/
Reproducibility Wiki: https://replication.uni-goettingen.de/
Paper Trail: https://thepapertrailjc.squarespace.com/
Brain Imaging Data Structure (BIDS): https://bids.neuroimaging.io/
Collaborative Replication Education Project (CREP): https://www.crep-psych.org/
The Center for Open Science: https://www.cos.io/
Nowhere Lab: http://nowherelab.com/
Advancing Big-team Reproducible Science through Increased Representation (ABRIR): https://abrirpsy.org/
Open Life Science: https://openlifesci.org/
Turing Way: https://the-turing-way.netlify.app/index.html

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E13: From Crisis To FORRTsitive Change

Today, Sarah, Will and Jan sit down to discuss the last season of ReproducibiliTea. We talk about Will's terrible terrible taste in puns, Jan's terrible taste in pizza, and Sarah's fall into FORRT(.org).

While we are wrapping up Season 3, stay tuned for a few more fun & exciting episodes we have planned for this year!

Not many footnotes this time:
Sarah mentioned sysmus: https://sites.google.com/view/sysmus/home

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks, and praise use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E14: Season 3 Closer

We welcome back the ReproducibiliTea Podcast with Will and Helena chatting to Nafisa Jadavji and Nele Haelterman about Reproducibility for Everyone (R4E), a community-led initiative to run reproducibility workshops.

Show notes:
Repro4Everyone - https://repro4everyone.org

S4E1: Reproducibility Training with Repro4Everyone with Nafisa Jadavji and Nele Haelterman

In this episode, we welcome Queen Saikia as a host of the podcast! She and Will Ngiam are joined by Jonny Coates, Associate Director of ASAPBio, a non-profit organisation seeking to Accelerate Science and Publication in Biology. The topic of conversation is preprint review and peer review. Enjoy!

Show notes:
ASAPBio: https://asapbio.org/
PREreview: https://prereview.org/

S4E2 – Preprint Review with Jonny Coates from ASAPBio

In this episode, Will and Helena are joined by Emmanuel Boakye and Lamis Elkheir to share their experiences as scientists and Open Science advocates in the Global South and how they started the African Reproducibility Network (AREN).

African Reproducibility Network
Website: https://africanrn.org/
Twitter: https://twitter.com/africanrepro

Lamis Elkheir
LinkedIn: https://sd.linkedin.com/in/lamis-elkheir-b5844092
Twitter: https://twitter.com/lamiselkheir?lang=en

Emmanuel Boakye
LinkedIn: https://gh.linkedin.com/in/emmaboakye
Twitter: https://twitter.com/thescientistgh

S4E3 African Reproducibility Network (AREN) with Lamis Elkheir and Emmanuel Boakye

In this episode, Will is joined by Jamie Moffa, a doctoral student in systems neuroscience at Washington University in St. Louis. Jamie has been thinking and working in the science communication space, especially via the In Plain English podcast, which is aimed at bringing scientific knowledge and understanding to the general public.

Show Notes:
We think about this paper:
Volk, S. C. (2024). Assessing the Outputs, Outcomes, and Impacts of Science Communication: A Quantitative Content Analysis of 128 Science Communication Projects. Science Communication, 10755470241253858. https://journals.sagepub.com/doi/10.1177/10755470241253858

Will mentions this paper by C Thi. Nguyen:
Nguyen, C. T. (2021). The seductions of clarity. Royal Institute of Philosophy Supplements, 89, 227-255. https://philarchive.org/rec/NGUTSO-2 

Will mentions this paper about color constancy and Crocs randomly...:
Wallisch, P., & Karlovich, M. (2019). Disagreeing about Crocs and socks: Creating profoundly ambiguous color displays. arXiv preprint arXiv:1908.05736.

Follow and reach out to Jamie, especially if you'd like to contribute to the In Plain English podcast!
Jamie Moffa – https://copitslab.wustl.edu/people/jamie-moffa/
In Plain English Podcast – https://inplainenglishpod.org/

Our science communicator highlights:
Nature and Nurture Podcast by Adam Omary –https://podcasters.spotify.com/pod/show/NatureNurture
Cass Eris – https://www.youtube.com/casseris
Dr Neurofourier – https://www.youtube.com/c/Neurofourier
SciShow by Complexly (Hank and John Green): https://www.youtube.com/@SciShow
Science Night Podcast – https://www.scinight.com/episodes
Ed Yong (no longer at the Atlantic!) – https://edyong.me/
The Violinist's Thumb by Sam Kean – https://samkean.com/books/the-violinists-thumb/

You can find Will on BlueSky: https://bsky.app/profile/willngiam.bsky.social

If you'd like to find out more about ReproducibiliTea, our grassroots initiative to build community in Open Science across institutions, check out https://reproducibilitea.org.

S4E4 Science Communication (with Jamie Moffa, In Plain English Podcast)

Why is Indigenous health research so crucial, especially for adolescents? What are the
systemic challenges researchers face, and how can we push for openness, transparency,
and equity in health research? In this conversation, hosts Queen Saikia and Sarah Sauvé
speak with leading experts from New Zealand - Prof. Sue Crengle (University of Otago),
Prof. Terryann Clarke (University of Auckland), and Dr. Andrew Sise (University of
Otago) - to explore the current landscape of Indigenous health research and the
methodologies used in these investigations. They also discuss key issues around
reproducibility, openness, and transparency, the discrepancies in research systems, and
how we can drive meaningful change. This episode is a must-listen for anyone passionate
about health equity, open research, and improving research culture. Listen now and join the conversation in the comments!

S4E5 Indigenous Research Methods: Valuing Knowledge, Community, and Impact

In this episode, Sarah and Will chat to Josh de Leeuw from Vassar College and the creator of jsPsych. We chat about the history of jsPsych, the unseen process behind creating open-access scientific software, and the current challenges facing software developers in the open scholarship movement.

jsPsych is a javaScript framework for creating online experiments, and is always looking for people to contribute to the codebase: https://jspsych.org.

Follow Josh de Leeuw on Bluesky: https://bsky.app/profile/joshdeleeuw.bsky.social

S4E6 Creating Open-Access Scientific Software with Josh de Leeuw (jsPsych)

Show notes:

OSF Preprints | Let's talk about it: positivism and critical theory in dialogue https://osf.io/preprints/osf/t2ywh_v1 
Caliban & the Witch by Silvia Federici
Pollution is Colonialism by Max Liboiron
Against Method by Paul Feyerabend
Lecture on Against Method by Tomas Petricek, University of Cambridge : https://youtu.be/jzD1O_gastA
S2E10: Limits of ReproducibiliTea for discussion and resources of a feminist lens on open science https://soundcloud.com/reproducibilitea/s1e10-limits 
The battle for your brain by Nita Farahany
Quokka app: https://palm-lab.github.io/QualCA
Quokka video guide: https://www.youtube.com/watch?v=9jJK70W0hAI

S4E7 Critical theory vs positivism

In this episode, Will is joined by Lianne Wolsink, PhD candidate at Ruhr University Bochum and current steering committee member of ReproducibiliTea. Will and Lianne discuss the ReproducibiliTea reading lists, created to help journal clubs do deep dives on metascience topics. Lianne created reading lists on replication and science communication; Will created an introductory reading list on Open Science, preregistration, and theory in psychology.

Reading lists: https://rpt-rl.netlify.app

Books mentioned:
Science Fictions by Stuart J Ritchie
Against Method by Paul Feyerabend
Nobody's Fool by Daniel Simons and Christopher Chabris

S4E8 ReproducibiliTea Reading Lists

This week we talk about “The natural selection of bad science” from Paul Smaldino and Richard McElreath. We get bummed, but try to put a positive spin on things. You can find the paper here http://rsos.royalsocietypublishing.org/content/3/9/160384 

Highlights
[1:00] “The natural selection of bad science” http://rsos.royalsocietypublishing.org/content/3/9/160384 
[5:00] the need to distinguish yourself as a scientist - innovative and/or high output?
[6:45] Our next SpecialiTEA - we want to hear your experiences about leaving academia
[11:00] “when a measure becomes a target it ceases to be a good measure”
[13:30] could quality control help ‘fix’ metrics?
[15:00] Competition - how quickly can you move from open science topic A to B purely with ranting?
[18:00] I have the powerrrrrrrrr  (I wish soundcloud would let me add gifs - millenial problems)
[26:00] We get a little confused about power in the simulations - we highly recommend reading the paper to get the details right :)
[29:00] Challenge to listeners - grab Smaldino & McElreath’s code and figure out how to create a scientific utopia!
[31:30] The simulation
[32:30] Watching out for forced retirements…
[35:00] Sam is super millenial and reads out this awesome tweet about terrible things in science https://mobile.twitter.com/aidybarnett/status/1036392482139865088
[37:00] Not enough detail in original papers to attempt to replicate in  The Reproducibility Project: Cancer Biology (https://osf.io/e81xl/wiki/home/), also a thread from @chrisdc77 https://twitter.com/chrisdc77/status/1024589364238667776
[42:00] “The continuous degradation of scientific process”
[44:00] Does promoting replication attempts solve the problem?
[48:30] So, what the hell can we do to stop the decline of science? Community, hiring and funding shifts, and more
[56:45] Observed power

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 7 - Natural Selection Of Bad Science

Serving mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science. Brewed by the @ReproducibiliT Team

Episode 7 - Natural Selection Of Bad Science

ReproducibiliTea Podcast

Related tracks