We are back! ReproducibiliTea 2.0 not titled #TheNewNormal.
ReproducibiliTea is back with a new ambitions and rotating hosts, but first we hand the whole thing over.

For hopefully not the last time brewed by @OrbenAmy, @Sam_D_Parsons and @Cruwelli

Find the Transcript here: https://drive.google.com/file/d/1bTwTL6S2Ov9nlfSKdUxxEdweSM9Uwhmh/view?usp=sharing
For more info visit ReproducibiliTea.org

S2E01: Handover

Our new co-hosts @Will_Ngiam, @Sarah_Sauve, and @VornhagenJB discuss how Science needs to be better while also sharing way to much cool ressources.

Transcript: https://drive.google.com/file/d/1lD0tTr-E-vv4lH8cJ9ItXedinORxnnQE/view?usp=sharing

Ressources like the blogpost that caused this:
https://williamngiam.github.io/Science_needs_to_be_better/

Cool stuff Sarah mentioned:
Indigenous Canada on Coursera: https://www.coursera.org/learn/indigenous-canada
An Indigenous Abolition Study Guide by the Yellowhead Institute: https://yellowheadinstitute.org/an-indigenous-abolitionist-study-guide/
Mapping accountability and relationships I got from Part 3 of Pollution is Colonialism by Max Liboiron: https://www.dukeupress.edu/pollution-is-colonialism
Emergent Strategy by adrienne maree brown: https://adriennemareebrown.net/tag/emergent-strategy/
Revolutionary Rehearsals in the Neoliberal Age edited by Colin Barker, Gareth Dale and Neil Davidson: https://www.haymarketbooks.org/books/1653-revolutionary-rehearsals-in-the-neoliberal-age

Another cool podcast:
https://secretfeministagenda.com/2018/06/29/episode-2-24-being-a-little-bit-bigger-and-more-awesome-than-you-feel-most-days-with-jennifer-askey/

More reading recommendations by Will:
https://www.hachettebookgroup.com/titles/damon-centola/change/9780316457330/#:~:text=As%20a%20leading%20sociologist%20and,and%20the%20diffusion%20of

And the blogpost about Elsevier whose author's names Jan had forgotten:
Eiko Fried and Robin Kok’s (https://twitter.com/robinnkok) Blog post:
https://eiko-fried.com/welcome-to-hotel-elsevier-you-can-check-out-any-time-you-like-not/


There will be a test on this next week.

This episode was produced by William Ngiam and edited by Jan Vornhagen.
Learn more on ReproducibiliTea.org

S2E02: Science Needs to Be Better

Today @Will_Ngiam talks to @eneayegba_ and @priyasilverst about the Nowhere Lab

Check out The Nowhere Lab at https://nowherelab.com/ or @theNowhereLab

This episode was produced by William Ngiam and edited by Jan Vornhagen.
Learn more on ReproducibiliTea.org

The Transcript will be added asap. Till then, you can find subtitles in the youtube version of this episode: https://www.youtube.com/channel/UCGbbo5KrnmAu_7zbnkm2swA

S2E03: The Nowhere Lab

Sarah and Will went/logged on to this years SIPS respectively and talk about their conference experience. It was cool!

More infos www.improvingpsych.org and you can find the conference program here: https://docs.google.com/document/d/1Rka3f0ZY9BBZVIlZoVINrpyaJYeitpq1yKXBLukeMng/edit

For more information about us and how to start your own ReproducibiliTea Journal club go to ReproducibiliTea.org.
For a transcript check the Youtube version: https://youtu.be/FpW0n3fhx90

S2E05: SIPS 2 - Improving Psychological Science Bugaloo

Sarah and Sam take a meandering discussion through slow science and what "slow" actually means in this context. Along the way, they also discuss some recommendations to promote slow science made in "Fast Lane to Slow Science" and how often scholarly critique often runs ahead of this slower pace.
Links and references:
Frith, U. (2020). Fast lane to slow science. Trends in Cognitive Sciences, 24(1), 1-2.
Pownall https://www.bps.org.uk/psychologist/slow-science-scholarly-critique
https://www.talyarkoni.org/blog/2018/10/02/no-its-not-the-incentives-its-you/

For more infos, visit ReproducibiliTea.org

S2E06: Slow Science

Today, Sarah, Will, Sam and Jan discuss what kind of community we would like to foster and how you can get involved.

One of those ways, send us your questions and comments, in audio or text right here: https://forms.gle/bRFcfiGQof43stoq6

Another way: Find us on Twitter as @ReproducibiliT or send uns an E-Mail via ReproducibiliTea.org.

The latter is also the best place for all infos regarding how to start your own journal club and get involved!

Courtesy of Will, please find the transcript here: 
https://drive.google.com/file/d/1C3P0oc0tf5gje2jUyahhNPvSdBRznREr/view?usp=sharing

S2E07: Community Values

What is the point of having a T in your name without being able to use it for a tea pun? ConTeabutorship was right there.

More information on CRediT here: https://credit.niso.org/
And more info on ReproducibiliTea here: https://ReproducibiliTea.org/
Questions? Answers? Comments? Feel free to drop them here: forms.gle/bRFcfiGQof43stoq6

Transcript: https://drive.google.com/file/d/1xi7sm5ExV7_sNejMIFUdH3CU7J4LWypH/view?usp=sharing

S2E08: CRediT

We mentioned lots of resources this week, brace yourselves!
Books that changed our worlds
How To Read a Paper: The Basics of Evidence-Based Medicine by Trisha Greenhalgh
https://www.amazon.co.uk/How-Read-Paper-Evidence-Based-Medicine/dp/1444334360

How to Win Campaigns by Chris Rose
https://www.amazon.co.uk/How-Win-Campaigns-Steps-Success/dp/1853839620
Pollution is Colonialism by Max Liboiron
https://www.dukeupress.edu/pollution-is-colonialism
A Student’s Guide to Open Science by Charlotte Pennington
https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
The Art of Statistics: Learning from Data by David Spiegelhalter
https://www.penguin.co.uk/books/294857/the-art-of-statistics-by-spiegelhalter-david/9780241258767

Tools we mention:
FORRT Academic Wheel of Privilege: https://www.youtube.com/watch?v=mzEdTyA06cU&ab_channel=FORRTproject
Ioannidis et al. (2019): https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3000384 who provide a means to adjust research impact for self-citations using a newly developed tool
Baccini et al. (2019): https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0221212 calculate an “inwardness” metric which shows bias to researchers’ own country
Citation Diversity Statement: tools that can help authors assess the citation diversity statistics of their papers (see, for example, https://github.com/dalejn/cleanBib#instructions)
Jane Lawrence Sumner’s Gender Balance Assessment Tool (GBAT) https://jlsumner.shinyapps.io/syllabustool/
Groups/projects working on highlighting under-cited work: ABRIR (https://abrirpsy.org/), Marginalia (https://www.marginaliascience.com/) and FORRT (https://forrt.org/neurodiversity/) 

Other relevant links/resources:
Evidence-Based Toxicology
https://www.tandfonline.com/journals/tebt20

Evidence-Based Toxicology Collaboration
https://www.ebtox.org/
Living a Feminist Life by Sara Ahmed
Peer review episodes of Secret Feminist Agenda: https://secretfeministagenda.com/2020/04/07/bonus-episode-season-3-peer-review-of-secret-feminist-agenda/ and https://secretfeministagenda.com/2020/04/07/bonus-episode-response-to-review-of-season-3/
Algorithms are racist & sexist: Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. nyu Press.
#MHAWS: Mirya Holman's Aggressive Winning Scholars Newsletter: https://miryaholman.substack.com/
MetaDocencia - https://www.metadocencia.org/

S3E02: Citational politics in open science: don't be a d*ck about it

! Important Update !
Since recording, UCU have announced that they will "ringfence £250,000 for members facing deductions for undertaking forms of ASOS, including the marking and assessment boycott." This is reassuring news for workers at universities where the VCs have threatened 50-100% pay deductions. But still no new offers from employers.

Today, Sophia and Jan are sitting down with @IlsePit(@fediscience.org) and @KatarinaWarren (k-almeidawarren.com) to chat about the ongoing UCU strikes in the UK, and how it is for ECRs to take industrial actions.

"The University and College Union (UCU) represents over 120,000 academics, lecturers, trainers, instructors, researchers, managers, administrators, computer staff, librarians, technicians, professional staff and postgraduates in universities, colleges, prisons, adult education and training organisations across the UK" (https://www.ucu.org.uk/article/1685/About-UCU)

You can support the UCU here: https://www.ucu.org.uk/
For more info go to https://ReproducibiliTea.org
For comments, questions, tips and tricks use our feedback form:  forms.gle/H6jgUzbbpyauLxUC8

S3E4: The UCU strikes wit Kat Almeida Warren and Ilse Pit

Today, Will talks to David Reinstein about scientific publishing and The Unjournal.

The Unjournal: https://www.unjournal.org
The Unjournal on LinkedIn: https://www.linkedin.com/company/unjournal/
To get the latest updates: https://bit.ly/ujupdates
To apply for positions at the Unjournal: https://bit.ly/Ujwork
Will and David’s extended notes for the episode: https://docs.google.com/document/d/13rL6mq71GD6gPv5wBHr_lfX6YSKkLK9n6EAVfGhZhCk/edit?usp=sharing


For more info go to https://ReproducibiliTea.org
For comments, questions, tips and tricks use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E12: Revolutionizing Scientific Publishing with David Reinstein

Today, Will sits down with Max Korbmacher, Thomas Rhys Evans, and Flavio Azevedo, some of the authors of the paper "The replication crisis has led to positive structural, procedural, and community changes" to talk about the paper, FORRT, and Open Science communities.

Show notes:
The paper we discuss for this episode: Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., ... & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Nature Communications Psychology, 1(1), 3. https://www.nature.com/articles/s44271-023-00003-2
FORRT – The Framework for Open and Reproducible Research Training: https://forrt.org
Getting involved with FORRT: https://forrt.org/about/get-involved/
Charlotte Pennington’s new book: A Student's Guide to Open Science: Using the Replication Crisis to Reform Psychology https://www.mheducation.co.uk/a-student-s-guide-to-open-science-using-the-replication-crisis-to-reform-psychology-9780335251162-emea-group
UK Reproducibility Network: https://www.ukrn.org/
Project Teaching Integrity in Empirical Research (TIER): https://www.projecttier.org/
Reproducibility Wiki: https://replication.uni-goettingen.de/
Paper Trail: https://thepapertrailjc.squarespace.com/
Brain Imaging Data Structure (BIDS): https://bids.neuroimaging.io/
Collaborative Replication Education Project (CREP): https://www.crep-psych.org/
The Center for Open Science: https://www.cos.io/
Nowhere Lab: http://nowherelab.com/
Advancing Big-team Reproducible Science through Increased Representation (ABRIR): https://abrirpsy.org/
Open Life Science: https://openlifesci.org/
Turing Way: https://the-turing-way.netlify.app/index.html

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E13: From Crisis To FORRTsitive Change

Today, Sarah, Will and Jan sit down to discuss the last season of ReproducibiliTea. We talk about Will's terrible terrible taste in puns, Jan's terrible taste in pizza, and Sarah's fall into FORRT(.org).

While we are wrapping up Season 3, stay tuned for a few more fun & exciting episodes we have planned for this year!

Not many footnotes this time:
Sarah mentioned sysmus: https://sites.google.com/view/sysmus/home

For more info go to ReproducibiliTea.org
For comments, questions, tips and tricks, and praise use our feedback form: forms.gle/H6jgUzbbpyauLxUC8

S3E14: Season 3 Closer

We welcome back the ReproducibiliTea Podcast with Will and Helena chatting to Nafisa Jadavji and Nele Haelterman about Reproducibility for Everyone (R4E), a community-led initiative to run reproducibility workshops.

Show notes:
Repro4Everyone - https://repro4everyone.org

S4E1: Reproducibility Training with Repro4Everyone with Nafisa Jadavji and Nele Haelterman

In this episode, we welcome Queen Saikia as a host of the podcast! She and Will Ngiam are joined by Jonny Coates, Associate Director of ASAPBio, a non-profit organisation seeking to Accelerate Science and Publication in Biology. The topic of conversation is preprint review and peer review. Enjoy!

Show notes:
ASAPBio: https://asapbio.org/
PREreview: https://prereview.org/

S4E2 – Preprint Review with Jonny Coates from ASAPBio

In this episode, Will and Helena are joined by Emmanuel Boakye and Lamis Elkheir to share their experiences as scientists and Open Science advocates in the Global South and how they started the African Reproducibility Network (AREN).

African Reproducibility Network
Website: https://africanrn.org/
Twitter: https://twitter.com/africanrepro

Lamis Elkheir
LinkedIn: https://sd.linkedin.com/in/lamis-elkheir-b5844092
Twitter: https://twitter.com/lamiselkheir?lang=en

Emmanuel Boakye
LinkedIn: https://gh.linkedin.com/in/emmaboakye
Twitter: https://twitter.com/thescientistgh

S4E3 African Reproducibility Network (AREN) with Lamis Elkheir and Emmanuel Boakye

In this episode, Will is joined by Jamie Moffa, a doctoral student in systems neuroscience at Washington University in St. Louis. Jamie has been thinking and working in the science communication space, especially via the In Plain English podcast, which is aimed at bringing scientific knowledge and understanding to the general public.

Show Notes:
We think about this paper:
Volk, S. C. (2024). Assessing the Outputs, Outcomes, and Impacts of Science Communication: A Quantitative Content Analysis of 128 Science Communication Projects. Science Communication, 10755470241253858. https://journals.sagepub.com/doi/10.1177/10755470241253858

Will mentions this paper by C Thi. Nguyen:
Nguyen, C. T. (2021). The seductions of clarity. Royal Institute of Philosophy Supplements, 89, 227-255. https://philarchive.org/rec/NGUTSO-2 

Will mentions this paper about color constancy and Crocs randomly...:
Wallisch, P., & Karlovich, M. (2019). Disagreeing about Crocs and socks: Creating profoundly ambiguous color displays. arXiv preprint arXiv:1908.05736.

Follow and reach out to Jamie, especially if you'd like to contribute to the In Plain English podcast!
Jamie Moffa – https://copitslab.wustl.edu/people/jamie-moffa/
In Plain English Podcast – https://inplainenglishpod.org/

Our science communicator highlights:
Nature and Nurture Podcast by Adam Omary –https://podcasters.spotify.com/pod/show/NatureNurture
Cass Eris – https://www.youtube.com/casseris
Dr Neurofourier – https://www.youtube.com/c/Neurofourier
SciShow by Complexly (Hank and John Green): https://www.youtube.com/@SciShow
Science Night Podcast – https://www.scinight.com/episodes
Ed Yong (no longer at the Atlantic!) – https://edyong.me/
The Violinist's Thumb by Sam Kean – https://samkean.com/books/the-violinists-thumb/

You can find Will on BlueSky: https://bsky.app/profile/willngiam.bsky.social

If you'd like to find out more about ReproducibiliTea, our grassroots initiative to build community in Open Science across institutions, check out https://reproducibilitea.org.

S4E4 Science Communication (with Jamie Moffa, In Plain English Podcast)

Why is Indigenous health research so crucial, especially for adolescents? What are the
systemic challenges researchers face, and how can we push for openness, transparency,
and equity in health research? In this conversation, hosts Queen Saikia and Sarah Sauvé
speak with leading experts from New Zealand - Prof. Sue Crengle (University of Otago),
Prof. Terryann Clarke (University of Auckland), and Dr. Andrew Sise (University of
Otago) - to explore the current landscape of Indigenous health research and the
methodologies used in these investigations. They also discuss key issues around
reproducibility, openness, and transparency, the discrepancies in research systems, and
how we can drive meaningful change. This episode is a must-listen for anyone passionate
about health equity, open research, and improving research culture. Listen now and join the conversation in the comments!

S4E5 Indigenous Research Methods: Valuing Knowledge, Community, and Impact

In this episode, Sarah and Will chat to Josh de Leeuw from Vassar College and the creator of jsPsych. We chat about the history of jsPsych, the unseen process behind creating open-access scientific software, and the current challenges facing software developers in the open scholarship movement.

jsPsych is a javaScript framework for creating online experiments, and is always looking for people to contribute to the codebase: https://jspsych.org.

Follow Josh de Leeuw on Bluesky: https://bsky.app/profile/joshdeleeuw.bsky.social

S4E6 Creating Open-Access Scientific Software with Josh de Leeuw (jsPsych)

Show notes:

OSF Preprints | Let's talk about it: positivism and critical theory in dialogue https://osf.io/preprints/osf/t2ywh_v1 
Caliban & the Witch by Silvia Federici
Pollution is Colonialism by Max Liboiron
Against Method by Paul Feyerabend
Lecture on Against Method by Tomas Petricek, University of Cambridge : https://youtu.be/jzD1O_gastA
S2E10: Limits of ReproducibiliTea for discussion and resources of a feminist lens on open science https://soundcloud.com/reproducibilitea/s1e10-limits 
The battle for your brain by Nita Farahany
Quokka app: https://palm-lab.github.io/QualCA
Quokka video guide: https://www.youtube.com/watch?v=9jJK70W0hAI

S4E7 Critical theory vs positivism

In this episode, Will is joined by Lianne Wolsink, PhD candidate at Ruhr University Bochum and current steering committee member of ReproducibiliTea. Will and Lianne discuss the ReproducibiliTea reading lists, created to help journal clubs do deep dives on metascience topics. Lianne created reading lists on replication and science communication; Will created an introductory reading list on Open Science, preregistration, and theory in psychology.

Reading lists: https://rpt-rl.netlify.app

Books mentioned:
Science Fictions by Stuart J Ritchie
Against Method by Paul Feyerabend
Nobody's Fool by Daniel Simons and Christopher Chabris

S4E8 ReproducibiliTea Reading Lists

Amy, Sophia, and Sam introduce the ReproducibiliTea Journal Club Podcast - where we serve up mugs of ReproducibiliTea in blends of transparency, openness, and robustness with a spoonful of science. 

In upcoming episodes we will cover (the pdfs can also be found at https://drive.google.com/drive/folders/1dpJ7LBLjXIBhiWBJMlG-B-UgziJxyS7D);

1. A manifesto for reproducible science https://www.nature.com/articles/s41562-016-0021 
2. False-Positive psychology  http://journals.sagepub.com/doi/abs/10.1177/0956797611417632
3. Measuring the prevalence of questionable research practices with incentives for truth telling  http://journals.sagepub.com/doi/abs/10.1177/0956797611430953 
4. Estimating the Reproducibility of Psychological Science http://science.sciencemag.org/content/349/6251/aac4716
5. Is the Replicability Crisis Overblown? Three Arguments Examined http://journals.sagepub.com/doi/pdf/10.1177/1745691612463401
6. Open Science: What, Why and How  https://psyarxiv.com/ak6jr
7. The Natural Selection of Bad Science  http://rsos.royalsocietypublishing.org/content/3/9/160384
8. The Preregistration Revolution  http://www.pnas.org/content/pnas/early/2018/03/08/1708274114.full.pdf

Episode Zero - Introductions

In our first journal club podcast we discuss "A manifesto for reproducible science" from Nosek et al. www.nature.com/articles/s41562-016-0021

Highlights
[0:00] Sam butchers everybody's names, right from the start
[7:00] "The first principle is that you must not fool yourself — and you are the easiest person to fool" - Richard Feynman
[9:00] Figure 1; the best figure; the every-figure
[13:30] HARKing (Hypothesising After the Results are Known), distinguishing confirmatory and exploratory analyses, preregistration
[17:00] Power and false positives
[19:00] Button et al. "Power failure: why small sample size undermines the reliability of neuroscience" https://www.nature.com/articles/nrn3475
[26:00] storytelling
[30:00] The garden of forking paths
[36:00] Education is key - for everyone
[40:00] suggestions to improve our practices


Music credit: Kevin MacLeod -  Funkeriffic
https://freepd.com/misc.php

Episode 1 - The problem defined

Episode 2 - Examining analytic flexibility

This week discuss analytic flexibility in “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant” from Simmons, Nelson, & Simonsohn (2011) http://journals.sagepub.com/doi/abs/10.1177/0956797611417632

Highlights:
[1:00] What is a false positive anyway?
[3.30] Dead salmon fMRI study http://prefrontal.org/files/posters/Bennett-Salmon-2009.pdf
[4:30] Pregnant men as our example of false positives
[8:30] Garden of forking paths
[11:00] Gelman & Lokens (2013) http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf 
[18:00] precognition - we needed results that broke physics to show us the problems in psychology
[21:00] Table 1 and simulating researcher degrees of freedom
[24:30] “Our goal as scientists is not to publish as many articles as
we can, but to discover and disseminate truth.”
[27:30] you can always get significances with optional stopping
[29:30] March of the P-values https://www.youtube.com/watch?v=5OL1RqHrZQ8, ‘Improving your statistical inferences’ on Coursera with Daniel Lakens (@lakens)
[32:00] Solutions, inc. transparency and preregistration

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 2 - Examining analytic flexibility

Episode 3 - Questionable Research Practices


This week we discuss the prevalence of questionable research practices in John, Lowenstein, & Prelec “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling” http://journals.sagepub.com/doi/abs/10.1177/0956797611430953


Highlights:

[2:00] What are questionable research practices?
[3:00] QRP as a political term
[6:00] a pinch of transparency
[8:00] QRPs as a grey area?
[12:00] Does defining a QRP as ‘just’ questionable water down the message of ‘this is wrong’?
[14:00] Do John, Lowenstein, & Prelec practice what they preach in this paper? We discuss the methodology
[19:30] Figure 1 - What do we see? “Everybody’s doing it”
[22:00] Passing on QRPs throughout the (research) generations
[24:30] Defending QRPs
[28:00] What would the QRP rates look like now?
[29:30] You can't round down p values to be less than .05, stop cheating
[30:30] Figure 2 - “I’m fine and so are my collaborators, its other people that I doubt…”
[33:00] Our job is to be critical. We get sad about the pushback to being critical on QRPs
[35:00] Sam tries desperately to find a silver lining, Sophia advocates arson.

Episode 3 - Questionable Research Practices

This week we talked about “Open Science: What, Why, and How” from Spellman, Gilbert, and Corker. You can find the paper on OSF https://osf.io/gv6r4/ 

0:14 Sophia is leaving Oxford :( (But the Podcast will continue)
0:48 This week’s focus: Open Science What Why and How; few in the JC read it but the discussion was awesome https://osf.io/gv6r4/ 
2:15 Shoutout to Matt Jaquiery @MJaquiery 
2:40 Broad Meaning of Open Science -- what do we mean; potentially misleading to include things beyond Open?
5:10 The Centre for Science that’s Actually Science
6:05 Focussing on Open Data as “open signalling”
7:30 What even is Open Data? Criteria for Open Data; How it can go wrong
10:25 Open vs Usable Data
11:10 FAIR Guidelines -- Findable Accessible Open Source Interoperable Reusable
12:20 (Advantages of) Open Code 
15:30 Why is Open Science just Science Done Right?
16:00 Answer Sam: Open Code -- Show Your Working
17:00 Answer Amy: Work cumulatively in order to avoid waste of taxpayers’ money
18:20 Answer Sophia: being open about subjectivities; slightly tautological argument of Open Science just is Science
21:10 Better system for citing code!
23:20 Not sharing data? Is it selfish?
27:30 BREAK
29:00 Shoutout to Remi Gau; Amy will be singing for you 
29:40 Amy and Sophia compete for supremacy in the Table 2 challenge - what are the problems and solutions at each stage of the research process?
31:10 Challenging Two Psychologists Four Beers to the Crossover Event 5 Psychologists 50 Shots
32:00 Competition Begins: 1. Research Planning
34:35 AMY IS THE QUEEN
35:00 Competition part 2. Data Collection and Methods Reporting
36:30 Sam has a picture of James Heathers next to his bed (aka. Amy and Sophia try to make Sam look like a creep)
37:45 Competition part 3. Data Analysis and Reporting
38:54 https://jasp-stats.org
39:25 Competition part 4. Publication Process
41:30 Open Peer Review -- Do you have any good or bad experiences of this?
42:40 Competition part 5. Storing and Archiving
44:10 Why do we give publishers the chance to adapt to openness, when we should just get rid of them?
49:55 Amy wins 14-10, but is also the kindest <3
51:30 Give us your suggestions for cool ECRs/baby researchers

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 6 - Open Science

This week we talk about “The natural selection of bad science” from Paul Smaldino and Richard McElreath. We get bummed, but try to put a positive spin on things. You can find the paper here http://rsos.royalsocietypublishing.org/content/3/9/160384 

Highlights
[1:00] “The natural selection of bad science” http://rsos.royalsocietypublishing.org/content/3/9/160384 
[5:00] the need to distinguish yourself as a scientist - innovative and/or high output?
[6:45] Our next SpecialiTEA - we want to hear your experiences about leaving academia
[11:00] “when a measure becomes a target it ceases to be a good measure”
[13:30] could quality control help ‘fix’ metrics?
[15:00] Competition - how quickly can you move from open science topic A to B purely with ranting?
[18:00] I have the powerrrrrrrrr  (I wish soundcloud would let me add gifs - millenial problems)
[26:00] We get a little confused about power in the simulations - we highly recommend reading the paper to get the details right :)
[29:00] Challenge to listeners - grab Smaldino & McElreath’s code and figure out how to create a scientific utopia!
[31:30] The simulation
[32:30] Watching out for forced retirements…
[35:00] Sam is super millenial and reads out this awesome tweet about terrible things in science https://mobile.twitter.com/aidybarnett/status/1036392482139865088
[37:00] Not enough detail in original papers to attempt to replicate in  The Reproducibility Project: Cancer Biology (https://osf.io/e81xl/wiki/home/), also a thread from @chrisdc77 https://twitter.com/chrisdc77/status/1024589364238667776
[42:00] “The continuous degradation of scientific process”
[44:00] Does promoting replication attempts solve the problem?
[48:30] So, what the hell can we do to stop the decline of science? Community, hiring and funding shifts, and more
[56:45] Observed power

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 7 - Natural Selection Of Bad Science

SpecialiTea Episode 4 – Leaving academia (part 1)

A few weeks ago we put out a survey to get a picture of peoples’ reasons for leaving academia and what advice they have for ECRs. We had lots of responses and dive into them here. There wasn’t quite enough time to really dig into the advice offered. But, that’s where you lovely people can come in. Our survey is still open (https://docs.google.com/forms/d/e/1FAIpQLSdad9GpUbqKebCxUSbUJXVvyOWH3gtC7zO77trFIo-SwUh-og/viewform), so if you have any advice to offer let us know there or DM us on twitter @ReproducibiliT

Some shownotes:
Oxford Reproducible research summer school https://osf.io/zk2em/ 
Last year’s oxford reproducible research summer school http://neuroanatody.com/category/robust-research/ 
Oxford-Berlin summer school on open, transparent, and reproducible research in the life sciences https://www.fosteropenscience.eu/event/berlin-oxford-summer-school-open-transparent-and-reproducible-research-life-sciences 
Link to the Dorothy Bishop appreciation society (work in progress)
Psychological science accelerator https://psysciacc.org/ 
Seminar series on Reproducibility and Open Research http://users.ox.ac.uk/~phys1213/ReproAtASC.html 

Music credit: Be Jammin – Alexander Nakarada
https://freepd.com/world.php

SpecialiTea 4 - Leaving Academia (part 1)

Episode 11 - Ivan Flis

This week we had an awesome chat with the super-interdisciplinary Ivan Flis. Ivan is like a cake made from psychology, history, and philosophy of science. This cake was the perfect compliment to our Repro-Tea. There was so much to cover that we will have Ivan back next time too!

Just a few of the amazing resources Ivan mentioned:

Deborah Mayo’s book, Statistical Inference as Severe Testing: How to Get Beyond the Statistics Words, Amy still doesn’t understand what she is really reading though…. (Sam is doing no better) (https://www.cambridge.org/core/books/statistical-inference-as-severe-testing/D9DF409EF568090F3F60407FF2B973B2) 

Loads of books Ivan mentions which we could not keep track of but he did recommend two after our conversation: 
OPTIMIST: Optimisation Methods in Science and Technology: http://www.ruhr-uni-bochum.de/optimist-survey/
George Reisch How the Cold War Transformed Philosophy of Science (2005) https://www.amazon.co.uk/How-Cold-Transformed-Philosophy-Science/dp/0521546893

Ivan’s Dissertation “Discipline through method: Recent history and philosophy of scientific psychology (1950-2018)”
https://www.dropbox.com/s/amjv3oyu8u09nw2/2018%20thesis%20Ivan%20Flis%20final%20version.pdf?dl=0 

Ivan’s paper about textbooks, Instructional Manual of Boundary-Work: Psychology Textbooks, Student Subjectivities and Disciplinary Historiographies (that's a mouthful!) https://onlinelibrary.wiley.com/doi/full/10.1002/jhbs.21791

The Descartes Centre in Utrecht: https://www.uu.nl/en/descartes-centre

Ivan highly recommends to “Read more books”, if you want a starting point he mentions Kurt Danzinger’s Constructing the Subject (1990) https://www.cambridge.org/core/books/constructing-the-subject/6B1C7891EC8C6670ECD341B3F3E08B65

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 11 - Ivan Flis

Episode 13 – Fighting the impostor (syndrome)
 
Hello 2019! Amy, Sophia, and Sam discuss impostor syndrome. While Sam was concerned this would leave him wanting to hide under the desk and cry-eat chocolate for the rest of the day, it turned into an unexpectedly uplifting talk.
 
Get in touch with your experiences; what helps? what makes it worse? how can we help each other?

Just a few links:
We should all feel a bit more like impostors – Julia Rohrer - http://www.the100.ci/2018/08/02/we-should-all-feel-a-bit-more-like-impostors/
Sam’s old, early blog post on what impostor syndrome feels like https://samdparsons.blogspot.com/2017/10/students-questions-4-what-is-imposter.html

Episode 13 - Fighting The Impostor (syndrome)

Episode 26 - Advice on starting a PhD

In a slight change of pace, Sophia interviews Amy and Sam for advice on starting a PhD. This is part 1 of a two part series on advice for new PhDs. If you have any thoughts or comments, hit up our twitter and join the conversation.
Caveat: Amy and Sam both completed their PhDs in Experimental Psychology at Oxford University. We did try to make any advice or comments as widely relevant as possible, however we should recognise the limits of our experience. We would love to hear from you, whether your institution/department would be very different, whether you agree or disagree with our comments, and if you have anything to add we’d love to comment!

Highlights
Question 1 – If you could give yourself some advice at the start of yo9ur PhD, what would you say?
Sams PsyPAG (@PsyPAG) blogpost: http://www.psypag.co.uk/what-advice-would-you-give-to-yourself-at-the-beginning-of-your-postgraduate-studies/
Related: check our Anne Scheel’s (@annemscheel) episode on Everything Hertz (@hertzpodcast) https://everythinghertz.com/47

Question 2 – What should you do at the start of your PhD?

Question 3 – how do you, and have you been successful at, developing a good work/life balance?
A part of this question we faced is, how do you define work?

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 26 - Advice on starting a PhD part 1

In the first of our new SolidariTea sub-series, Amy Orben talks to Robert Stenson from the University of Nottingham, UK, where he is finishing a PhD at the School of Cultures, Languages and Area Studies. SolidariTea episodes are short podcast conversations with Early Career Researchers around the world that highlight injustices, campaigns, struggles and discussions mainly about working conditions, diversity and equality, employment, and work-life balance. Robert Stenson tells us about how his university has outsourced all grad student teachers to a temporary staffing company and how this has affected their working conditions and ability to strike (see his tweet here: https://twitter.com/robert_stenson/status/1199260126319910912). The episode highlights how increasing amounts of universities are outsourcing workers (see https://unitemps.com) and how this precariousness affects grad students and early-career scientists. The practice implemented by the University of Nottingham sets a dangerous precedent for outsourcing teaching by the most junior and vulnerable workers, who are often crucial to delivering the courses departments offer to their students. 

Have you, or someone you know, been affected by precariousness, outsourcing or temporary contracts? Please get in touch with us! We are planning to highlight more ECR stories in future SolidariTea episodes.

Music credit:
River Meditation - Jason Shaw
https://freepd.com/misc.php

SolidariTEA 1 - Robert Stenson

Episode 28 - Jade Pickering and Marta Topor

This time we are joined by the amazing Jade Pickering (@Jade_Pickering) and Marta Topor (@MartaTopor). 

Jade and Marta share their own ReproducibiliTea experiences and an exciting new project on building tools for systematic reviews. Watch this space as the duo get ready to release this tool to the wilds!

Keep an eye out for the most positive and wholesome answers to our usual guest question "what advice do you have for other ECRs?"


Music credit: Be Jammin - Alexander Nakarada
freepd.com/world.php

Episode 28 - Jade Pickering and Marta Topor

Episode 33 with Flavio Azevedo on FORRT

Our latest awesome ECR you need to watch out for is Flavio Azevedo @Flavio_Azevedo_. He was recently named one of one of the top 100 global shapers from Portugal! (https://www.100oportunidades.pt/) and by gosh he's just one of our favorite people too.

Flavio tells us all about the importance of openness in reproducibility in teaching. He is leading an amazing project: a Framework for Open and Reproducible Research Training, or FORRT. The project advocates for integrating open and reproducible research practices into not only methods training, but subject material too. FORRT will be doing this with a dedicated platform collating teaching materials and the pedagogues to teach them. Listen in to hear what else FORRT has to offer, and how you can get involved!

Useful links:
Check out Flavio's awesome website; not only for how cool he is academically, but also some sweet photography http://flavioazevedo.com/ 
Flavio's recent talk about FORRT at Open Science Day at Goethe University https://video01.uni-frankfurt.de/Mediasite/Play/8fae430a4ee24d62a7f61985f74f27121d
FORRT website - under development https://forrt.org/
FORRT twitter @FORRTproject
The FORRT manuscript "Introducing a Framework for Open and Reproducible Research Training (FORRT)" https://osf.io/bnh7p/
Check out this twitter thread for all things FORRT https://twitter.com/FORRTproject/status/1207303102245801984?s=20

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 33 - Flavio Azevedo and building a FORRT

Episode 32 - Research under Crisis with Anne Scheel

We have a very special guest in this lockdown episode of ReproducibiliTea: Anne Scheel (@annemscheel). We reflect on research during the COVID-19 pandemic and the wide range of responses from the research community. 

We talked to Anne about her recent blogpost “Crisis research, fast and slow” (http://www.the100.ci/2020/03/26/crisis-research-fast-and-slow/) - her first in two years! A lot of research is being rushed to testing and to (pre)print; Anne worries that some of this goes against our collective efforts to promote ‘slow’ science. 

Anne masterfully flips the interview on Amy and Sam to give a teaser about their upcoming studies, and how they are trying to avoid the potential pitfalls of fast research during crisis mode.

Listen through the end for some stellar ECR advice from our latest Awesome ECR

Useful links:

Anne’s Blogpost: Crisis research, fast and slow http://www.the100.ci/2020/03/26/crisis-research-fast-and-slow/

The 100% CI blog http://www.the100.ci/

Emergency Kittens @EmrgencyKittens

Anne’s zotero library of COVID-19-related psychology preprints https://www.zotero.org/groups/2472136/covid-19_psych_papers 

Anne was also a guest on one of our very favourite episodes of the Everything Hertz podcast https://everythinghertz.com/47

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php

Episode 32 - Crisis Research With Anne Scheel

Serving mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science. Brewed by the @ReproducibiliT Team

ReproducibiliTea Podcast

Popular tracks