🎉 Join us in ReproducibiliTea Basel next semester! This semester we continue online with a great program!

You can register and secure your place: https://eventbrite.com/o/unibasel-reproducibilitea-53629203863

#RTeaUnibasel
#OpenScience #Reproducibility #Replicability #ReproducibiliTea @mrifranz
https://osf.io/kp98v/?view_only=

#ML #SocialSciences #Science #Replicability: "In our past work, we have shown how errors affect hundreds of papers in over a dozen fields that have adopted ML methods, so we were skeptical of these claims. In our experience, models that try to predict consequential social outcomes are particularly likely to be flawed. Worse, these flaws are often inherent to the use of ML in these settings, and thus not fixable.

So we decided to dig in—through a collaboration led by our colleague, Princeton psychology professor Molly Crockett. Yale anthropology professor Lisa Messeri and Princeton psychology PhD student Xuechunzi Bai were our other collaborators.

We found that the model developed by the authors has major drawbacks, which we describe in a letter sent to PNAS, published earlier this week. We explain why the use of ML for estimating replicability cannot offer a shortcut to the hard work of building more credible scientific practices and institutions.

The model described in the paper was trained on an extremely small sample: just 388 past papers that had been evaluated for replicability in past efforts (such as from a landmark study by the Open Science Foundation)."

https://www.aisnakeoil.com/p/machine-learning-is-useful-for-many

Will high school students' reflection test performance predict the reasoning preferences and habits it does in adults?

Rizek and Toplak report "patterns of correlations are generally consistent with what has been reported in adult samples" in a sample of over 300 9th through 12 graders from North America:  

https://doi.org/10.4324/9781003009351-20

#DecisionScience #DevPsych #Psychology #Replicability

We specifically discuss and highlight many recent changes and updates from #Twitter, #Reddit, #Meta, and #Tiktok, while noting the extremely fragile and volatile environment we are all currently in.
We relate this back to #OpenScience and how achieving #reproducibility and #replicability is challenging--increasingly so today. We outline key issues researchers face when working with large-scale social media data relating to:

Another paper finds that highlighting identifiable victims in public health messaging didn't reliably improve intentions to comply with public health guidelines more than a standard public health message (that doesn't mention a victim).

These data were collected about the same time as data from Byrd & Białek (2021): March to May 2020.

https://doi.org/10.1371/journal.pone.0284354 #noxp

#Psychology #PublicHealth #DecisionScience #Replicability

We're looking for new members of our Credibility Advisory Board, which helps shape our Credibility in Neuroscience campaign.

It's open to BNA members to express interest by May 30th. If you're interested, but not currently a member, you can join and complete the form for CAB membership at the same time.

Find out more at: https://bnacredibility.org.uk/credibility-advisory-board

#reproducibility #replicability #openscience #neuroscience

The #RandomLaboratory model allows one to estimate whether an experimental result is likely to #replicate. This study uses new experimental data to show that such a model, when applied to archived data, improves prediction of #replicability #PLOSBiology https://plos.io/40YEv5b

The #RandomLaboratory model allows one to estimate whether an experimental result is likely to #replicate. This study uses new experimental data to show that such a model, when applied to archived data, improves prediction of #replicability #PLOSBiology https://plos.io/40YEv5b

The #RandomLaboratory model allows one to estimate whether an experimental result is likely to #replicate. This study uses new experimental data to show that such a model, when applied to archived data, improves prediction of #replicability #PLOSBiology https://plos.io/40YEv5b

A little more than two weeks left (deadline is April 30) to submit an abstract for the Media & Communication special issue on "Reproducibility and Replicability in Communication Research" edited by @drfollowmario and me. You can find the full CfP here: https://www.cogitatiopress.com/mediaandcommunication/pages/view/nextissues#Reproducibility
We are looking forward to receiving your submissions! #commodon #reproducibility #replicability @communicationscholars

Is Economics Self-Correcting?
Replications in the American Economic Review
https://www.rwi-essen.de/fileadmin/user_upload/RWI/Publikationen/Ruhr_Economic_Papers/REP_23_1005.pdf
“…most comments are barely cited, & they have no impact on the original papers’ subsequent citations.
…#replications do not update the #economics literature
…conventional wisdom that #robustness & #replicability are hard to define in economics.”

The winners of the 2023 BNA Credibility Prizes have been announced!

Congratulations to Maria Korochkina, Roni Tibon, and the
#EEGManyLabs project team on their great work to ensure neuroscience research is as credible as possible.

We'd like to also congratulate Abigail Fiske, Esther Walton & Dementias Platform UK, who were all highly commended for their work to strengthen Credibility in #Neuroscience!

Read more: https://www.bna.org.uk/mediacentre/news/credibility-prize-2023/

#reproducibility #replicability #openscience

But what if this study goes viral!? At least the data seems to show psychology is becoming more rigorous.

#psychology #replicability

https://bigthink.com/neuropsych/psychology-replication/

Join us tomorrow for the next webinar in our #neuroimaging series.

Cass Gould van Praag (Wellcome Centre for Integrative Neuroimaging) is joined by Cyril Pernet
is joined by @CyrilPernet to discuss data privacy in neuroimaging research, and answer your questions.

Register for free: https://us02web.zoom.us/webinar/register/4016729343814/WN_Zr7lzcfNRw-A2j5rRjSYTw

#neuroscience #neuro #openscience #reproducibility #replicability #researchintegrity #dataprivacy

Interesting new study estimating the #replicability of published research in #psychology over the past 20 years.

The paper includes *nearly all papers* published in six top psychology #journals over last 2 decades.

https://www.pnas.org/doi/10.1073/pnas.2208863120

The researchers used a #MachineLearning model (#RandomForest & logistic regression ensemble) to estimate the replication likelihood of over 14,000 #articles from 2000-2019 in six subfields of psychology.

#Science #Academia #Research #Fediverse #OpenAccess

Join us tomorrow at 1pm GMT for the first of our new Credibility Lunchbox series on #neuroimaging -
Cass Gould van Praag (Wellcome Centre for Integrative Neuroimaging) is joined by
Roni Tibon (University of Nottingham) to take you through how to go about preregistering research, and answer questions you may have on how to do this most effectively.

Register for free: https://us02web.zoom.us/webinar/register/4016729343814/WN_Zr7lzcfNRw-A2j5rRjSYTw

#neuroscience #preregistration #neuro #reproducibility #openscience #replicability #researchintegrity

Listening again to this great #conversation between the #Nobel prize winner #danielKahnemann and #samharris #CognitiveBiases #intuition #expertIntuition #replicability
https://podcasts.google.com/feed/aHR0cHM6Ly93YWtpbmd1cC5saWJzeW4uY29tL3Jzcw/episode/ZDRkZGFmYmRhODMyNDBkOGFhNDY4MjVjZDMzYTMxNWY?ep=14

RT @JuliaEberlen@twitter.com

Are you from one of the other main universities @UNamur@twitter.com @umons@twitter.com @UCLouvain_be@twitter.com @UnivStLouisBxl@twitter.com and interested in #OpenScience #OpenData #Reproducibility #Replicability etc. ? Contact us to learn how you could participate, contribute or simply stay informed about the @BelRepro@twitter.com https://twitter.com/Ch_Phillips/status/1616362000392536064

🐦🔗: https://twitter.com/JuliaEberlen/status/1616419275350200320

Our 2023 Credibility Prizes recognise outstanding examples to make neuroscience as credible as possible.

Last year, Fiona Ramage from University of Dundee picked up the student researcher prize, Matt Grubb from KCL won the individual researcher prize, while the NC3Rs took the team prize.

Nominations close 30th Jan. Nominees can be working in any neuroscience field.

Full details: https://bnacredibility.org.uk/prizes

#neuroscience #reproducibility #replicability #reliability #robustness #openscience

#Replicability #Zcurve #FrontiersInPsychology

This is my first write-up of a journal analysis of a psychology journal.

How much have research practices in psychology changed?

Please provide feedback about unclear, missing information on the blog or by emai / DM.

https://replicationindex.com/2023/01/11/frontiersinpsychology/