Meta launches an AI model / SeamlessM4T / which can transcribe and translate almost 100 languages.

https://seamless.metademolab.com/demo

#Meta #MetaAI #SeamlessM4T #SpeechToText #Translation #AIpoweredTranslation #UniversalSpeechTranslator #MultilingualTech #OpenSourceAI #SpeechRecognition #LanguageBarrierBreaker #AIinCommunication #MetaResearch #MachineTranslation  #NextGenTranslation #AI

New article from me:

“The replication crisis is less of a ‘crisis’ in the Lakatosian approach than it is in the Popperian and naïve methodological falsificationism approaches”

Substack: https://markrubin.substack.com/p/popper-lakatos-and-the-replication-crisis

Preprint: https://doi.org/10.31222/osf.io/2dz9s

#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#PhilosophyOfScience
#PhilSci
@philosophyofscience

How does the science reform movement align with broader changes in the academic landscape? Tom Hostler tackles this question in a new article on “Scientific reform, post-academic research, and academic identity”: https://markrubin.substack.com/p/scientific-reform-post-academic-research
🧵👇

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing

"Discretion in research practice should perhaps not be seen as a weakness or a fault in the scientific method, but rather an integral part of it."

New preprint: https://osf.io/preprints/metaarxiv/7dh3t/

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing

Metascience News:

Tom Stafford (@tomstafford) provides a round up of the latest metascience news, workshops, conferences, talks, and listservs!

https://open.substack.com/pub/tomstafford/p/anyone-for-metascience

#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing

New proposal for scientists to sign NDA’s to facilitate reproducibility: https://www.scientificamerican.com/article/a-simple-replication-agreement-could-improve-trust-in-science/

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing

Just finished ‘Evaluating What Works’ by @deevybee & Paul Thompson. A really good primer on how to evaluate #interventions and, despite the speech and language therapy context, I found it highly relevant to #psychology & #metaresearch.

I’ll be adding this to my module’s reading list, but unfortunately I can’t put it on my Goodreads :ablobcatcry:

#evaluation #researchmethods #evidence #openscience

Read online for free:
https://bookdown.org/dorothy_bishop/Evaluating_What_Works/

"Concerned about the reproducibility and transparency of research? Interested in learning more about meta-research, or the science of science? Looking for hands-on experience? Excited to work with other early career researchers across disciplines? Apply for the Meta-Science Summer School to learn more about meta-research by working collaboratively in a small team to design a meta-research study."

Free from BIH, Frankfurt, 28 Aug-1 Sept, apply by 16 June: https://www.bihealth.org/en/notices/meta-science-summer-school-designing-studies-to-improve-research-1

#MetaResearch

“Instead of focusing purely on replicability, we should strive to maximize transparency, rigor, and quality in all aspects of research.”

New review summarises the structural, procedural, and community changes following the replication crisis.

Preprint: https://osf.io/preprints/metaarxiv/r6cvx/

#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS

Peer Review and Article Retractions

New study of 260 peer reviews finds that expert and senior reviewers are more likely to identify issues in manuscript submissions that later lead to article retractions.

https://doi.org/10.1016/j.joi.2023.101423

#Science
#MetaScience
#MetaResearch
#AcademicChatter
@academicchatter

Preregistration:

Interesting new article in the Journal of Trial and Error proposes that we establish core preregistration criteria (i.e., a minimum amount of information required to consider a preregistration complete) and only award preregistered badges only to articles that meet those criteria.

🦣 Author: @drcpennington

Open access: https://doi.org/10.36850/mr6

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#Preregistration

Selfish Scientists

Researchers who thought of themselves as “scientists” saw themselves as less warm, fair, cooperative, likeable.

“The reminder of being a member of the scientific community that incentivizes individual gain might make researchers less willing to share their knowledge with peers.”

Altenmüller et al. (2023). https://doi.org/10.32872/spb.10011

#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS

New paper argues insights from qualitative research can help to improve open science.

Steltenpohl et al. (2023). Rethinking transparency and rigor from a qualitative open science perspective. Journal of Trial & Error. https://doi.org/10.36850/mr7

#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing

🔸New Critical Metascience blog post🔸

"Opening up open science to epistemic pluralism: Comment on Bazzoli (2022) and some additional thoughts"

https://open.substack.com/pub/markrubin/p/opening-up-open-science-to-epistemic?r=2bqjb7&utm_campaign=post&utm_medium=web

#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS

My new article on “Questionable Metascience Practices."

Open access: https://doi.org/10.36850/mr4

Few quotes follow: 🧵👉

#OpenScience
#MetaScience #MetaResearch
#PhilSci
#SociologyofScience
#ScienceofScience
#STS
@stsing

Where could I find a list of journals which publish referee reports for *all* their accepted articles?
By "open" I mean you can read the referee reports -- I don't care if they are signed or not.
By "all" I mean either all the accepted articles since the journal began OR all accepted articles after a specific date.
#PeerReview #scholcomm #MetaResearch

Rethinking Transparency and Rigor from a Qualitative Open Science Perspective

“The aim of this paper is to challenge the current quantitative-focused mainstream understanding of transparency and rigor within the open science movement and suggest additional considerations relating to these concepts from qualitative research paradigms.”

Preprint: https://psyarxiv.com/bpu5f

#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing
@cnsyoung

Motives for Not Sharing Data:

"We found no robust empirical evidence for the claim that not sharing research data for reanalysis is associated with consistency errors."

https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0284243

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing

Replications Welcome!

“Replicators seem to believe that their work is seen as hostile (Nosek and Errington 2020; Nosek et al. 2022). In response, they are likely to see the outside world as a source of threats….However, the current results suggest that replicators possibly overestimate the risk of negative reactions to their work.”

https://doi.org/10.1080/08989621.2023.2198126

#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing

A narrow definition of “research quality”

"[Preregistration, computational reproducibility of analyses, and replication studies] are all methodological procedures which have been developed from a narrow perspective of positivist epistemology, quantitative methodology, and a-priori confirmatory hypothesis testing.”

https://psyarxiv.com/2zhwe/

🧵👉

#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
@stsing
#Preregistration
#ReplicationCrisis

1/4