New article from me:
“The replication crisis is less of a ‘crisis’ in the Lakatosian approach than it is in the Popperian and naïve methodological falsificationism approaches”
Substack: https://markrubin.substack.com/p/popper-lakatos-and-the-replication-crisis
Preprint: https://doi.org/10.31222/osf.io/2dz9s
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#PhilosophyOfScience
#PhilSci
@philosophyofscience
#philsci #philosophyofscience #sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience
How does the science reform movement align with broader changes in the academic landscape? Tom Hostler tackles this question in a new article on “Scientific reform, post-academic research, and academic identity”: https://markrubin.substack.com/p/scientific-reform-post-academic-research
🧵👇
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
"Discretion in research practice should perhaps not be seen as a weakness or a fault in the scientific method, but rather an integral part of it."
New preprint: https://osf.io/preprints/metaarxiv/7dh3t/
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
New proposal for scientists to sign NDA’s to facilitate reproducibility: https://www.scientificamerican.com/article/a-simple-replication-agreement-could-improve-trust-in-science/
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Revisiting the Behavioral Revolution in Economics https://www.project-syndicate.org/commentary/behavioral-economics-revolution-has-been-tamed-by-antara-haldar-2023-06
#BehavioralEconomics #BoundedRationality #ReplicationCrisis
#replicationcrisis #BoundedRationality #behavioraleconomics
Meanwhile, "no novel results are reported" is used to gatekeep manuscripts out of publication in the life sciences, all the while living through a replication crisis.
So refreshing to witness the physicists have had this worked out for decades.
#scientificpublishing #science #replicationcrisis #academia
“Instead of focusing purely on replicability, we should strive to maximize transparency, rigor, and quality in all aspects of research.”
New review summarises the structural, procedural, and community changes following the replication crisis.
Preprint: https://osf.io/preprints/metaarxiv/r6cvx/
#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience #science
Preregistration:
Interesting new article in the Journal of Trial and Error proposes that we establish core preregistration criteria (i.e., a minimum amount of information required to consider a preregistration complete) and only award preregistered badges only to articles that meet those criteria.
🦣 Author: @drcpennington
Open access: https://doi.org/10.36850/mr6
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#Preregistration
#PreRegistration #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Some of You might remember that just as we are buzzing about #AI today, several years ago #psychology had a moment of its own around the #replicationcrisis. I share a lot of sentiments with the message of this article. It's wittily written, too.
https://www.experimental-history.com/p/psychology-might-be-a-big-stinkin
#ai #psychology #replicationcrisis
🆕 New Critical Metascience blog post 🆕
"Sabina Leonelli’s “Philosophy of Open Science"
#Science
#Metascience
#ReplicationCrisis
#PhilosophyOfScience
#PhilSci
@sabinaleonelli
#philsci #philosophyofscience #replicationcrisis #metascience #science
Motives for Not Sharing Data:
"We found no robust empirical evidence for the claim that not sharing research data for reanalysis is associated with consistency errors."
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0284243
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Replications Welcome!
“Replicators seem to believe that their work is seen as hostile (Nosek and Errington 2020; Nosek et al. 2022). In response, they are likely to see the outside world as a source of threats….However, the current results suggest that replicators possibly overestimate the risk of negative reactions to their work.”
https://doi.org/10.1080/08989621.2023.2198126
#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience #science
Podcast on #replicationcrisis in #psychology and #science.
Podcast link: https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkcy5idXp6c3Byb3V0LmNvbS8xODAxNDM2LnJzcw/episode/QnV6enNwcm91dC0xMjUwMzE2Ng?ep=14
Article link: https://www.cambridge.org/core/journals/philosophy-of-science/article/abs/what-is-a-replication/F41B751ECC31462CBBD46711BC733AEE
#replicationcrisis #psychology #science
A narrow definition of “research quality”
"[Preregistration, computational reproducibility of analyses, and replication studies] are all methodological procedures which have been developed from a narrow perspective of positivist epistemology, quantitative methodology, and a-priori confirmatory hypothesis testing.”
🧵👉
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
@stsing
#Preregistration
#ReplicationCrisis
1/4
#PreRegistration #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
RT @jayjoseph22
Science is experiencing a #ReplicationCrisis. In "Schizophrenia and Genetics: The End of An Illusion," I use replication crisis concepts and terms to explain how genetic research on psychiatry's archetypal "mental disorder" has gone terribly wrong.
Psychology experiments in major journals - do they hold true? Very nice quiz in which you get to inspect 21 findings published in Nature or Science and guess whether a replication with a larger sample size obtained the same result
#quiz #replicationcrisis #psychology
New blog post. I did the thing: checked to see how well ChatGPT could do my job. Turns out... I'm more impressed than I thought I'd be, but I'm not worried about being replaced.
https://danvers.substack.com/p/writing-in-the-era-of-chatgpt
#Blogging #ChatGPT #Replication #ReplicationCrisis #AI #Writing
#blogging #chatgpt #replication #replicationcrisis #ai #writing