Mark Rubin · @MarkRubin
1841 followers · 1707 posts · Server fediscience.orgNew article from me:
“The replication crisis is less of a ‘crisis’ in the Lakatosian approach than it is in the Popperian and naïve methodological falsificationism approaches”
Substack: https://markrubin.substack.com/p/popper-lakatos-and-the-replication-crisis
Preprint: https://doi.org/10.31222/osf.io/2dz9s
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#PhilosophyOfScience
#PhilSci
@philosophyofscience
#philsci #philosophyofscience #sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience
Mark Rubin · @MarkRubin
1833 followers · 1700 posts · Server fediscience.orgHow does the science reform movement align with broader changes in the academic landscape? Tom Hostler tackles this question in a new article on “Scientific reform, post-academic research, and academic identity”: https://markrubin.substack.com/p/scientific-reform-post-academic-research
🧵👇
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1833 followers · 1697 posts · Server fediscience.org
"Discretion in research practice should perhaps not be seen as a weakness or a fault in the scientific method, but rather an integral part of it."
New preprint: https://osf.io/preprints/metaarxiv/7dh3t/
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Joel Chan · @joelchan86
428 followers · 308 posts · Server hci.socialI'm looking for dataset/metrics for estimating domain distance between pairs of research publications.
I'm thinking of sth like the patent classification system (used to estimate technological distance between patents: https://arxiv.org/pdf/1503.02373.pdf), but for research papers.
#MetaScience #ScienceOfScience
Mark Rubin · @MarkRubin
1802 followers · 1683 posts · Server fediscience.orgMetascience News:
Tom Stafford (@tomstafford) provides a round up of the latest metascience news, workshops, conferences, talks, and listservs!
https://open.substack.com/pub/tomstafford/p/anyone-for-metascience
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1779 followers · 1668 posts · Server fediscience.org
New proposal for scientists to sign NDA’s to facilitate reproducibility: https://www.scientificamerican.com/article/a-simple-replication-agreement-could-improve-trust-in-science/
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1689 followers · 1580 posts · Server fediscience.org
“Instead of focusing purely on replicability, we should strive to maximize transparency, rigor, and quality in all aspects of research.”
New review summarises the structural, procedural, and community changes following the replication crisis.
Preprint: https://osf.io/preprints/metaarxiv/r6cvx/
#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience #science
Mark Rubin · @MarkRubin
1675 followers · 1554 posts · Server fediscience.org
Preregistration:
Interesting new article in the Journal of Trial and Error proposes that we establish core preregistration criteria (i.e., a minimum amount of information required to consider a preregistration complete) and only award preregistered badges only to articles that meet those criteria.
🦣 Author: @drcpennington
Open access: https://doi.org/10.36850/mr6
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#Preregistration
#PreRegistration #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1670 followers · 1540 posts · Server fediscience.org
Selfish Scientists
Researchers who thought of themselves as “scientists” saw themselves as less warm, fair, cooperative, likeable.
“The reminder of being a member of the scientific community that incentivizes individual gain might make researchers less willing to share their knowledge with peers.”
Altenmüller et al. (2023). https://doi.org/10.32872/spb.10011
#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
#sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience #science
Mark Rubin · @MarkRubin
1666 followers · 1536 posts · Server fediscience.org
New paper argues insights from qualitative research can help to improve open science.
Steltenpohl et al. (2023). Rethinking transparency and rigor from a qualitative open science perspective. Journal of Trial & Error. https://doi.org/10.36850/mr7
#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience #science
Mark Rubin · @MarkRubin
1639 followers · 1492 posts · Server fediscience.org🔸New Critical Metascience blog post🔸
"Opening up open science to epistemic pluralism: Comment on Bazzoli (2022) and some additional thoughts"
#Science
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
#sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience #science
Angelo Salatino · @angelosalatino
56 followers · 123 posts · Server fediscience.org
Read now "Diversity of Expertise is Key to Scientific Impact: a Large-Scale Analysis in the Field of Computer Science" publication in Orvium
Pre-print: 🌐https://dapp.orvium.io/deposits/6442f3fd947802668eee976c/view
#ScienceOfScience #ResearchTeamDiversity #ResearchImpact @FraOsborne
#researchimpact #researchteamdiversity #ScienceOfScience
Mark Rubin · @MarkRubin
1623 followers · 1482 posts · Server fediscience.org
My new article on “Questionable Metascience Practices."
Open access: https://doi.org/10.36850/mr4
Few quotes follow: 🧵👉
#OpenScience
#MetaScience #MetaResearch
#PhilSci
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #philsci #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1611 followers · 1473 posts · Server fediscience.org
Rethinking Transparency and Rigor from a Qualitative Open Science Perspective
“The aim of this paper is to challenge the current quantitative-focused mainstream understanding of transparency and rigor within the open science movement and suggest additional considerations relating to these concepts from qualitative research paradigms.”
Preprint: https://psyarxiv.com/bpu5f
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing
@cnsyoung
#sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1602 followers · 1451 posts · Server fediscience.org
Motives for Not Sharing Data:
"We found no robust empirical evidence for the claim that not sharing research data for reanalysis is associated with consistency errors."
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0284243
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Sam Scarpino · @scarpino
864 followers · 512 posts · Server fediscience.org
RT @barabasi
What role does philanthropy play in Science?
Much more important than you think: https://arxiv.org/abs/2206.10661
A great collaboration with @ComplexGates and @LouisShekhtman.
#philanthropy #AcademicChatter #NetSci #ScienceOfScience
#ScienceOfScience #NetSci #academicchatter #philanthropy
Mark Rubin · @MarkRubin
1584 followers · 1442 posts · Server fediscience.org
Replications Welcome!
“Replicators seem to believe that their work is seen as hostile (Nosek and Errington 2020; Nosek et al. 2022). In response, they are likely to see the outside world as a source of threats….However, the current results suggest that replicators possibly overestimate the risk of negative reactions to their work.”
https://doi.org/10.1080/08989621.2023.2198126
#Science
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
#STS
@stsing
#sts #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience #science
Mark Rubin · @MarkRubin
1581 followers · 1429 posts · Server fediscience.org
A narrow definition of “research quality”
"[Preregistration, computational reproducibility of analyses, and replication studies] are all methodological procedures which have been developed from a narrow perspective of positivist epistemology, quantitative methodology, and a-priori confirmatory hypothesis testing.”
🧵👉
#OpenScience
#MetaScience
#MetaResearch
#ReplicationCrisis
#SociologyofScience
#ScienceofScience
@stsing
#Preregistration
#ReplicationCrisis
1/4
#PreRegistration #ScienceOfScience #sociologyofscience #replicationcrisis #metaresearch #metascience #OpenScience
Mark Rubin · @MarkRubin
1565 followers · 1359 posts · Server fediscience.org
“Responsible research assessment should prioritize theory development and testing over ticking open science boxes”
New preprint comments on proposals to change hiring and promotion in psychology to become more oriented to open science.
Few quotes follow: 🧵👉
#Science
#Psychology
@psychology
#OpenScience
#MetaScience
#MetaResearch
#SociologyofScience
#ScienceofScience
#STS
@stsing
#PsychJobs
@academicchatter
@academicsunite
#psychjobs #sts #ScienceOfScience #sociologyofscience #metaresearch #metascience #OpenScience #psychology #science