Viewing research assessment, the academic reward system, and academic publishing through the power/knowledge lens of Foucault

https://microblogging.infodocs.eu/2023/09/01/viewing-research-assessment-the-academic-reward-system-and-academic-publishing-through-the-power-knowledge-lens-of-foucault/

#ResearchAssessment #ScientificCommunication #TimothyDBowman

PCI signed DORA like 2867 other organizations, to support robust #researchassessment & healthy #scholarlypublication.

Did you know that more than 20,000 individual researchers also signed it? Discover why you should sign! | Via The Bibliomagic https://thebibliomagician.wordpress.com/2023/07/06/why-i-signed-dora/

Tired: Impact Factors 🥱

Wired: https://coara.eu/ & https://sfdora.org 🔥

See https://www.morressier.com/post/impact-factor-its-effects-significance-and-limitations-for-research

#ReformingRA #ImpactFactors #Bibliometrics #ImpactFactor #JournalCitationReports #JCR #ResearchAssessment #CoARA #DORA

"The risk of pitting us all against each other in some unholy research culture competition is that hyper-competition was always at the heart of so many of our unhelpful research cultures." - @lizziegadd in #WonkHE, on the increased weight given to #ResearchCulture in the UK's #REF28.

https://wonkhe.com/blogs/my-research-culture-is-better-than-yours/

#ReformingRA #ResearchAssessment #REF2028 #HigherEd #HigherEducation #UKuniversities

Worth a read: An interview on #OpenAccess, #APCs and the reform of #researchassessment with Alain Schuhl (CNRS):
https://www.cnrs.fr/fr/cnrsinfo/frais-de-publication-nous-sommes-au-bord-du-gouffre

"Researchers are under brutal pressure to publish studies. Their salary increases, promotions, project funding and social prestige depend on evaluations in which their performance is measured practically by weight. This system — known as “publish or perish” — has created monsters."

HT @JessButler

https://english.elpais.com/science-tech/2023-06-04/a-researcher-who-publishes-a-study-every-two-days-reveals-the-darker-side-of-science.html

#ResearchAssessment #PublicationEthics #PublishOrPerish

Open consultation by the @ALLEA e-Humanities WG on recognising innovative research outputs in the humanities. Respond by 26th July.

#OpenScience #eHumanities #ResearchAssessment

https://allea.org/call-for-contributions-open-consultation-on-innovative-outputs-in-the-humanities/

Are university rankings true, fair, or helpful? For @lizziegadd , it is time for the higher education sector to think carefully about the effects of global university rankings. To explain why, she responds to these three questions.

Read her #EUAExpertVoices article here https://eua.eu/resources/expert-voices/307-are-university-rankings-true,-fair,-or-helpful.html?utm_source=mastodon&utm_medium=social&utm_campaign=social-mastodon-26-05-2023

#university #rankings #universityrankings #ResearchAssessment #CoARA @INORMS_REG

Take-home messages from Karen Stroobants. #UKRIOevents #ResearchCulture #ResearchAssessment #ReformingRA

Competency-based assessment is underused in academia, notes Karen Stroobants. #UKRIOevents #ReformingRA #ResearchAssessment #ResearchCulture

Should how research is done by captured in quantitative metrics, asks Karen Stroobants?

She refers to @lizziegadd's blog post, https://thebibliomagician.wordpress.com/2018/08/21/measuring-openness-should-we-be-careful-what-we-wish-for/

#UKRIOevents #ReformingRA #ResearchAssessment

#ReformingRA has coalesced in Europe around @coarassessment notes Karen Stroobants. #UKRIOevents #ResearchAssessment

The reaction on 🐦 to this proposal in @timeshighered to replace journals with a UK REF repository has mostly been:
👎
🙅
🚮
🚀☀️

https://www.timeshighereducation.com/blog/should-uk-replace-journals-ref-repository

How would *you* reform publishing and UK #ResearchAssessment?

#Publishing #Journals #ResearchExcellenceFramework #ResearchReform #HigherEducation #TimesHigherEducation #JournalPublishing #AcademicMastodon #ScholComm

It seems that I will have the opportunity to speak about the links between #researchassessment and #openscience, in Stockholm, next month, at a conference associated with the Swedish Presidency of the Council of the European Union.

Open Science – From Policy to Practice
https://oppenvetenskap.se/
The event is streamed online.

Universities may be motivated to a good and ethical part of the research community, but they may be constrained by government policy, university rankings, etc., says @briannosek.

We can make misconduct harder to do, focus less on papers and more on peer review, and alter incentives.

To undermine the market for #PaperMills and #PredatoryJournals,
Brian provocatively suggests a no-fee journal that will publish all submissions.

#PublicationEthics
#ResearchAssessment #ResearchCulture

#OpenScience isn't enough for the challenge of #PaperMills, says @briannosek. We see symptoms, but the cause is incentives: researchers must publish! However, they may lack resources, time, training, community, and institutional support.

Researchers can be intrinsically motivated to have integrity, but if they'll lose their job by being ethical then this is a big ask. We need to change how researchers earn rewards and gain resources.

#PublicationEthics #ResearchCulture #ResearchAssessment

@ResearchWhisperer @lizziegadd @DrBeth This was during Lizzie's breakout session, "What role should journal publications play in research evaluation?". See https://www.uksg.org/event/conference23, Programme, Group A.

This was largely an audience of librarians and publishers. "Excellence" has been critiqued as a concept, e.g., see https://www.nature.com/articles/palcomms2016105, and "critical", "forward thinking", and "creative" did feature high on the list. #UKSG2023 #ResearchAssessment

"Nobody can really be expected to read a pile of papers".

Robert Kiley ponders what may replace IF and journal reputation in #ResearchAssessment. Can transparent #PeerReview help by making that appraisal visible?

#UKSG2023 #PlanS

The SCOPE evaluation matrix from INORMS focuses you on what you're evaluating and why such as in researcher recruitment, notes @lizziegadd

https://inorms.net/scope-framework-for-research-evaluation/

#UKSG2023 #ResearchAssessment

Quoting Alan Dix, @lizziegadd says "Metrics are rubbish... but people are (far) worse."

#PeerReview of outputs can be even more biased (on gender or field, for example) than are #Bibliometrics.

This supports the use of #ResponsibleMetrics.

#UKSG2023 #ResearchAssessment