Multiple Testing:

New article discusses the “use and misuse of corrections for multiple testing.”

“In general, avoid corrections for multiple testing if statistical claims are to be made for each individual test...”

https://doi.org/10.1016/j.metip.2023.100120

#Stats
#Statistics
#MultipleTesting
#MultipleComparisons
#NHST

New paper provides a history of “voodoo science,” which discusses the controversy surrounding Vul et al.’s (2009) controversial article “Puzzlingly High Correlations in FMRI Studies of Emotion, Personality, and Social Cognition.”

Five quotes follow: 🧵👉

🔓 https://doi.org/10.3390/socsci12010015

#MetaScience
#Neuroscience
#Neuroimaging
#MetaResearch
#PsychMethods
#ReplicationCrisis
#PhilosophyOfScience
#PhilSci
#Fmri
#VoodooCorrelations
#UseNovelty
#MultipleTesting

Useful recommendations when to use corrections for #MultipleTesting and when not:

Rubin, M. (2021). When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing. Synthese, https://doi.org/10.1007/s11229-021-03276-4

From the abstract:
"It is argued that alpha adjustment is only appropriate in the case of disjunction testing, in which at least one test result must be significant in order to reject the associated joint null hypothesis."