Interpolation Can Provably Preclude Invariance https://arxiv.org/abs/2211.15724
#Overfitting to the point of #interpolation can hinder invariance-inducing objectives: One cannot assume a #DeepLearninig model with an invariance penalty will indeed achieve any form of #invariance… suggests that “benign overfitting,” in which models generalize well despite interpolating, might not favorably extend to settings in which #robustness or #fairness are desirable.

@eric_brachmann Now I remember a prior discussion on this -- putting it here.

#Invariance #Equivariance (so I can find it again!)
https://sigmoid.social/@at/109396194101648343

"By definition, only amodal properties (information not specific to a particular sensory system; e.g., tempo, rhythm, duration, intensity) can be redundantly specified across the senses."

In other words, cross-modal redundancy is a type of invariance or symmetry with respect to transformation of sensory modality.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4316375/

🧵 More excerpts below 👇

#Neuroscience #Psychology #Attention #Invariance #Symmetry

@teixi

All linguistic communication requires symbols, no?

I like to think of metaphors as latent analogies. More on this here:

https://yohanjohn.com/axispraxis/metaphor-the-alchemy-of-thought/

Both metaphor and analogy are in turn types of #symmetry or #invariance.

https://3quarksdaily.com/3quarksdaily/2014/07/science-is-symmetry.html

#Introduction

I'm a senior researcher at Microsoft Research Health futures in Amsterdam/Cambridge.

My research interests include invariance/equivariance, causality and representation learning, especially the interplay of these 3 things. All applied to medical imaging.

#machinelearning #deeplearning #causality #invariance

#stats #sem #review #invariance

Interesting review by a solid and robust team on invariance testing in Sturctural Equation Modeling.
https://www.sciencedirect.com/science/article/pii/S0049089X22001168?dgcid=coauthor

Very interesting #review paper on #measurement #invariance
https://www.sciencedirect.com/science/article/abs/pii/S0049089X22001168