Why do wide stochastic neural networks have vanishing variance?

https://openreview.net/forum?id=WGckk0bk5T

#stochasticity #stochastic #variance

Which mechanisms for neural exploration/sampling do you think of as most likely?

1. Periodic and quasi-periodic sweeps
2. 'Real' random perturbations
3. Pseudo-random and/or chaotic pattern generators
4. Deterministic, non-periodic 'principled' exploration

I suspect that the answer is 'all of the above'.

Am I missing any plausible mechanisms?

#Neuroscience #Randomness #Stochasticity #Exploration

RT @ICPhysicsofLife
This Friday, November 18th 2pm, we are happy to have Diana Fusco from @DeptofPhysics talk about the role and #evolution of #stochasticity in phage-bacteria interactions in our #physicsoflife seminar series.

Join us online or in person!

https://www.imperial.ac.uk/events/154082/dr-diana_fusco_phage_bacteria/