New preprint paper from the Desimone gang! Hopefully, the first of a few from us this year.

"Stimulus representations in visual cortex shaped by spatial attention and microsaccades"

https://www.biorxiv.org/content/10.1101/2023.02.25.529300v1

Work done with @elowet, Bruno Gomes, and of course the boss!

#SpatialAttention #Microsaccades #V4 #ITcortex #Pulvinar #Attention #ObjectRepresentation

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Coda:

We see even in this coarse reading, establishing the role of IT cortex in object recognition and processing was nearly a six-decade culmination of work by multiple researchers working on the anatomy, physiology, theory and behavior.

Large parts of what I have written is from Society for Neuroscience’s “The History of Neuroscience in Autobiography” of Charlie Gross:
https://www.sfn.org/-/media/SfN/Documents/TheHistoryofNeuroscience/Volume-6/c4.pdf

I highly recommend to students and neuroscientists alike to make use of this excellent resource that SfN has to offer:
https://www.sfn.org/about/history-of-neuroscience/autobiographical-chapters

10/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Yasushi Miyashita and his group in Tokyo around the late 80s furthered the short-term pictorial memory in IT and how they relate to long term associational memory.

Justine Sergent at McGill in the early 90s showed the first evidence of a dedicated face processing region in the ventral stream, which Nancy Kanwisher later clearly established in the mid to late 90s for its domain specificity and calling it the Fusiform Face Area (FFA). Nancy also identified another region that was dedicated exclusively to places/scenes, Parahippocampal Place Area (PPA)

9/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Mort Mishkin and the Gross gang during the same period showed IT cortex receives inputs from the striate cortices, thus establishing the ventral stream visual pathway. In the early 80s, a plethora of what were then hard to synthesize/reconcile studies of different brain areas were synthesized by Mort Mishkin and the great Leslie Ungerleider, into what we now know as the famous the dual visual (dorsal and ventral stream) pathways for visual recognition.
8/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

In the 1980s, much of the work on extra striate cortex, and IT was driven by Charlie's lab and his protégés, especially Bob Desimone, Tom Albright, and later Earl Miller, John Duncan. Their work further established IT neurons were selective to particular classes of objects, attention related effects, as well as suppression of activity by repeated presentation (including a sort of short-term memory).

7/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Charlie Gross then moved to Princeton in the 1970s. Bob Desimone (my mentor), and Tom Albright joined as some of his first grad students. The inimitable Eric Schwartz joined them as a postdoc for a couple years. The Gross lab in the mid to late 1970s established systematically that IT neurons responded to complex visual inputs, their overall shapes, and thus objects rather than to individual features like orientations, or color, or simple curvature. This led to the funny and famous story of the "toilet-brush" neurons. The toilet-brush neurons also responded to “hand” cells that Charlie had earlier identified, so the “fingers” in the two were the commonality. This led them to come up with the idea of Fourier shape descriptors to suggest how the brain builds the "it" from the "bits" (a forerunner to all the modern linear combination of activities to give an output response, including the currently in-vogue deepnet models).

6/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

In the middle to late 1960s, then at MIT, George Gerstein, and a dashing young Charlie Gross (my intellectual grandfather), inspired by single neuron recordings of Hubel and Wiesel, and the work of Pribram and Mishkin, stuck microelectrodes in IT cortex of awake monkeys and showed that they responded to visual stimuli. This was the first demonstration of neurons being active for visual inputs far away from the striate areas!

Later Peter Schiller joined them in the experiments. They also showed these neurons were involved in attentional mechanisms. The input stimuli, however were still rudimentary and not resembling anything “object” like: diffused light, orientation, movement etc., And then by happenstance, Charlie found "face" and "hand" cells (much like how Hubel and Wiesel found orientation cells by complete accident, slipping of the image on the projector)!

5/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

The great Karl Pribram (at Stanford) and Mortimer Mishkin (at NIH) towards the end of the 1960s performed focalized lesions in macaques in only the IT cortex (instead of the entire MTL as reported in Klüver-Bucy). In their experiments, they observed that such lesions only led to deficits in visual processing, and learning!

4/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

While neurosurgeons were working with patients and characterizing the syndrome, there was a short interregnum in the world of visual neuroscience, thanks to the groundbreaking work (dare I say, paradigmatic leap) from David Hubel and Torsten Wiesel with their experiments in the striate cortex (V1, V2) and LGN.

3/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Heinrich Klüver in the 1930s wanted to study the effects of mescaline(!) in macaques after bilateral temporal lobectomy. Paul Bucy, a neurosurgeon performed the surgery and experiments. However, Bucy did not observe any of the hypothesized effects of mescaline and instead discovered that the animal had significant impairment/abnormalities. These broadly included: subdued/docile emotional expressions, adverse sexual behavior, dietary changes, utilization behaviors, increased tendency to use the mouth for exploring the world, and finally, but most importantly for our story, difficulties in visual learning and agnosia!

In the 1950s, neuroscientists and surgeons documented and confirmed similar behaviors in humans who had temporal lobectomy. Today, we know this as the famous/eponymous Klüver-Bucy syndrome due to bilateral lesions (or tumors) of the medial temporal lobe (MTL).

2/10

#OldNeuroPapers #neuroscience #HistoryOfIdeas #ITcortex #ObjectRecognition

Everyone in neuroscience has heard of the famous story of patient HM. The bilateral medial temporal lobectomy performed on him (in 1953) resecting most of his hippocampi to cure epilepsy, but led to him having anterograde amnesia. This observation directly implicated hippocampus as necessary for memory formation, thus kickstarting an entire field.

How did we arrive at the inferotemporal cortex (IT) as the region involved in object processing/recognition? The history of IT is even longer, not as straightforward as that of hippocampus, and in fact was a multi-decade culmination.

Here’s a shortish compressed history of how IT became the center of visual object recognition in ten toots!

1/10