1 memory == 1 neuron pathway!
📖
I’m OK you’re OK
(p. 10)
The evoking of complex memory sequences makes it seem plausible that each of the memories we can recall has a separate neuron pathway. Particularly significant to our understanding of how the past influence the present is the observation that the temporal Corex is obviously utilised in the interpretation of the current experience.
Isn’t an LLM exactly the same? Do we also look at neuron activations for the most probabilistic next word when it comes to pretraininf?
Can a memory equal to one word/token for the LLM?