How are memories stored in neural networks? | The Hopfield Network

Can we measure memories in networks of neurons in bytes? Or should we think of our memory differently?

Submission to the Summer of Math Exposition 2022 (#SoME2). More information: https://summerofmathexposition.substa...

Time stamps:
0:00 - Where is your memory?
1:41 - Computer memory in a nutshell
2:58 - Modeling neural networks
4:42 - Memories in dynamical systems
9:54 - Learning
13:36 - Memory capacity and conclusion

Animations largely made using the manim community edition:
https://www.manim.community/

Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.

Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid

Music: Aakash Gandhi - "Dreamland"