Reproduce “Key-value memory in the brain” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Samuel J. Gershman, Ila Fiete, Kazuki Irie

The authors present memory as separate key and value operations: keys help queries locate memories, while values carry content. They connect this account to machine-learning systems and propose a speculative hippocampal-neocortical division of labor. In a toy classifier, scaling Task 1’s associations restores accuracy from 9% to 99% without retraining; this does not establish the proposed brain mechanism.

Key insights

  • Key-value memory allows for the separate optimization of memory representations: keys for maximal discriminability and values for high-fidelity content, addressing distinct computational demands.
  • Forgetting in biological memory is primarily attributable to retrieval failure (inaccessible keys), rather than the permanent erasure of stored information (values).
  • Metamemory phenomena, like tip-of-the-tongue states, can be explained by the brain assessing a match between a query and a key without fully accessing the associated value.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.