Reproduce “Prototypes of the Mind: A Unified Framework for Probing the Visual Brain” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Shi Chen, Seoyoung Ahn, Doris Tsao

The authors introduce a prototype framework linking visual content to predicted fMRI responses and enabling targeted image manipulation. It learns sparse prototypes from vision-model features, aggregates them across image locations, and maps them linearly to voxel responses. With DINOv3-ViT, mean Pearson correlation across eight ROIs rises from 0.338 to 0.394. These are model-based results, not evidence of effects on brain activity.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.