Reproduce “CHIMERA: A Flexible and Scalable 3.1 TOPS/W AI-MCU with Transformer Accelerator and 563 Gb/s Shared-L2 Memory Subsystem with QoS Guarantees” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Lorenzo Leone, Philip Wiese, Gamze İslamoğlu, Michael Rogenmoser, Davide Rossi, Francesco Conti, Luca Benini

Researchers from ETH Zürich and Università di Bologna developed CHIMERA, an AI-MCU integrating a transformer accelerator and a 563 Gb/s shared-L2 memory subsystem with QoS. The chip achieved 3.1 TOPS/W peak energy efficiency and maintained a 34-cycle worst-case latency for critical L2 accesses under contention.

Key insights

  • Tight integration of specialized accelerators with programmable cores offers both high energy efficiency for common operations and adaptability for evolving AI models.
  • An interleaved L2 memory architecture can significantly mitigate inter-cluster contention, enabling higher effective bandwidth utilization and performance scaling in multi-cluster edge AI-MCUs.
  • Implementing QoS mechanisms within a shared L2 memory subsystem is crucial for guaranteeing predictable, low-latency access for critical control traffic, even under concurrent high-throughput data loads.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.