Reproduce “Creating Power Flexibility in Datacenters via Query Routing” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Shivam Patel, Bingqing Chen, Jared Fernandez, Guannan Qu, Gauri Joshi

The authors present a method for controlling datacenter power by routing eligible inference requests between larger and smaller model pools, subject to pool capacity. It estimates power from arrivals and request lengths to identify feasible routing allocations. A trace-driven simulation reports flexibility of 1.19 MW, or 16% of mean facility power, when all queries are flexible; this is not a live measurement.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.