Reproduce “Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.