Reproduce “DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.