Reproduce “Assessing and Advancing Benchmarks for Evaluating Large Language Models in Software Engineering Tasks” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.