Reproduce “APITestGenie: Generating Web API Tests from Requirements and API Specifications with LLMs” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
André Pereira, Bruno Lima, João Pascoal Faria
APITestGenie generates integration tests by combining a requirement with an OpenAPI specification, retrieving API details, and asking an LLM to produce tests spanning endpoints. Across 25 requirements and three attempts each, 22 had at least one valid script (88.6%), and 52 of 75 scripts were valid (69.3%). Evaluation used ten APIs, eight from one automotive partner, with manual review.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.