Reproduce “Innovative JavaScript Programming: The Rise of ChatGPT” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Fang Liu, Finley Gibson
The authors study how ChatGPT-4o solves JavaScript LeetCode problems through participant prompts and feedback from failed test cases. The study involved seven participants and nine problems. ChatGPT-4o generated solutions for six problems, four on the first attempt; feedback-guided revisions did not solve the other three. This small task set does not establish general productivity gains or broad code-quality improvements.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.