Reproduce “Not Everyone Wins with LLMs: Behavioral Patterns and Pedagogical Implications for AI Literacy in Programmatic Data Science” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Qianou Ma, Kenneth Koedinger, Tongshuang Wu
The study examines how technical experience relates to students’ use of an embedded notebook assistant in a graduate data-science course. Technical experience predicted normalized homework scores (coefficient 6.09), while self-reported LLM familiarity and communication experience did not. In a short exercise, a performance gap appeared without AI but was not detected with AI; these observational results concern one course and do not establish causation.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.