Reproduce “States of LLM-generated Texts and Phase Transitions between them” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Nikolay Mikhaylovskiy
Researchers from NTR Labs and Tomsk State University identify distinct phases in LLM-generated text through statistical physics analysis, demonstrating how temperature parameters create transitions between periodic, critical, and amorphous states while revealing universal patterns in how different models generate text across these phases.
Key insights
- LLM-generated text exhibits three distinct phases: periodic (low temperature), critical (medium), and amorphous (high)
- Phase transitions occur between temperatures 0.7-1.0 across different models
- Medium-distance autocorrelations (up to 2000 words) follow power-law decay in critical phase
- Different transformer-based LLMs appear to belong to the same universality class
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.