Reproduce “Query Optimization in the Wild: Realities and Trends” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Yuanyuan Tian

This paper examines the state of query optimization (QO) in industrial database systems, identifying three pragmatic trends that address limitations in modern cloud and lakehouse environments. It highlights the evolution towards more adaptive, workload-aware, and composable QO architectures that enhance system resilience and performance.

Key insights

  • Foundational QO frameworks remain enduring but require augmentation, not replacement, to meet the demands of modern data infrastructure.
  • Query optimization remains an 'unsolved problem' primarily due to the brittleness of cost models and persistent cardinality estimation inaccuracies.
  • Industrial adoption of advanced QO techniques prioritizes pragmatic, incremental enhancements (e.g., ML-driven feedback loops) over complete system overhauls due to high stakes in stability and reliability.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.