Reproduce “NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Driving” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

William Ljungbergh, Adam Tonderski, Joakim Johnander, Holger Caesar, Kalle Åström, Michael Felsberg, Christoffer Petersson

NeuroNCAP introduces a photorealistic closed-loop safety testing framework for autonomous driving, utilizing neural rendering to simulate real-world safety-critical scenarios. The framework demonstrates that state-of-the-art end-to-end autonomous driving planners, despite strong open-loop performance, exhibit critical safety failures in these interactive edge cases, often crashing in the majority of tests.

Key insights

  • State-of-the-art end-to-end planners struggle to generalize from nominal driving data to rare, safety-critical scenarios despite accurate perception.
  • The failure of E2E planners in safety-critical situations primarily stems from planning deficiencies rather than perception errors, indicating a covariate shift problem.
  • Trajectory post-processing can improve collision avoidance, particularly for simpler scenarios, but it does not fully resolve fundamental planning issues in complex edge cases.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.