Reproduce “Neuro-Symbolic Manipulation Understanding with Enriched Semantic Event Chains” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Fatemeh Ziaeetabar

The eSEC-LAM framework from the University of Tehran develops a neuro-symbolic approach that transforms enriched Semantic Event Chains into an explicit event-level symbolic state for manipulation understanding. This system achieves competitive action recognition and superior next-primitive prediction, demonstrating enhanced robustness to perceptual noise and generating interpretable explanations for inferred actions.

Key insights

  • A neuro-symbolic approach effectively bridges robust visual perception with transparent, explicit symbolic reasoning, addressing the limitations of both purely data-driven and purely descriptive methods.
  • Enriching symbolic representations with confidence values, functional object roles, and affordance priors enables enhanced robustness to perceptual noise and better generalization in complex manipulation scenarios.
  • Modeling manipulation as a sequence of structured relational states with explicit pre- and post-conditions allows for more accurate short-horizon action anticipation compared to end-to-end temporal models.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.