Reproduce “Virtual, Augmented, and Mixed Reality for Human-Robot Interaction: A Survey and Virtual Design Element Taxonomy” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Michael Walker, Thao Phung, Tathagata Chakraborti, Tom Williams, Daniel Szafir

Researchers from the University of North Carolina at Chapel Hill, Colorado School of Mines, and IBM Research AI introduce a novel Virtual Design Element (VDE) taxonomy, providing a standardized framework to categorize and describe virtual, augmented, and mixed reality interfaces for human-robot interaction. This work systematically surveys 175 papers over 30 years, identifying four core categories of virtual design elements and highlighting under-explored areas in the field.

Key insights

  • The proposed VDE taxonomy offers a shared descriptive basis, crucial for bringing order and coherence to the nascent but rapidly growing VAM-HRI field.
  • Analyzing VDE usage across applications revealed that Task Comprehension VDEs are historically most explored, while Object Comprehension and Virtual Robot Alteration VDEs are newer and significantly under-explored, pointing to future research directions.
  • The 'explosive growth' in VAM-HRI research, transitioning from specialized lab hardware to inexpensive, standardized systems, has enabled new avenues for enhancing robot control, supervision, and collaboration.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.