Reproduce “NavStick: Making Video Games Blind-Accessible via the Ability to Look Around” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Vishnu Nair, Jay L. Karp, Samuel Silverman, Mohar Kalra, Hollis Lehv, Faizan Jamil, Brian A. Smith

Researchers at Columbia University developed NavStick, an audio-based tool enabling visually impaired players to "look around" in 3D video games using a standard game controller's thumbstick. It significantly enhanced mental map formation and player agency in mainstream-like game environments, offering a more engaging experience than traditional linear menus.

Key insights

  • Providing on-demand, directional environmental information significantly improves visually impaired players' ability to form accurate mental maps and enhances their sense of agency and freedom within 3D game worlds.
  • A blend of navigation tools, combining directional surveying (like NavStick) with efficient item listing (like linear menus), is desired by players for comprehensive accessibility in complex game environments.
  • Complex game elements such as environmental occlusions, time pressure, and enemy movement pose specific challenges for audio-based navigation, requiring nuanced and adaptable feedback mechanisms beyond simple object identification.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.