Reproduce “SurgSync: Time-Synchronized Multi-Modal Data Collection Framework and Dataset for Surgical Robotics” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Haoying Zhou, Chang Liu, Yimeng Wu, Junlin Wu, Zijian Wu, Yu Chung Lee, Sara Martuscelli, Spetimiu E. Salcudean and 2 more
SurgSync is a multi-modal data collection framework for surgical robotics that provides precisely time-synchronized data across vision, kinematics, and contact sensing modalities. This framework, integrating a modern endoscope and novel contact sensor, yielded a dataset of 214 instances for canonical surgical tasks, achieving superior image clarity and demonstrating utility for surgical skill assessment with SROCC values up to 0.803.
Key insights
- Precise temporal synchronization of multi-modal data streams is crucial for accurate analysis and effective AI model training in dynamic surgical robotics tasks.
- Upgrading imaging capabilities with modern endoscopes significantly improves visual fidelity, yielding over 30 times higher Laplacian variance and benefiting downstream perception tasks.
- Integrating novel ground truth sensors, such as capacitive contact sensors, enriches datasets with critical interaction information, even if requiring post-collection refinement.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.