Reproduce “WildLive: Near Real-time Visual Wildlife Tracking onboard UAVs” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Nguyen Ngoc Dat, Tom Richardson, Matthew Watson, Kilian Meier, Jenna Kline, Sid Reid, Guy Maalouf, Duncan Hine and 2 more

WildLive, developed by researchers at the University of Bristol, introduces an onboard, near real-time multi-animal tracking framework for UAVs capable of processing HD and 4K video. It achieves 10-20 times faster processing while maintaining or slightly improving accuracy over existing methods by combining deep learning re-detection with sparse optical flow on constrained embedded hardware.

Key insights

  • A hybrid approach combining intermittent deep learning detection with lightweight sparse optical flow tracking enables high-resolution, real-time performance on resource-constrained edge devices.
  • Strategic re-detection using localized windows, rather than full-frame scans, is crucial for achieving high processing speeds for high-resolution video while maintaining tracking accuracy.
  • The creation of a high-resolution, comprehensively annotated dataset, including segmentation and point tracklets, is vital for advancing and benchmarking UAV-based wildlife tracking research.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.