GhostVision: Democratizing Derelict Gear Detection Using Low-Cost Sonar and Artificial Intelligence

Abstract

Derelict crab pots (“ghost pots”) cause bycatch mortality, habitat degradation, and lost harvest in shallow coastal ecosystems. Existing detection and recovery programs rely on expert operators and high-cost sonar, limiting coverage and reproducibility. Here, we present GhostVision, an open-source framework that integrates low-cost consumer side-scan sonar with modern object-detection models to enable scalable, rapid post-processing and mapping of derelict gear. Mobile Mapping Units (MMUs) equipped with off-the-shelf fishfinders surveyed more than 1500 acres in Delaware’s Inland Bays between 2020 and 2022. Three architectures (YOLOv12, YOLOv26, RF-DETR) were trained on 3110 manually annotated sonar images and evaluated with both dataset-centric metrics and full pipeline implementation. YOLOv12 showed the strongest untuned operational performance (F1 = 0.512; recall = 0.922), while post-processing optimization produced comparable performance across all three models (F1 ≈ 0.71–0.73). Across 11 complete test recordings, end-to-end processing required only 8.87–9.79% of survey time (approximately 10–11× faster than real-time), supporting same-day analysis and recovery workflows. GhostVision can foster community engagement in derelict crab-pot removal by pairing low-cost sonar with AI to aid recovery efforts at management-relevant scales. By lowering financial and technical barriers, GhostVision provides a reproducible pathway for large-scale stewardship and supports future extensions to multi-class detection and autonomous platforms.

Bibliographic Information