基于特征级融合与 AIS 增强的水面船舶目标检测与跟踪方法

Vessel Detection and Tracking Based on Feature-Level Fusion and AIS Enhancement

  • 摘要: 【目的】针对复杂水面环境下单一传感器感知能力受限、检测不稳定及跟踪易漂移等问题,提出一种基于特征级融合与 AIS 增强的水面船舶目标检测与跟踪方法。该方法充分融合航海雷达、可见光相机与 AIS 等多源异构信息,构建高可靠性的船舶感知流程。【方法】首先,为改善雷达图像目标检测中因目标相对尺寸小、特征不明显而产生的漏检和误检问题,设计了一种融合可见光特征的雷达目标检测网络,利用跨模态特征级融合改善船舶目标检测效果。其次,设计了一种可变形交叉注意力机制,用于实现跨模态特征间的交互与对齐,增强雷达目标的特征表达。然后,在网络中引入尺度自适应损失函数,用于缓解小目标交并比损失对偏移的敏感性。最后,构建了一种融合AIS数据的多目标跟踪方法,利用多特征轨迹相似度度量方法实现AIS轨迹与跟踪轨迹间的鲁棒关联,并使用关联AIS数据缓解跟踪过程中因量测缺失而产生的误差积累。【结果】实验结果表明,所设计方法对船舶目标的平均检测精度达到了91.9%,跟踪指标MOTA和IDF1分别达到了85.2%和76.2%。【结论】提出的方法有效改善了船舶感知中的漏检、误检与跟踪漂移问题,能够有效提升对水面船舶目标的感知能力,为智能海事监管与自主航行系统提供可靠的环境感知支撑。

     

    Abstract: Objectives To address the limitations of single-sensor perception in complex water surface environments, including unstable detection and tracking drift, a vessel detection and tracking method based on feature-level fusion and AIS-enhanced tracking is proposed. By effectively integrating multi-source heterogeneous information from marine radar, visible-light cameras, and the Automatic Identification System (AIS), the proposed method constructs a highly reliable vessel perception framework. Methods First, to mitigate missed and false detections caused by the small relative size and indistinct features of radar targets, this study designs VFFRadar-Net, a radar object detection network with visible features fusion. By leveraging cross-modal feature-level fusion, the proposed network enhances vessels detection performance. Secondly, a deformable cross-attention is introduced to facilitate feature interaction and alignment across modalities, thereby improving radar target representation. Third, a scale-adaptive loss function is incorporated into the network to alleviate the sensitivity of small-target IoU loss to positional deviations. Finally, this study develops AF-SORT(Improved SORT with AIS Fusion), a simple online and realtime tracking enhanced by AIS. By employing a multi-feature trajectory similarity measurement approach, AE-SORT achieves robust association between AIS and radar trajectories. Furthermore, AIS data helps mitigate error accumulation in tracking caused by measurement losses. Results Experimental results show that the proposed method achieves an average detection precision of 91.9% for ship targets, with tracking metrics MOTA(Multiple object tracking accuracy) and IDF1(Identity F1 score) reaching 85.2% and 76.2%, respectively.Conclusions The proposed method effectively mitigates missed detections, false alarms, and tracking drift in ship perception, significantly enhancing the perceptual capability for surface ship targets and providing reliable environmental awareness support for intelligent maritime supervision and autonomous navigation systems.

     

/

返回文章
返回