five

image

收藏
DataCite Commons2024-06-12 更新2024-07-13 收录
下载链接:
https://ieee-dataport.org/documents/image
下载链接
链接失效反馈
官方服务:
资源简介:
 Existing RGB-T tracking research in general suffers from the challenge of a shortage of training data. Fundamental data enhancement methods (e.g., rotation, translation, etc.) have limited effectiveness, despite the presentation of approaches as Generative Adversarial Networks (GANs), which have not yet been insufficiently tackled for their semantic distortion and information loss arising from cross-modal disparities, high computational cost, and high time overhead.Additionally, as Transformer gains popularity in the vision field, it has been widely recognized that a growing proportion of work has begun to extract single-modal features using the self-attention mechanism as well as inter-modal information with the help of the cross-modal cross-attention mechanism, whereas the intractable noise in a single modality remains open to be tackled, which results in the transfer of noise to the other modalities during the information fusion process, thus affecting the accuracy and robustness of the target tracking. To overcome the above limitations, we propose a gradient-based data enhancement method (G-MDE) that iteratively generates RGB and TIR data with perturbation information and retrains the model to enhance its robustness. Furthermore, we design a multi-modal shared information interaction module (SIM) for selecting critical information within modalities and minimize the interference of futile information. Extensive experiments on three popular RGB-T tracking benchmarks demonstrate that our method achieves new state-of-the-art performance.
提供机构:
IEEE DataPort
创建时间:
2024-06-12
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作