상세 보기
Exploiting All Mamba Fusion for Efficient RGB-D Tracking
- Ying, Ge;
- Zhang, Dawei;
- Yang, Chengzhuan;
- Liu, Wei;
- Jeon, Sang-Woon;
- 외 3명
WEB OF SCIENCE
2SCOPUS
2초록
Despite the progress made through deep learning, existing Visual Object Tracking (VOT) frameworks struggle with real-world challenges. Recent approaches incorporate additional modalities like Depth, Thermal Infrared, and Language to enhance the robustness of VOT, particularly with the improvement of the depth sensor precision, facilitating RGB-D tracking. However, current RGB-D trackers often copy RGB tracking paradigms, leading to inefficiency due to two-stream architectures that fail to exploit heterogeneous features, and reliance on simplistic or large-parameter fusion methods. To address these challenges, we propose AMTrack, a one-stream RGB-D tracker leveraging Mamba’s linear complexity for simultaneous feature extraction and two-stage cross-modal feature fusion. Our innovation also includes a low-parameter Multimodal Mix Mamba (3M) module, which optimizes deep feature fusion and reduces computational overhead. The advantage of the 3M module stems from our Multimodal State Space Model (MSSM), a multimodal feature interaction component reconstructed based on SSM. Experiments across multiple RGB-D tracking datasets indicate that AMTrack achieves superior performance with lower parameters and memory demands compared to state-of-the-arts.
- 제목
- Exploiting All Mamba Fusion for Efficient RGB-D Tracking
- 저자
- Ying, Ge; Zhang, Dawei; Yang, Chengzhuan; Liu, Wei; Jeon, Sang-Woon; Wang, Hua; Huang, Changqin; Zheng, Zhonglong
- 발행일
- 2026-03
- 유형
- Conference paper
- 권
- 40
- 호
- 14
- 페이지
- 12063 ~ 12071
- 언어
- ENG
- 출판사
- Association for the Advancement of Artificial Intelligence
- 발행국가
- 영국
- 분량
- 9 페이지
- ISSN
- E 2374-3468
P 2159-5399