A Reliable Sample Selection Strategy for Weakly Supervised Visual Tracking

Abstract

Reliability is an important property in the applied engineering systems, especially in visual tracking. The supervised visual tracking method uses reliable ground truth that is manually annotated, which is hard to get in many applications. However, weakly supervised visual trackings are limited by the low-quality labels. Therefore, a reliable sample selection strategy is the most important issue for the weakly supervised visual trackings. In this article, we propose an optimal sample selection strategy and apply it to the visual tracking system. The strategy first assesses the reliability of the samples according to the score map, where the score map is the pseudolabel generated by the upstream task to meet the needs of the downstream task. Then, the unreliable pseudolabels are replaced by reliable ground truth or discarded to overcome the degraded modeling problem by filtering low-quality samples. Finally, through comparison with multiple selection strategies, it is verified that the model trained using this strategy has the best performance. The proposed visual tracking model achieves the best performance among multiple assessment metrics in multiple datasets. Experiments verify that the scientific sample quality assessment method is very important. It can guide the improvement of model performance, which is of great help to the weakly supervised learning systems based on data.