TY - JOUR
T1 - Multi-object tracking by multi-feature fusion to associate all detected boxes
AU - Bilakeri, Shavantrevva
AU - Karunakar, A. K.
N1 - Funding Information:
The authors received no direct funding for this research. We would like to thank Manipal Academy of Higher Education for providing infrastructure and computing resource to conduct this research.
Publisher Copyright:
© 2022 The Author(s). This open access article is distributed under a Creative Commons Attribution (CC-BY) 4.0 license.
PY - 2022
Y1 - 2022
N2 - Multi-object tracking (MOT) aims to estimate object trajectory in videos using either a public or private detection approach. Current trackers trained in private mode on diverse datasets make the comparison with cutting-edge methods unfair. Instead of relying exclusively on a single feature, integrating several features is more effective as it helps in data association in various conditions such as occlusion and fast Motion. Driven by this, we propose an improvised data association method by employing public detection tracker built on a CenterNet detector. In contrast to prior arts that merely used high score boxes, we improvise the data association in two stages by considering all the detections. The first stage is enforced by fusing feature embedding, IoU, and Motion features extracted from high-score boxes, followed by unmatched trajectories associated with low-score boxes using IoU similarity in the second stage. Our approach greatly surpasses cutting-edge methods in terms of excellent track quality, fewer ID switches, and high accuracy on MOT challenge datasets. The tracklet interpolation is used as a post-processing approach to fill the gap left by missing detections that improve performance even more.
AB - Multi-object tracking (MOT) aims to estimate object trajectory in videos using either a public or private detection approach. Current trackers trained in private mode on diverse datasets make the comparison with cutting-edge methods unfair. Instead of relying exclusively on a single feature, integrating several features is more effective as it helps in data association in various conditions such as occlusion and fast Motion. Driven by this, we propose an improvised data association method by employing public detection tracker built on a CenterNet detector. In contrast to prior arts that merely used high score boxes, we improvise the data association in two stages by considering all the detections. The first stage is enforced by fusing feature embedding, IoU, and Motion features extracted from high-score boxes, followed by unmatched trajectories associated with low-score boxes using IoU similarity in the second stage. Our approach greatly surpasses cutting-edge methods in terms of excellent track quality, fewer ID switches, and high accuracy on MOT challenge datasets. The tracklet interpolation is used as a post-processing approach to fill the gap left by missing detections that improve performance even more.
UR - http://www.scopus.com/inward/record.url?scp=85143282128&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85143282128&partnerID=8YFLogxK
U2 - 10.1080/23311916.2022.2151553
DO - 10.1080/23311916.2022.2151553
M3 - Article
AN - SCOPUS:85143282128
SN - 2331-1916
VL - 9
JO - Cogent Engineering
JF - Cogent Engineering
IS - 1
M1 - 2151553
ER -