Abstract
Distributed tracking systems have several benefits over centralized setups such as faster processing time and greater robustness to failures. However, the practical deployment of a distributed multi-camera multi-target tracking system poses other important challenges. In this work, we address two of these practical problems. The first one is the spatial and temporal identification of the targets in the network, i.e., the data association problem. To solve it, we propose to build intelligent and adaptive local appearance models of each target that only store the most relevant information. The second problem is the intensive use of bandwidth caused by the periodic communications that each camera requires for the cooperative tracking and the data association of all the targets. In the paper, we manage the bandwidth usage with an event-triggered mechanism that controls how much information is sent. The main novelty of our mechanism is to account for the scene density, coupling it with the data association module and enhancing it. We integrate the new modules into an existing distributed multi-person multi-camera tracking system and demonstrate their benefits on different public benchmarks of increasing difficulty.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, J., Dames, P.: Collision-free distributed multi-target tracking using teams of mobile robots with localization uncertainty. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 6968–6974 (2020)
Lajoie, P.Y., Ramtoula, B., Chang, Y., Carlone, L., Beltrame, G.: Door-slam: distributed, online, and outlier resilient slam for robotic teams. IEEE Robot. Autom. Lett. 5(2), 1656–1663 (2020)
Casao, S., Naya, A., Murillo, A.C., Montijano, E.: Distributed multi-target tracking in camera networks. In: IEEE International Conference on Robotics and Automation. pp. 1903–1909 (2021)
He, L., Liu, G., Tian, G., Zhang, J., Ji, Z.: Efficient multi-view multi-target tracking using a distributed camera network. IEEE Sens. J. 20, 2056–2063 (2019)
Sebastián, E., Montijano, E., Sagüés, C.: All-in-one: certifiable optimal distributed Kalman filter under unknown correlations. In: 60th IEEE Conference on Decision and Control. pp. 6578–6583 (2021)
Battistelli, G., Chisci, L., Selvi, D.: A distributed Kalman filter with event-triggered communication and guaranteed stability. Automatica 93, 75–82 (2018)
Choudhary, A., Sharma, S., Sreedevi, I., Chaudhury, S.: Real-time distributed multi-object tracking in a PTZ camera network. In: International Conference on Pattern Recognition and Machine Intelligence. pp. 183–192. Springer (2015)
Kamal, A.T., Bappy, J.H., Farrell, J.A., Roy-Chowdhury, A.K.: Distributed multi-target tracking and data association in vision networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(7), 1397–1410 (2015)
Su, H., Li, Z., Ye, Y.: Event-triggered Kalman-consensus filter for two-target tracking sensor networks. ISA Trans. 71, 103–111 (2017)
De Langis, K., Sattar, J.: Realtime multi-diver tracking and re-identification for underwater human-robot collaboration. In: IEEE International Conference on Robotics and Automation. pp. 11140–11146 (2020)
Berclaz, J., Fleuret, F., Turetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 33(9), 1806–1819 (2011)
Chavdarova, T., Baqué, P., Bouquet, S., Maksai, A., Jose, C., Bagautdinov, T., Lettry, L., Fua, P., Van Gool, L., Fleuret, F.: Wildtrack: A multi-camera HD dataset for dense unscripted pedestrian detection. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 5030–5039 (2018)
Tardioli, D., Montijano, E., Mosteo, A.R.: Visual data association in narrow-bandwidth networks. In: International Conference on Intelligent Robots and Systems. pp. 2572–2577. IEEE (2015)
Zhang, C., Jia, Y.: Distributed Kalman consensus filter with event-triggered communication: formulation and stability analysis. J. Franklin Inst. 354(13), 5486–5502 (2017)
Zhou, Y., Kong, L., Sosnowski, S., Liu, Q., Hirche, S.: Distributed event- and self-triggered coverage control with speed constrained unicycle robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. pp. 1458–1465 (2021)
Wang, L., Wang, Z., Han, Q.L., Wei, G.: Event-based variance-constrained \({H}_{\infty }\) filtering for stochastic parameter systems over sensor networks with successive missing measurements. IEEE Trans. Cybern. 48(3), 1007–1017 (2017)
Montijano, E., Aragues, R., Sagüés, C.: Distributed data association in robotic networks with cameras and limited communications. IEEE Trans. Robot. 29(6), 1408–1423 (2013)
Sharma, S., Ansari, J.A., Murthy, J.K., Krishna, K.M.: Beyond pixels: Leveraging geometry and shape cues for online multi-object tracking. In: IEEE International Conference on Robotics and Automation. pp. 3508–3515 (2018)
Ferraguti, F., Landi, C.T., Costi, S., Bonfè, M., Farsoni, S., Secchi, C., Fantuzzi, C.: Safety barrier functions and multi-camera tracking for human–robot shared environment. Robot. Auton. Syst. 124 (2020)
Zhou, K., Yang, Y., Cavallaro, A., Xiang, T.: Learning generalisable omni-scale representations for person re-identification. In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2021)
Kuhn, H.W.: The Hungarian method for the assignment problem. Naval Res. Logistics Q. 2(1–2), 83–97 (1955)
Soto, C., Song, B., Roy-Chowdhury, A.K.: Distributed multi-target tracking in a self-configuring camera network. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 1486–1493 (2009)
Wu, Y., Kirillov, A., Massa, F., Lo, W.Y., Girshick, R.: Detectron2. https://github.com/facebookresearch/detectron2 (2019)
Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: Openpose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2019)
Ristani, E., Solera, F., Zou, R., Cucchiara, R., Tomasi, C.: Performance measures and a data set for multi-target, multi-camera tracking. In: European Conference on Computer Vision. pp. 17–35 (2016)
Acknowledgments
This work has been supported by the ONR Global grant N62909-19-1-2027, the Spanish project PID2021-125514NB-I00 (MCIU/AEI/FEDER, UE), DGA T45-20R.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Casao, S., Murillo, A.C., Montijano, E. (2023). Data Association Tools for Target Identification in Distributed Multi-target Tracking Systems. In: Tardioli, D., Matellán, V., Heredia, G., Silva, M.F., Marques, L. (eds) ROBOT2022: Fifth Iberian Robotics Conference. ROBOT 2022. Lecture Notes in Networks and Systems, vol 589. Springer, Cham. https://doi.org/10.1007/978-3-031-21065-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-031-21065-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21064-8
Online ISBN: 978-3-031-21065-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)