Abstract
In this paper, we propose a robust model for tracking in video sequences with non-static backgrounds. The object boundaries are tracked on each frame of the sequence by minimizing an energy functional that combines region, boundary and shape information. The region information is formulated by minimizing the symmetric Kullback–Leibler (KL) distance between the local and global statistics of the objects versus the background. The boundary information is formulated using a color and texture edge map of the video frames. The shape information is calculated adaptively to the dynamic of the moving objects and permits tracking that is robust to background distractions and occlusions. Minimization of the energy functional is implemented using the level set method. We show the effectiveness of the approach for object tracking in color, infrared (IR), and fused color-infrared sequences.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Barron J., Fleet D. and Beauchemin S. (1994). performance of optical flow techniques. Int. J. of Comput. Vis. 12(1): 43–77
Mansouri A.R. and Konrad J. (2003). Multiple motion segmentation with level sets. IEEE Trans. Image Process. 12(2): 201–220
Stiller C. and Konrad J. (1999). Estimating motion in image sequences: a tutorial on modelling and computation 2nd motion. IEEE Signal Process. Mag. 16(4): 70–91
Adiv G. (1985). Determining 3D motion and structure from optical flow generated by several moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 7(4): 384–401
Blake A. and Isard M. (1998). Active Contours. Springer, Heidelberg
Chan T. and Vese L.A. (2001). Active contours without edges. IEEE Trans. Image Process. 10(2): 266–277
Goldenberg R., Kimmel R., Rivlin E. and Rudzsky M. (2001). Fast geodesic active contours. IEEE Trans. Image Process. 10(10): 1467–1475
Cavallaro A., Steiger O. and Ebrahimi T. (2005). Tracking video objects in cluttered background. IEEE Trans. Circuits Syst. Video Technol. 15(4): 575–584
Collins R.T., Liu Y. and Leordeanu M. (2005). Online selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. 27(10): 1631–1643
Comaniciu D., Ramesh V. and Meer P. (2003). Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5): 564–577
Wren C.R., Azarbayejani A., Darrell T. and Pentland A.P. (1997). Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19(7): 780–785
Delamarre Q. and Faugeras O. (2001). 3D articulated models and multi-view tracking with physical forces. Comput. Vis. Image Understand. 81(3): 328–357
Pänkers R. and Fua P. (2001). Tracking and modeling people in video sequences. Comput. Vis. Image Understand. 81(3): 285–302
Mansouri A.R. (2002). Region tracking via level set pdes without motion computation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7): 947–961
Paragios N. and Deriche R. (2000). Geodesic active contours and level sets for the detection and tracking of moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 22(3): 266–280
Paragios N. and Deriche R. (2004). Geodesic active regions and level set methods for motion estimation and tracking. Comput. Vis. Image Understand. 97(3): 259–282
Unal G., Krim H. and Yezzi A. (2005). Fast incorporation of optical flow into active polygons. IEEE Trans. Image Process. 14(6): 745–759
Osher S. and Sethian J. (1988). Fronts propagating with curvature-dependant speed: algorithms based on Hammilton-Jacobi formulations. J. Comput. Phys. 79(1): 12–49
Jehan-Besson, S.: Barlaud, M., Aubert, G.: Detection and tracking of moving objects using a new level set based method. Proceedings of IEEE International Conference on Pattern Recognition, Barcelona, Spain, 3–8 September, 2000, pp. 7112–7117
Jehan-Besson S., Barlaud M. and Aubert G. (2003). DREAM2S: deformable regions driven by an eulerian accurate minimization method for image and video segmentation. Int. J. Comput. Vis. 53(1): 45–70
Cremers D. (2006). Dynamical statistical shape priors for level set-based tracking. IEEE Trans. Pattern Anal. Mach. Intell. 28(8): 1262–1273
Zhang T. and Freedman D. (2005). Improving performance of distribution tracking through background mismatch. IEEE Trans. Pattern Anal. Mach. Intell. 27(2): 282–287
Huang J., Kumar S.R., Mitra M., Zhu W.-J. and Zabih R. (1999). Spatial color indexing and applications. Int. J. Comput. Vis. 35(3): 245–268
Allili, M.S., Ziou, D.: Automatic color-texture image segmentation by using active contours. In: Proceedings of 1st IEEE International Workshop on Intelligent Computing in Pattern Analysis/Synthesis, Xi’an, China, 26–27, August 2006, LNCS 4153, pp. 495–504
Tuceryan, M., Jain, A.: Texture analysis. In: Chen, C.H., Pau, L.F., Wang, P.S.P. (eds) The Handbook of Pattern Recognition and Computer Vision, 2nd edn. chap. 2.1, 207–248. World Scientific Publishing, Signapore (1998)
Duda R.O., Hart P.E. and Stork D.G. (2001). Pattern Classification. Wiley, New York
McLachlan, G., Peel, D.: Finite Mixture Models, Wiley Series in Probability and Statistics (2000)
Drewniok C. (1994). Multispectral edge detection: some experiments on data from landsat-TM. Int. J. Remote Sens. 15(18): 3743–3765
Caselles V., Kimmel R. and Sapiro G. (1997). Geodesic active contours. Int. J. Comput. Vis. 22(1): 61–79
Cremers, D., Soatto, S.: A pseudo-distance for shape priors in level set segmentation. In: Proceedings of 2nd IEEE Workshop on Variational, Geometric and Level Set Methods in Computer Vision, Nice, France, 13–16 October 2003, 169–176
Adalsteinsson D. and Sethian J. (1995). A fast level set method for propagating surfaces. J. Comput. Phys. 118(2): 269–277
Erdem Ç.E., Sankur B. and Tekalp A.M. (2004). Performance measures for video object segmentation and tracking. IEEE Trans. Image Process. 13(7): 937–951
Weickert, J., Kühne, G.: Fast methods for implicit active contour models. In: Osher, S., Paragios, N.: (eds) Geometric Level Set Methods in Imaging, Vision and Graphics, chap. 3, pp. 44–57. Springer, Heidelberg
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Allili, M.S., Ziou, D. Active contours for video object tracking using region, boundary and shape information. SIViP 1, 101–117 (2007). https://doi.org/10.1007/s11760-007-0021-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-007-0021-8