Abstract
Video surveillance of large facilities, such as airports, rail stations and casinos, is developing rapidly. Cameras installed at such locations often overlook large crowds, which makes problems such as activity and scene understanding very challenging. Traditional activity recognition methods which rely on input from lower level processing units dealing with background subtraction and tracking, are unable to cope with frequent occlusions in such scenes. In this paper, we propose a novel activity representation and recognition method that bypasses these commonly used low level modules. We model each local spatio-temporal patch as a dynamic texture. Using a Martin distance metric to compare two patches based on their estimated dynamic texture parameters, we present a method to temporally stitch together local regions to form activity streamlines and represent each streamline by its constituent dynamic textures. This allows us to seamlessly perform activity recognition without explicitly detecting individuals in the scene. We demonstrate our method on multiple real data sets and show promising results.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Veeraraghavan, A., RoyChowdhury, A.K., Chellappa, R.: Matching Shape Sequences in Video with Applications in Human Movement Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 (December 2005)
Ma, Y., Damelin, S.B., Masoud, O., Papanikolopoulos, N.: Activity Recognition Via Classification Constrained Diffusion Map. In: International Symposium on Visual Computing 2006, pp. 1–8 (2006)
Ma, Y., Miller, B., Buddharaju, P., Bazakos, M.: Activity Awareness: From Predefined Events to New Pattern Discovery. In: IEEE International Conference on Vision Systems, New York, NY, USA, January 5-7 (2006)
Park, S., Aggarwal, J.K.: A Hierarchical Bayesian Network for Event Recognition of Human Actions and Interactions. Multimedia Systems; Special issue on Video Surveillance 10(2), 164–179 (2004)
Muncaster, J., Ma, Y.: Hierarchical Model-Based Activity Recognition With Automatic Low-Level State Discovery. Journal of Multimedia 2(5), 66–76 (2007)
Doretto, G., Chiuso, A., Wu, Y.N., Soatto, S.: Dynamic Textures. International Journal of Computer Vision 51(2), 91–109 (2003)
Saisan, P., Doretto, G., Wu, Y.N., Soatto, S.: Dynamic Texture Recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 58–63 (2001)
Chan, A., Vasconcelos, N.: Modeling, Clustering and Segmentating Video with Mixtures of Dynamic Textures. IEEE Trans. on Pattern Analysis and Machine Intelligence 30(5), 909–926 (2008)
Fujita, K., Nayar, S.K.: Recognition of Dynamic Textures using Impulse Response of State Variables. In: 3rd International Workshop on Texture analysis and synthesis (2003)
Zhao, G., Pietikainen, M.: Dynamic Texture Recognition Using Volume Local Binary Patterns. In: 9th European Conference on Computer Vision, Graz, Austria, May 7 - 13 (2006)
Ma, Y., Cisar, P.: Motion Analysis Using Dynamic Texture in Crowd Environment. Image Analysis - From Theory to Applications, Research Publishing, pp. 49–54 (2008)
Ma, Y., Miller, B., Cohen, I.: Video Sequence Querying Using Clustering of Objects’ Appearance Models. In: Bebis, G., et al. (eds.) International Symposium on Visual Computing 2007, pp. 328–339 (2007)
i-lids dataset for avss (2007)
Ali, S., Shah, M.: A Lagrangian Particle Dynamic Approach for Crowd Flow Segmenta-tion and Stability Analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN 2007 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ma, Y., Cisar, P. (2008). Activity Representation in Crowd. In: da Vitoria Lobo, N., et al. Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2008. Lecture Notes in Computer Science, vol 5342. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89689-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-89689-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89688-3
Online ISBN: 978-3-540-89689-0
eBook Packages: Computer ScienceComputer Science (R0)