Abstract
In this paper, we propose dynamic texture recognition from video snippets by constructing temporal intensity co-occurrence histograms for feature representation and learning. The pair-wise intensity co-occurrence frequencies are summarized from every pixel position between every pair of sequential frames in the video separated by a certain time lapse or offset distance. A 256 × 256 grayscale intensity co-occurrence matrix is thus constructed for the given offset distance. Twenty offset distances from d = 1, 2, …, 20 are used for the computation that yields twenty 256 × 256 temporal co-occurrence matrices from a single video. The twenty 2D histograms so formed are individually converted to complete probability distributions whose elements sum up to one, and then each histogram is converted to a 1D feature vector. The twenty 1D feature vectors represent local patterns that are concatenated to form a unique ID pattern that is matched using the ensemble of bagged decision trees classifier. Alternatively, a 20 × 20 grid of distance classifiers is substituted to find matches between the local patterns followed by the summation of distances from all the grids. The recognition rate achieved in our experiments is found superior to the state-of-the-art, when tested on the raw, unprocessed, and unsegmented videos of the benchmark Dyntex++ dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Qi, X., Li, C.G., Zhao, G., Hong, X., Pietikainen, M.: Dynamic texture and scene classification by transferring deep image features. Neurocomputing 171, 1230–1241 (2016)
Ji, S., Wei, X., Yang, M., Kai, Yu.: 3D convolutional neural network for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 221–231 (2013)
Guoying, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. Ieee Trans. Pattern Anal. Mach. Intell. 29(6) (2007)
Susan, S., Chakre, R.: 3D-difference theoretic texture features for dynamic face recognition. In: 2016 International Conference on Computational Techniques in Information and Communication Technologies (ICCTICT), pp. 227–232. IEEE (2016)
Hajati, F., Tavakolian, M., Gheisari, S., Gao, Y., Mian, A.S.: Dynamic texture comparison using derivative sparse representation: application to video-based face recognition. IEEE Trans. Hum. Mach. Syst. (2017)
Chetverikov, D., Péteri, R.: A brief survey of dynamic texture description and recognition. Comput. Recogn. Syst. 17–26 (2005)
Péteri, R., Chetverikov, D.: Dynamic texture recognition using normal flow and texture regularity. In: Proceedings of Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2005), Estoril, Portugal, pp. 223–230 (2005)
Feichtenhofer, C., Pinz, A., Wildes, R.P.: Dynamic scene recognition with complementary spatiotemporal features. IEEE Trans. Pattern Anal. Mach. Intell. 38(12), 2389–2401 (2016)
Rivera, A., Chae, O.: Spatiotemporal directional number transitional graph for dynamic texture recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(10), 2146–2152 (2015)
Saisan, P., Doretto, G., Wu, Y.N., Soatto, S.: Dynamic texture recognition. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2, pp. 11–11. IEEE (2001)
Fablet, R., Bouthemy, P.: Motion recognition using nonparametric image motion models estimated from temporal and multiscale co-occurrence statistics. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1619–1624 (2003)
Yang, F., Xia, G.S., Liu, G., Zhang, L., Huang, X.: Dynamic texture recognition by aggregating spatial and temporal features via ensemble SVMs. Neurocomputing 173, 1310–1321 (2016)
Haralick, R.M.: Statistical and structural approaches to texture. Proc. IEEE 67(5), 786–804 (1979)
Haralick, R.M., Shanmugam, K.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 6, 610–621 (1973)
Susan, S., Hanmandlu, M.: A non-extensive entropy feature and its application to texture classification. Neurocomputing 120, 214–225 (2013)
Susan, S., Hanmandlu, M.: Color texture recognition by color information fusion using the non-extensive entropy. Multidimension. Syst. Signal Proc. 1–16 (2017)
Susan, S., Hanmandlu, M.: Unsupervised detection of nonlinearity in motion using weighted average of non-extensive entropies. SIViP 9(3), 511–525 (2015)
Nelson, R.C., Polana, R.: Qualitative recognition of motion using temporal texture. CVGIP: Image Underst. 56(1), 78–89 (1992)
Zalevsky, Z., Rivlin, E., Rudzsky, M.: Motion characterization from co-occurrence vector descriptor. Pattern Recogn. Lett. 26(5), 533–543 (2005)
Bouthemy, P., Fablet, R.: Motion characterization from temporal cooccurrences of local motion-based measures for video indexing. In: Proceedings of Fourteenth International Conference on Pattern Recognition, vol. 1, pp. 905–908. IEEE (1998)
Susan, S., Jain, A., Sharma, A., Verma, S., Jain, S.: Fuzzy match index for scale-invariant feature transform (SIFT) features with application to face recognition with weak supervision. IET Image Proc. 9(11), 951–958 (2015)
Susan, S., Kakkar, G.: Decoding facial expressions using a new normalized similarity index. In: 2015 Annual IEEE India Conference (INDICON), pp. 1–6. IEEE (2015)
Péteri, R., Fazekas, S., Huiskes, M.J.: DynTex: a comprehensive database of dynamic textures. Pattern Recogn. Lett. 31(12), 1627–1632 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Susan, S., Mittal, M., Bansal, S., Agrawal, P. (2019). Dynamic Texture Recognition from Multi-offset Temporal Intensity Co-occurrence Matrices with Local Pattern Matching. In: Verma, N., Ghosh, A. (eds) Computational Intelligence: Theories, Applications and Future Directions - Volume II. Advances in Intelligent Systems and Computing, vol 799. Springer, Singapore. https://doi.org/10.1007/978-981-13-1135-2_41
Download citation
DOI: https://doi.org/10.1007/978-981-13-1135-2_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1134-5
Online ISBN: 978-981-13-1135-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)