Abstract
Saliency detection aims to segment the object of interest from the rest of the scene. While there has been a big number of saliency detection methods in still images, video saliency is in its early stages. In this paper, we propose a two stages video saliency detection method using local saliency estimation and global homogeneity refinement. Starting from a patch, the problem of saliency detection is modeled as a growing region which starts from a patch with high saliency information to the background. Local saliency is measured by combining spatial priors presented by local surrounding contrast with temporal information issued from the motion estimation feature. Temporal and spatial information are fused and then used to label each patch as foreground and background patches and produce the final saliency maps. Finally, Global homogeneity refinement is used to refine the saliency results by evaluating the foreground and background probabilities ratio propagated from the patches. Experiments have proved that the proposed method outperforms state-of-the-art methods over two benchmark datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. (TOG) 26, 10 (2007)
Bi, S., Li, G., Yu, Y.: Person re-identification using multiple experts with random subspaces. J. Image Graph. 2 (2014)
Borji, A., Cheng, M.-M., Jiang, H., Li, J.: Salient object detection: a benchmark. IEEE Trans. Image Process. 24, 5706–5722 (2015)
Fang, Y., Lin, W., Chen, Z., Tsai, C.-M., Lin, C.-W.: A video saliency detection model in compressed domain. IEEE Trans. Circ. Syst. Video Technol. 24, 27–38 (2014)
Fu, H., Cao, X., Tu, Z.: Cluster-based co-saliency detection. IEEE Trans. Image Process. 22, 3766–3778 (2013)
Fukuchi, K., Miyazato, K., Kimura, A., Takagi, S., Yamato, J.: Saliency-based video segmentation with graph cuts and sequentially updated priors. In: 2009 IEEE International Conference on Multimedia and Expo, pp. 638–641. IEEE (2009)
Gao, D., Mahadevan, V., Vasconcelos, N.: The discriminant center-surround hypothesis for bottom-up saliency. In: Advances in Neural Information Processing Systems, pp. 497–504 (2008)
Gao, D., Vasconcelos, N.: Bottom-up saliency is a discriminant process. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–6. IEEE (2007)
Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1915–1926 (2012)
Harel, J., Koch, C., Perona, P., et al.: Graph-based visual saliency. In: NIPS, vol. 1, p. 5 (2006)
Itti, L., Baldi, P.: A principled approach to detecting surprising events in video. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 631–637. IEEE (2005 )
Kim, H., Kim, Y., Sim, J.-Y., Kim, C.-S.: Spatiotemporal saliency detection for video sequences based on random walk with restart. IEEE Transa. Image Process. 24, 2552–2564 (2015)
Lee, S.-H., Kim, J.-H., Choi, K.P., Sim, J.-Y., Kim, C.-S.: Video saliency detection based on spatiotemporal feature learning. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 1120–1124. IEEE (2014)
Li, F., Kim, T., Humayun, A., Tsai, D., Rehg, J.M.: Video segmentation by tracking many figure-ground segments. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2192–2199 (2013)
Lucas, B.D., Kanade, T., et al.: An iterative image registration technique with an application to stereo vision. In: IJCAI, vol. 81, pp. 674–679 (1981)
Mahadevan, V., Vasconcelos, N.: Spatiotemporal saliency in dynamic scenes. IEEE Trans. Pattern Anal. Mach. Intell. 32, 171–177 (2010)
Mancas, M., Riche, N., Leroy, J., Gosselin, B.: Abnormal motion selection in crowds using bottom-up saliency. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 229–232. IEEE (2011)
Mauthner, T., Possegger, H., Waltner, G., Bischof, H.: Encoding based saliency detection for videos and images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2494–2502 (2015)
Navalpakkam, V., Itti, L.: An integrated model of top-down and bottom-up attention for optimizing detection speed. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), vol. 2, pp. 2049–2056. IEEE (2006)
Rahtu, E., Kannala, J., Salo, M., Heikkilä, J.: Segmenting salient objects from images and videos. In: Computer Vision-ECCV 2010, pp. 366–379 (2010)
Seo, H.J., Milanfar, P.: Static and space-time visual saliency detection by self-resemblance. J. Vis. 9, 15–15 (2009)
Singh, A., Chu, C.-H.H., Pratt, M.: Learning to predict video saliency using temporal superpixels. In: 4th International Conference on Pattern Recognition Applications and Methods, pp. 201–209 (2015)
Treisman, A.M., Gelade, G.: A feature-integration theory of attention. Cogn. psychol. 12, 97–136 (1980)
Wang, W., Shen, J., Porikli, F.: Saliency-aware geodesic video object segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3395–3402 (2015)
Wu, R., Yu, Y., Wang, W.: Scale: supervised and cascaded Laplacian eigenmaps for visual object recognition based on nearest neighbors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 867–874 (2013)
Yeh, H.-H., Liu, K.-H., Chen, C.-S.: Salient object detection via local saliency estimation and global homogeneity refinement. Pattern Recogn. 47, 1740–1750 (2014)
Zhong, S., Liu, Y., Ren, F., Zhang, J., Ren, T.: Video saliency detection via dynamic consistent spatio-temporal attention modelling. In: AAAI, pp. 1063–1069 (2013)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Kalboussi, R., Abdellaoui, M., Douik, A. (2019). Local Saliency Estimation and Global Homogeneity Refinement for Video Saliency Detection. In: De Pietro, G., Gallo, L., Howlett, R., Jain, L., Vlacic, L. (eds) Intelligent Interactive Multimedia Systems and Services. KES-IIMSS-18 2018. Smart Innovation, Systems and Technologies, vol 98. Springer, Cham. https://doi.org/10.1007/978-3-319-92231-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-92231-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92230-0
Online ISBN: 978-3-319-92231-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)