Abstract
Salient object detection, especially for multi-object detection in complex scene, is a very challenging issue in computer vision. With the emergence and promotion of somatosensory sensors such as Kinect, RGB-D data jointing color and depth information can be obtained easily and inexpensively. This paper focuses on the RGB-D salient object detection. Firstly, the RGB image is converted into Lab color space and superpixels are segmented according to color and merged according to depth. Then, color contrast features and depth contrast features are calculated to construct an effective multi-feature fusion to generate saliency map. Finally, multi-scale enhancement is operated on the saliency map to further improve the detection precision. Experiments on the public data set NYU depth V2 show that the proposed method can effectively detect each salient object in multi-object scenes, and can also highlight the each object entirely.
Chapter PDF
Similar content being viewed by others
References
Chang, K.Y., Liu, T.L., Lai, S.H.: From co-saliency to co-segmentation: an efficient and fully unsupervised energy minimization model. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2129–2136 (2011)
Sharma, G., Jurie, F., Schmid, C.: Discriminative spatial saliency for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3506–3513 (2012)
Ren, Z., Gao, S., Chia, L.T., et al.: Region-based Saliency Detection and Its Application in Object Recognition. IEEE Transactions on Circuits and Systems for Video Technology 24(5), 769–779 (2014)
Hao, M., Biruk, G., Kishore, P.: Color point cloud registration with 4D ICP algorithm. In: IEEE International Conference on Robotics and Automation. Shanghai, China, pp. 1511–1516 (2011)
Zollhofer, M., Niebner, M., et al.: Real-time Non-rigid Reconstruction using an RGB-D Camera. ACM Transactions on Graphics 33(4), 1–12 (2014)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(11), 1254–1259 (1998)
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Annual Conference on Neural Information Processing Systems, pp. 545–552 (2006)
Hou, X.D., Zhang, L.Q.: Saliency detection: a spectral residual approach. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE, Minneapolis (2007)
Achanta, R., Hemami, S., Estrada, F., et al.: Frequency-tuned salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597–1604. IEEE, Miami Beach (2009)
Cheng, M.M., Zhang, G.X., Mitra, N.J., et al.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 409–416. IEEE, Colorado Springs (2011)
Perazzi, F., Krahenbuhl, P., Pritch, Y., et al.: Saliency filters: contrast based filtering for salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 733–740 (2012)
Margolin, R., Tal, A., Zelnik-Manor, L.: What makes a patch distinct? In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1139–1146 (2013)
Ciptadi, A., Hermans, T., Rehg, J.M.: An in Depth View of Saliency. In: BMVC, pp. 1–11 (2013)
Desingh, K., Krishna, K.M., Jawahar, C.V., Rajan, D.: Depth really matters: improving visual salient region detection with depth. In: BMVC, pp. 1–11 (2013)
Lang, C., Nguyen, T.V., Katti, H., Yadati, K., Kankanhalli, M., Yan, S.: Depth Matters: Influence of Depth Cues on Visual Saliency. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 101–115. Springer, Heidelberg (2012)
Peng, H., Li, B., Xiong, W., Hu, W., Ji, R.: RGBD Salient Object Detection: A Benchmark and Algorithms. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part III. LNCS, vol. 8691, pp. 92–109. Springer, Heidelberg (2014)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. International Journal of Computer Vision 59, 167–181 (2004)
Comaniciu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 603–619 (2002)
Achanta, R., Shaji, A., Smith, K., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 2274–2282 (2012)
Gopalakrishnan, V., Hu, Y., Rajan, D.: Salient region detection by modeling distributions of color and orientation. IEEE Transactions on Multimedia. 11(5), 892–905 (2009)
Goferman, S., Zelnik-Manor, L., Tal, A.: Context- aware saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(10), 1915–1926 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wu, P., Duan, L., Kong, L. (2015). RGB-D Salient Object Detection via Feature Fusion and Multi-scale Enhancement. In: Zha, H., Chen, X., Wang, L., Miao, Q. (eds) Computer Vision. CCCV 2015. Communications in Computer and Information Science, vol 547. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-48570-5_35
Download citation
DOI: https://doi.org/10.1007/978-3-662-48570-5_35
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-48569-9
Online ISBN: 978-3-662-48570-5
eBook Packages: Computer ScienceComputer Science (R0)