Abstract
A Sketch-Based Image Retrieval (SBIR) algorithm compares a line-drawing sketch with images. The comparison is made difficult by image background clutter. A query sketch includes an object of interest only, while database images would also contain background clutters. In addition, variability of hand-drawn sketches, due to “stroke noise” such as disconnected and/or wobbly lines, also makes the comparison difficult. Our proposed SBIR algorithm compares edges detected in an image with lines in a sketch. To emphasize presumed object of interest and disregard backgrounds, we employ Visual Saliency Weighting (VSW) of edges in the database image. To effectively compare the sketch containing stroke noise with database images, we employ Cross-Domain Manifold Ranking (CDMR), a manifold-based distance metric learning algorithm. Our experimental evaluation using two SBIR benchmarks showed that the combination of VSW and CDMR significantly improves retrieval accuracy.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Chalechale, A., Naghdy, G., Mertins, A.: Sketch-based image matching using angular partitioning. IEEE Transactions on Systems, Man and Cybernetics 35(1), 28–41 (2005)
Eitz, M., Hildebrand, K., Boubekeur, T., Alexa, M.: Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors. Visualization and Computer Graphics 2011 17(11), 1624–1636 (2011)
Saavedra, J., Bustos, B.: An improved histogram of edge local orientations for sketch-based image retrieval. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds.) Pattern Recognition. LNCS, vol. 6376, pp. 432–441. Springer, Heidelberg (2010)
Cao, Y., Wang, C., Zhang, L., Zhang, L.: Edgel index for large-scale sketch-based image search. In: CVPR 2011 (2011)
Bozas, K., Izquierdo, E.: Large scale sketch based image retrieval using patch hashing. In: Bebis, G., et al. (eds.) ISVC 2012, Part I. LNCS, vol. 7431, pp. 210–219. Springer, Heidelberg (2012)
Hu, R., Barnard, M., Collomosse, J.: Gradient Field Descriptor for Sketch based Retrieval and Localization. In: ICIP 2010 (2010)
Hu, R., Collomosse, J.: A Performance Evaluation of Gradient Field HOG Descriptor for Sketch Based Image Retrieval. In: CVIU 2013 (2013)
Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.H.: Saliency Detection via Graph-based Manifold Ranking. In: CVPR 2013 (2013)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with Local and Global Consistency. In: NIPS 2003 (2003)
Eitz, M., Richter, R., Boubekeur, T., Hildebrand, K., Alexa, M.: Sketch-Based Shape Retrieval. ACM TOG 31(4), 1–10 (2012)
Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. IJCV 60(2) (November 2004)
Furuya, T., Ohbuchi, R.: Ranking on cross-domain manifold for sketch-based 3D model retrieval. Accepted as Regular Paper, Cyberworlds 2013 (2013)
Furuya, T., Ohbuchi, R.: Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features. ACM CIVR 2009, Article No. 26 (2009)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR 2005 (2005)
Weinberger, K.Q., Saul, L.K.: Distance Metric Learning for Large Margin Nearet Neighbor Classification. In: Journal of Machine Learning Research (JMLR) (2009)
Achanta, R., Estrada, F., Wils, P., Süsstrunk, S.: Salient region detection and segmentation. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 66–75. Springer, Heidelberg (2008)
Hou, X., Zhang, L.: Saliency detection: A spectral residual approach. In: CVPR 2007 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Furuya, T., Ohbuchi, R. (2014). Visual Saliency Weighting and Cross-Domain Manifold Ranking for Sketch-Based Image Retrieval. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds) MultiMedia Modeling. MMM 2014. Lecture Notes in Computer Science, vol 8325. Springer, Cham. https://doi.org/10.1007/978-3-319-04114-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-04114-8_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04113-1
Online ISBN: 978-3-319-04114-8
eBook Packages: Computer ScienceComputer Science (R0)