Abstract
In this paper, we study the problem of how to segment a freehand sketch at the object level. By carefully considering the basic principles of human perceptual organization, a real-time solution is presented to automatically segment a user’s sketch during his/her drawing. First, a graph-based sketch segmentation algorithm is proposed to segment a cluttered sketch into multiple parts based on the factor of proximity. Then, to improve the ability of detecting semantically meaningful objects, a semantic-based approach is introduced to simulate the past experience in the perceptual system by leveraging a web-scale clipart database. Finally, other important factors learnt from past experience, such as similarity, symmetry, direction, and closure, are also taken into account to make the approach more robust and practical. The proposed sketch segmentation framework has ability to handle complex sketches with overlapped objects. Extensive experimental results show the effectiveness of the proposed framework and algorithms.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Marr, D.: Early processing of visual information. Philosophical Transactions of the Royal Society of London. B, Biological Sciences (1976)
Cao, Y., Wang, C., Zhang, L., Zhang, L.: Edgel index for large-scale sketch-based image search. In: CVPR (2011)
Bronstein, A., Bronstein, M., Guibas, L., Ovsjanikov, M.: Shape google: Geometric words and expressions for invariant shape retrieval. TOG (2011)
Sun, Z., Wang, C., Zhang, L., Zhang, L.: Query-adaptive shape topic mining for hand-drawn sketch recognition. In: ACM Multimedia (2012)
Temlyakov, A., Munsell, B., Waggoner, J., Wang, S.: Two perceptually motivated strategies for shape classification. In: CVPR (2010)
Pu, J., Gur, D.: Automated freehand sketch segmentation using radial basis functions. In: Computer-Aided Design (2009)
Sezgin, T., Stahovich, T., Davis, R.: Sketch based interfaces: Early processing for sketch understanding. In: ACM SIGGRAPH (2006)
Sezgin, T.: Feature point detection and curve approximation for early processing of freehand sketches (Masters thesis, Massachusetts Institute of Technology)
Hammond, T., Davis, R.: Ladder, a sketching language for user interface developers. Computers & Graphics (2005)
Sezgin, T., Davis, R.: Hmm-based efficient sketch recognition. In: ACM IUI (2005)
Wertheimer, M.: Laws of organization in perceptual forms. A source book of Gestalt psychology (1938)
Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. IJCV (2004)
Shi, J., Malik, J.: Normalized cuts and image segmentation. PAMI (2000)
Boykov, Y., Funka-Lea, G.: Graph cuts and efficient nd image segmentation. IJCV (2006)
Carreira, J., Sminchisescu, C.: Constrained parametric min-cuts for automatic object segmentation. In: CVPR (2010)
Cao, Y., Wang, H., Wang, C., Li, Z., Zhang, L., Zhang, L.: Mindfinder: Interactive sketch-based image search on millions of images. In: ACM Multimedia (2010)
Wang, C., Zhang, J., Yang, B., Zhang, L.: Sketch2cartoon: composing cartoon images by sketching. In: ACM Multimedia (2011)
Borgefors, G.: Hierarchical chamfer matching: A parametric edge matching algorithm. PAMI (1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, Z., Wang, C., Zhang, L., Zhang, L. (2012). Free Hand-Drawn Sketch Segmentation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7572. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33718-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-642-33718-5_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33717-8
Online ISBN: 978-3-642-33718-5
eBook Packages: Computer ScienceComputer Science (R0)