Abstract
Line drawing is a style of image abstraction where the perceptual content of the image is conveyed using distinct straight or curved lines. However, extracting semantically salient lines is not trivial and mastered only by skilled artists. While many parametric filters have successfully extracted accurate and coherent lines, their results are sensitive to parameter choice and easily lead to either an excessive or insufficient number of lines. In this work, we present an interactive system to generate concise line abstractions of arbitrary images via a few user specified strokes. Specifically, the user simply has to provide a few intuitive strokes on the input images, including tracing roughly along edges and scribbling on the region of interest, through a sketching interface. The system then automatically extracts lines that are long, coherent and share similar textural structures to form a corresponding highly detailed line drawing. We have tested our system with a wide variety of images. Our experimental results show that our system outperforms state-of-the-art techniques in terms of quality and efficiency.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Canny, J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. PAMI-8, No. 6, 679–698, 1986.
Kyprianidis, J. E.; Döllner, J. Image abstraction by structure adaptive filtering. In: Proceedings of the EG UK Theory and Practice of Computer Graphics, 51–58, 2008.
Winnemöeller, H.; Olsen, S. C.; Gooch, B. Real-time video abstraction. ACM Transactions on Graphics Vol. 25, No. 3, 1221–1226, 2006.
Winnemöller, H.; Kyprianidis, J. E.; Olsen, S. C. XDoG: An extended difference-of-Gaussians compendium including advanced image stylization. Computers & Graphics Vol. 36, No. 6, 740–753, 2012.
Arbelaez, P.; Maire, M.; Fowlkes, C.; Malik, J. Contour detection and hierarchical image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 33, No. 5, 898–916, 2011.
Maire, M.; Arbelaez, P.; Fowlkes, C.; Malik, J. Using contours to detect and localize junctions in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2008.
Limpaecher, A.; Feltman, N.; Treuille, A.; Cohen, M. Real-time drawing assistance through crowdsourcing. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 54, 2013.
Su, Q.; Li, W. H. A.; Wang, J.; Fu, H. EZsketching: Three-level optimization for error-tolerant image tracing. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 54, 2014.
Gleicher, M. Image snapping. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, 183–190, 1995.
Li, Y.; Sun, J.; Tang, C.-K.; Shum, H.-Y. Lazy snapping. ACM Transactions on Graphics Vol. 23, No. 3, 303–308, 2004.
Lee, Y. J.; Zitnick, C. L.; Cohen, M. F. ShadowDraw: Real-time user guidance for freehand drawing. ACM Transactions on Graphics Vol. 30, No. 4, Article No. 27, 2011.
Iarussi, E.; Bousseau, A.; Tsandilas, T. The drawing assistant: Automated drawing guidance and feedback from photographs. In: Proceedings of the ACM Symposium on User Interface Software and Technology, 2013.
Dixon, D.; Prasad, M.; Hammond, T. iCanDraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 897–906, 2010.
Lu, J.; Barnes, C.; DiVerdi, S.; Finkelstein, A. RealBrush: Painting with examples of physical media. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 117, 2013.
Berger, I.; Shamir, A.; Mahler, M.; Carter, E.; Hodgins, J. Style and abstraction in portrait sketching. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 55, 2013.
Yang, S.; Wang, J.; Shapiro, L. Supervised semantic gradient extraction using linear-time optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2826–2833, 2013.
Wobbrock, J. O.; Wilson, A. D.; Li, Y. Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, 159–168, 2007.
Orbay, G.; Kara, L. B. Beautification of design sketches using trainable stroke clustering and curve fitting. IEEE Transactions on Visualization and Computer Graphics Vol. 17, No. 5, 694–708, 2011.
Floyd, R. W. Algorithm 97: Shortest path. Communications of the ACM Vol. 5, No. 6, 345, 1962.
McDonald, R.; Smith, K. J. CIE94—A new colourdifference formula. Journal of the Society of Dyers and Colourists Vol. 111, No. 12, 376–379, 1995.
Acknowledgements
We are grateful to the anonymous reviewers for their comments and suggestions. The work was supported in part by the “Ministry of Science and Technology of Taiwan” (Nos. 103-2221-E-007-065-MY3 and 105-2221-E-007-104-MY2).
Author information
Authors and Affiliations
Corresponding authors
Additional information
This article is published with open access at Springerlink.com
Hui-Chi Tsai received her bachelor and master degrees in computer science from “National Tsing Hua University”, Taiwan, China. She is currently a software engineer in the Information and Communications Research Laboratories, Industrial Technology Research Institute, Taiwan, China. Her research interests include computer graphics and computer vision.
Ya-Hsuan Lee received her B.S. degree in computer science from “National Tsing Hua University”, Taiwan, China, in 2016. She is currently working at MediaTek as an engineer. Her research interests include computer graphics and computer vision.
Ruen-Rone Lee received his Ph.D. degree in computer science from “National Tsing Hua University”, Taiwan, China, in 1994. From 1994 to 2010, he worked in several IC design companies for graphics hardware and software development. Later, from 2010 to 2015, he was an associate researcher with the Department of Computer Science, “National Tsing Hua University”. He is currently a deputy director in the Information and Communications Research Laboratories, Industrial Technology Research Institute, Taiwan, China. His research interests include computer graphics, non-photorealistic rendering, and graphics hardware architecture design. He is a member of the IEEE Computer Society and the ACM SIGGRAPH.
Hung-Kuo Chu received his Ph.D. degree from the Department of Computer Science and Information Engineering, “National Cheng Kung University”, Taiwan, China, in 2010. He is currently an associate professor at the Department of Computer Science, “National Tsing Hua University”. His research interests focus on shape understanding, smart manipulation, perception-based rendering, recreational graphics, and human computer interaction.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
Electronic supplementary material
Rights and permissions
Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Tsai, HC., Lee, YH., Lee, RR. et al. User-guided line abstraction using coherence and structure analysis. Comp. Visual Media 3, 177–188 (2017). https://doi.org/10.1007/s41095-016-0076-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-016-0076-y