Abstract.
A spatial relation graph (SRG) and its partial matching method are proposed for online composite graphics representation and recognition. The SRG-based approach emphasizes three characteristics of online graphics recognition: partial, structural, and independent of stroke order and stroke number. A constrained partial permutation strategy is also proposed to reduce the computational cost of matching two SRGs, which is originally an NP-complete problem as is graph isomorphism. Experimental results show that our proposed SRG-based approach is both efficient and effective for online composite graphics recognition in our sketch-based graphics input system - SmartSketchpad.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Almohamad HA, Duffuaa SO (1993) A linear programming approach for the weighted graph matching problem. IEEE Trans PAMI 15(5):522-525
Alvarado C, Oltmans M, Davis R (2002) A framework for multi-domain sketch recognition. In: Proceedings of the AAAI spring symposium on sketch understanding, pp 1-8
Chang S-K, Shi QY, Yan CW (1987) Iconic indexing by 2-D strings. IEEE Trans PAMI 9(3):413-428
Christmas WJ, Kittler J, Petrou M (1995) Structural matching in computer vision using probabilistic relaxation. IEEE Trans PAMI 17(8):749-764
Davis R (2002) Sketch understanding in design: overview of work at the MIT AI Lab. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 24-31
Foggia P, Sansone C, Vento M (2001) A database of graphs for isomorphism and sub-graph isomorphism benchmarking. In: Proceedings of the 3rd IAPR-TC15 workshop on graph-based representations in pattern recognition, Ischia
Fonseca MJ, Jorge JA (2000) Using fuzzy logic to recognize geometric shapes interactively. In: Proceedings of the 9th IEEE conference on fuzzy systems, 1:291-196
Fonseca MJ, Pimetal C, Jorge J (2002) CALI: an online scribble recognizer for calligraphic interfaces. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 51-58
Gold S, Rangarajan A (1996) A graduated assignment algorithm for graph matching. IEEE Trans PAMI 18(4):522-525
Gross MD (1996) The electronic cocktail napkin - a computational environment for working with design diagrams. Des Stud 17:53-69
Gross MD, Do EY (1996) Ambiguous intentions: a paper-like interface for creative designing. In: In: Proceedings of the ACM symposium on user interface software and technology, pp:183-192
Hammond T, Davis R (2002) Tahuti: a geometrical sketch recognition for UML class diagrams. In: Proceedings of the 2002 AAAI spring symposium on sketch understanding, pp 59-66
Jin XY, Liu WY, Sun JY, Sun ZX (2002) Online graphics recognition. In: Proceedings of the Pacific Graphics conference, Beijing, October 2002, pp 256-265
Kim IJ, Kim JH, Liu CL (1999) Stroke-guided pixel matching for handwritten Chinese character recognition. In: Proceedings of the 5th international conference on document analysis and recognition
Landay J, Myers B (1995) Interactive sketching for the early stages of user interface. In: Proceedings of the ACM CHI 95 conference on human factors in computing systems, pp 43-50
Landay J, Myers B (2001) Sketching interfaces: toward more human interface design. IEEE Comput 34(3):56-64
Lee SY, Hsu FJ (1990) 2D C-string: a new spatial knowledge representation for image database systems. Patt Recog 23(10):1077-1087
Lee SW, Kim YJ (1995) A new type of recurrent neural network for handwritten character recognition. In: Proceedings of the 3rd international conference on document analysis and recognition, 1:38-42
Li C, Yang B, Xie W (2000) On-line hand-sketched graphics recognition based on attributed relation graph matching. In: Proceedings of the 3rd world congress on intelligent control and automation, Hefei, China, pp 2549-2553
Liu WY (2004) On-line graphics recognition: state of the art. Lecture notes in computer science. Springer, Berlin Heidelberg New York. (Selected and revised papers from Proceedings of GREC2003, July 2004, Spain (in press)
Liu WY, Qian W, Xiao R, Jin XY (2001) SmartSketchpad - an online graphics recognition system. In: Proceedings of the ICDAR2001, Seattle, pp 1050-1054
Liu WY, Jin XY, Sun ZX (2002) Sketch-based user interface for inputting graphic objects on small screen devices. Lecture notes in computer science, vol 2390. Springer, Berlin Heidelberg New York. (Selected and revised papers from Proceedings of GREC2001, 7-8 September 2001, Kingston, Canada)
Lladös J, Martí E, José J (2001) Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Trans PAMI 23(10)::1137-1143
Mehlhorn K (1984) Graph algorithm and NP-completeness. Springer, Berlin Heidelberg New York
Messmer BT (1995) Efficient graph matching algorithms. PhD thesis, University of Bern, Switzerland
Messmer BT, Bunke H (1998) A new algorithm for error-tolerant sub-graph isomorphism detection. IEEE Trans PAMI 20(5):493-504
Müller S, Eickeler S, Rigoll G (1998) Image database retrieval of rotated objects by user sketch. In: Proceedings of the IEEE workshop on content-based access to image and video libraries (CBAIVL), Santa Barbara, CA pp 40-44
Osuna E, Freund R, Girosi F (1997) Training support vector machines: an application to face detection. In: Proceedings of CVPR 97
Petrakis EGM (2002) Design and evaluation of spatial similarity approach for image retrieval. Image Vision Comput 20:59-76
Plamondon R, Guerfali W, Lalonde M (1999) Automatic signature verification: a report on a large-scale public experiment. In: Proceedings of the 9th biennial conference, Singapore, pp 9-13
Pontil M, Verri A (1998) Support vector machines for 3D object recognition. IEEE Trans PAMI 20(6):637-646
Rabiner LR (1989) Tutorial on hidden Markov model and selected applications in speech recognition. Proc IEEE 77(2):257-285
Ranganath HS, Chipman LJ (1992) Fuzzy relaxation approach for inexact scene matching. Image Vision Comput 10(9):631-640
Saund E (2003) Finding perceptually closed paths in sketches and drawings. IEEE Trans Patt Anal Mach Intell 25(4):475-491
Sun ZX, Xu XG, Sun JY, Jin XY (2003) Sketch-based graphic input tool for conceptual design. J Comput Aided Des Comput Graph (in Chinese) 15(9):205-206
Xu XG, Liu WY, Jin XY, Sun ZX (2002) Sketch-based user interface for creative tasks. In: Proceedings of the 5th Asia Pacific conference on computer human interaction, Beijing, pp 560-570
Author information
Authors and Affiliations
Corresponding author
Additional information
Received: 13 March 2003, Accepted: 13 March 2004, Published online: 1 June 2004
Rights and permissions
About this article
Cite this article
Xiaogang, X., Zhengxing, S., Binbin, P. et al. An online composite graphics recognition approach based on matching of spatial relation graphs. IJDAR 7, 44–55 (2004). https://doi.org/10.1007/s10032-004-0126-3
Issue Date:
DOI: https://doi.org/10.1007/s10032-004-0126-3