Abstract
The effective management and exploitation of multimedia documents requires the extraction of the underlying semantics. Multimedia analysis algorithms can produce fairly rich, though imprecise information about a multimedia document which most of the times remains unexploited. In this paper we propose a methodology for semantic indexing and retrieval of images, based on techniques of image segmentation and classification combined with fuzzy reasoning. In the proposed knowledge-assisted analysis architecture a segmentation algorithm firstly generates a set of over-segmented regions. After that, a region classification process is employed to assign semantic labels using a confidence degree and simultaneously merge regions based on their semantic similarity. This information comprises the assertional component of a fuzzy knowledge base which is used for the refinement of mistakenly classified regions and also for the extraction of rich implicit knowledge used for global image classification. This knowledge about images is stored in a semantic repository permitting image retrieval and ranking.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Adamek, T., O’Connor, N., Murphy, N.: Region-based segmentation of images using syntactic visual features. In: Proc. Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2005, Montreux, Switzerland, 13–15 April 2005
Athanasiadis Th., Mylonas Ph., Avrithis Y., Kollias S.: Semantic image segmentation and object labeling. IEEE Trans. Circuits Syst. Video Technol. 17(3), 298–312 (2007)
Athanasiadis, Th., Tzouvaras, V., Petridis, K., Precioso, F., Avrithis, Y., Kompatsiaris, Y.: Using a multimedia ontology infrastructure for semantic annotation of multimedia content. In: Proceedings of the 5th International Workshop on Knowledge Markup and Semantic Annotation (2005)
Baader F., McGuinness D., Nardi D., Patel-Schneider P.F.: The Description Logic Handbook: Theory, Implementation and Applications. Cambridge University Press, Cambridge (2002)
Berretti S., Del Bimbo A., Vicario E.: Efficient matching and indexing of graph models in content-based retrieval. IEEE Trans. Circuits Syst. Video Technol. 11(12), 1089–1105 (2001)
Borenstein, E., Sharon, E.: Combining top-down and bottom-up segmentation. In: 8th Conference on Computer Vision and Pattern Recognition Workshop, CVPR 2004 (2004)
Christel, M.G., Hauptmann, A.G.: The use and utility of high-level semantic features in video retrieval. In: Proceedings of 4th International Conference on Image and Video Retrieval, CIVR 2005, Singapore, July 2005
Cross V.: Fuzzy information retrieval. J. Intell. Inform. Syst. 3, 29–56 (1994)
Description-logic knowledge representation system specification from the KRSS group of the ARPA knowledge sharing effort. http://dl.kr.org/krss-spec.ps
Giugno, R., Lukasiewicz, T.: P-shoq(d): A probabilistic extension of shoq(d) for probabilistic ontologies in the semantic web. In: JELIA ’02: Proceedings of the European Conference on Logics in Artificial Intelligence, pp. 86–97. Springer, London (2002)
Hollink, L., Worring, M., Schreiber, G.: Building a visual ontology for video retrieval. In: Proceedings of the ACM Multimedia (2005)
Hoogs, A., Rittscher, J., Stein, G., Schmiederer, J.: Video content annotation using visual analysis and a large semantic knowledgebase. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2003)
Horrocks, I., Sattler, U., Tobies, S.: Reasoning with Individuals for the Description Logic \({\mathcal{SHIQ}}\) . In: MacAllester, D. (ed.) CADE-2000, number 1831 in LNAI, pp. 482–496. Springer, Berlin (2000)
Kompatsiaris, I., Papadopoulos, G., Mezaris, V., Strintzis, M.: Combining global and local information for knowledge-assisted image analysis and classification. EURASIP Journal on Advances in Signal Processing, Special Issue on Knowledge-Assisted Media Analysis for Interactive Multimedia Applications, accepted for publication (2007)
Klir G.J., Yuan B.: Fuzzy Sets and Fuzzy Logic: Theory and Applications. Prentice-Hall, Englewood Cliffs (1995)
Kumar, M.P., Torr, P.H.S., Zisserman, A.: OBJ CUT. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego (2005)
Mazzieri, M., Dragoni, A.F.: A fuzzy semantics for semantic web languages. In: ISWC-URSW, pp. 12–22 (2005)
Morris O.J., Lee M.J., Constantinides A.G.: Graph theory for image analysis: an approach based on the shortest spanning tree. Inst. Elect. Eng. 133, 146–152 (1986)
Mylonas, P., Athanasiadis, T., Wallace, M., Avrithis, Y., Kollias, S.: Semantic representation of multimedia content: Knowledge representation and semantic indexing. Multimed. Tools Appl. (in press)
Naphade M., Huang T.S.: A probabilistic framework for semantic video indexing, filtering and retrieval. IEEE Trans. Multimed. 3(1), 144–151 (2001)
Naphade M., Smith J., Tesic J., Chang S.-F., Hsu W., Kennedy L., Hauptmann A., Curtis J.: Large-scale concept ontology for multimedia. IEEE Multimed. 13(3), 86–91 (2006)
Pan, J.Z., Stamou, G., Stoilos, G., Thomas, E.: Expressive querying over fuzzy DL-Lite ontologies. In: Proceedings of the International Workshop on Description Logics (DL 2007) (2007)
Patel-Schneider, P.F., Hayes, P., Horrocks, I.: OWL Web Ontology Language Semantics and Abstract Syntax. Technical report, W3C, Feb. 2004. W3C Recommendation. http://www.w3.org/TR/2004/REC-owl-semantics-20040210/
Prud’hommeaux, E., Seaborne, A.: SPARQL query language for RDF, 2006. W3C Working Draft. http://www.w3.org/TR/rdf-sparql-query/
Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: MIR ’06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330. ACM Press, New York (2006)
Smith J.R.: Video indexing and retrieval using MPEG-7. CRC Press, Boca Raton (2004)
Snoek C., Huurninkm B., Hollink L., de Rijke M., Schreiber G., Worring M.: Adding semantics to detectors for video retrieval. IEEE Trans. Multimed. 9(5), 144–151 (2007)
Snoek C.G.M., Huurnink B., Hollink L., de Rijke M., Schreiber G., Worring M.: Adding semantics to detectors for video retrieval. IEEE Trans. Multimed. 9(5), 975–986 (2007)
Stoilos G., Stamou G., Tzouvaras V., Pan J.Z., Horrocks I.: Reasoning with very expressive fuzzy description logics. J. Artif. Intell. Res. 30(5), 273–320 (2007)
Straccia U.: Reasoning within fuzzy description logics. J. Artif. Intell. Res. 14, 137–166 (2001)
Vaneková, V., Bella, J., Gurský, P., Horváth, T.: Fuzzy RDF in the semantic web: deduction and induction. In: Proceedings of Workshop on Data Analysis (WDA 2005), pp. 16–29 (2005)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2001)
Zhang, L., Lin, F., Zhang, B.: Support vector machine learning for image retrieval. Image Processing, 2001. In: Proceedings. 2001 International Conference on, 2 (2001)
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the European Commission under contract FP6-027026 K-SPACE.
Rights and permissions
About this article
Cite this article
Simou, N., Athanasiadis, T., Stoilos, G. et al. Image indexing and retrieval using expressive fuzzy description logics. SIViP 2, 321–335 (2008). https://doi.org/10.1007/s11760-008-0084-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-008-0084-1