Abstract
Correlating image semantics with its low level features is a challenging task. Although, humans are adept in distinguishing object categories, both in visual as well as in semantic space, but to accomplish this computationally is yet to be fully explored. The learning based techniques do minimize the semantic gap, but unlimited possible categorization of objects in real world is a major challenge to these techniques. This work analyzes and utilizes the strength of a semantically categorized image database to assign semantics to query images. Semantics based categorization of images would result in image hierarchy. The algorithms proposed in this work exploit visual image descriptors and similarity measures in the context of a semantically categorized image database. A novel ‘Branch Selection Algorithm’ is developed for a highly categorized and dense image database, which drastically reduces the search space. The search space so obtained is further reduced by applying any one of the four proposed ‘Pruning Algorithms’. Pruning algorithms maintain accuracy while reducing the search space. These algorithms use an adaptive combination of multiple visual features of an image database to find semantics of query images. Branch Selection Algorithm tested on a subset of ‘ImageNet’ database reduces search space by 75%. The best pruning algorithm further reduces this search space by 26% while maintaining 95% accuracy.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Sternberg, R.J.: Cognitive Psychology, 5th edn. Wadsworth Cencage Learning, Belmont (2008)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Comput. Surv. 40(2), 5–60 (2008)
Deselaers, T., Keysers, D., Ney, H.: Features for Image Retrieval: An Experimental Comparison. Inf. Retr. 11(2), 77–107 (2008)
Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)
Wang, H.H., Mohamad, D., Ismail, N.A.: Semantic Gap in CBIR: Automatic Objects Spatial Relationships Semantic Extraction and Representation. IJIP International Journal of Image Processing 4(3), 192–204 (2010)
Li, J., Wang, J.Z.: Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1075–1088 (2003)
Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 106(1), 59–70 (2007)
Lowe, D.G.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, ICCV 1999, vol. 2, pp. 1150–1157 (1999)
Zhuang, Y., Liu, X., Pan, Y.: Apply Semantic Template to Support Content-based Image Retrieval. In: Proceeding of IS&T and SPIE Storage and Retrieval for Media Databases, San Jose, California, USA, January 23-28, pp. 442–449 (2000)
Shotton, J., Winn, J., Rother, C., Criminisi, A.: TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 1–15. Springer, Heidelberg (2006)
Liu, Y., Zhang, D., Lu, G.: Region-based image retrieval with high-level semantics using decision tree learning. Pattern Recogn. 41(8), 2554–2570 (2008)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: A Large-Scale Hierarchical Image Database. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (June 2009)
Wang, X.Y., Yu, Y.J., Yang, H.Y.: An effective image retrieval scheme using color, texture and shape features. Computer Standards & Interfaces 33(1), 59–68 (2011)
Vassilieva, N.S.: Content-based Image Retrieval Methods. Program. Comput. Softw. 35(3), 158–180 (2009)
Liu, G.H., Yang, J.Y.: Content-based image retrieval using color difference histogram. Pattern Recogn. 46(1), 188–198 (2013)
Pandey, K.K., Mishra, N., Sharma, H.K.: Enhanced of color matching algorithm for image retrieval. International Journal of Computer Science Issues 8(3), 529–532 (2011)
Sural, S., Qian, G., Pramanik, S.: A Histogram with Perceptually Smooth Color Transition for Image Retrieval. In: 4th International Conference on Computer Vision, Pattern Recognition and Image Processing, Durham, North Carolina, pp. 664–667 (2002)
Shih, J.L., Chen, L.H.: Colour image retrieval based on primitives of colour moments. IEEE Proceedings on Vision, Image and Signal Processing 149(6), 370–376 (2002)
Stricker, M., Orengo, M.: Similarity of Color Images. In: SPIE Conference on Storage and Retrieval for Image and Video Databases III, San Jose, CA, USA, vol. 2420, pp. 381–392 (1995)
Manjunath, B.S., Ma, W.Y.: Texture Features for Browsing and Retrieval of Image Data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)
NIST/SEMATECH: e-handbook of statistical methods (2012), http://www.itl.nist.gov/div898/handbook/eda/section3/eda356.htm
Malik, F., Baharudin, B.: Quantized histogram color features analysis for image retrieval based on median and Laplacian filters in DCT domain. In: International Conference on Innovation Management and Technology Research (ICIMTR), Malacca, Malaysia, May 21-22, pp. 624–629 (2012)
Gali, R., Dewal, M.L., Anand, R.S.: Genetic Algorithm for Content Based Image Retrieval. In: International Conference on Computational Intelligence, Communication Systems and Networks (CICSyN), Phuket, Thailand, July 24-26, pp. 243–247 (2012)
Kinnaree, P., Pattanasethanon, S., Thanaputtiwirot, S., Boontho, S.: RGB Color Correlation Index for Image Retrieval. Procedia Engineering (8), 36–41 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khanna, P., Pandey, S., Yokota, H. (2013). Finding Image Semantics from a Hierarchical Image Database Based on Adaptively Combined Visual Features. In: Decker, H., Lhotská, L., Link, S., Basl, J., Tjoa, A.M. (eds) Database and Expert Systems Applications. DEXA 2013. Lecture Notes in Computer Science, vol 8055. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40285-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-40285-2_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40284-5
Online ISBN: 978-3-642-40285-2
eBook Packages: Computer ScienceComputer Science (R0)