Abstract
The semantics of multimedia data, which features context-dependency and media-independency, is of vital importance to multimedia applications but inadequately supported by the state-of-the-art database technology. In this paper, we address this problem by proposing MediaView as an extended object-oriented view mechanism to bridge the “semantic gap” between conventional databases and semantics-intensive multimedia applications. This mechanism captures the dynamic semantics of multimedia using a modelling construct named media view, which formulates a customized context where heterogeneous media objects with similar/related semantics are characterized by additional properties and user-defined semantic relationships. Due to the complex ingredients and dynamic application requirements of multimedia databases, it is however difficult for users to define by themselves individual media views in a top–down fashion. To this end, a unique approach of constructing media views logically is devised. In addition, a set of user level operators is defined and implemented to accommodate the specialization and generalization relationships among the views. The usefulness and elegancy of MediaView are demonstrated by its application in a multi-modal information retrieval system.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Abiteboul, S., Bonner, A.: Objects and Views. In Proc. of ACM SIGMOD Conf. on the Management of Data, 238–247 (1991)
Adiba, M.: STORM: Structural and Temporal Object-Oriented Multimedia Database Systems. IEEE Int. Workshop on Multimedia DBMS, NY, USA, August, (1995)
Apers, P., Blanken, H., Houtsma, M. (eds.): Multimedia Databases in Perspective. Springer, London (1997)
Benitez, A.B., Smith, J.R., Chang, S.F.: MediaNet: A Multimedia Information Network for Knowledge Representation”. Proceeding of the SPIE 2000 Conference on Internet Multimedia Management Systems, 4210, (2000)
Bertino, E., Catania, B., Ferrari, E.: Query processing. In: Apers, P.M.G., Blanken, H.M., Houtsma, M.A.W. (eds.) Multimedia Databases in Perspective. vol 181–217Springer, Berlin/Heidelberg (1997)
Eisenberg, A., Melton, J.: SQL Multimedia and Application Packages (SQL/MM). ACM SIGMOD Record 30(4), Dec. 2001
Faloutsos, C.: Indexing of multimedia data. In: Burkhard, W.A., Keller, R.M. (eds.) Multimedia Databases in Perspective. vol 219–245Springer, Berlin/Heidelberg (1997)
French, J.C., Watson, J.V.S., Jin, X., Martin, W.N.: Integrating Multiple Multi-channel CBIR Systems. International Work Shop on Multimedia Information System (MIS’03), Ischia, Italy, May 2003
Hauptmann, A., et al.: Video Classification and Retrieval with the Informedia Digital Video Library System. Text Retrieval Conference (TREC02), Gaithersburg, MD, 2002
Heiler, S., Zdonik, S. B.: Object views: Extending the vision. Proc. of Int’l Conf. on Data Eng. (ICDE’90), pp. 86–93, Feb, 1990, IEEE
ISO/IEC, MPEG-7 Overview: http://www.chiariglione.org/mpeg/standards/mpeg-7/mpeg-7.htm (2006)
Kim, W.: Object-Oriented Database Systems: Promises, Reality, and Future. Proc. of 19th Very Large Database, 676–687 (1993)
Kim, W., Garza, J.F., Ballou, N., Woelk, D.: Architecture of the ORION Next-Generation Database System. IEEE Trans. Knowl. Data Eng. 2, (1), 109–124 (1990)
Klas, W., Bool, S., Lohr, M.: Integrated database services for multimedia presentation. Multimedia Information Storage and Management. Kluwer Academic, USA (1996)
Li, Q., Özsu, M.T.: Editorial: Introduction to web media information systems (special issue on web media information systems). World Wide Web. 5, (3), 179–180 (2002)
Li, Q., Yang, J., Zhuang, Y. MediaView: A Semantic View Mechanism for Multimedia Modeling. Proceedings of the Pacific Rim Conference on Multimedia (PCM’02), pp. 729–736, IEEE, 2002.
Lu, Y., Hu, C.H., Zhu, X.Q., Zhang, H.J., Yang, Q. A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems. In: Proceedings of the 8th ACM Multimedia conference, 2000
Miller, G.A.: WordNet: A lexical database for English. Comm. ACM. 38, (11), 39–41 (1995) Nov
NCITS H2, SQL:1999, available from: http://www.service-architecture.com/database/articles/sql1999.html
Oomoto, E., Tanaka, K.: OVID: Design and implementation of a video-object database system. In IEEE Trans. Knowl. Data Eng. 5, 629–641 (1993)
Rundensteiner, E. A.: MutiView: A Methodology for Supporting Multiple Views in Object-Oriented Databases. Proc. of the 18th Conf. on Very Large Database, Canada (1992)
Santini, S., Jain, R.: Interface for emergent semantics in multimedia database. Proceedings of the IS&T/SPIE Conference on Storage and Retrieval for Image and Video Database 167–175 (1999)
Scholl, M.H., Lassch, C., Tresch, M.: Updateable Views in Object-Oriented Databases. Proceedings of the 2nd DOOD Conference, Germany, Dec. 1991
Smith, J.: MPEG-7 multimedia content description standard. In: Feng, D., Siu, W.C., Zhang, H.J. (editors), Multimedia Information Retrieval and Management, Chap. 6, Springer, (2003).
Smith, J.R., Chang, S.F.: Visually searching the Web for content. IEEE Multimedia. Magazine. 4, (3), 12–20 (1997)
Song, Y., Wang, W., Zhang, A.: Automatic annotation and retrieval of images. World. Wide. Web. 6, (2), 209–231 (2003)
Tanaka, K., Yoshikawa, M., Ishihara, K.: Schema Virtualization in Object-Oriented Databases. Proceedings of the Int’l Conf. on Data Engineering (ICDE’88), 23–30, Feb, IEEE (1988)
Tansley, R.: The Multimedia Thesaurus: An Aid for Multimedia Information Retrieval and Navigation. Master Thesis, Computer Science. University of Southampton, UK (1998)
W3C, Extensible Markup Language (XML) 1.0 (Fourth Edition): http://www.w3.org/TR/REC-xml/ (2006)
Wu, F., Zhang, H., Zhuang, Y-T.: Learning Semantic Correlations for Cross-Media Retrieval. ICIP:1465–1468, 2006
Yang, J., Li, Q., Liu, W., Zhuang, Y.: Searching for flash movies on the Web: A content and context based framework. World Wide Web 8, (4), 495–517 (2005)
Yang, J., Li, Q., Zhuang, Y.T.: Octopus: Aggressive Search of Multi-Modality Data Using Multifaceted Knowledge Base. Proceedings of the 11th International Conference on World Wide Web (WWW’02):54–64 (2002)
Zakos, J., Verma, B.: A novel context-based technique for Web information retrieval. World Wide Web 9, (4), 485–503 (2006)
Zhang, H., Chen, Z., Li, M., Su, Z.: Relevance feedback and learning in content-based image search. World Wide Web 6, (2), 131–155 (2003)
Author information
Authors and Affiliations
Corresponding author
Additional information
Main part of the work by this Qing Li was done when he was on leave from City University of Hong Kong, HKSAR, China.
Rights and permissions
About this article
Cite this article
Li, Q., Zhao, J. & Zhu, X. Multimedia Data Modeling Through a Semantic View Mechanism. World Wide Web 11, 287–311 (2008). https://doi.org/10.1007/s11280-008-0045-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-008-0045-1