Abstract
This paper presents a combined structure for using real, complex, and binary valued vectors for semantic representation. The theory, implementation, and application of this structure are all significant.
For the theory underlying quantum interaction, it is important to develop a core set of mathematical operators that describe systems of information, just as core mathematical operators in quantum mechanics are used to describe the behavior of physical systems. The system described in this paper enables us to compare more traditional quantum mechanical models (which use complex state vectors), alongside more generalized quantum models that use real and binary vectors.
The implementation of such a system presents fundamental computational challenges. For large and sometimes sparse datasets, the demands on time and space are different for real, complex, and binary vectors. To accommodate these demands, the Semantic Vectors package has been carefully adapted and can now switch between different number types comparatively seamlessly.
This paper describes the key abstract operations in our semantic vector models, and describes the implementations for real, complex, and binary vectors. We also discuss some of the key questions that arise in the field of quantum interaction and informatics, explaining how the wide availability of modelling options for different number fields will help to investigate some of these questions.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Varadarajan, V.S.: Geometry of Quantum Theory. Springer (1985)
Boole, G.: The Mathematical Analysis of Logic. Macmillan (1847) (republished by St Augustine’s Press, 1998, introduction by John Slater)
Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning. Springer Series in Statistics (2001)
Rosch, E.: Principles of categorization. In: Collins, A., Smith, E.E. (eds.) Readings in Cognitive Science: A Perspective from Psychology and Artificial Intelligence, Kaufmann, San Mateo, CA, pp. 312–322 (1988)
Schvaneveldt, R.W.: Pathfinder Associative Networks: Studies in Knowledge Organization. Intellect Books (1990)
Gärdenfors, P.: Conceptual Spaces: The Geometry of Thought. Bradford Books MIT Press (2000)
Kanerva, P.: Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors. Cognitive Computation 1(2), 139–159 (2009)
Boole, G.: An Investigation of the Laws of Thought. Macmillan (1854) Dover edition (1958)
Plate, T.: Holographic Reduced Representations: Distributed Representation for Cognitive Structures. CSLI Publications (2003)
de Vine, L., Bruza, P.: Semantic oscillations: Encoding context and structure in complex valued holographic vectors. In: Proceedings of the AAAI Fall Symposium on Quantum Informatics for Cognitive, Social, and Semantic Processes, QI 2010 (2010)
Aerts, D., Czachor, M., De Moor, B.: Geometric analogue of holographic reduced representation. Journal of Mathematical Psychology 53(5), 389–398 (2007)
Gayler, R.W.: Vector symbolic architectures answer Jackendoff’s challenges for cognitive neuroscience. In: Slezak, P. (ed.) ICCS/ASCS International Conference on Cognitive Science, pp. 133–138. University of New South Wales, Sydney (2004)
Jones, M.N., Mewhort, D.J.K.: Representing word meaning and order information in a composite holographic lexicon, vol. 114, pp. 1–37 (2007)
Sahlgren, M., Holst, A., Kanerva, P.: Permutations as a means to encode order in word space. In: Proceedings of the 30th Annual Meeting of the Cognitive Science Society (CogSci 2008), Washington D.C., USA, July 23-26 (2008)
Widdows, D.: Semantic vector products: Some initial investigations. In: Proceedings of the Second International Symposium on Quantum Interaction (2008)
Grefenstette, E., Sadrzadeh, M.: Experimental support for a categorical compositional distributional model of meaning. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP (2011)
Baroni, M., Zamparelli, R.: Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP (2010)
Cohen, T., Widdows, D., Schvaneveldt, R., Rindflesch, T.: Logical leaps and quantum connectives: Forging paths through predication space. In: Proceedings of the AAAI Fall Symposium on Quantum Informatics for Cognitive, Social, and Semantic Processes, QI 2010 (2010)
Cohen, T., Widdows, D., Schvaneveldt, R., Rindflesch, T.: Finding Schizophrenia’s Prozac Emergent Relational Similarity in Predication Space. In: Song, D., Melucci, M., Frommholz, I., Zhang, P., Wang, L., Arafat, S. (eds.) QI 2011. LNCS, vol. 7052, pp. 48–59. Springer, Heidelberg (2011)
Widdows, D., Cohen, T.: The semantic vectors package: New algorithms and public tools for distributional semantics. In: Fourth IEEE International Conference on Semantic Computing, ICSC (2010)
Landauer, T., Dumais, S.: A solution to plato’s problem: The latent semantic analysis theory of acquisition. Psychological Review 104(2), 211–240 (1997)
Widdows, D.: Geometry and Meaning. CSLI Publications (2004)
Kanerva, P.: Binary spatter-coding of ordered k-tuples. In: Artificial Neural Networks, ICANN 1996, pp. 869–873 (1996)
Kanerva, P.: Sparse distributed memory. The MIT Press, Cambridge (1988)
Widdows, D., Peters, S.: Word vectors and quantum logic. In: Proceedings of the Eighth Mathematics of Language Conference, Bloomington, Indiana (2003)
Aerts, D., Aerts, S., Broekaert, J., Gabora, L.: The violation of bell inequalities in the macroworld. Foundations of Physics 30, 1387–1414 (2000)
Galea, D., Bruza, P., Kitto, K., Nelson, D., McEvoy, C.: Modelling the Acitivation of Words in Human Memory: The Spreading Activation, Spooky-activation-at-a-distance and the Entanglement Models Compared. In: Song, D., Melucci, M., Frommholz, I., Zhang, P., Wang, L., Arafat, S. (eds.) QI 2011. LNCS, vol. 7052, pp. 149–160. Springer, Heidelberg (2011)
van Rijsbergen, K.: The Geometry of Information Retrieval. Cambridge University Press (2004)
Khrennikov, A.: Ubiquitous Quantum Structure: From Psychology to Finance. Springer (2010)
Cohen, T., Widdows, D., De Vine, L., Schvaneveldt, R., Rindflesch, T.C.: Many Paths Lead to Discovery: Analogical Retrieval of Cancer Therapies. In: Busemeyer, J.R., Dubois, F., Lambert-Mogiliansky, A. (eds.) QI 2012. LNCS, vol. 7620, pp. 90–101. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Widdows, D., Cohen, T. (2012). Real, Complex, and Binary Semantic Vectors. In: Busemeyer, J.R., Dubois, F., Lambert-Mogiliansky, A., Melucci, M. (eds) Quantum Interaction. QI 2012. Lecture Notes in Computer Science, vol 7620. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35659-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-35659-9_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35658-2
Online ISBN: 978-3-642-35659-9
eBook Packages: Computer ScienceComputer Science (R0)