Abstract
In this paper we investigate some mathematical consequences of the Equivocation Principle, and the Maximum Entropy models arising from that, for first order languages. We study the existence of Maximum Entropy models for these theories in terms of the quantifier complexity of the theory and will investigate some invariance and structural properties of such models.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bacchus, F., A. J. Grove, J. Y. Halpern, and D. Koller, Generating new beliefs from old, Proceedings of the Tenth Annual Conference on Uncertainty in Artificial Intelligence, (UAI-94), 1994, pp. 37–45.
Barnett O. W., J. B. Paris.: Maximum Entropy inference with qualified knowledge. Logic Journal of the IGPL 16(1), 85–98 (2008)
Berger A., Della Pietra S., Della Pietra V.: A maximum entropy approach to natural language processing. Computational Linguistics 22(1), 39–71 (1996)
Chen, C. H., Maximum entropy analysis for pattern recognition, in P. F. Fougere (ed.), Maximum Entropy and Bayesian Methods, Kluwer Academic Publisher, London, 1990.
Gaifman H.: Concerning measures in first order calculi. Israel Journal of Mathematics 24, 1–18 (1964)
Grotenhuis, M. G., An Overview of the Maximum Entropy Method of Image Deconvolution, A University of Minnesota Twin Cities Plan B Masters paper.
Grove A. J., J. Y. Halpern, and D. Koller, Asymptotic conditional probabilities: the unary case, SIAM Journal of Computing 25(1):1–51, 1996.
Jaynes, E. T., Information theory and statistical mechanics, Physical Reviews 106:620–630, 108:171–190, 1957.
Jaynes, E. T., Notes on present status and future prospects, in W. T. Grandy and L. H. Schick (eds.), Maximum Entropy and Bayesian Methods, Kluwer, London, 1990, pp. 1–13.
Jaynes, E. T., How Should We Use Entropy in Economics? 1991, manuscript available at: http://www.leibniz.imag.fr/LAPLACE/Jaynes/prob.html.
Kapur J. N.: Twenty five years of maximum entropy. Journal of Mathematical and Physical Sciences 17(2), 103–156 (1983)
Kapur J. N.: Non-additive measures of entropy and distributions of statistical mechanics. Indian Journal of Pure and Applied Mathematics 14(11), 1372–1384 (1983)
Landes J., Williamson J.: Objective Bayesianism and the maximum entropy principle. Entropy 15(9), 3528–3591 (2013)
Landes J., Williamson J.: Justifying objective bayesianism on predicate languages. Entropy 17, 2459–2543 (2015)
Paris J. B.: The Uncertain Reasoner’s Companion. Cambridge University Press, Cambridge (1994)
Paris J. B., Vencovská A.: A note on the inevitability of maximum entropy. International Journal of Approximate Reasoning 4(3), 183–224 (1990)
Paris J.B., Vencovská A.: In defense of the maximum entropy inference process. International Journal of Approximate Reasoning 17(1), 77–103 (1997)
Paris, J. B., and S. Rafiee Rad, A note on the least informative model of a theory, in F. Ferreira, B. Löwe, E. Mayordomo, and L. Mendes Gomes (eds.), Programs Proofs Processes, CiE 2010, Springer LNCS 6158, 2010, pp. 342–351.
Rafiee Rad, S., Inference Processes For Probabilistic First Order Languages. PhD Thesis, University of Manchester, 2009. http://www.maths.manchester.ac.uk/~jeff/
Rosenkrantz, R. D., Inference, Method and Decision: Towards a Bayesian Philosophy of Science, Reidel, Dordrecht, 1977.
Shannon C. E., Weaver W.: The Mathematical Theory of Communication. University of Illinois Press, Champaign (1949)
Williamson J.: Bayesian nets and causality: philosophical and computational foundations. Oxford University Press, Oxford (2005)
Williamson J.: Objective Bayesian probabilistic logic. Journal of Algorithms in Cognition, Informatics and Logic 63, 167–183 (2008)
Williamson, J., In Defence of Objective Bayesianism, Oxford University Press, Oxford, 2010, pp. 167–183.
Zellner, A., Bayesian methods and entropy in economics and econometrics, in W. T. Grandy and L. H. Schick (eds.), Maximum Entropy and Bayesian Methods, 1991.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Rafiee Rad, S. Equivocation Axiom on First Order Languages. Stud Logica 105, 121–152 (2017). https://doi.org/10.1007/s11225-016-9684-x
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11225-016-9684-x