Abstract
This essay introduces probability in support of decision-making, as a state of mind and not of things. Probability provides a framework for reasoning coherently about uncertainty. According to Cox’s theorem, it is the only way to reason coherently about uncertainty. Probability summarizes states of information. A basic desideratum is that states of information judged equivalent should lead to the same probability distributions. Some widely used probabilistic models have both sufficient statistics and maximum entropy characterizations. In practice, outside of certain physics and engineering applications, human judgment is usually needed to quantify uncertainty as probabilities. Reality is highly complex, but one can test judgments against what is known, drawing upon many specialized areas of human knowledge. Sensitivity analysis can evaluate the importance of multiple uncertainties in a decision context. When the choice between alternatives is close, what is the value of further information (VOI)? Important concepts discussed in this chapter are the expected value of perfect information and the expected value of further experimental testing.Practical application is illustrated in two case studies. The first involves assessing the probability for replication of a terrestrial microbe on Mars, in the decision context of a constraint on planetary exploration. The second involves weather modification of hurricanes/typhoons: whether to deploy this technology to reduce damage from hurricanes impacting US coastal areas and valuing experimental testing offshore. The decision context is that of a natural disaster turned political by deployment of new technology where such deployment might be followed by a reduction, or by an increase, in adverse impacts, compared to not deploying the technology.Decision support should be viewed as an iterative process of working with those with decision responsibility and with experts who are the best available sources of information. The decision support process includes characterizing uncertainties and values for outcomes in the context of a choice among decision alternatives. Sensitivity analysis and VOI can give insight on whether to act now or to seek more information and more refined analysis. In a public policy decision context, the process can facilitate stakeholders sharing and critiquing information as the basis for characterizing uncertainties and learning which uncertainties and value judgments are most important for decisions.
Similar content being viewed by others
References
Arrow, K.J.: A difficulty in the concept of social welfare. J. Political Econ. 58, 328–346 (1950)
Arrow, K.J.: Alternative approaches to the theory of choice in risk-taking situations. Econometrica 19(4), 404–437 (1951)
Arrow, K.J.: Essays in the Theory of Risk-Bearing. North Holland Pub. Co., Amsterdam (1970)
Boyd, D.W., Howard, R.A., Matheson, J.E., North, D.W.: Decision Analysis of Hurricane Modification, Final Report, SRI Project 8503, Stanford Research Institute, Menlo Park (1971)
Budnitz, R.J., Apostolakis, G., Boore, D.M., Cluff, L.S., Coppersmith, K.J., Cornell, C.A., Morris, P.A.: Recommendations for Probabilistic Seismic Hazard Analysis: Guidance on Uncertainty and Use of Experts, Report prepared for the Nuclear Regulatory Commission, NUREG/CR-6372, vol. 1, main report, vol. 2, appendices. http://www.nrc.gov/reading-rm/doc-collections/nuregs/contract/cr6372/ (1997)
Budnitz, R.J., Apostolakis, G., Boore, D.M., Cluff, L.S., Coppersmith, K.J., Cornell, C.A., Morris, P.A.: Use of technical expert panels: applications to probabilistic seismic hazard analysis. Risk Anal. 18(4), 463–469 (1998)
Cooke, R.M.: Experts in Uncertainty: Opinion and Subjective Probability in Science. Oxford University Press, Oxford (1991)
Cox, R.T.: Probability, Frequency, and Reasonable Expectation. Am. J. Phys. 14, 1–10 (1946)
Cox, R.T.: The Algebra of Probable Inference. Johns Hopkins University Press, Baltimore (1961); See also http://en.wikipedia.org/wiki/Cox%27s_theorem;; http://en.wikipedia.org/wiki/Richard_Threlkeld_Cox
De Finetti, B.: La Prevision: ses lois logiques, ses sources subjectives. Annales de L’Institut Henri Poincaré (1937). An English translation is in Studies in Subjective Probability, Kyburg and Smokler (eds), 1964
Fischhoff, B.: The realities of risk-cost-benefit analysis. Science 350(6260) (2015). doi:10.1126/science.aaa6516
Fishburn, P.C.: Utility Theory for Decision Making. Wiley, New York (1970)
Fishburn, P.C.: Personal communication (1970)
Haidt, J.: The Righteous Mind: Why Good People Are Divided by Politics and Religion. Vintage Books, New York (2013)
Howard, R.A.: Decision analysis: applied decision theory. In: Hertz, D.B., Melese, J. (eds.) Proceedings of the Fourth International Conference on Operation Research, pp. 55–71. Wiley-Interscience, New York (1966)
Howard, R.A.: The foundations of decision analysis. IEEE Trans. Syst. Sci. Cybern. SSC-4(3), 1–9 (1968)
Howard, R.A., Abbas, A.E.: Foundations of Decision Analysis. Pearson, New York (2015)
Howard, R.A., Matheson, J.E.: Influence diagrams. Decis. Anal. 2(3), 127–143 (2005)
Howard, R.A., Matheson, J.E., North, D.W.: The decision to seed hurricanes. Science 176, 1191–1202 (1972)
Jaynes, E.T.: Prior probabilities. IEEE Trans. Syst. Sci. Cybern. 4(3), 227–241 (1968)
Jaynes, E.T.: Probability Theory: The Logic of Science. Cambridge University Press, Cambridge (2003). Earlier versions of this book were circulated as colloquium lectures, Socony Mobil Oil Company, 1958, then in a version available online, prior to Jaynes’ death in 1998. The Cambridge University Press version was edited by G. Larry Bretthorst and published five years after Jaynes’ death
Jeffreys, H.: Theory of Probability, 3rd edn. Clarendon Press, Oxford (1939, 1961)
Jet Propulsion Laboratory News: http://mars.nasa.gov/mro/news/whatsnew/index.cfm? FuseAction=ShowNews&NewsID=1183 (2011)
Jet Prolusion Laboratory News: http://www.jpl.nasa.gov/news/news.php?feature=4722 (2015)
Judd, B.R., Warner North, D., Pezier, J.P.: Assessment of the Probability of Contaminating Mars., Report No. MSU-2788, prepared for the Planetary Programs Division, National Aeronautics and Space Administration by SRI International, Menlo Park, 156 pp. (1974). Available at: http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/19740018186.pdf
Kahneman, D.: Thinking, Fast and Slow. Farrar, Strauss, and Giroux, New York (2011)
Kahneman, D., Tversky, A., Slovic, P.: Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press, New York (1982)
Kok, J.F., Parteli, E.J.R., Michaels, T.I., Karam, D.B.: The physics of wind-blown sand and dust. Rep. Prog. Phys. 75, 106901 (2012). Available at http://arxiv.org/ftp/arxiv/papers/1201/1201.4353.pdf
Kyburg, H.E., Jr., Smokler, H.E. (eds.): Studies in Subjective Probability. Wiley, New York (1964)
Laplace, P.-S., marquis de, Essai philosophique sur les probabilities (1814). English translation, Dover, New York (1951)
Loève, M.: Probability Theory, 4th edn. 1963, Springer, New York (1977)
Luce, R.D., Howard R.: Games and Decisions: Introduction and Critical Survey. Wiley, New York (1957) Reprinted by Dover (1989)
Morgan, M.G.: The use (and abuse) of expert elicitation in support of decision making for public policy. Proc. Natl. Acad. Sci. 111, 7176–7184 (2014)
Morgan, M.G.: Commentary: our knowledge of the world is not simple: policy makers should deal with it. Risk Anal. 35(1), 19–20 (2015)
National Research Council: Understanding Risk: Informing Decisions in a Democratic Society. National Academy Press, Washington, D.C. (1996)
National Research Council: Public Participation in Environmental Assessment and Decision Making. National Academy Press, Washington, D.C. (2008)
Navarro, D., Perfors, A.: An introduction to the Beta-Binomial Model, University of Adelaide. https://www.cs.cmu.edu/~10701/lecture/technote2_betabinomial.pdf (undated). Last accessed 2 Feb 2016
North, D.W.: The invariance approach to the probabilistic encoding of information. Ph.D. dissertation, Stanford University (1970). Available at: http://www.northworks.net/phd_thesis.pdf
North, D.W.: Limitations, definitions, principles, and methods of risk analysis. Rev. sci. Tech. Off. Int. Epiz. 14(4), 913–923 (1995)
North, D.W.: Review of five books on climate change. Risk Anal. 35(12), 2221–2227 (2015)
North, D.W., Judd, B.R., Pezier, J.P.: New methodology for assessing the probability of contaminating Mars. Life Sci. Space Res. XIII, 103–109. Academie-Verlag, Berlin (1975)
Phillips, L., von Winterfeldt, D.: Reflections on the Contributions of Ward Edwards to Decision Analysis and Behavioral Research, Working paper, London School of Economics. eprints.lse.ac.uk/22711/1/06086.pdf (2006). Chapter 5 in Advances in Decision Analysis. Cambridge University Press, Cambridge (2007)
Pratt, J.: Risk Aversion in the Small and In the Large. Econometrica 32(1/2), 122–136 (1964)
Pratt, J., Raiffa, H., Schlaifer, R.: Introduction to Statistical Decision Theory. MIT, Cambridge (1995)
Raiffa, H.: Decision Analysis: Introductory Lectures on Choices under Uncertainty. Addison-Wesley, Reading (1968)
Raiffa, H., Schlaifer, R.: Applied Statistical Decision Theory. Cambridge, MA: Graduate School of Business, Harvard University, 1961. Reprinted, Wiley Classics Library, New York (2000)
Ramsey, F.P.: Truth and Probability (1926). Reprinted in: Studies in Subjective Probability, Kyburg and Smokler (eds.) 1964. Also, the text of this paper appears in the book by Ramsey, The Foundations of Mathematics and Other Essays. Harcourt Brace and Company, New York (1931) and is available at: http://socserv2.socsci.mcmaster.ca/~econ/ugcm/3ll3/ramseyfp/ramsess.pdf
Savage, L.J.: The Foundations of Statistics. Wiley, New York (1954). 2nd revised edition, Dover, New York (1972)
Space Science Board: National Research Council, Biological Contamination of Mars. National Academy Press, Washington, D.C. http://www.nap.edu/catalog.php?record_id=12305 (1992)
Spetzler, C., Stael von Holstein, C.-A.S.: Probability encoding in decision analysis. Manag. Sci. 22, 340–358 (1975)
Stanford Encyclopedia of Philosophy, Modal Logic entry: http://plato.stanford.edu/entries/logic-modal/. Last accessed 2 Feb 2016
Taleb, N.N.: Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets, 2001, updated second edition. Random House, New York (2005)
Taleb, N.N.: The Black Swan. Random House, New York (2007)
Taleb, N.N.: Antifragile: Things That Gain from Disorder. Random House, New York (2012)
Tetlock, P.E., Gardner, D.: Superforecasting: The Art and Science of Prediction. Crown Publishers, New York (2015)
Tribus, M.: Rational Descriptions, Decisions, and Designs, Pergamon Press, Elmsford (1969)
Vaihinger, H.: The Philosophy of ‘As-If’: A System of the Theoretical, Practical, and Religious Fictions of Mankind. Published in German (1911); in England (1924). Available in a translation by C.K. Ogden, New York, Barnes and Noble. http://en.wikipedia.org/wiki/Hans_Vaihinger (1968). Last accessed 2 Mar 2015
Van Horn, K.S.: Constructing a logic of probable inference: a guide to Cox’s theorem. Int. J. Approx. Reason. 34(1), 3–24 (2003)
Von Neumann, J., Morgenstern, O.: Theory of Games and Economic Behavior, 2nd edn. 1947, paperback edition, 2007, Princeton University Press, Princeton
Von Winterfeldt, D., Edwards, W.: Decision Analysis and Behavioral Research. Cambridge University Press, New York (1986)
Wald, A.: Statistical Decision Functions. Wiley, New York (1950)
Wiki, Arrow’s impossibility theorem: https://en.wikipedia.org/wiki/Arrow%27s_impossibility_theorem. Last accessed 30 Jan 2016
Wiki, Bayesian network: https://en.wikipedia.org/wiki/Bayesian_network. Last accessed 30 Jan 2016
Wiki, Cox’s theorem: https://en.wikipedia.org/wiki/Cox%27s_theorem. Last accessed 30 Jan 2016
Wiki, De Finetti’s theorem: https://en.wikipedia.org/wiki/De_Finetti%27s_theorem. Last accessed 7 Feb 2016
Wiki, Influence diagram: https://en.wikipedia.org/wiki/Influence_diagram. Last accessed on 30 Jan 2016
Wiki, Maxwell-Boltzmann distribution: https://en.wikipedia.org/wiki/Maxwell%E2%80 %93Boltzmann_distribution. See also: http://farside.ph.utexas.edu/teaching/sm1/lectures/node72.html. Both last accessed 7 Feb 2016
Wiki, Monty Hall problem: https://en.wikipedia.org/wiki/Monty_Hall_problem. Last accessed 14 Nov 2015
Wiki, Probability interpretations: http://en.wikipedia.org/wiki/Probability_interpretations. Last accessed 17 Nov 2015
Wiki, Project Stormfury: https://en.wikipedia.org/wiki/Project_Stormfury. Last accessed 15 Nov 2015
Wiki, Voting paradox: https://en.wikipedia.org/wiki/Voting_paradox. Last accessed 30 Jan 2016
Winkler, R.: Equal versus differential weighting in combining forecasts. Risk Anal. 31(1), 16–18 (2015)
Acknowledgements
This chapter draws from presentations on the two case studies at the November 2014 meeting of INFORMS (Institute for Operations Research and the Management Sciences) in San Francisco, on the occasion of the 50th Anniversary of Decision Analysis honoring its founders, Stanford University Professor Ronald Howard and Harvard University Professor Howard Raiffa. The author wishes to acknowledge the collaboration with colleagues in the two case studies, and appreciation to Tony Cox for detailed comments on the initial draft of this chapter. The author expresses gratitude to these and other colleagues over 50 years in decision and risk analysis for the many insights learned about assessing uncertainties and values in a decision support context.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this entry
Cite this entry
North, D.W. (2016). Decision Analytic and Bayesian Uncertainty Quantification for Decision Support. In: Ghanem, R., Higdon, D., Owhadi, H. (eds) Handbook of Uncertainty Quantification. Springer, Cham. https://doi.org/10.1007/978-3-319-11259-6_41-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-11259-6_41-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Online ISBN: 978-3-319-11259-6
eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering