1 Introduction

Maxmin expected utility (MMEU), axiomatized by Gilboa and Schmeidler (1989), is one of the best-studied alternatives to subjective expected utility (SEU) maximization (Savage 1954). Its compatibility with ambiguity-averse preferences makes it an attractive descriptive decision model, in light of experimental evidence (e.g., the Allais Paradox, Allais 1953 and the Ellsberg Paradox, Ellsberg 1961) showing that intuitive decisions may violate the ambiguity neutrality, or “independence”, property implied by the SEU model. In the (multiple priors) MMEU decision model, there is a set of possible probability distributions over the state space, each giving rise to a (potentially different) expected utility value for each object of choice. An MMEU decision maker chooses an option that maximizes the minimum of such expected utility values.

However, even MMEU may be too restrictive a model for representing reasonable decision-making. For example, Chateauneuf and Faro (2009) (henceforth CF) point out that MMEU does not allow “attraction for smoothing an uncertain act with the help of a positive constant act”, a property that is intuitively reasonable and is demonstrated in Example 5.2.

To deal with this, CF consider a “weighted” version of maxmin expected utility (Gilboa and Schmeidler 1989). Recall that in the MMEU model, beliefs are represented by a set of probability measures over the state space. The distributions that are in the set are viewed as the possible distributions over the states. However, sometimes it makes sense to treat some distributions as “more likely” than other distributions, rather than just separating the distributions into two groups (“possible” and “impossible”). CF provide a method of treating distributions differently, by assigning a confidence value to each distribution.

Others have independently studied similar models. Klibanoff et al. (2005) propose a model of decision making that associates weights with probability measures, but makes decisions based on a “weighted” expected utility function. Maccheroni et al. (2006) study a model of decision making where additive, instead of multiplicative, weights are associated with probability measures. Hayashi (2008) considers a model of expected regret minimization where the regret associated with each state is taken to a positive power before the expectation is taken. In a previous work Halpern and Leung (2012), we have also considered associating multiplicative weights with probability measures in expected regret minimization. Others have also proposed and studied approaches of representing uncertainty that are similar to weighted probabilities (see, e.g., de Cooman 2005; Moral 1992; Walley 1997).

In the CF model, a high confidence value on a probability measure can be interpreted as the probability measure being “significant” or “likely to be the correct distribution”, while a low confidence value on a probability measure is interpreted as the probability measure being insignificant or unlikely to be the correct distribution. These confidence values are used to scale the expected utilities of the acts in a way that reflects the relative significance of each probability measure. Since larger weights should always magnify the influence of a distribution, one must restrict to either nonnegative or nonpositive utilities. CF choose to restrict to nonnegative utilities, and they multiply the expected utilities by the multiplicative inverse of the associated confidence value. The maxmin expected utility criterion is then used to compare utility acts based on these “weighted” expected utilities. In this paper, we use the term weight to refer to the final real number by which we multiply the expected utilities. In the CF model, the weight is obtained by taking the multiplicative inverse of the confidence value. Multiplying by the inverse ensures that probability measures with low confidence have a smaller effect, since they are less likely to give the minimum expected utility. This generalization of the maxmin expected utility decision rule allows for a “smoothing” effect. Instead of simply being in or out of the set of probability measures considered possible, probability measures now have finer weights associated with them.

However, CF also introduce a numerical confidence threshold \(\alpha _0 > 0\); a probability measure is “discarded” (i.e., ignored) if its confidence value is below this threshold \(\alpha _0\). This threshold affects the resulting behavior of the decision model, as captured by the axioms characterizing the decision model. Having this threshold seems to be incompatible with the intuition behind weights. If a probability measure has low weight, we should perhaps take it less seriously than the one with high weight, but there seems to be no good reason to ignore it altogether. Therefore, we define a simpler version of the decision rule where there is no threshold \(\alpha _0\). This simplified decision rule is characterized by removing one of the CF axioms.

Another problem with the CF approach is that of using the multiplicative inverse of the confidence value as the weight on the expected utilities. This choice seems rather arbitrary. Why not use the square of the inverse? We show that any monotonically decreasing transformation that maps (0, 1] onto \({\mathbb {R}}^+\) (the nonnegative reals) satisfies the same axioms. Although all these transformations are characterized by the same axioms, different transformations may lead to quite different decisions.

It is not clear which transformation function is the “right” one. There is no compelling argument for using \(\frac{1}{x}\) rather than, say, \(\frac{1}{x^2}\). Our axiomatization leads to some important observations:

  1. 1.

    What is important is the composition \(t\circ \; \phi \) of the transformation function t and the confidence function \(\phi \), not the confidence function itself nor the transformation function itself; it is the composition that determines the preferences.

  2. 2.

    Confidence values have no cardinal meaning: a confidence value of \(\frac{1}{2}\) can have the same meaning as a confidence value of \(\frac{1}{3}\) if the transformation t changes.

Moreover, as our results show, the confidence value and the transformation interact. In our earlier work on minimax weighted expected regret (Halpern and Leung 2012), we were able to get a strong uniqueness result in the context of regret by multiplying the probability measure by the weight. That is, instead of considering the set of probability measures and the associated weights separately, we consider what we called subprobability measures, which are probability measures “scaled” by a weight in [0, 1]. By looking at these subprobability measures, we were able to find natural properties to ensure the uniqueness of the representation. Here, we show that by multiplying the probability measure by the weight, we can get a uniqueness result analogous to that for regret.

With weighted regret, there is no need to apply a transformation to the confidence values. The weights are simply the confidence values. Equivalently, the identify function is a valid transformation for weighted regret. We show that for maxmin weighted expected utility, if we restrict to nonpositive utilities instead of nonnegative utilities, we can also take the transformation to be the identity function. That is, we can just multiply the expected utilities by a confidence value without applying any transformations. We then replace the axiom saying that there is a worst outcome with one saying that there is a best outcome. This results in essentially the same representation theorem.

The rest of this paper is organized as follows. Section 2 sets up some preliminary definitions. Section 3 presents the CF model and some of their results. Section 4 considers a generalization of the CF model. Section 5 presents a simpler model and provides a representation theorem. Proofs are collected in the appendices.

2 Formal definitions

In this section, we provide definitions that will be used to present the CF results, as well as to develop our new results. We restrict to what is known in the literature as the AnscombeAumann (AA) framework (Anscombe and Aumann 1963), where outcomes are restricted to lotteries. This framework is standard in the decision theory literature; axiomatic characterizations of SEU (Anscombe and Aumann 1963) and MMEU (Gilboa and Schmeidler 1989) have been obtained in the AA framework.

We assume that the state space S is associated with a sigma algebra, and we let \(\Delta (S)\) denote the set of all probability distributions on S. Given a set X (which we view as consisting of prizes or outcomes), a lottery over X is just a probability distribution on X with finite support. Let \(\underline{\Delta }(X)\) be the set of all lotteries. In the AA framework, the set of outcomes is \(\underline{\Delta }(X)\). So, now acts are functions from the state space S to \(\underline{\Delta }(X)\). (Such acts are sometimes called AnscombeAumann acts.) We denote the set of all acts by \(\mathcal {F}\). The technical advantage of considering such a set of outcomes is that we can consider convex combinations of acts. If f and g are acts, define the act \(\alpha f + (1-\alpha )g\) to be the act that maps a state s to the lottery \(\alpha f(s) + (1-\alpha )g(s)\).

Given a utility function U on prizes in X, the utility of a lottery \(l \in \underline{\Delta }(X)\) is just the expected utility of the prizes obtained, that is,

$$\begin{aligned} u(l) = \sum _{\{x \in X :l(x)>0\}} l(x) U(x). \end{aligned}$$

This makes sense since l(x) is the probability of getting prize x if lottery l is played. The expected utility of an act f with respect to a probability p on states is then just \(u(f) = \int _{ S} u(f(s)) dp\), as usual.

3 CF maxmin expected utility with confidence functions

The CF approach is formalized as follows. Let \(\phi : \Delta (S) \rightarrow [0,1]\) be a confidence function on the probability measures, and let u be a utility function on lotteries over X with values in \({\mathbb {R}}^+\) (all instances of \({\mathbb {R}}^+\) in this paper include 0). Let \(L_{\alpha _0} \phi \) denote the set \(\{ p \in \Delta (S) : \phi (p) \ge \alpha _0\}\) for \(\alpha _0 \in (0,1]\).

Definition 3.1

Define \(\succeq _{\phi }^{+,\alpha _0}\) so that

$$\begin{aligned} f\succeq ^{+,\alpha _0}_\phi g \Leftrightarrow \min _{p \in L_{\alpha _0} \phi } \frac{1}{\phi (p)} \int _S{ u(f) dp} \ge \min _{p \in L_{\alpha _0} \phi } \frac{1}{\phi (p)} \int _S{ u(f) dp}. \end{aligned}$$

The superscript \(+\) on \(\succeq ^{+,\alpha _0}_{\phi }\) indicates that the preference is defined for nonnegative utilities. Note that, according to Definition 3.1, a probability measure that has a confidence value (according to \(\phi \)) lower than \(\alpha _0\) is simply discarded. The analogy to maxmin expected utility of Gilboa and Schmeidler (1989) is that the probability measure is not in the belief set. Indeed, if \(\alpha _0 = 1\), then the CF approach essentially reduces to maxmin expected utility.

CF call confidence functions satisfying the following properties regular* fuzzy sets.

Definition 3.2

The set of regular* fuzzy sets consists of all mappings \(\phi : \Delta (S) \rightarrow [0,1]\) satisfying the following properties:

  1. (a)

    \(\phi \) is normal: \( \{ p \in \Delta (S) : \phi (p) = 1 \} \ne \emptyset .\)

  2. (b)

    \(\phi \) is weakly* upper semi-continuous: \( \{p \in \Delta (S) : \phi (p) \ge \alpha \} \) is weakly* closed for all \(\alpha \in [0,1]\).

  3. (c)

    \(\phi \) is quasi-concave:

    $$\begin{aligned} \forall \beta \in [0,1] (\phi (\beta p_1 + (1-\beta )p_2) \ge \min \{ \phi (p_1), \phi (p_2) \}). \end{aligned}$$

One role of regular* fuzzy sets in the CF representation is that the condition provides a canonical representation. That is, every preference order satisfying appropriate axioms can be represented by some utility function, some \(\alpha _0 > 0\), and some regular* fuzzy \(\phi \). Moreover, there is a \(\phi ^*\) within the set of regular* fuzzy sets generating these preferences such that \(\phi ^*\) is maximal in the sense that for every probability measure p, \(\phi ^*\) assigns weakly larger confidence to p than every other regular* fuzzy set generating these preferences.

CF consider the following axioms. In the axioms, the acts f and g are viewed as being universally quantified; given an outcome \(x \in X\), we write \(x^*\) to denote the constant act that maps all states to the outcome x.

Axiom 1

  1. (a)

    (Transitivity): \(f\succeq g\succeq h\Rightarrow f\succeq h.\)

  2. (b)

    (Completeness): \(f\succeq g \text { or } g\succeq f.\)

  3. (c)

    (Nontriviality): \(f\succ g\) for some acts f and g.

Axiom 2

(Monotonicity). If \((f(s))^* \succeq (g(s))^*\) for all \(s\in S\), then \(f\succeq g\).

Axiom 3

(Continuity). For all \(f,g,h \in \mathcal {F}\), the sets \( \{ \alpha \in [0,1] : \alpha f + (1-\alpha ) g \succeq h\}, \{ \alpha \in [0,1] : h \succeq \alpha f + (1-\alpha ) g\}\) are closed.

Axiom 4

(Worst independence). There exists a worst outcome \(\underline{x} \in X\) such that \(f \succeq \underline{x}^*\) for every \(f\in \mathcal {F}\). Moreover,

$$\begin{aligned} f\sim g \Rightarrow \alpha f + (1-\alpha ) \underline{x}^* \sim \alpha g + (1-\alpha ) \underline{x}^*. \end{aligned}$$

Axiom 4 is reminiscent of Gilboa and Schmeidler’s 1989 C-independence axiom of MMEU; C-independence is stronger in the sense that the independence property needs to hold not only for \(\underline{x}^*\), but all other constant acts as well.

Axiom 5

(Independence on constant acts).

$$\begin{aligned} \forall x,y,z \in X \left( x^* \sim y^* \Leftrightarrow \frac{1}{2} x^* + \frac{1}{2} z^* \sim \frac{1}{2} y^* + \frac{1}{2} z^*\right) . \end{aligned}$$

Axiom 5 is a weaker version of the more common independence axiom for constant acts, where instead of \(\frac{1}{2}\) mixtures, all convex mixtures of the constant acts are allowed. CF chose to present this weaker axiom, since it was shown by Herstein and Milnor 1953 that Axioms 1, 3 and 5 are sufficient to satisfy the premises of the von-Neumann–Morgenstern theorem, which says that there is an expected-utility representation for preferences over constant acts. While we could have used the more standard/stronger versions of the continuity and independence axioms, to make comparisons easier, we use the versions used by CF.

Axiom 6

(Ambiguity aversion).

$$\begin{aligned} f\sim g\Rightarrow pf+(1-p)g \succeq g. \end{aligned}$$

Ambiguity aversion says that when there are two equally good alternatives, the decision maker prefers to hedge between these two alternatives. Ambiguity aversion is also sound for MMEU (Gilboa and Schmeidler 1989).

Axiom 7

(Bounded attraction for certainty). There exists \(\delta \ge 1\) such that for all \(f\in \mathcal {F}\) and \(x,y \in X\):

$$\begin{aligned} x^* \sim f \Rightarrow \frac{1}{2} x^* + \frac{1}{2} y^* \succeq \frac{1}{2} f + \frac{1}{2} \left( \frac{1}{\delta } y^* + \left( 1 - \frac{1}{\delta } \right) \underline{x}^* \right) . \end{aligned}$$

As CF point out, Axiom 6 implies that if an agent is indifferent between an act f and a constant act \(x^*\), then she could strictly prefer the convex combination of f with a constant act \(y^*\) to the combination of \(x^*\) and \(y^*\). In particular, if we let \(y^*=x^*\), then Axiom 6 implies that \(p f + (1-p) y^* \succeq x^* = p x^* + (1-p) y^*\) for all \(p \in [0,1]\). CF explain that Axiom 7 imposes a bound on the affinity for smoothing out an uncertain act with a constant act. Continuing with our example and letting \(\underline{x}^* = 0^*\) (assuming that outcomes are numbers), Axiom 7 implies that \(\frac{1}{2} x^* + \frac{1}{2} y^* \succeq \frac{1}{2} f + \frac{1}{2\delta } y^*\) for some fixed \(\delta \) specified by Axiom 7. The fact that there exists a \(\delta > 1\) such that \(\frac{1}{2} x^* + \frac{1}{2} y^* \succeq \frac{1}{2} f + \frac{1}{2\delta } y^*\) follows from monotonicity. The power of Axiom 7 comes from the fact that there is a single \(\delta \ge 1,\) such that this preference holds for all \(x, y \in X\), and \(f \in \mathcal {F}\).

The Bounded Attraction for Certainty axiom in the CF representation captures the lower bound \(\alpha _0\) in the model. Recall that if the confidence value of a probability measure is less than \(\alpha _0\), then that measure is considered “impossible”, or ignored. CF show that the \(\delta \) in the Bounded Attraction for Certainty axiom can be taken to be \(\frac{1}{\alpha _0}\) in the representation. \(\delta \) is roughly interpreted as an upper bound on how much the mixing of a constant act to an act can make the act more preferable. We essentially take \(\alpha _0 = 0\) all probability measures into account, regardless of their weight, as long as the weight is positive. Since weighted regret already says that regret due to probability measures with low confidence is not taken seriously, there seems to be no reason to ignore probability measures of low confidence altogether. In any case, since we take \(\alpha _0 = 0\), we would expect decision rule to satisfy an unbounded version of attraction for certainty. Our representation theorem shows that such an axiom is not needed to characterize maxmin weighted expected utility.

CF prove the following representation theorem:

Theorem 3.3

(CF representation Theorem Chateauneuf and Faro 2009). A binary relation \(\succeq \) on \(\mathcal {F}\) satisfies Axioms 17 if and only if there exists a unique nonconstant function \(u: X\rightarrow {\mathbb {R}}^+,\) such that \(u_{x_*}=0\), unique up to positive linear transformations, a minimal confidence level \(\alpha _0 \in (0,1]\), and a regular* fuzzy set \(\phi : \Delta (S) \rightarrow [0,1]\) such that \(\succeq = \succeq _{\phi }^{+,\alpha _0}\).

Note that although CF guarantee the existence of a representation with a regular* fuzzy set, the confidence function does not necessarily need to be regular* fuzzy to satisfy Axioms 17. For example, if there are two states, \(s_1\) and \(s_2\), \(p_i\) is the point mass on state \(s_i\) for \(i\in \{1,2\}\), \(\phi (p_1)=\phi (p_2)=1\), and \(\phi (p)=0\) for all other probability measures p, then \(\phi \) is not a regular* fuzzy set, since it is not quasi-concave. Nevertheless, \(\succeq ^{+,\frac{1}{2}}_\phi \) is determined by maxmin expected utility and thus must satisfy Axioms 17, because Axioms 17 are strictly weaker than the axioms for maxmin expected utility (Gilboa and Schmeidler 1989).

4 t-Maxmin weighted expected utility

In this section, we consider a generalization of the CF approach, which we call the t-maxmin weighted decision rule. The t-maxmin weighted rule applies a monotonically decreasing transformation function t to the confidence values and then uses the maxmin criterion on expected utilities multiplied by the transformed confidence values. The CF decision rule is the special case of the t-weighted maxmin decision rule, where \(t(x) = \frac{1}{x}\).

Let \(\phi : \Delta (S) \rightarrow [0,1]\) be a confidence function, \(t : (0,1] \rightarrow {\mathbb {R}}^+\) be a transformation function, and u be a nonnegative utility function.

Definition 4.1

( t -maxmin weighted expected utility). Define \(\succeq ^{+,\alpha _0}_{t,\phi },\) so that

$$\begin{aligned} f \succeq ^{+,\alpha _0}_{t,\phi } g \Leftrightarrow \min _{p \in L_{\alpha _0} \phi } t({\phi (p)}) \int _S{ u(g) dp \ge \min _{p \in L_{\alpha _0} \phi } t({\phi (p)}) \int _Su(f) dp}. \end{aligned}$$

The threshold value \(\alpha _0\) affects the preferences \(\succeq _\phi ^{+,\alpha _0}\) only if it is larger than the smallest confidence value. That is, let \(\alpha _0^*(\phi ) = \max \{ \alpha _0, \inf _{p \in \Delta (S)} \phi (p) \}\). It is easy to see that, for all \(0 < \alpha \le \alpha _0^*(\phi )\), we have \(\succeq _\phi ^{+,\alpha } = \succeq _\phi ^{+,\alpha _0^*(\phi )}.\)

Theorem 4.2 shows that it is not necessary to use the transformation \(t(x) = \frac{1}{x}\) to map confidence values into weights with which expected utilities are multiplied. Other functions, such as \(t(x) = \frac{1}{x^2}\), represent the same class of preference orders. However, there are some constraints on the allowed transformation functions t, since we need to “simulate” \(\frac{1}{\phi (p)}\) with \(t(\phi '(p))\). In addition to being strictly decreasing (a property of \(t(x) = \frac{1}{x}\)), the condition that there exists some \(\beta > 0\) such that \([\beta , \beta / \alpha _0^*(\phi )]\subseteq \mathrm{range}(t)\) guarantees that we can “simulate” \(\frac{1}{\phi (p)}\) with \(t(\phi '(p))\) for some \(\phi '\) and \(\alpha _0'\). Continuity guarantees that we can find a preimage \(\phi '(p)\) for every value in the range of t.

Theorem 4.2

For all measurable spaces \((S,\Sigma )\), consequences X, nonnegative utility functions u, confidence functions \(\phi : \Delta (S) \rightarrow [0,1]\), thresholds \(\alpha _0 > 0\) and strictly decreasing, continuous transformation functions \(t: (0,1] \rightarrow {\mathbb {R}}^+,\) such that there exists some \(\beta > 0\) and \([\beta , \beta / \alpha _0^*(\phi )]\subseteq \mathrm{range}(t)\), there exists \(\alpha _0' > 0\) and \(\phi '\) such that

$$\begin{aligned} \succeq ^{+,\alpha _0}_{\phi } = \succeq ^{+,\alpha '_0}_{t,\phi '}; \end{aligned}$$

also, if \(\phi \) is regular* and \(t(1)=\beta \), then \(\phi '\) is regular*.

Theorem 4.2 highlights another perspective of the t-weighted maxmin expected utility representation. In addition to viewing \(\phi : [0,1]\) as a confidence function which is transformed and then applied to probability measures, we can also view \(t(\phi (p))\) as a weight applied to the probability measure p. In this paper, we use the term weight to refer to a value in \({\mathbb {R}}^+\) with which the expected probability is multiplied, while the term confidence refers to a value in [0, 1] in the sense used by Chateaneuf and Faro. In the theorem statement (and later in the paper), we take \(U^+\) to denote a nonnegative utility function.

A corollary of Theorem 4.2 is a representation theorem for the CF axioms, that is, Axioms 17. Theorem 4.3 requires that \(t(1)>0\), since if \(t(1) \le 0\) and the confidence function is normal, then the preferences will be trivial. Theorem 4.3 provides a stronger uniqueness result than Theorem 3.3.

Theorem 4.3

Let \(t:(0,1]\rightarrow {\mathbb {R}}^+\) be a continuous, strictly decreasing function with \(t(1) > 0\) and \(\lim _{x \rightarrow 0^+} t(x) > c\) for \(c \in {\mathbb {R}}^+\). For all X, \(U^+\), S, \(\alpha _0 > 0\), and \(\phi \), if \(U^+\) is nonconstant and \(\alpha ^*_0(\phi ) \ge c \), then the preference order \(\succeq ^{+,\alpha _0}_{t,\phi }\) satisfies Axioms 17, with \(\delta = \frac{c}{t(1)}\) in Axiom 7. Conversely, if the preference order \(\succeq \) on the acts in \(\mathcal {F}\) satisfies Axioms 17 with \(t(1)\delta \le c\) in Axiom 7, then there exists a nonnegative utility function \(U^+\) on X, a threshold \(\alpha _0 > 0\), and a confidence function \(\phi : \Delta (S) \rightarrow [0,1]\) such that \(\phi \) is regular* fuzzy, \(t \circ \phi \) has convex upper support, and \(\succeq = \succeq ^{+,\alpha _0}_{t,\phi }\). Moreover, \(U^+\) is unique up to positive linear transformations, and if S is finite, there is a sense in which \(\phi \) is unique (see Theorem 5.5).

Proof

That \(\succeq ^{+,\alpha _0}_{t,\phi }\) satisfies Axioms 17 follows from Theorems 3.3 and  4.2, since \(\succeq ^{+,\alpha _0}_{t,\phi } = \succeq ^{+,\alpha _0'}_{\phi '}\) for some \(\alpha _0'\) and \(\phi '\), and \(\succeq ^{+,\alpha _0'}_{\phi '}\) satisfies Axioms 17.

Proving the converse also involves Theorems 3.3 and 4.2. If a preference order satisfies Axioms 17, then by Theorem 3.3 there exists a CF representation. Moreover, the \(\alpha _0\) in the construction of the representation in CF’s proof of Theorem 3.3 is equal to \(\frac{1}{\delta }\), where \(\delta \) is the number in Axiom 7. Also, recall that \(\alpha _0 \le \alpha _0^*\). Therefore, if \(\lim _{x \rightarrow 0^+} t(x) > t(1) \delta \) and \(t(1) > 0\), then for \(\beta = t(1)\), we have \([\beta , \beta / \alpha _0^*(\phi )] \subseteq [\beta , \beta \delta ] \in \mathrm{range}(t)\) over the domain (0, 1]. By Theorem 4.2, we can conclude that there exists a t-weighted maxmin expected utility representation.

The uniqueness claim follows from Theorem 5.5 below, which requires only Axioms 16. \(\square \)

It is well known that for MMEU and regret, the preference order determined by a set P of probability measures is the same as that determined by the convex hull of P. Thus, to get uniqueness, Gilboa and Schmeidler 1989 consider only convex sets of probability measures. In Halpern and Leung (2012), we show that a set of sub-probability measures determine the same minimax weighted expected regret (MWER) preferences as its convex hull. Proposition 4.5 shows that the generalized probability measures behave in much the same way as the probability measures in MMEU and the sub-probability measures in MWER.

Given a set V of generalized probabilities, define the relation \(\succeq _{{V}}\) by taking

$$\begin{aligned} f \succeq _{{V}} g \Leftrightarrow \inf _{p \in {V}} \int _{S} u(f) dp \ge \inf _{p \in {V}} \int _{S} u(g) dp. \end{aligned}$$

It is not difficult to see that we can convert back and forth between the upper support of a weighting function and the weighting function itself. Therefore, we lose no information by looking at the upper support of a weighting function.

Proposition 4.4

\(\succeq _{\overline{V}^{\alpha _0}_{t\circ \phi }} = \succeq ^{+,\alpha _0}_{t,\phi }.\)

Proof

$$\begin{aligned} f \succeq _{\overline{V}^{\alpha _0}_{t\circ \phi }} g \text { iff }&\inf _{ p' \in \overline{V}^{\alpha _0}_{t\circ \phi }} \int _{S} u(f) dp' \ge \inf _{p' \in \overline{V}^{\alpha _0}_{t\circ \phi }} \int _{ S} u(g) dp'\\ \text { iff }&\inf _{\{q : q = t(\phi (p))p, \phi (p) > \alpha _0 \}} \int _{S} u(f) dq \ge \inf _{\{ q : q = t(\phi (p))p, \phi (p) > \alpha _0 \}} \int _{ S} u(g) dq\\ \text { iff }&\inf _{\{p : \phi (p) > \alpha _0 \}} t({\phi (p)}) \int _S{ u(f) dp} \ge \inf _{\{p : \phi (p) > \alpha _0\}} t({\phi (p)}) \int _S{ u(f) dp} \\ \text { iff }&f \succeq ^{+,\alpha _0}_{t,\phi } g, \end{aligned}$$

if \(\phi (p)\) is lower semi-continuous. \(\square \)

Recall that, given a set V in a mixture space, Conv\((V) = \{ \alpha x + (1-\alpha ) y : x,y \in V, \alpha \in [0,1] \}\) is the convex hull of V.

Proposition 4.5

If \(V,V'\) are sets of generalized probability measures and Conv\((V)=\mathrm{Conv}(V')\), then \(\succeq _V = \succeq _{V'}\).

Proof

It suffices to show that V represents the same preferences as Conv(V). Let V be a set of generalized probability measures. Given \(\beta \in [0,1]\), \(p_1,p_2 \in V\), and an act \(f \in \mathcal {F}\), we have

$$\begin{aligned} \beta \int { u(f) dp_1 } + (1-\beta ) \int { u(f) dp_2 } \ge \min \left\{ \int { u(f) dp_1 },\int { u(f) dp_2 }\right\} . \end{aligned}$$

This means that \(\beta p_1 + (1-\beta ) p_2\) can be added to V without changing the preferences, as required. \(\square \)

4.1 Impact of the threshold

In the following example, we examine how Axiom 7 qualitatively affects the weighted maxmin expected utility preferences.

Example 4.6

Suppose there are two states: \(S = \{ s_0, s_1\}\). Consider the confidence function \(\phi \) defined by \(\phi (p) = \sqrt{p(s_1)}\). Like CF, we let \(t(x)=\frac{1}{x}\), and let \(\alpha _0 > 0\) be a fixed threshold value. Let \(\succeq ^{+,\alpha _0}_{\phi }\) be the resulting preference relation. Let f be an act such that \(u(f(s_0))=0\) and \(u(f(s_1)) = 1\). Let \(c^*\) be a constant act with utility \(c>0\). Then we have that

$$\begin{aligned} f \succeq ^{+,\alpha _0}_{\phi } c^* \Leftrightarrow \inf _{\{p : \sqrt{p(s_1)} \ge \alpha _0\}} \sqrt{p(s_1)} \ge c. \end{aligned}$$

This means that f is strictly preferred to all constant acts \(c^*\) with \(c < \alpha _0\), but is considered strictly worse than all constant acts \(c^*\) with \(c > \alpha _0\).

Now compare this to the preference order obtained by considering the same confidence function c and weight function t, but with no threshold on the confidence. Then we have that

$$\begin{aligned} f \succeq ^{+}_{\phi } c^* \Leftrightarrow \inf _{ p \in \Delta (S) } \sqrt{p(s_1)} \ge c. \end{aligned}$$

Since \( \min _{ p \in \Delta (S) } \sqrt{p(s_1)} =0\), this means that f is strictly worse than all constant acts c with \(c > 0\). Clearly, imposing a threshold has a nontrivial impact on the preference order.

We can also show how CF’s Axiom 7 is violated by \(\succeq ^{+}_{\phi }\). Suppose that the worst outcome in this example (i.e., \(\underline{x}\)) is 0. If there is no threshold (or, equivalently, if \(\alpha _0 = 0\)), then \(f \sim 0^*\). Thus, Axiom 7 implies that, for some fixed \(\epsilon >0\), for all outcomes y, we have that \(\frac{1}{2} y^* \succeq \frac{1}{2} f + \epsilon y^*\). However,

$$\begin{aligned} \begin{array}{crll} &{} \frac{1}{2} y^* &{}\succeq _{\phi }^{+,0} \frac{1}{2} f + \epsilon y^*\\ \text { iff } &{}\frac{y}{2} &{}\ge \inf _{ p \in \Delta (S)}\left( \frac{1}{\sqrt{p(s_1)}}\left( p(s_1)\left( \frac{1}{2} + \epsilon y\right) + (1-p(s_1))\epsilon y\right) \right) \\ &{}&{}= \inf _{ p \in \Delta (S) }\left( \frac{\epsilon y}{\sqrt{p(s_1)}} + \frac{1}{2}\sqrt{p(s_1)} \right) \end{array}. \end{aligned}$$

It is easy to see that

$$\begin{aligned} \inf _{ p \in \Delta (S) }\left( \frac{\epsilon y}{\sqrt{p(s_1)}} + \frac{1}{2}\sqrt{p(s_1)} \right) = \sqrt{ 2 \epsilon y }, \end{aligned}$$

which means that for all \(y < 8 \epsilon \), we have that \(\frac{1}{2} y \prec \frac{1}{2} f + \epsilon y\), contradicting Axiom 7.

5 Maxmin weighted expected utility

5.1 Removing the threshold

As discussed in the previous section, it does not seem natural to discard probability measures if their confidence values do not meet some fixed threshold \(\alpha _0 > 0\). We can naturally extend the definition of t-weighted maxmin expected utility to remove the threshold \(\alpha _0\).

Definition 5.1

(t -maxmin weighted expected utility without \(\alpha _0\)). Define \(\succeq ^{+}_{t,\phi }\) so that

$$\begin{aligned} f \succeq ^{+}_{t,\phi } g \Leftrightarrow \inf _{\{p : \phi (p) > 0 \}} t({\phi (p)}) \int _S{ u(g) dp} \ge \inf _{\{p : \phi (p) > 0 \}} t({\phi (p)}) \int _S{ u(f) dp}. \end{aligned}$$

Clearly, \(\succeq ^{+,\alpha _0}_{t,\phi } = \succeq ^{+}_{t,\phi '}\) where \(\phi '(p)=\phi (p),\) if \(\phi (p) \ge \alpha _0\) and \(\phi '(p) = 0\) if \(\phi (p) < \alpha _0\). Thus, \(\succeq ^+_{t,\phi }\) is at least as expressive as \(\succeq ^{+,\alpha _0}_{t,\phi }\).

If we consider CF’s preference order \(\succeq ^{+}_{\phi }\) without a threshold \(\alpha _0\), then as Example 5.2 below shows, Axiom 7 no longer holds.

Example 5.2

Let \(S = \{s_1, s_2\}\). Let the constant act \(\tilde{1}\) have constant utility 1, so that the minimum weighted expected utility of \(\tilde{1}\) is 1 as long as \(\phi \) is normal. Let \(p_c \in \Delta (S)\) be the measure such that \(p_c( s_1 ) = c\) for \(c \in [0,1]\). Let \(\phi \) be a confidence function on \(\Delta (S),\) such that the confidence value for \(p_c \in \Delta (S)\) is

$$\begin{aligned} \phi (p_c) = {\left\{ \begin{array}{ll} 1 ,\quad \text {if } c \ge \frac{1}{2} \\ { \frac{1}{2^{1}}} ,\quad \text {if } c \in [\frac{1}{8}, \frac{1}{2}) \\ { \frac{1}{2^{2}}} ,\quad \text {if } c \in [\frac{1}{32}, \frac{1}{8}) \\ \ldots \\ { \frac{1}{2^{n}}} ,\quad \text {if } c \in \left[ \frac{1}{2^{2n+1}}, \frac{1}{2^{2n-1}}\right) ,\quad \text {for } n \in {\mathbb {N}}. \end{array}\right. } \end{aligned}$$

Clearly, \(\phi \) is normal, since \(\phi (p_{\frac{1}{2}}) = 1\). It is also easy to see from the definition that \(\phi \) is weakly* upper semi-continuous. Lastly, to check quasi-concavity, note that a function which is nondecreasing up to a point and is nonincreasing from that point on is quasi-concave. Therefore, \(\phi \) is quasi-concave.

We describe the utility of an act f on a state space \(S=\{s_1,\ldots ,s_n\}\) using a utility profile with the format \((u(f(s_1)), \ldots , u(f(s_n)))\). Consider the sequence of acts \(\{f_n\}_{n \ge 1}\) with utility profiles as follows:

$$\begin{aligned} f_1&= \left( 2, \frac{2}{7} \right) \\ f_2&= \left( 4, \frac{4}{31} \right) \\ f_3&= \left( 8, \frac{8}{127} \right) \\ \ldots&\\ f_n&= \left( 2^n, \frac{ 2^n }{2^{2n+1} - 1} \right) . \end{aligned}$$

Suppose, by way of contradiction, that there is a fixed \(\delta \in {\mathbb {R}}\) such that \(\succeq ^{+}_{\phi }\) satisfies Axiom 7. In Appendix 2, we show that for all \(n\ge 1\), \(f_n \sim ^{+}_{\phi } \tilde{1}\).

Now, let \(\tilde{m}\) be a constant act with constant utility m. The act \(\frac{1}{2} f_n + \frac{1}{2 \delta } \tilde{\delta }\) has utility \( 2^{n-1} + \frac{1}{2}\) in state \(s_1\) and utility \(\frac{ 2^{n-1} }{2^{2n+1} - 1} + \frac{1}{2}\) in state \(s_2\). If \(c \in [\frac{1}{2^{2m+1}}, \frac{1}{2^{2m-1}})\) for \(m \ge 1\), then the weighted expected utility of \(\frac{1}{2} f_n + \frac{1}{2 \delta } \tilde{\delta }\) with respect to \(p_c\) is at least \(2^{n-m-2} + 2^{m-2}\). This means that if \(n \ge 4 + 2\log _2 \delta \), then the minimum weighted expected utility of \(\frac{1}{2} f_n + \frac{1}{2 \delta } \tilde{\delta }\) is strictly greater than \(\delta \). The details are worked out in Appendix 2.

On the other hand, the minimum weighted expected utility of \(\frac{1}{2} \tilde{1} + \frac{1}{2} \tilde{\delta } \) is \(\frac{1}{2}( 1 + \delta ) < \delta \) for \(\delta \ge 1\). Thus, \(\frac{1}{2} f_n + \frac{1}{2} \frac{1}{\delta } \tilde{\delta } \succ ^+_{t,\phi } \frac{1}{2} \tilde{1} + \frac{1}{2} \tilde{\delta }\) for sufficiently large n, violating Axiom 7 with \(x_{*} = \tilde{0}\). Although Axiom 7 is violated, it is easy to see that Axioms 16 hold. Indeed, as we show that we can get a representation theorem for Axioms 16.

5.2 Maxmin weighted expected utility

It is useful to think of the CF model not as probability measures accompanied by confidence values, but rather as a set of “super-probability measures.” By super-probability measure we mean that by multiplying a probability measure by a positive scalar in \([1,\infty )\), we get a scaled positive vector whose components may sum up to more than 1. A super-probability measure is therefore a nonnegative vector whose components sum to at least 1. This notion is analogous to the sub-probability measures used in our previous work on minimax weighted expected regret (Halpern and Leung 2012), where a sub-probability measure is a nonnegative vector whose components sum to at most 1. Intuitively, a sub-probability measure is obtained by multiplying a probability measure by a scalar weight that is at most 1. We are also interested in sets containing both super- and sub-probability measures. We will call these sets of generalized probability measures.

It is often helpful to consider the set of generalized probability measures supporting the weighting function. For generalized probability measures p and \(p'\), let \(p' \ge p\) if for all \(s \in S, p'(s) \ge p(s)\).

Definition 5.3

(Upper Support). The upper support of a nonnegative weighting function \(t\circ \phi \) is the set \(\overline{V}_{t\circ \phi }=\{p' :\exists p ( \phi (p) > 0 \text { and } p' \ge t(\phi (p))) \} \).

The upper support of \(t\circ \phi \) contains the set of generalized probabilities \(t(\phi (p))p\), as well as all generalized probabilities that are larger. Including these larger generalized probabilities does not change the underlying preferences of the upper support, since these larger generalized probabilities will never provide minimum expected utilities. While adding larger generalized probabilities does not affect the minimum expected utility, working with the upper support turns out to be technically convenient, as we shall see.

Define a relation \(\succeq _{\overline{V}_{t\circ \phi }}\) by taking

$$\begin{aligned} f \succeq _{\overline{V}_{t\circ \phi }} g \Leftrightarrow&\inf _{p \in \overline{V}_{t\circ \phi }} \int _{S} u(f) dp \ge \inf _{p \in \overline{V}_{t\circ \phi }} \int _{S} u(g) dp. \end{aligned}$$

Just as before, we can convert back and forth between the upper support of a weighting function and the weighting function itself. The proof is analogous to that for Proposition 4.4 and is left to the reader.

Proposition 5.4

\(\succeq _{\overline{V}_{t\circ \phi }} = \succeq ^{+}_{t,\phi }.\)

For the results beyond this point, we assume that the state space S is finite, since we make use of results due to Halpern and Leung (2012), which are proved under the assumption of a finite state space.

Theorem 5.5

Let \(t:(0,1]\rightarrow {\mathbb {R}}^+\) be a strictly decreasing function with \(t(1) > 0\). For all X, nonconstant \(U^+\), S, and normal \(\phi \), the preference order \(\succeq ^{+}_{t,\phi }\) satisfies Axioms 16. Furthermore, if t is continuous, \(\lim _{x \rightarrow 0^+} t(x) = \infty \), and the preference order \(\succeq \) on the acts in \(\mathcal {F}\) satisfies Axioms 16, then there exists a nonnegative utility function \(U^+\) on X and a regular* fuzzy confidence function \(\phi : \Delta (S) \rightarrow [0,1],\) such that \(t \circ \phi \) has convex upper support and \(\succeq = \succeq ^{+}_{t,\phi }\). Moreover, \(U^+\) is unique up to positive linear transformations, and \(\phi \) is unique in the sense that if \(\phi '\) is such that \(\succeq ^{+}_{t,\phi '} = \succeq \) and \(\phi '\circ t\) has convex upper support, then \(\phi = \phi '\).

Theorem 5.5 characterizes t-maxmin weighted expected utility without the threshold \(\alpha _0\) of CF. By doing so, we show that the lower bound \(\alpha _0\) on the confidence or weight of probabilities is not a crucial part of the characterization of a weighted version of MMEU. Moreover, we provide a uniqueness result that is in some sense stronger than that by CF (Chateauneuf and Faro 2009), in that our uniqueness result directly identifies a “representative” set of beliefs, while the CF construction (Chateauneuf and Faro 2009) needs to be maximal to be unique. For example, consider a state space S with two states and the regular* fuzzy set \(\phi \) such that \(\phi (p)=1\) for all \(p \in \Delta (S)\). Consider a second regular* fuzzy set \(\phi '\) where \(\phi '(p) = \frac{1}{1 + \min _{s \in S } p(s)} \). It is not difficult to check that both sets induce the same maxmin preferences in the Chateaneuf and Faro representation, since the supports of the two regular* fuzzy sets have the same convex hull.

The requirement that \(\lim _{x \rightarrow 0^+} t(x) = \infty \) is necessary to model probability measures that are arbitrarily close to being “ignored”. This requirement was not necessary in the representation that made use of a lower bound \(\alpha _0\). However, there is another natural way to relax the constraints on t without introducing a lower bound \(\alpha _0\). As we show in the next section, if instead of restricting to nonnegative utilities, we restrict to nonpositive utilities, then we can drop the requirement that \(\lim _{x \rightarrow 0^+} t(x) = \infty \), thus allowing a larger set of transformation functions.

5.3 Nonpositive utilities

Although the preceding results provide a relatively simple characterization of t-weighted maxmin expected utility, we have not yet presented the full picture. In the preceding results, just as in the CF model (Chateauneuf and Faro 2009), we have restricted utilities of acts to be nonnegative. It is easy to see why the restriction to nonnegative utilities was necessary. A larger weight makes positive utilities better, but negative utilities worse. If we were to allow utilities to range over positive and negative values, the resulting decision rule would have very different, rather unintuitive behavior.

It turns out that we can get a simpler decision rule, characterized almost exactlyFootnote 1 by Axioms 16, if we look at nonpositive utilities instead of nonnegative utilities; in this section, we consider a representation that is restricted to nonpositive utilities, rather than nonnegative utilities. We use the notation \(U^-\) to indicate a nonpositive utility function.

Definition 5.6

(Weighted maxmin representation). Given a confidence function \(\phi : \Delta (S) \rightarrow [0,1]\) and strictly increasing transformation function \(t : [0,1] \rightarrow {\mathbb {R}}^+\), define \(\succeq ^-_{t, \phi }\) as follows:

$$\begin{aligned} f \succeq ^-_{t, \phi } g \Leftrightarrow \min _{p \in \Delta (S)} {t( \phi (p))} \sum _{s \in S}{ p(s) u(f,s) } \ge \min _{p \in \Delta (s)} t(\phi (p)) \sum _{s\in S}{ p(s) u(g,s )}. \end{aligned}$$

The \(^-\) superscript on \(\succeq ^{-}_{t,\phi }\) denotes that the relation is defined on acts with nonpositive utilities. One benefit of using nonpositive utilities instead of nonnegative utilities is that we no longer need to transform confidence values \(\phi (p)\) in (0, 1] into multiplicative weights \(t( \phi (p)) \in [0,\infty )\). Instead, because a larger multiplicative confidence value results in utilities that are more negative, we can simply use the confidence function as the weights. Equivalently, we can take t to be the identity. Arguably, this is the most natural choice for t and minimizes concerns regarding which transformation function to use.

We show that preferences generated by the weighted maxmin representation is characterized by Axioms 16, with Axiom 4 replaced by the following axiom:

Axiom 8

(Best act independence). There exists a best outcome \(\overline{x} \in X\) such that \(\overline{x}^* \succeq f\) for every \(f \in \mathcal {F}\). Moreover,

$$\begin{aligned} f\sim g \Rightarrow \alpha f + (1-\alpha ) \overline{x}^* \sim \alpha g + (1-\alpha ) \overline{x}^*. \end{aligned}$$

In the case of nonpositive utilities, as in the case of minimax weighted expected regret (MWER) (Halpern and Leung 2012), it is useful to look at the lower support \(\underline{V} _{t\circ \phi }\) formed by the set of sub-probabilities, defined by

$$\begin{aligned} \underline{V} _{t\circ \phi } = \{ p' : \exists p ( p' \le t(\phi (p))p )\}. \end{aligned}$$

Theorem 5.7

Let \(t: [0,1] \rightarrow {\mathbb {R}}^+\) be a strictly increasing, continuous transformation such that \(t(1) > 0 \ge t(0)\). For all X, nonconstant \(U^-\), S, and regular* fuzzy \(\phi \), the preference order \(\succeq ^-_{t, \phi }\) satisfies Axioms 1356, and 8. Conversely, if a preference order \(\succeq \) on the acts in \(\mathcal {F}\) satisfies Axioms 1356, and 8, then there exists a nonpositive utility function \(U^-\) on X and a confidence function \(\phi : \Delta (S) \rightarrow [0,1]\) such that \(\phi \) is regular* fuzzy, has convex lower support, and \(\succeq = \succeq ^-_{t, \phi }\). Moreover, \(U^-\) is unique up to positive linear transformations, and \(\phi \) is unique in the sense that if \(\phi '\) is such that \(\succeq ^{-}_{t,\phi '} = \succeq \) and \(\phi \circ t\) has convex lower support, then \(\phi = \phi '\).

Note that the transformation t in Theorem 5.7 has domain [0, 1] instead of (0, 1). This is because in a setting with nonpositive utilities, a confidence value of 0 can be mapped to a weight of 0, contributing nothing to the definition of the preferences. This is analogous to a measure being ignored in the case of nonnegative utilities. Furthermore, t is required to be strictly increasing, instead of decreasing, since a larger multiplier amplifies the significance of a negative utility value. We need that \(t(1) > 0\), since if \(t(1) = 0\) then the preferences will be trivial. In the second part of the theorem, we need \(t(0)\le 0\) to find a representation for all possible preferences that satisfy the axioms. For example, suppose the preference \(\succeq \) is such that \((c,0) \sim (c',0)\) for all \(c,c' \in {\mathbb {R}}-\). Intuitively, this means that the first state is ignored. More precisely, any probability measure giving positive probability to the first state should be ignored. If \(t(0) > 0\), then we do not have the representation power to ignore these probability measures. Therefore, we are unable to find a representation for \(\succeq \).

5.4 The case of general acts

We have considered two different settings, one restricted to nonnegative utilities, and the other restricted to nonpositive utilities. One might wonder whether a maxmin weighted expected utility representation could apply to a setting that includes both positive and negative utilities. Recall that in the case of nonnegative utilities, a large positive multiplier on the utility decreases the impact of the constraint or weighted probability measure, while in the case of nonpositive utilities, a large positive multiplier on the utility increases the impact of the constraint or weighted probability measure. As a result, to have reasonable behavior when dealing with both positive and negative utilities, the multiplier on a utility value must depend not only on the probability measure, but also on the utility value itself (whether it is positive or negative).