Abstract
This paper presents a sequence of fuzzy mean difference divergence measures. The validity of these fuzzy mean difference divergence measures is proved axiomatically. In addition, it introduces a sequence of inequalities among some of these fuzzy mean difference divergence measures. The applications of proposed fuzzy mean difference divergence measures in the context of pattern recognition have been presented using a numerical example. It is shown that the proposed fuzzy mean difference divergence measures are well suited to use with linguistic variables. Finally, on establishing inequalities, we find that our proposed measures are computationally much more efficient.
Similar content being viewed by others
Introduction
Shannon (1948) was first to use the word “entropy” to measure an uncertain degree of the randomness in a probability distribution. Entropy as a measure of fuzziness was first introduced by Zadeh (1968). There is an intrinsic similarity between two equations however Shannon entropy measures the average uncertainty in bits associated with the prediction of outcomes in a random experiment, but the entropy of fuzzy set describes the degree of fuzziness in a fuzzy set. The concept of fuzzy sets proposed by Zadeh (1968) has proven useful in the context of pattern recognition, image processing, speech recognition, bioinformatics, fuzzy aircraft control, feature selection, decision making, etc.
Entropy, as a very important notion for measuring fuzziness degree or uncertain information in fuzzy set theory, has received a great attention. For example, Kullback and Leibler (1951) obtained the measure of directed divergence between two probability distributions. Bhandari and Pal (1993) presented some axioms to describe the measure of directed divergence between fuzzy sets, which is proposed corresponding to Kullback and Leibler (1951) measure of directed divergence. Thereafter, many other researchers have studied the fuzzy divergence measures in different ways and provide their application in different areas. In 1999, Fan and Xie introduced the divergence measure based on exponential operation and studied its relation with divergence measure introduced in Bhandari and Pal (1993). Montes et al. (2002) studied the special classes of divergence measures and used the link between fuzzy and probabilistic uncertainty. Parkash et al. (2006) proposed two fuzzy divergence measures corresponding to Ferreri (1980) probabilistic measure of directed divergence. Ghosh et al. (2010) gave the application of Bhandari and Pal (1993) divergence measure in the area of automated leukocyte recognition. Bhatia and Singh (2012) proposed the fuzzy divergence measure corresponding to Taneja (2008) Arithmetic–geometric divergence measure.
In the recent years, many authors have introduced various divergence measures between fuzzy sets. We introduce a sequence of fuzzy mean difference divergence measures and established the inequalities among them to explore the fuzzy inequalities. The advantage of establishing the inequalities is to make the computational work much simpler. The technique of inequalities provides a better comparison among fuzzy mean divergence measures.
Preliminaries on fuzzy divergence measures
Fuzziness, a feature of uncertainty, results from the lack of sharp difference of being or not being a member of the set, i.e., the boundaries of the set under consideration are not sharply defined. A fuzzy set A defined on a universe of discourse X is given as Zadeh (1965):
where μ A : X → [0, 1] is the membership function of A. The membership value μ A (x) describes the degree of the belongingness of x ∈ X in A. When μ A (x) is valued in {0, 1}, it is the characteristic function of a crisp (non-fuzzy) set. Zadeh (1965) gave some notions related to fuzzy sets, one of them which we shall need in our discussion, is as follows:
The measure of information defined by Shannon (1948) is given by
Taking into consideration the concept of fuzzy sets, De Luca and Termini (1972) introduced the measure of fuzzy entropy corresponding to Shannon’s entropy given in (2) as
Kullback and Leibler (1951) obtained the measure of directed divergence of probability distribution P = (p1, p2, … p n ) from probability distribution Q = (q1, q2, … q n ) as
Measure of fuzzy divergence between two fuzzy sets gives the difference between two fuzzy sets and this measure of distance/difference between two fuzzy sets is called the fuzzy divergence measure.
Bhandari and Pal (1993) introduced the measure of fuzzy directed divergence corresponding to (4) as
The fuzzy mean divergence measures corresponding to seven geometrical mean measures given in Taneja (2012) are presented in Table 1.
We have the following Lemma in fuzzy context corresponding to the Lemma of Taneja (2005):
Lemma 1: Let f : I ⊂ R+ → R be a convex and differentiable function satisfying . Consider a function
Then the function φ f (a, b) is convex . Additionally, if f′(1/2) = 0, then the following inequality holds:
Lemma 2: Schwarz’s Lemma: Let f1, f2 : I ⊂ R+ → R be two convex functions satisfying the assumptions:
-
i)
;
-
ii)
f1 and f2 are twice differentiable in R+;
-
iii)
there exist the real constants α, β such that 0 ≤ α < β and , , for all z > 0 then we have the inequalities:
for all a, b ∈ (0, 1), where the function φ(.)(a, b) is defined as
Results and discussion
Sequence of fuzzy mean difference divergence measures
Corresponding to the fuzzy mean divergence measures defined in Table 1, we propose a sequence of fuzzy mean difference divergence measures as follows:
Theorem 1: All the proposed measures (6) - (23) are valid measures of fuzzy mean difference directed divergence.
Proof: (a) Non-negativity: From one of inequality in Taneja (2012), for two fuzzy sets A and B, we have H(A, B) ≤ G(A, B) ≤ N(A, B) ≤ A(A, B) ≤ R(A, B) ≤ S(A, B) ≤ C(A, B).
Hence, the condition of non-negativity of measures (6) - (23) is proved.
Also clearly, for all measures from (6) - (23) where A1 and B1 belongs to the fuzzy mean divergence measures given in Table 1.
(b) Invariant under complementation: From the notion of compliment of a fuzzy set given in (1) we can easily check for measures (6) - (23) that .
(c) Convexity: Now we shall prove the condition of convexity of measures (6) - (23) with the help of Lemma 1.
For simplicity, Let us write where with A1 ≥ B1.
Let us take μ A = z ⇒ μ B = 1 − z. So, corresponding to measures (6) - (23) we have the following generating functions:
Now in all the cases from (24) - (41), we can easily check that . It is understood that z ∈ [0, 1].
The first and second order derivatives of the functions (24) - (41) are as follows:
We see that in the entire cases second order derivative are positive and satisfies for all z ∈ [0, 1]. Thus according to the Lemma 1 and equation (42) - (59), we get the convexity of the measures (6) - (23).
Hence all the defined measures (6) - (23) are valid measures of fuzzy mean difference directed divergence.
Inequalities among fuzzy mean difference divergence measures
Theorem 2: The fuzzy mean difference divergence measures defined in (6) - (23) admit the following inequalities:
i.e., we have the following inequalities:
-
i)
,
-
ii)
,
-
iii)
,
-
iv)
.
Proof: The proof of the above theorem is based on Lemma 2 and is given in parts in the following propositions.
Proposition 1: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SA (A, B) and D SN (A, B) and using (60), we get
Proposition 2: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SA (A, B) and D SH (A, B) and using (61), we get
Proposition 3: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SH (A, B) and D CR (A, B) and using (62), we get
Proposition 4: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CR (A, B) and D CN (A, B) and using (63), we get
Proposition 5: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CR (A, B) and D SG (A, B) and using (64), we get
Proposition 6: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SN (A, B) and D CN (A, B) and using (65), we get
Proposition 7: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SN (A, B) and D SG (A, B) and using (66), we get
Proposition 8: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CN (A, B) and D CS (A, B) and using (67), we get
Proposition 9: We have D CS ≤ 3D AN
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CS (A, B) and D AN (A, B) and using (68), we get
Proposition 10: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CN (A, B) and D CG (A, B) and using (69), we get
Proposition 11: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D SG (A, B) and D RG (A, B) and using (70), we get
Proposition 12: We have
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D CG (A, B) and D RG (A, B) and using (71), we get
Proposition 13: We have D RG ≤ 5D AN
Proof: Let us consider the function
This gives
And we have
Applying Lemma 2 for the difference of fuzzy means D RG (A, B) and D AN (A, B) and using (72), we get
Application of fuzzy mean difference divergence measures to pattern recognition
We now present the application of the proposed fuzzy mean difference divergence measures in the context of pattern recognition. Next, an example related to pattern recognition is given to demonstrate the results obtained by the fuzzy mean difference divergence measures (6) - (23).
In order to demonstrate the application of the introduced fuzzy mean difference divergence measures to pattern recognition, suppose that we are given three known patterns P1, P2 and P3 which have classifications C1, C2 and C3 respectively. The patterns are represented by the following fuzzy sets in the universe of discourse X = {x1, x2, x3, x4}:
Given an unknown pattern Q, represented by the fuzzy set
Our aim is to classify Q to one of the classes C1, C2 and C3. According to the principle of minimum divergence/discrimination information between fuzzy sets, the process of assigning Q to is described by
Table 2 presents D AB (P k , Q), k = {1, 2, 3}. It is observed that Q has been classified to C3 correctly.
Numerical example
We now establish that the proposed fuzzy mean difference divergence measures (6) - (23) are reliable in applications with compound linguistic variables.
Example: Let F = {(x, μ F (x))/x ∈ X} be a fuzzy set in X. Tomar and Ohlan (2014) defined for any positive real number n, from the operation of power of a fuzzy set: Fn = {(x, [μ F (x)]n)/x ∈ X}.
Using the above operation, the concentration and dilation of a fuzzy set F are as follows:
CON (F) and DIL (F) are treated as “very (F)” and “more or less (F)”, respectively.
We consider F in X = {x1, x2, x3, x4, x5} defined as:
By taking into account the characterization of linguistic variables, we regard F as “LARGE” in X. Using the operations of concentration and dilation
F1/2 may be treated as “More or less LARGE”,
F2 may be treated as “Very LARGE”,
F4 may be treated as “Vey very Large”.
The proposed fuzzy mean difference divergence measures are used to calculate the degree of divergence/distance between these fuzzy sets. The divergence/distance values have been calculated by Eqs. (6) - (23) between different fuzzy sets. The comparative results are summarized in Table 3. For convenience, we use the notation * (i) in Table 3 to present the divergence/distance value computed from equation i. The following abbreviated notions are used in Table 3.
L.: LARGE
M.L.L.: More or less LARGE
V.L.: Very LARGE
V.V.L.: Very very LARGE
From the viewpoint of mathematical operations and the characterization of linguistic variables, the divergence/distance between the above fuzzy sets has the following requirements:
From the numerical results presented in Table 3, we see that the proposed fuzzy mean difference divergence measures (6) - (23) satisfy the requirement (73) - (76). Therefore, the proposed fuzzy mean difference divergence measures are consistent in the application with compound linguistic measures.
Conclusion
To sum up, we present a sequence of fuzzy mean difference divergence measures. We also establish a sequence of inequalities among some of the proposed fuzzy mean difference divergence measures. An application of the proposed divergence measures in the field of pattern recognition is established. A numerical example is used to present the consistency of these divergence measures in application with compound linguistic variables. Numerical results show that the fuzzy mean difference divergence measures are much simpler with the difference of the means involved.
References
Bhandari D, Pal NR: Some new information measures for fuzzy sets. Inf Sci 1993, 67(3):209-228. 10.1016/0020-0255(93)90073-U
Bhatia PK, Singh S: Three families of generalized fuzzy directed divergence. AMO-Adv Model Optim 2012, 14(3):599-614.
De Luca A, Termini S: A definition of non-probabilistic entropy in the setting of fuzzy set theory. Inf Control 1972, 20(4):301-312. 10.1016/S0019-9958(72)90199-4
Fan J, Xie W: Distance measures and induced fuzzy entropy. Fuzzy Sets Syst 1999, 104(2):305-314. 10.1016/S0165-0114(99)80011-6
Ferreri C: Hyperentropy and related heterogeneity divergence and information measures. Statistica 1980, 40(2):155-168.
Ghosh M, Das D, Chakraborty C, Roy AK: Automated leukocyte recognition using fuzzy divergence. Micron 2010, 41(7):840-846. 10.1016/j.micron.2010.04.017
Kullback S, Leibler RA: On information and sufficiency. Ann Math Stat 1951, 22(1):79-86. 10.1214/aoms/1177729694
Montes S, Couso I, Gil P, Bertoluzza C: Divergence measures between fuzzy sets. Int J Approx Reason 2002, 30(2):91-105. 10.1016/S0888-613X(02)00063-4
Parkash O, Sharma PK, Kumar S: Two new measures of fuzzy divergence and their properties. SQU J Sci 2006http://web.squ.edu.om/squjs/volum11/MATH041130-corrected.pdf
Shannon CE: A mathematical theory of communication. Bell Syst Tech J 1948http://cm.bell-labs.com/cm/ms/what/shannonday/shannon1948.pdf10.1002/j.1538-7305.1948.tb01338.x
Taneja IJ: Refinement of Inequalities among Means. 2005. Available online: http://arxiv.org/pdf/math/0505192v2.pdf
Taneja IJ: On mean divergence measures. In Advances in Inequalities from Probability Theory and Statistics. Edited by: Barnett NS, Dragomir SS. USA: Nova; 2008:169-186.
Taneja IJ: Inequalities having Seven Means and Proportionality Relations. 2012. Available online: http://arxiv.org/pdf/1203.2288v1.pdf
Tomar VP, Ohlan A: Two new parametric generalized R–norm fuzzy information measures. Int J Comp Appl 2014http://research.ijcaonline.org/volume93/number13/pxc3896029.pdf
Zadeh LA: Fuzzy sets. Inf Control 1965, 8(3):338-353. 10.1016/S0019-9958(65)90241-X
Zadeh LA: Probability measures of fuzzy events. J Math Anal Appl 1968, 23(2):421-427. 10.1016/0022-247X(68)90078-4
Acknowledgements
The authors would like to thank the editor and two anonymous referees of this journal for their constructive suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Both authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Tomar, V.P., Ohlan, A. Sequence of inequalities among fuzzy mean difference divergence measures and their applications. SpringerPlus 3, 623 (2014). https://doi.org/10.1186/2193-1801-3-623
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/2193-1801-3-623