Abstract
In this paper, a new method for response integration, based on the Choquet integral with interval type 2 Sugeno measures, is presented. Type 1 and interval type 2 fuzzy systems for edge detection based on the Sobel and morphological gradient are used, which is a preprocessing system applied to the training data for better performance in the modular neural network. Fuzzy Sugeno measures are represented by an interval type 2 fuzzy system. The Choquet integral is used as a method to integrate the outputs of the modules of the modular neural networks (MNN). A database of faces was used to perform the preprocessing, the training, and the combination of information sources of the MNN.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
1 Introduction
An integration method is a mechanism which takes input as a number n of data and combines them to form a value representative of the information, methods exist which combine information from different sources which can be aggregation operators as arithmetic mean, geometric mean, ordered weighted averaging (OWA) [1], and inter alia.
Artificial neural networks were introduced by W.S. McCullogh and W. Pitts in 1943 [2] and can be used in a variety of applications; however, there are problems that cannot be processed in a single network either because of their complexity or the amount of information they have; in these cases, a modular neural network (MNN) is used so that each of the modules is responsible for a sub-task or a part of the problem [3–7]. Therefore, it is necessary to have a mechanism to integrate information from different modules to provide the general solution to the problem.
In a MNN, it is common to use some methods such as fuzzy logic type 1 and type 2 [8–10], the fuzzy Sugeno integral [11], interval type 2 fuzzy logic Sugeno integral [12], a probabilistic sum integrator [13], a Bayesian learning method [14], among others, as shown in Fig. 1.
The Choquet integral is an aggregation operator, which has been successfully used in various applications [15–17]. In this paper, the fuzzy Sugeno measures are represented by an interval type 2 fuzzy system in combination with the Choquet integral.
This paper is organized as follows: Sect. 2 shows the concepts of fuzzy measures, interval type 2 fuzzy measures, and Choquet integral which is the technique that was applied for the combination of the several information sources. Section 3 shows edge detection based on Sobel and morphological gradient with interval type 2 fuzzy system. Section 4 shows the modular neural network proposal, and in Sect. 5, the simulation results are shown. Finally, Sect. 6 shows the Conclusions.
2 Fuzzy Measures and Choquet Integral
Initially, Michio Sugeno defined the concept of “fuzzy measures and fuzzy integral” in 1974 [18]. A fuzzy measure is a non-negative monotone function of defined values in “classical sets.” Currently, when referring to this topic, the term “fuzzy measures” has been replaced by the term “monotonic measures,” “non-additive measures,” or “generalized measures” [19–21]. When fuzzy measures are defined on fuzzy sets, we speak about monotonous fuzzified measures [21].
2.1 Fuzzy Measure
If \(x = \left\{ {x_{ 1} ,x_{ 2} , \ldots ,x_{n} } \right\}\) is a finite set, a fuzzy measure μ with respect to the data set X is a function \(\mu :2^{x} \to [0,1]\) that must satisfy the following conditions:
-
(1)
\(\mu\)(X) = 1; \(\mu\)(∅) = 0
-
(2)
If A ⊆ B, then \(\mu\)(A) ≤ \(\mu\)(B)
where in the second condition, A and B are subsets of X.
A fuzzy measure is a Sugeno measure or λ-fuzzy, if it satisfies condition (1) of addition for some λ > −1.
where \(\lambda\) can be calculated with (2):
The value of the λ parameter is determined by the conditions of the Theorem 1.
Theorem 1
Let \(\mu \left( {\left\{ x \right\}} \right) < 1\) for each x ∈ X and let \(\mu \left( {\left\{ x \right\}} \right) > 0\) for at least two elements of X, then ( 2 ) determines a unique parameter \(\lambda\) in the following way:
-
If \(\sum\limits_{x \in X} \mu \left( {\{ x\} } \right) < 1,\;then\;is\;in\;the\;interval\;(0,\infty ).\)
-
\(If\; \mathop \sum \limits_{x \in X} \mu \left( {\{ x\} } \right) = 1,\,then\;\lambda = 0;\) That is the unique root of the equation.
-
If \(\sum\limits_{x \in X} \mu \left( {\{ x\} } \right) > 1,\;then\;\lambda \;is\;in\;the\;interval\;( - 1,0).\)
The fuzzy measure represents the importance or relevance of the sources when computing the aggregation [ 22 ], and the method to calculate Sugeno measures is performed recursively using ( 3 ) and ( 4 ).
where \(A_{i}\) represents the fuzzy measure and \(M_{i}\) represents the fuzzy density determined by an expert, where \(1 < M_{i} \le \ldots \le n\) should be permuted with respect to the descending order of their respective \(\mu (A_{i} ).\)
2.2 Fuzzy Measures for Interval Type 2 Fuzzy Sets
For the estimation of the fuzzy densities of each information source, we take the maximum value of each X i , where an interval of uncertainty is added.
You need to add an uncertainty footprint or FOU which will create an interval based on the fuzzy density. Equation (5) can be used to approximate the center of the interval for each fuzzy density, and Eqs. (6) and (7) are used to estimate left and right values of the interval for each fuzzy density. Note that the domain for \(\mu_{L} (x_{i} )\) and \(\mu_{U} (x_{i} )\) is given in Theorem 1 [23].
Calculation of the fuzzy densities:
Calculating the parameters \(\lambda_{L}\) and \(\lambda_{U}\) for each side of the interval with (8) and (9)
Once the λ U , λ L are obtained, parameters can be calculated fuzzy measures left and right by extending the recursive formulas (10, 11) (12, 13):
There are two types of integral that performed the calculation of Sugeno measures: the integral of Sugeno and Choquet Integral.
2.3 Choquet Integral
The Choquet integral can be calculated using (14) or an equivalent expression (15)
with A 0 = 0,
or also
with D (n+1) = 0,
where \(A_{i}\) represents the fuzzy measurement associated with data \(D_{i}\).
3 Edge Detection
Edge detection can be defined as a method consisting of identifying changes that exist in the light intensity, which can be used to determine certain properties or characteristics of the objects in the image.
We used the ORL Database of Faces [24] to perform the training of the modular neural network, which has images of 40 people with 10 samples of each individual. To each of the images was applied to a preprocessing by making use of Sobel edge detector and morphological gradient with type 1 and type 2 fuzzy logic system [25] in order to highlight features, some of the images can be displayed in Fig. 5b, d.
3.1 The Morphological Gradient
To perform the method of morphological gradient, we need to calculate every one of the four gradients as commonly done in the traditional method using (16–20), see Fig. 2; however, the addition of the gradients is performed by a type 1 and type 2 fuzzy system [25]; in Fig. 3, the membership functions of the fuzzy system are shown, and the resulting image can be viewed in Fig. 5b, d.
3.2 Sobel
The Sobel operator is applied to a digital image in gray scale is a pair of 3 × 3 convolution masks, one estimating the gradient in the x-direction (columns) (21) and the other estimating the gradient in the y-direction (rows) (22) [26].
If we have I m,n as a matrix of m rows and r columns, where the original image is stored, then g x and g y are matrices having the same dimensions as I, which at each element contains the horizontal and vertical derivative approximations and are calculated by (23) and (24) [25].
In the Sobel method, the gradient magnitude g is calculated by (25).
For the type 1 and type 2 fuzzy inference systems, 3 inputs can be used, in which 2 of them are the gradients with respect to the x-axis and y-axis, calculated with (23) and (24), which we call DH and DV, respectively. The third variable m is the image after the application of a low-pass filter hMF in (26); this filter allows to detect image pixels belonging to regions of the input where the mean gray level is lower. These regions are proportionally more affected by noise, which it is supposed to be uniformly distributed over the whole image [26]. The membership functions of interval type 2 system are shown in Fig. 4.
After applying the type 1 and type 2 edge detector with Sobel Method, the resulting image can be viewed in Fig. 5c, e.
4 Modular Neural Networks
We trained a MNN of 3 modules with the data set of ORL. To each image, a methodology of edge detector was applied as described in Sect. 3 and then the image was divided into three horizontal sections, each of which was used as training data in each of the modules, as shown in Fig. 6.
The integration of the modules of the MNN was performed with the Choquet integral (14) and (15). In Table 1, we can appreciate the data distribution of the database.
4.1 Training Parameters
-
Training method: gradient descendent with momentum and adaptive learning rate back-propagation (Traingdx).
-
Each module of the MNN has two hidden layers [200 200].
-
Error goal: 0.00001.
-
Epochs: 500.
In Table 2, the distribution of the training data in the MNN is shown; 70 % of data are used for training, 15 % for validation, and the other 15 % for testing.
4.2 The Experiment Consists of a Modular Neural Network Recognition System and Choquet Integral for the Modules Fusion
The experiment consist on apply a preprocessing at the images through an edge detector on database of faces ORL to obtain a data set with which we train a modular neural network, this with the purpose of compare the recognition rate obtained using the k-fold cross validation method [27], see Table 3.
In the experiments, we performed 27 tests in each simulation of the trainings with each edge detector making variations in fuzzy densities and performing the calculation of the parameter λ U and λ L with the bisection method.
In Table 4, the parameters shown are used for the integration of information; the first column shows the tests number performed, the second shows the diffuse density associated with each information source—in this case each one of the 3 modules—and the third and fourth columns show the value of lambda for the upper λ U and lower λ L intervals calculated from the fuzzy densities.
5 Simulation Results
In Table 5, are shown an example of the results obtained for face recognition. For this case, the preprocessing of the image is done with the interval type-2 morphological gradient edge detector, and the aggregation method used for the MNN is the interval type-2 Choquet integral.
In Table 6, the percentage of recognition of the Choquet integral with each interval edge detector is displayed, and a higher percentage of recognized with the usage of the type 2 edge detector with the gradient morphological was obtained with a 0.9549 %.
In Table 7, the percentage of recognition of the Choquet integral using interval fuzzy measures presents a small increase with respect to Choquet integral without interval fuzzy measures.
6 Conclusions
The use of Choquet integral as an integration method of responses of a modular neural network applied to face recognition has yielded favorable results when performing the aggregation process of the preprocessed images with the detectors type 1 and type 2 of Sobel edges and morphological gradient; the use of the Sugeno measure by intervals allowed increase of the percentage of data recognition; however, it is still necessary to use a method that optimizes the value of the Sugeno measure assigned to each source of information, and also how to calculate the interval because these were designated arbitrarily. Future work could be considering the optimization of the proposed method, as in [28–30].
7 Future Works
Although good results were obtained by applying the Choquet integral as an aggregation operator of the MNN, more testing is needed on other benchmark databases to verify results obtained also to find another way to generate an interval of uncertainty among the data, fuzzy measures, value of lambda, and fuzzy densities.
References
Zhou, L-G., Chen, H-Y., Merigó, J.M., Anna, M.: Uncertain generalized aggregation operators. Expert Syst. Appl. 39, 1105–1117 (2012)
McCulloh, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133 (1943)
Alves, V.M.O., Cavalcanti, G.D.C.: A Nonexclusive Task Decomposition Method for Modular Neural Networks. IEEE, New York (2010) (978-1-4244-8126-2/10)
Bo, Y-C., Qiao, J-F., Yang, G.: A Modular Neural Networks Ensembling Method Based on Fuzzy Decision-Making. IEEE, New York (2011) (978-1-4244-8039-5/11)
Vazirani, H., Kala, R., Shukla, A., Tiwari, R.: Diagnosis of Breast Cancer by Modular Neural Network. IEEE, New York (2010) (978-1-4244-5540-9/10)
Turchenko, I., Kochan, V., Sachenko, A.: Recognition of Multi-sensor Output Signal Using Modular Neural Networks Approach. TCSET, Lviv-Slavsko, Ukraine (2006)
Liu, Y., Yao, X.: Evolving Modular Neural Networks Which Generalise Well. IEEE, New York (1997) (0-7803-3949-5/97)
Hidalgo, D.: Fuzzy inference systems type 1 and type 2 as integration methods in neural networks for multimodal biometrics and me-optimization by means of genetic algorithms, Master Thesis, Tijuana Institute of Technology (2008)
Sánchez D., Melin P.: Modular neural network with fuzzy integration and its optimization using genetic algorithms for human recognition based on iris, ear and voice biometrics. Soft Comput. Recognit. Based Biom. 85–102 (2010)
Sánchez, D., Melin, P., Castillo, O., Valdez, F.: Modular neural networks optimization with hierarchical genetic algorithms with fuzzy response integration for pattern recognition. MICAI, pp. 247–258 (2012)
Melin, P., Gonzalez, C., Bravo, D., Gonzalez, F., Martínez, G.: Modular neural networks and fuzzy sugeno integral for pattern recognition: the case of human face and fingerprint. In: Hybrid Intelligent Systems: Design and Analysis. Springer, Heidelberg, Germany (2007)
Melin, P., Mendoza, O., Castillo O.: Face recognition with an improved interval type-2 fuzzy logic sugeno integral and modular neural networks. IEEE Trans. Syst. Man Cybernet. Part A Syst. Hum. 41(5) (2011)
Meena, Y., Arya, K.V., Kala, R.: Classification using redundant mapping in modular neural networks. In: Second World Congress on Nature and Biologically Inspired Computing, Dec 15–17, in Kitakyushu, Fukuoka, Japan (2010)
Wang, P., Xua, L., Zhou, S-M., Fan, Z., Li, Y., Feng, S.: A novel Bayesian learning method for information aggregation in modular neural networks. Expert Syst. Appl. 37, 1071–1074 (2010)
Kwak, K.-C., Pedrycz, W.: Face recognition: a study in information fusion using fuzzy integral. Pattern Recogn. Lett. 26, 719–733 (2005)
Timonin, M.: Robust optimization of the Choquet integral. Fuzzy Sets Syst. 213, 27–46 (2013)
Yanga, W., Chena, Z.: New aggregation operators based on the Choquet integral and 2-tuple linguistic information. Expert Syst. Appl. 39(3), 2662–2668 (2012)
Sugeno, M.: Theory of fuzzy integrals and its applications. Thesis Doctoral, Tokyo Institute of Technology, Tokyo, Japan (1974)
Murofushi, T., Sugeno, M.: Fuzzy Measures and Fuzzy Integrals. Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology, Yokohama, Japan (2000)
Song, J., Li, J.: Lebesgue theorems in non-additive measure theory. Fuzzy Sets Syst. 149(3), 543–548 (2005)
Wang, Z., Klir, G.: Generalized Measure Theory. Springer, New York (2009)
Torra, V., Narukawa, Y.: The interpretation of fuzzy integrals and their application to fuzzy systems. Int. J. Approx. Reason. 41, 43–58 (2006)
Mendoza, O., Melin, P.: Extension of the Sugeno Integral with Interval Type-2 Fuzzy Logic. Fuzzy Information Processing Society, NAFIPS (2008)
Database ORL Face. Cambridge University Computer Laboratory. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html (2012)
Mendoza, O., Melin, P., Castillo, O., Castro, J.: Comparison of fuzzy edge detectors based on the image recognition rate as performance index calculated with neural networks. Soft Comput. Recognit. Biom. Stud. Comput. Intell. 312, 389–399 (2010)
Mendoza, O., Melin, P., Licea, G.: A hybrid approach for image recognition combining type-2 fuzzy logic, modular neural networks and the Sugeno integral. Inf. Sci. Int. J. 179(13), 2078–2101 (2009)
Mendoza, O., Melin, P.: Quantitative evaluation of fuzzy edge detectors applied to neural networks or image recognition. Adv. Res. Dev. Digit. Syst. 324–335 (2011)
Sánchez D., Melin P.: Multi-objective hierarchical genetic algorithm for modular granular neural network optimization. Soft Comput. Appl. Optim. Control Recognit. 157–185 (2013)
Sánchez, D., Melin, P., Castillo, O., Valdez, F.: Modular granular neural networks optimization with multi-objective hierarchical genetic algorithm for human recognition based on iris biometric. IEEE Congr. Evolut. Compu. 772–778 (2013)
Sánchez, D., Melin, P.: Optimization of modular granular neural networks using hierarchical genetic algorithms for human recognition using the ear biometric measure. Eng. Appl. AI 27, 41–56 (2014)
Acknowledgment
We are grateful to the MyDCI program of the Division of Graduate Studies and Research, UABC, Tijuana Institute of Technology and for the financial support provided by our sponsor CONACYT contract grant number: 189350.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Martínez, G.E., Mendoza, O., Castro, J.R., Melin, P., Castillo, O. (2016). Choquet Integral with Interval Type 2 Sugeno Measures as an Integration Method for Modular Neural Networks. In: Zadeh, L., Abbasov, A., Yager, R., Shahbazova, S., Reformat, M. (eds) Recent Developments and New Direction in Soft-Computing Foundations and Applications. Studies in Fuzziness and Soft Computing, vol 342. Springer, Cham. https://doi.org/10.1007/978-3-319-32229-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-32229-2_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-32227-8
Online ISBN: 978-3-319-32229-2
eBook Packages: EngineeringEngineering (R0)