Abstract
In this paper new interpretable neural network architectures are proposed. A Neural Network with sigmoid activation function is converted into a sigmoid-based approximation operator, which, at its turn, can be approximated by a fuzzy system of Takagi-Sugeno type. Altogether this process shows that a neural network with sigmoid activation functions can be approximated by a Takagi-Sugeno fuzzy system. As the TS fuzzy system provides interpretability, while Neural Networks provide approximation capability, we obtain a novel interpretable Neural Network Architecture. Interpretability of the TS fuzzy system can provide insights into data in a new way, enhancing decision making.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bede, B.: Mathematics of Fuzzy Sets and Fuzzy Logic. Springer, Heidelberg (2013)
Bonanno, D., Nock, K., Smith, L., Elmore, P., Petry, F.: An approach to explainable deep learning using fuzzy inference. In: Next-Generation Analyst V, SPIE Proceedings, vol. 10207, International Society for Optics and Photonics (2017)
Costarelli, D., Spigler, R.: Approximation results for neural network operators activated by sigmoidal functions. Neural Netw. 44, 101–106 (2013)
Cybenko, G.: Approximation by superpositions of a sigmoidal function. Math. Control Signals Syst. 2(4), 303–314 (1989)
Horikawa, S.-I., Furuhashi, T., Uchikawa, Y.: On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm. IEEE Trans. Neural Netw. 3(5), 801–806 (1992)
Jang, J.-S.R.: ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 23(3), 665–685 (1993)
Jin, Y., Sendhoff, B.: Extracting interpretable fuzzy rules from RBF networks. Neural Process. Lett. 17(2), 149–164 (2003)
Kasabov, N.K.: Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems. Fuzzy Sets Syst. 82(2), 135–149 (1996)
Montavon, G., Samek, W., Muller, K.R.: Methods for interpreting and understanding deep neural networks. Digit. Signal Process. 73, 1–15 (2018)
Sugeno, M.: An introductory survey of fuzzy control. Inf. Sci. 36, 59–83 (1985)
Tanaka, K., Sugeno, M.: Stability analysis and design of fuzzy control systems. Fuzzy Sets Syst. 45(2), 135–156 (1992)
Wang, L.-X., Mendel, J.M.: Fuzzy basis functions, universal approximation, and orthogonal least-squares learning. IEEE Trans. Neural Netw. 3(5), 807–814 (1992)
Ying, H.: General SISO Takagi-Sugeno fuzzy systems with linear rule consequent are universal approximators. IEEE Trans. Fuzzy Syst. 6(4), 582–587 (1998)
Zadeh, L.A.: Fuzzy Sets. Inf. Control 8, 338–353 (1965)
Zadeh, L.A.: The concept of a linguistic variable and its application to approximate reasoning - I. Inf. Sci. 8(3), 199–249 (1975)
Zadeh, L.A.: Fuzzy logic, neural networks, and soft computing. Fuzzy Sets, Fuzzy Logic, And Fuzzy Systems, pp. 775–782 (1996). Selected Papers by Zadeh, L.A
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Bede, B. (2019). Fuzzy Systems with Sigmoid-Based Membership Functions as Interpretable Neural Networks. In: Kearfott, R., Batyrshin, I., Reformat, M., Ceberio, M., Kreinovich, V. (eds) Fuzzy Techniques: Theory and Applications. IFSA/NAFIPS 2019 2019. Advances in Intelligent Systems and Computing, vol 1000. Springer, Cham. https://doi.org/10.1007/978-3-030-21920-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-21920-8_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-21919-2
Online ISBN: 978-3-030-21920-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)