Abstract
The Recursive Deterministic Perceptron (RDP) feed-forward multilayer neural network is a generalisation of the single layer perceptron topology. This model is capable of solving any two-class classification problem unlike the single layer perceptron which can only solve classification problems dealing with linearly separable sets. For all classification problems, the construction of an RDP is done automatically and convergence is always guaranteed. A generalisation of the 2-class Recursive Deterministic Perceptron (RDP) exists. This generalisation always allows the deterministic separation of m-classes. It is based on a new notion of linear separability and it arises naturally from the 2 valued RDP. The methods for building 2-class RDP neural networks have been extensively tested. However, no testing has been done before on the m-class RDP method. For the first time, a study on the performance of the m-class method is presented. This study will allow the highlighting of the main advantages and disadvantages of this method by comparing the results obtained while building m-class RDP neural networks with other more classical methods such as Backpropagation and Cascade Correlation in terms of level of generalisation and topology size. The networks were trained and tested using the following standard benchmark classification datasets: Glass, Wine, Zoo, Iris, Soybean, and Wisconsin Breast Cancer.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bennett, K.P., Mangasarian, O.L.: Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods and Software 1, 23–34 (1992)
Dasarathy, B.W.: Nosing around the neighborhood: A new system structure and classification rule for recognition in partially exposed environments. IEEE Transactions on Pattern Analysis and Machine Intelligence 2(1), 67–71 (1980)
Newman, D.J., Hettich, S., Merz, C.B.: C.: UCI repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Elizondo, D.: The recursive determinist perceptron (rdp) and topology reduction strategies for neural networks. Ph.D. thesis, Université Louis Pasteur, Strasbourg, France (1997)
Elizondo, D.: Searching for linearly separable subsets using the class of linear separability method. In: Proceedings of the IEEE-IJCNN, pp. 955–960 (2004)
Elizondo, D.: The linear separability problem: Some testing methods. Accepted for Publication: IEEE TNN (2006)
Fisher, R.A.: The use of multiple measurements in taxonomic problems. Annual Eugenics 7(II), 179–188 (1936)
Gates, G.W.: The reduced nearest neighbor rule. IEEE Transactions on Information Theory, 431–433 (1972)
Mangasarian, O.L., Wolberg, W.H.: Cancer diagnosis via linear programming. SIAM News 23(5), 1–18 (1990)
Preparata, F.P., Shamos, M.I.: Computational Geometry. An Introduction. Springer, New York (1985)
Rosenblatt, F.: Principles of Neurodynamics. Spartan, Washington D.C (1962)
Tajine, M., Elizondo, D.: Enhancing the perceptron neural network by using functional composition. Tech. Rep. 96-07, Computer Science Department, Université Louis Pasteur, Strasbourg, France (1996)
Tajine, M., Elizondo, D., Fiesler, E., Korczak, J.: Adapting the 2 −class recursive deterministic perceptron neural network to m −classes. In: The International Conference on Neural Networks (ICNN), IEEE, Los Alamitos (1997)
Weiss, S.M., Kulikowski, C.A.: Computer Systems That Learn. Morgan Kaufmann Publishers, San Mateo (1991)
Wolberg, W.H., Mangasarian, O.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proceedings of the National Academy of Sciences 87, 9193–9196 (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Elizondo, D.A., Ortiz-de-Lazcano-Lobato, J.M., Birkenhead, R. (2009). Analysis and Testing of the m-Class RDP Neural Network. In: Franco, L., Elizondo, D.A., Jerez, J.M. (eds) Constructive Neural Networks. Studies in Computational Intelligence, vol 258. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04512-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-04512-7_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04511-0
Online ISBN: 978-3-642-04512-7
eBook Packages: EngineeringEngineering (R0)