Abstract
Most of the current constructive induction algorithms degrade performance as the target concept becomes larger and more complex in terms of Boolean combinations. Most are only capable of constructing relatively smaller new attributes. Though it is impossible to build a learner to learn any arbitrarily large and complex concept, there are some large and complex concepts that could be represented in a simple relation such as prototypical concepts, e.g., m-of-n, majority, etc. In this paper, we propose a new approach that combines the neural net and iterative attribute construction to learn relatively short but complex Boolean combinations and prototypical structures. We also carried a series of systematic experiments to characterize our approach.
Chapter PDF
Similar content being viewed by others
References
Aha, D. “Incremental Constructive Induction: An Instanced-Based Approach”, in Proceeding of the 8th Machine Learning Workshop, p117–121, 1991.
Dietterich, T. G. & Michalski, R. S. “Inductive Learning of Structural Description: Evaluation Criteria and Comparative Review of Selected Methods”, Artificial Intelligence 16 (3), p257–294, 1981.
Hertz, J., Krogh, A. and Palmer, R. G. “Introduction to the Theory of Neural Computation”, Addison-Wesley, 1991.
Hu, Y. & Kibler, D. “Generation of Attributes for Learning Algorithms”, in Proceeding of the 13th National Conference on Artificial Intelligence, p806–811, 1996.
Kadie, C. M. “Quantifying the Value of Constructive Induction, Knowledge, and Noise Filtering on Inductive Learning”, in Proceeding of the 8th Machine Learning Workshop, p153–157, 1991.
Kung, S. Y. “Digital Neural Networks”, Prentice Hall, 1993.
Matheus, C. J. & Rendell, L. A. “Constructive Induction on Decision Trees”, in Proceeding of the 11th International Joint Conference on Artificial Intelligence, p645–650, 1989.
Matheus, C. J. “The Need for Constructive Induction”, in Proceeding of the 8th Machine Learning Workshop, p173–177, 1991.
Mehra, P., Rendell, L. A., Wah, B. W. “Principled Constructive Induction”, in Proceeding of the 11th International Joint Conference on Artificial Intelligence, p651–656, 1989.
Pagallo, G. “Learning DNF by Decision Trees”, in Proceeding of the 11th International Joint Conference on Artificial Intelligence.
Pagallo, G. & Haussler, D. “Boolean Feature Discovery in Empirical Learning”, Machine Learning 5, p71–99, 1990.
Perez, E. & Rendell, L. “Using Multidimensional Projection to Find Relations”, in Proceeding of the 12th Machine Learning Conference, p447–455, 1995.
Perez, E. & Rendell, L. “Learning Despite Concept Variation by Finding Structure in Attribute-based Date”, in Proceeding of the 13th Machine Learning Conference, p391–399, 1996.
Quinlan, J. R. “Learning efficient classification procedures and their application to chess end games”, in Michalski et. al.'s Machine Learning: An artificial intelligence approach. (Eds.) 1983.
Quinlan, J. R. C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.
Ragavan, H., Rendell, L., Shaw, M., Tessmer, A. “Complex Concept Acquisition through Directed Search and Feature Caching”, in Proceeding of the 13th International Joint Conference on Artificial Intelligence, p946–958, 1993.
Ragavan, H. & Rendell, L. “Lookahead Feature Construction for Learning Hard Concepts”, in Proceeding of the 10th Machine Learning Conference, p252–259, 1993.
Rendell L. A. & Ragavan, H. “Improving the Design of Induction Methods by Analyzing Algorithm Functionality and Data-Based Concept Complexity”, in Proceeding of the 13th International Joint Conference on Artificial Intelligence, p952–958, 1993.
Spackman, K. “Learning Categorical Decision Criteria in Biomedical Domains”, in Proceeding of the 5th International Workshop on Machine Learning, p36–46, 1988.
Yang, D-S., Rendell, L. A., Blix, G. “A Scheme for Feature Construction and a Comparison of Empirical Methods”, in Proceedingof the 12th International Joint Conference on Artificial Intelligence, p699–704, 1991.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hu, YJ. (1997). Learning different types of new attributes by combining the neural network and iterative attribute construction. In: van Someren, M., Widmer, G. (eds) Machine Learning: ECML-97. ECML 1997. Lecture Notes in Computer Science, vol 1224. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62858-4_77
Download citation
DOI: https://doi.org/10.1007/3-540-62858-4_77
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62858-3
Online ISBN: 978-3-540-68708-5
eBook Packages: Springer Book Archive