Abstract
Since the introduction of bagging and boosting many new techniques have been developed within the field of classification via aggregation methods. Most of them have in common that the class indicator is treated as a nominal response without any structure. Since in many practical situations the class must be considered as an ordered categorical variable, it seems worthwhile to take this additional information into account. We propose several variants of bagging and boosting, which make use of the ordinal structure and it is shown how the predictive power might be improved. Comparisons are based not only on misclassification rates but also on general distance measures, which reflect the difference between true and predicted class.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
BREIMAN, L. (1996): Bagging Predictors. Machine Learning, 24, 123–140.
BREIMAN, L. (1998): Arcing Classifiers. Annals of Statistics, 26, 801–849.
BÜHLMANN, P. and YU, B. (2002): Boosting with the L2-Loss: Regression and Classification. To appear in Journal of the American Statistical Association.
FREUND, Y (1995): Boosting a Weak Learning Algorithm by Majority. Information And Computation, 121, 256–285.
FREUND, Y. and SCHAPIRE, R.E. (1996): Experiments with a New Boosting Algorithm. Machine Learning: Proceedings of the Thirteenth International Conference.
FRIEDMAN, J., HASTIE, T. and TIBSHIRANI, R. (2000): Additive Logistic Regression: A Statistical View of Boosting. Annals of Statistics, 28, 337–374.
HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. (2001): The Elements of Statistical Learning. New York, Spinger.
SCHAPIRE, R.E. (2002): The Boosting Approach to Machine Learning: An Overview. MSRI Workshop on Nonlinear Estimation and Classification.
TUTZ, G. and HECHENBICHLER, K. (2003): Aggregating Classifiers with Ordinal Response Structure. Discussion Paper 359, SFB 386 der Ludwig-Maximilians-Universität München.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin · Heidelberg
About this paper
Cite this paper
Hechenbichler, K., Tutz, G. (2005). Bagging, Boosting and Ordinal Classification. In: Weihs, C., Gaul, W. (eds) Classification — the Ubiquitous Challenge. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-28084-7_14
Download citation
DOI: https://doi.org/10.1007/3-540-28084-7_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25677-9
Online ISBN: 978-3-540-28084-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)