Abstract
Multi-label learning deals with the problem where each instance is associated with a set of class labels. In multi-label learning, different labels may have their own inherent characteristics for distinguishing each other, and the correlation information has shown promising strength in improving multi-label learning. In this study, we propose a novel multi-label learning method by simultaneously taking into account both the learning of label-specific features and the correlation information during the learning process. Firstly, we learn a sparse weight parameter vector for each label based on the linear regression model, and the label-specific features can be extracted according to the corresponding weight parameters. Secondly, we constrain label correlations directly on the output of labels, not on the corresponding parameter vectors which conflicts with the label-specific feature learning. Specifically, for any two related labels, their corresponding models should have similar outputs rather than similar parameter vectors. Thirdly, we also exploit the sample correlations through sparse reconstruction. The experimental results on 12 benchmark datasets show that the proposed method performs better than the existing methods. The proposed method ranks in the 1st place at 66.7% case and achieves optimal average rank in terms of all evaluation measures.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
He Z Y, Wu J, Lv P. Multi-label text classification based on the label correlation mixture model. Intelligent Data Analysis Analysis, 2017, 21(6): 1371-1392.
Kazawa H, Izumitani T, Taira H et al. Maximal margin labeling for multi-topic text categorization. In Proc. the 18th Annual Conference on Neural Information Processing Systems, December 2004, pp.649-656.
de Almeida A M G, Ricardo C, Paraiso E C et al. Applying multi-label techniques in emotion identification of short texts. Neurocomputing, 2018, 320: 35-46.
Li Y, Song Y, Luo J. Improving pairwise ranking for multi-label image classification. In Proc. the 30th IEEE Conference on Computer Vision and Pattern Recognition, July 2017, pp.1837-1845.
Tan M, Shi Q, van den Hengel A et al. Learning graph structure for multi-label image classification via clique generation. In Proc. the 28th IEEE Conference on Computer Vision and Pattern Recognition, June 2015, pp.4100-4109.
Sun F, Tang J, Li H et al. Multi-label image categorization with sparse factor representation. IEEE Transactions on Image Processing, 2014, 23(3): 1028-1037.
Trohidis K, Tsoumakas G, Kalliris G et al. Multi-label classification of music into emotions. In Proc. the 9th International Conference on Music Information Retrieval, September 2008, pp.325-330.
Wu B, Zhong E, Horner A et al. Music emotion recognition by multi-label multi-layer multi-instance multi-view learning. In Proc. the 22nd ACM International Conference on Multimedia, November 2014, pp.117-126.
Zhang M L, Zhou Z H. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8): 1819-1837.
Zhou Z H, Zhang M L. Multi-label learning. In Encyclopedia of Machine Learning and Data Mining, Sammut C, Webb G (eds.), Springer, 2016.
Zhang M L, Wu L. Lift: Multi-label learning with label-specific features. In Proc. the 22nd International Joint Conference on Artificial Intelligence, July 2011, pp.1609-1614.
Huang J, Li G, Huang Q et al. Learning label specific features for multi-label classification. In Proc. the 15th IEEE International Conference on Data Mining, November 2015, pp.181-190.
Huang J, Li G, Huang Q et al. Joint feature selection and classification for multi-label learning. IEEE Transactions on Cybernetics, 2018, 48(3): 876-889.
Han H, Huang M, Zhang Y et al. Multi-label learning with label specific features using correlation information. IEEE Access, 2019, 7: 11474-11484.
Elisseeff A, Weston J. A kernel method for multi-labelled classification. In Proc. the 15th Annual Conference on Neural Information Processing Systems, December 2001, pp.681-687.
Tsoumakas G, Katakis I, Vlahavas I. Random k-labelsets for multilabel classification. IEEE Transactions on Knowledge and Data Engineering, 2011, 23(7): 1079-1089.
Zhang Q W, Zhong Y, Zhang M L. Feature-induced labeling information enrichment for multi-label learning. In Proc. the 32nd AAAI Conference on Artificial Intelligence, February 2018, pp.4446-4453.
Zhang J, Li C, Cao D et al. Multi-label learning with label-specific features by resolving label correlations. Knowledge-Based Systems, 2018, 159: 148-157.
Roweis S T, Saul L K. Nonlinear dimensionality reduction by locally linear embedding. Science, 2000, 290(5500): 2323-2326.
Read J, Pfahringer B, Holmes G et al. Classifier chains for multi-label classification. Machine Learning, 2011, 85(3): 333-359.
Boutell M R, Luo J, Shen X et al. Learning multi-label scene classification. Pattern Recognition, 2004, 37(9): 1757-1771.
Furnkranz J, Hüllermeier E, Mencia E L et al. Multi-label classification via calibrated label ranking. Machine Learning, 2008, 73(2): 133-153.
Zhang M L, Zhang K. Multi-label learning by exploiting label dependency. In Proc. the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, July 2010, pp.999-1008.
Xu S, Yang X, Yu H et al. Multi-label learning with label-specific feature reduction. Knowledge-Based Systems, 2016, 104: 52-61.
Yan Y, Li S, Yang Z et al. Multi-label learning with label-specific feature selection. In Proc. the 24th International Conference on Neural Information Processing, November 2017, pp.305-315.
Huang S J, Zhou Z H. Multi-label learning by exploiting label correlations locally. In Proc. the 26th AAAI Conference on Artificial Intelligence, July 2012, pp.949-955.
Lin Z, Ganesh A, Wright J et al. Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. Technical Report, University of Illinois at Urbana-Champaign, 2009. https://www.ideals.illinois.edu/bitstream/handle/2142/74352/B40-DC_246.pdf?sequence=2&isAllowed=y, Dec. 2019.
Demisar J. Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research, 2006, 7(1): 1-30.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
ESM 1
(PDF 308 kb)
Rights and permissions
About this article
Cite this article
Jia, XY., Zhu, SS. & Li, WW. Joint Label-Specific Features and Correlation Information for Multi-Label Learning. J. Comput. Sci. Technol. 35, 247–258 (2020). https://doi.org/10.1007/s11390-020-9900-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-020-9900-z