Abstract
The incompleteness of multi-view data is a phenomenon associated with real-world data mining applications, which brings a huge challenge for multi-view clustering. Although various types of clustering methods, which try to obtain a complete and consensus clustering result from a latent subspace, have been developed to overcome this problem, most methods excessively rely on views-public instances to bridge the connection with view-private instances. When lacking sufficient views-public instances, existing methods fail to transmit the information among incomplete views effectively. To overcome this limitation, we propose an incomplete multi-view clustering algorithm via local and global co-regularization (IMVC-LG). In this algorithm, we define a new objective function that is composed of two terms: local clustering from each view and global clustering from multiple views, which constrain each other to exploit the local clustering information from different incomplete views and determine a global consensus clustering result, respectively. Furthermore, an iterative optimization method is proposed to minimize the objective function. Finally, we compare the proposed algorithm with other state-of-the-art incomplete multi-view clustering methods on several benchmark datasets to illustrate its effectiveness.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
von Luxburg U. A tutorial on spectral clustering. Stat Comput, 2007, 17: 395–416
Rodriguez A, Laio A. Clustering by fast search and find of density peaks. Science, 2014, 344: 1492–1496
Yue S H, Wang J S, Tao G, et al. An unsupervised grid-based approach for clustering analysis. Sci China Inf Sci, 2010, 53: 1345–1357
Li C Z, Xu Z B, Qiao C, et al. Hierarchical clustering driven by cognitive features. Sci China Inf Sci, 2014, 57: 012109
Li Z W, Cheong L F, Yang S G, et al. Simultaneous clustering and model selection: algorithm, theory and applications. IEEE Trans Pattern Anal Mach Intell, 2018, 40: 1964–1978
Wang Y S, Fang H Y, Yang D J, et al. Network clustering analysis using mixture exponential-family random graph models and its application in genetic interaction data. IEEE ACM Trans Comput Biol Bioinf, 2019, 16: 1743–1752
Oyelade J, Isewon I, Oladipupo O, et al. Data clustering: algorithms and its applications. In: Proceedings of the 19th International Conference on Computational Science and Its Applications (ICCSA), Saint Petersburg, 2019. 71–81
Wang J L, Lu Y H, Liu J B, et al. A robust three-stage approach to large-scale urban scene recognition. Sci China Inf Sci, 2017, 60: 103101
Bai L, Liang J Y, Cao F Y. Semi-supervised clustering with constraints of different types from multiple information sources. IEEE Trans Pattern Anal Mach Intell, 2021, 43: 3247–3258
Zhang C Q, Fu H Z, Hu Q H, et al. Generalized latent multi-view subspace clustering. IEEE Trans Pattern Anal Mach Intell, 2020, 42: 86–99
Liu J, Cao F Y, Gao X Z, et al. A cluster-weighted kernel k-means method for multi-view clustering. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI), New York, 2020. 4860–4867
Wang H, Yang Y, Liu B. GMC: graph-based multi-view clustering. IEEE Trans Knowl Data Eng, 2020, 32: 1116–1129
Lu Z M, Liu C, Zhang Q, et al. Visual analytics for the clustering capability of data. Sci China Inf Sci, 2013, 56: 052110
Xu X M, Li K K, Xu C, et al. GDFace: gated deformation for multi-view face image synthesis. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI), New York, 2020. 12532–12540
Fei H L, Li P. Cross-lingual unsupervised sentiment classification with multi-view transfer learning. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), 2020. 5759–5771
Jiang X P, Hu X H, He T T. Identification of the clustering structure in microbiome data by density clustering on the Manhattan distance. Sci China Inf Sci, 2016, 59: 070104
Wang M H, Lin Y J, Yang K P, et at. M2GRL: a multi-task multi-view graph representation learning framework for web-scale recommender systems. In: Proceedings of the 26th ACM Conference on Knowledge Discovery and Data Mining (SIGKDD), 2020. 2349–2358
Zhang X N, Song S J, Zhu L, et al. Unsupervised learning of Dirichlet process mixture models with missing data. Sci China Inf Sci, 2016, 59: 012201
Zhang C Q, Cui Y J, Han Z B, et al. Deep partial multi-view learning. IEEE Trans Pattern Anal Mach Intell, 2020. doi: https://doi.org/10.1109/TPAMI.2020.3037734
Sun S L. A survey of multi-view machine learning. Neural Comput Appl, 2013, 23: 2031–2038
Yang Y, Wang H. Multi-view clustering: a survey. Big Data Min Anal, 2018, 1: 83–107
Li S Y, Jiang Y, Zhou Z H. Partial multi-view clustering. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI), Québec, 2014. 1968–1974
Zhao H D, Liu H F, Fu Y. Incomplete multi-modal visual data grouping. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), New York, 2016. 2392–2398
Shao W X, He L f, Philip S Y. Multiple incomplete views clustering via weighted nonnegative matrix factorization with L2,1 regularization. In: Proceedigns of Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML & PKDD), Porto, 2015. 318–334
Zhou W, Wang H, Yang Y. Consensus graph learning for incomplete multi-view clustering. In: Proceedings of the 23rd Pacific-Asia Advances in Knowledge Discovery and Data Mining Conference (PAKDD), Macau, 2019. 529–540
Min C, Cheng M M, Yu J, et al. Partial multi-view clustering via auto-weighting similarity completion. In: Proceedings of the 13th Chinese Conference on Biometric Recognition (CCBR), Urumqi, 2018. 214–222
Guo J, Ye J H. Anchors bring ease: an embarrassingly simple approach to partial multi-view clustering. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI), Hawaii, 2019. 118–125
Wu J, Zhuge W Z, Tao H, et al. Incomplete multi-view clustering via structured graph learning. In: Proceeding of the 15th Pacific Rim International Conference on Artificial Intelligence (PRICAI), Nanjing, 2018. 98–112
Yang L, Shen C Y, Hu Q H, et al. Adaptive sample-level graph combination for partial multiview clustering. IEEE Trans Image Process, 2020, 29: 2780–2794
Wen J, Yan K, Zhang Z, et al. Adaptive graph completion based incomplete multi-view clustering. IEEE Trans Multimedia, 2021, 23: 2493–2504
Wen J, Zhang Z, Zhang Z, et al. Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans Cybern, 2021, 51: 101–114
Wen J, Xu Y, Liu H. Incomplete multiview spectral clustering with adaptive graph learning. IEEE Trans Cybern, 2020, 50: 1418–1429
Wen J, Zhang Z, Zhang Z, et al. Unified tensor framework for incomplete multi-view clustering and missing-view Inferring. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI), 2021
Liu X W, Zhu X Z, Li M M, et al. Multiple kernel k-means with incomplete kernels. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI), San Francisco, 2017. 2259–2265
Zhu X Z, Liu X W, Li M M, et al. Localized incomplete multiple kernel k-means. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, 2018. 3271–3277
Liu X W, Zhu X Z, Li M M, et al. Late fusion incomplete multi-view clustering. IEEE Trans Pattern Anal Mach Intell, 2019, 41: 2410–2423
Bai L, Liang J Y. Sparse subspace clustering with entropy-norm. In: Proceedings of the 37th International Conference on Machine Learning (ICML), Vienna, 2020. 561–568
Nie F P, Wang X Q, Huang H. Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM International Conference on Knowledge Discovery & Data Mining (SIGKDD), New York, 2014. 977–986
Wen J, Zhang X, Xu Y, et al. Incomplete multi-view clustering via graph regularized matrix factorization. In: Proceedings of European Conference on Computer Vision (ECCV), Munich, 2018. 593–608
Hu M L, Chen S C. Doubly aligned incomplete multi-view clustering. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, 2018. 2262–2268
Maaten L V D, Hinton G. Visualizing data using t-SNE. J Mach Learn Res, 2008, 9: 2579–2605
Acknowledgements
This work was supported by National Key Research and Development Program of China (Grant No. 2020AAA0106100) and National Natural Science Foundation of China (Grant Nos. 62022052, 62006147).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liang, J., Liu, X., Bai, L. et al. Incomplete multi-view clustering via local and global co-regularization. Sci. China Inf. Sci. 65, 152105 (2022). https://doi.org/10.1007/s11432-020-3369-8
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11432-020-3369-8