Application of Sparse Kernel Graph-regularized Discriminant Non-negative Matrix Factorization in Image Clustering

Authors

  • Ran Zhou
  • Jianlei Li

DOI:

https://doi.org/10.54097/xzcbza36

Keywords:

Graph Regularization, Image Clustering, Non-negative Matrix Factorization, Sparsity, Spectral Clustering

Abstract

Non-negative Matrix Factorization (NMF) is widely used in image clustering; however, it has inherent limitations, including its unsupervised nature, lack of sparsity constraints, inability to leverage label information, and difficulty in capturing the geometric structure and nonlinear characteristics of data. To address these limitations, this paper proposes a Sparse Kernel Graph-regularized Discriminant Non-negative Matrix Factorization (SKGDNMF) algorithm. The algorithm innovatively adopts a dual normalization strategy, which involves column normalization for the basis matrix and row normalization for the coefficient matrix, and integrates spectral clustering to construct an end-to-end deep clustering framework. By applying sparse regularization to the coefficient matrix, the model’s robustness is significantly improved; this regularization forms complementary optimization with graph regularization, thereby effectively alleviating overfitting. A three-dimensional golden-section parameter optimization method is employed to determine key parameters, which enhances the algorithm’s practicality. Comparative experiments conducted on multiple datasets show that SKGDNMF significantly outperforms mainstream algorithms in terms of sparsity, robustness, and clustering performance, indicating its superior effectiveness for image clustering tasks.

Downloads

Download data is not yet available.

References

[1] Cai D, He X, Wu X, et al. Non-negative matrix factorization on manifold[C]//2008 Eighth IEEE International Conference on Data Mining. IEEE, 2008: 63-72.

[2] Babaee M, Tsoukalas S, Babaee M, et al. Discriminative nonnegative matrix factorization for dimensionality reduction [J]. Neurocomputing, 2016, 173: 212-223.

[3] Zhang D, Zhou Z H, Chen S. Non-negative matrix factorization on kernels[C]//PRICAI 2006: Trends in Artificial Intelligence: 9th Pacific Rim International Conference on Artificial Intelligence Guilin, China, August 7-11, 2006 Proceedings 9. Springer Berlin Heidelberg, 2006: 404-412.

[4] Sun L, Zhao K, Han C Y, et al. Enhancing hyperspectral unmi-xing with two-stage multiplicative update nonnegative matrix factorization[J]. IEEE Access, 2019,7:171023-171031.

[5] Ashabi A, Sahibuddin S B, Salkhordeh Haghighi M. The systematic review of K-means clustering algorithm[C]// Proceedings of the 2020 9th International Conference on Networks, Communication and Computing. 2020: 13-18.

[6] Schölkopf B, Smola A ,Müller, K.Nonlinear Component Analysis as a Kernel Eigenvalue Problem[J].Neural Computation, 1998, 10(5):1299-1319.

[7] Lee D D , Seung H S. Learning the parts of objects by non-negative matrix factorization[J]. Nature, 1999, 401(6755):788-791.

[8] Li H, Zhang J, Shi G, et al. Graph-based discriminative nonnegative matrix factorization with label information[J]. Neurocomputing, 2017, 266: 91-100.

[9] Li X L, Zhang Y. Kernel-based discriminative graph regularized non-negative matrix factorization [in Chinese][J]. Journal of Computer Science and Exploration, 2020,14 (11): 1899-1907.

[10] Ng A Y, Jordan M I , Weiss Y .On Spectral Clustering: Analysis and an algorithm[J].proc nips, 2002.

Downloads

Published

27-11-2025

Issue

Section

Articles