Skip to main content
SpringerLink
Log in

Self-eliminating Discriminant Analysis Dictionary Learning for Pattern Classification

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

As a branch of dictionary learning (DL), analysis dictionary learning has been widely used for pattern classification, which achieves outstanding performance. However, it is still a challenging to learn a more compact and discriminative analysis dictionary to ensure that the coding coefficient matrix of training samples presents a more discriminative block diagonal structure. To address this issue, we propose a self-eliminating discriminant analysis dictionary learning (SeDADL) method to learn a discriminant analysis dictionary that makes the coding coefficient matrix have an approximate block diagonal structure. Specifically, we first design a novel analysis dictionary regularization term to improve the discrimination capability of analysis dictionary by eliminating repeated and linearly dependent atoms in the analysis dictionary while preventing the generation of trivial solutions. Then, we design a self-eliminating coding coefficient constraint term to enhance the discrimination capability of spare codes by forcing the coding coefficient matrix to achieve an approximate block diagonal structure. In order to further improve the classification efficiency of SeDADL model, we introduce a linear classification error term into SeDADL model to learn a linear classifier, which constructs the links between spare codes and class labels. Moreover, an efficient iterative algorithm is designed to solve the optimization problem of SeDADL. Extensive experimental results on six datasets demonstrate that SeDADL can achieve satisfactory classification performance compared with some state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Wright J, Yang AY, Ganesh A, Shankar Sastry S, Ma Y (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  2. Xu Y, Zhang D, Yang J, Yang J (2011) A two-phase test sample sparse representation method for use with face recognition. IEEE Trans Circ Sys Video Technol 21(9):1255–1262

    Article  MathSciNet  Google Scholar 

  3. Peng Y, Li L, Liu S, Lei T (2018) Space-frequency domain based joint dictionary learning and collaborative representation for face recognition. Signal Process 147:101–109

    Article  Google Scholar 

  4. Xu Y, Fang X, Wu J, Li X, Zhang D (2016) Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans Image Process 25(2):850–863

    Article  MathSciNet  MATH  Google Scholar 

  5. Xu Y, Zhang Z, Lu G, Yang J (2016) Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification. Patt Recogn 54:68–82

    Article  Google Scholar 

  6. Aharon M, Elad M, Bruckstein A (2006) K-svd: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322

    Article  MATH  Google Scholar 

  7. Engan K, Aase SO, Husoy JH (1999) Frame based signal compression using method of optimal directions (mod). In: 1999 IEEE International symposium on circuits and systems (ISCAS), vol. 4, pp 1–4

  8. Giryes R, Elad M (2014) Sparsity-based poisson denoising with dictionary learning. IEEE Trans Image Process 23(12):5057–5069

    Article  MathSciNet  MATH  Google Scholar 

  9. Ying F, Lam A, Sato I, Sato Y (2015) Adaptive spatial-spectral dictionary learning for hyperspectral image denoising. In: 2015 IEEE International conference on computer vision (ICCV), pp 343–351

  10. Jing L, Ng MK, Zeng T (2013) Dictionary learning-based subspace structure identification in spectral clustering. IEEE Trans Neural Netw Learn Sys 24(8):1188–1199

    Article  Google Scholar 

  11. Xiang S, Meng G, Wang Y, Pan C, Zhang C (2015) Image deblurring with coupled dictionary learning. Int J Comp Vision 114(2–3):248–271

    Article  MathSciNet  MATH  Google Scholar 

  12. Ma L, Moisan L, Yu J, Zeng T (2013) A dictionary learning approach for poisson image deblurring. IEEE Trans Med Imag 32(7):1277–1289

    Article  Google Scholar 

  13. Yang B, Guan X, Zhu J, Gu C, Wu K, Xu J (2021) Svms multi-class loss feedback based discriminative dictionary learning for image classification. Patt Recognit 112:107690

    Article  Google Scholar 

  14. Cheng X, Zhang Y, Zhou L, Lu G (2021) Online dual dictionary learning for visual object tracking. J Ambient Intell Human Comp 12:10881–10896

  15. Kong Y, Wang T, Chu F, Feng Z, Selesnick I (2021) Discriminative dictionary learning-based sparse classification framework for data-driven machinery fault diagnosis. IEEE Sens J 21(6):8117–8129

    Article  Google Scholar 

  16. Zhang Q, Li B (2010) Discriminative k-svd for dictionary learning in face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2691–2698

  17. Jiang Z, Lin Z, Davis LS (2013) Label consistent k-svd: learning a discriminative dictionary for recognition. IEEE Trans Patt Anal Mach Intell 35(11):2651–2664

    Article  Google Scholar 

  18. Yang M, Zhang L, Feng X, Zhang D (2014) Sparse representation based fisher discrimination dictionary learning for image classification. Int J Comp Vision 109(3):209–232

    Article  MathSciNet  MATH  Google Scholar 

  19. Du H, Ma L, Li G, Wang S (2020) Low-rank graph preserving discriminative dictionary learning for image recognition. Knowl-Based Sys 187:104823

    Article  Google Scholar 

  20. Ma L, Moisan L, Yu J, Zeng T (2013) A dictionary learning approach for poisson image deblurring. IEEE Trans Med Imag 32(7):1277–1289

    Article  Google Scholar 

  21. Yin H, Wu X, Chen S (2019) Locality constraint dictionary learning with support vector for pattern classification. IEEE Access 7:175071–175082

    Article  Google Scholar 

  22. Li Y, Chai Y, Zhou H, Yin H (2021) A novel dimension reduction and dictionary learning framework for high-dimensional data classification. Patt Recognit 112:107793

    Article  Google Scholar 

  23. Guo J, Guo Y, Kong X, Zhang M, He R (2016) Discriminative analysis dictionary learning. In: Proceedings of the AAAI conference on artificial intelligence, Vol. 30

  24. Wang Q, Guo Y, Guo J, Kong X (2018) Synthesis k-svd based analysis dictionary learning for pattern classification. Multim Tools Appl 77(13):17023–17041

    Article  Google Scholar 

  25. Wang J, Guo Y, Guo J, Luo X, Kong X (2017) Class-aware analysis dictionary learning for pattern classification. IEEE Signal Process Lett 24(12):1822–1826

    Article  Google Scholar 

  26. Tang W, Panahi A, Krim H, Dai L (2018) Structured analysis dictionary learning for image classification. In: Proceedings of the IEEE international conference on acoustics, speech and signal processing (ICASSP) pp. 2181–2185

  27. Tang W, Panahi A, Krim H, Dai L (2019) Analysis dictionary learning: an efficient and discriminative solution. In: Proceedings of the IEEE International conference on acoustics, speech and signal processing (ICASSP). pp. 3682–3686

  28. Du H, Zhang Y, Ma L, Zhang F (2021) Structured discriminant analysis dictionary learning for pattern classification. Knowl-Based Sys 216:1–10

    Google Scholar 

  29. Gu S, Zhang L, Zuo W, Feng X (2014) Projective dictionary pair learning for pattern classification. In Advances in Neural Information Processing Systems (NIPS), pp 793–801

  30. Yang M, Chang H, Luo W, Yang J (2017) Fisher discrimination dictionary pair learning for image classification. Neurocomputing 269:13–20

    Article  Google Scholar 

  31. Sun Y, Zhang Z, Jiang W, Zhang Z, Zhang L, Yan S, Wang M (2020) Discriminative local sparse representation by robust adaptive dictionary pair learning. IEEE Trans Neural Netw Learn Sys 31(10):4303–4317

    Article  MathSciNet  Google Scholar 

  32. Zhang Z, Sun Y, Wang Y, Zhang Z, Zhang H, Liu G, Wang M (2021) Twin-incoherent self-expressive locality-adaptive latent dictionary pair learning for classification. IEEE Trans Neural Netw Learn Sys 32(3):947–961

    Article  MathSciNet  Google Scholar 

  33. Yang J, Wang S, Su S, Li H (2020) Structural constraint and discriminative constraint based dictionary pair learning for image classification. IEEE Access 8:184414–184425

    Article  Google Scholar 

  34. Shekhar S, Patel V, Chellappa R (2014) Analysis sparse coding models for image-based classification. In: 2014 IEEE international conference on image processing (ICIP), pp 5207–5211

  35. Ravishankar S, Bresler Y (2012) Learning sparsifying transforms for image processing. In: 2012 19th IEEE international conference on image processing, pp 681–684

  36. Zhang X (2017) Matrix analysis and applications. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  37. Ravishankar S, Wen B, Bresler Y (2015) Online sparsifying transform learning-part i: algorithms. IEEE J Select Topics Signal Process 9(4):625–636

    Article  Google Scholar 

  38. Wang J, Guo Y, Guo J, Li M, Kong X (2017) Synthesis linear classifier based analysis dictionary learning for pattern classification. Neurocomputing 238:103–113

    Article  Google Scholar 

  39. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cognit Neurosci 3(1):71–86

    Article  Google Scholar 

  40. Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Patt Anal Mach Intell 23(6):643–660

    Article  Google Scholar 

  41. Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) Vol 2, pp. 2169–2178

  42. Sim T, Baker S, Bsat M (2003) The CMU pose, illumination, and expression database. IEEE Trans Patt Anal Mach Intell 25(12):1615–1618

    Article  Google Scholar 

  43. Martinez AM (1998) The AR face database. Technical Report, CVC Technical Report, pp 24

  44. Du H, Zhao Z, Wang S, Zhang F (2018) Discriminative low-rank graph preserving dictionary learning with schatten-p quasi-norm regularization for image recognition. Neurocomputing 275:697–710

    Article  Google Scholar 

  45. Li F, Fergus R, Perona P (2007) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comp Vision Image Underst 106(1):59–70

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the Science and Technology Development Plan Project of Henan Province, China (No. 222102110135) and the Natural Science Foundation of Henan Province, China (No. 202300410093).

Author information

Authors and Affiliations

  1. School of Artificial Intelligence, Henan University, Kaifeng, China

    Haishun Du, Zhaoyang Li, Panting Liu & Dingyi Wang

  2. School of Intelligent Manufacturing, Nanyang Institute of Technology, Nanyang, China

    Yonghao Zhang

Authors
  1. Haishun Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yonghao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhaoyang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Panting Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dingyi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haishun Du.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Du, H., Zhang, Y., Li, Z. et al. Self-eliminating Discriminant Analysis Dictionary Learning for Pattern Classification. Neural Process Lett 55, 9969–9993 (2023). https://doi.org/10.1007/s11063-023-11234-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-023-11234-z

Keywords

Search

Navigation