Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2017

09-03-2016 | Theoretical Advances

A stochastic framework for K-SVD with applications on face recognition

Authors: Gustavo Malkomes, Carlos Eduardo Fisch de Brito, João Paulo Pordeus Gomes

Published in: Pattern Analysis and Applications | Issue 3/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, the sparse representation modeling of signals has received a lot of attention due to its state-of-the-art performance in different computer vision tasks. One important factor to its success is the ability to promote representations that are well adapted to the data. This is achieved by the use of dictionary learning algorithms. The most well known of these algorithms is K-SVD. In this paper, we propose a stochastic framework for K-SVD called \(\alpha\)K-SVD. The \(\alpha\)K-SVD uses a parameter \(\alpha\) to control a compromise between exploring the space of dictionaries and improving a possible solution. The use of this heuristic search strategy was motivated by the fact that K-SVD uses a greedy search algorithm with fast convergence, possibly leading to local minimum. Our approach is evaluated on two public face recognition databases. The results show that our approach yields better results than K-SVD and LC-KSVD (a K-SVD adaptation to classification) when the sparsity level is low.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aharon M, Elad M, Bruckstein A (2005) K-SVD: Design of dictionaries for sparse representation. In: Proceedings of SPARS05, pp 9–12 Aharon M, Elad M, Bruckstein A (2005) K-SVD: Design of dictionaries for sparse representation. In: Proceedings of SPARS05, pp 9–12
2.
3.
go back to reference Davenport MA, Wakin MB (2010) Analysis of orthogonal matching pursuit using the restricted isometry property. IEEE Trans Inf Theory 56(9):4395–4401MathSciNetCrossRef Davenport MA, Wakin MB (2010) Analysis of orthogonal matching pursuit using the restricted isometry property. IEEE Trans Inf Theory 56(9):4395–4401MathSciNetCrossRef
4.
go back to reference Elad M (2010) Sparse and redundant representations: from theory to applications in signal and image processing, 1st edn. Springer, HeidelbergCrossRefMATH Elad M (2010) Sparse and redundant representations: from theory to applications in signal and image processing, 1st edn. Springer, HeidelbergCrossRefMATH
6.
go back to reference Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef
8.
go back to reference Huang K, Aviyente S (2006) Sparse representation for signal classification. In: Advances in Neural Information Processing Systems (NIPS 2006). MIT Press, pp 609–616 Huang K, Aviyente S (2006) Sparse representation for signal classification. In: Advances in Neural Information Processing Systems (NIPS 2006). MIT Press, pp 609–616
9.
go back to reference Jiang Z, Lin Z, Davis L (2011) Learning a discriminative dictionary for sparse coding via label consistent k-svd. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1697–1704. doi:10.1109/CVPR.2011.5995354 Jiang Z, Lin Z, Davis L (2011) Learning a discriminative dictionary for sparse coding via label consistent k-svd. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1697–1704. doi:10.​1109/​CVPR.​2011.​5995354
10.
go back to reference Jiang Z, Lin Z, Davis LS (2013) Label consistent k-svd: Learning a discriminative dictionary for recognition. IEEE Trans Pattern Anal Mach Intell 35(11):2651–2664CrossRef Jiang Z, Lin Z, Davis LS (2013) Label consistent k-svd: Learning a discriminative dictionary for recognition. IEEE Trans Pattern Anal Mach Intell 35(11):2651–2664CrossRef
13.
go back to reference Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2008) Discriminative learned dictionaries for local image analysis. In: CVPR Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2008) Discriminative learned dictionaries for local image analysis. In: CVPR
14.
go back to reference Martinez AM, Benavente R (1998) The AR Face Database. Tech. rep, CVC Martinez AM, Benavente R (1998) The AR Face Database. Tech. rep, CVC
17.
go back to reference Pati YC, Rezaiifar R, Krishnaprasad P (1993) Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In: 1993 IEEE Conference Record of The Twenty-Seventh Asilomar Conference on Signals, Systems and Computers, pp 40–44 Pati YC, Rezaiifar R, Krishnaprasad P (1993) Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In: 1993 IEEE Conference Record of The Twenty-Seventh Asilomar Conference on Signals, Systems and Computers, pp 40–44
19.
go back to reference Rubinstein R, Zibulevsky M, Elad M (2008) Efficient Implementation of the K-SVD Algorithm using Batch Orthogonal Matching Pursuit. Tech. rep Rubinstein R, Zibulevsky M, Elad M (2008) Efficient Implementation of the K-SVD Algorithm using Batch Orthogonal Matching Pursuit. Tech. rep
21.
go back to reference Zhang Q, Li B (2010) Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2691–2698. doi:10.1109/CVPR.2010.5539989 Zhang Q, Li B (2010) Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2691–2698. doi:10.​1109/​CVPR.​2010.​5539989
Metadata
Title
A stochastic framework for K-SVD with applications on face recognition
Authors
Gustavo Malkomes
Carlos Eduardo Fisch de Brito
João Paulo Pordeus Gomes
Publication date
09-03-2016
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 3/2017
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-016-0541-3

Other articles of this Issue 3/2017

Pattern Analysis and Applications 3/2017 Go to the issue

Premium Partner