Skip to main content
Erschienen in: Pattern Analysis and Applications 2/2015

01.05.2015 | Industrial and Commercial Application

CSIFT based locality-constrained linear coding for image classification

verfasst von: Junzhou Chen, Qing Li, Qiang Peng, Kin Hong Wong

Erschienen in: Pattern Analysis and Applications | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the past decade, SIFT descriptor has been witnessed as one of the most robust local invariant feature descriptors and widely used in various vision tasks. Most traditional image-classification systems depend on the gray-based SIFT descriptors, which only analyze the gray level variations of the images. Misclassification may happen since their color contents are ignored. In this article, we concentrate on improving the performance of existing image-classification algorithms by adding color information. To achieve this purpose, different kinds of colored SIFT descriptors are introduced and implemented. locality-constrained linear coding (LLC), a state-of-the-art sparse coding technology, is employed to construct the image-classification system for the evaluation. Moreover, we propose a simple \(\ell _2\)-norm regularized local distance to improve the traditional LLC method. The real experiments are carried out on several benchmarks. With the enhancements to color SIFT and \(\ell _2\)-norm regularization, the proposed image-classification system obtains approximately \(2\,\%\) improvement of classification accuracy on the Caltech-101 dataset and approximately \(5\,\%\) improvement of classification accuracy on the Caltech-256 dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
2.
Zurück zum Zitat Geusebroek J-M, van den Boomgaard R, Smeulders AWM, Geerts H (2001) Color invariance. IEEE Trans Pattern Anal Mach Intell 23(12):1338–1350 Geusebroek J-M, van den Boomgaard R, Smeulders AWM, Geerts H (2001) Color invariance. IEEE Trans Pattern Anal Mach Intell 23(12):1338–1350
3.
Zurück zum Zitat Abdel-Hakim AE, Farag AA (2006) Csift: a sift descriptor with color invariant characteristics. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 1978–1983 Abdel-Hakim AE, Farag AA (2006) Csift: a sift descriptor with color invariant characteristics. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 1978–1983
4.
Zurück zum Zitat Van De Weijer J, Gevers T, Bagdanov AD (2006) Boosting color saliency in image feature detection. IEEE Trans Pattern Anal Mach Intell 28(1):150–156 Van De Weijer J, Gevers T, Bagdanov AD (2006) Boosting color saliency in image feature detection. IEEE Trans Pattern Anal Mach Intell 28(1):150–156
5.
Zurück zum Zitat Burghouts GJ, Geusebroek J-M (2009) Performance evaluation of local colour invariants. Comput Vis Image Underst 113(1):48–62CrossRef Burghouts GJ, Geusebroek J-M (2009) Performance evaluation of local colour invariants. Comput Vis Image Underst 113(1):48–62CrossRef
6.
Zurück zum Zitat Gevers T, Gijsenij A, Van de Weijer J, Geusebroek J-M (2012) Color in computer vision: fundamentals and applications, vol 24. Wiley, New York Gevers T, Gijsenij A, Van de Weijer J, Geusebroek J-M (2012) Color in computer vision: fundamentals and applications, vol 24. Wiley, New York
7.
Zurück zum Zitat Goldfarb D, Idnani A (1983) A numerically stable dual method for solving strictly convex quadratic programs. Math Program 27(1):1–33CrossRefMATHMathSciNet Goldfarb D, Idnani A (1983) A numerically stable dual method for solving strictly convex quadratic programs. Math Program 27(1):1–33CrossRefMATHMathSciNet
8.
Zurück zum Zitat Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, vol 1, pp 22 Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, vol 1, pp 22
9.
Zurück zum Zitat Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 2169–2178 Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 2169–2178
10.
Zurück zum Zitat Shabou A, LeBorgne H (2012) Locality-constrained and spatially regularized coding for scene categorization. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3618–3625 Shabou A, LeBorgne H (2012) Locality-constrained and spatially regularized coding for scene categorization. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3618–3625
11.
Zurück zum Zitat Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: IEEE conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE, pp 1794–1801 Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: IEEE conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE, pp 1794–1801
12.
Zurück zum Zitat Yu K, Zhang T, Gong Y (2009) Nonlinear learning using local coordinate coding. Adv Neural Inf Process Syst 22:2223–2231 Yu K, Zhang T, Gong Y (2009) Nonlinear learning using local coordinate coding. Adv Neural Inf Process Syst 22:2223–2231
13.
Zurück zum Zitat Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3360–3367 Wang J, Yang J, Yu K, Lv F, Huang T, Gong Y (2010) Locality-constrained linear coding for image classification. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3360–3367
14.
Zurück zum Zitat Yang J, Yu K, Huang T (2010) Supervised translation-invariant sparse coding. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3517–3524 Yang J, Yu K, Huang T (2010) Supervised translation-invariant sparse coding. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3517–3524
15.
Zurück zum Zitat Liu L, Wang L, Liu X (2011) In defense of soft-assignment coding. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 2486–2493 Liu L, Wang L, Liu X (2011) In defense of soft-assignment coding. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 2486–2493
16.
Zurück zum Zitat Yang M, Zhang L, Feng X, Zhang D (2011) Fisher discrimination dictionary learning for sparse representation. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 543–550 Yang M, Zhang L, Feng X, Zhang D (2011) Fisher discrimination dictionary learning for sparse representation. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 543–550
17.
Zurück zum Zitat Shafer SA (1985) Using color to separate reflection components. Color Res Appl 10(4):210–218CrossRef Shafer SA (1985) Using color to separate reflection components. Color Res Appl 10(4):210–218CrossRef
18.
Zurück zum Zitat Gevers T, Van De Weijer J, Stokman H et al (2007) Color feature detection. Color image processing: methods and applications, pp 203–226 Gevers T, Van De Weijer J, Stokman H et al (2007) Color feature detection. Color image processing: methods and applications, pp 203–226
19.
Zurück zum Zitat Gevers T, Smeulders WM et al (1999) Color based object recognition. Pattern Recognit 32(3):453–464 Gevers T, Smeulders WM et al (1999) Color based object recognition. Pattern Recognit 32(3):453–464
20.
Zurück zum Zitat van de Sande KEA, Gevers T, Snoek CGM (2010) Evaluating color descriptors for object and scene recognition. IEEE Trans Pattern Anal Mach Intell 32(9):1582–1596 van de Sande KEA, Gevers T, Snoek CGM (2010) Evaluating color descriptors for object and scene recognition. IEEE Trans Pattern Anal Mach Intell 32(9):1582–1596
21.
Zurück zum Zitat Lowe DG (1999) Object recognition from local scale-invariant features. In: The proceedings of the seventh IEEE international conference on computer vision, vol 2. IEEE, pp 1150–1157 Lowe DG (1999) Object recognition from local scale-invariant features. In: The proceedings of the seventh IEEE international conference on computer vision, vol 2. IEEE, pp 1150–1157
22.
Zurück zum Zitat Bosch A, Zisserman A, Muoz X (2008) Scene classification using a hybrid generative/discriminative approach. IEEE Trans Pattern Anal Mach Intell 30(4):712–727CrossRef Bosch A, Zisserman A, Muoz X (2008) Scene classification using a hybrid generative/discriminative approach. IEEE Trans Pattern Anal Mach Intell 30(4):712–727CrossRef
23.
Zurück zum Zitat Hering E (1964) Outlines of a theory of the light sense, vol 344. Harvard University Press, Cambridge Hering E (1964) Outlines of a theory of the light sense, vol 344. Harvard University Press, Cambridge
24.
Zurück zum Zitat Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611CrossRef Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611CrossRef
25.
Zurück zum Zitat Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset
26.
Zurück zum Zitat Fan R-E, Chang K-W, Hsieh C-J, Wang X-R, Lin C-J (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9:1871–1874MATH Fan R-E, Chang K-W, Hsieh C-J, Wang X-R, Lin C-J (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9:1871–1874MATH
27.
Zurück zum Zitat Khan R, Van de Weijer J, Khan FS, Muselet D, Ducottet C, Barat C (2013) Discriminative color descriptors. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2866–2873 Khan R, Van de Weijer J, Khan FS, Muselet D, Ducottet C, Barat C (2013) Discriminative color descriptors. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2866–2873
Metadaten
Titel
CSIFT based locality-constrained linear coding for image classification
verfasst von
Junzhou Chen
Qing Li
Qiang Peng
Kin Hong Wong
Publikationsdatum
01.05.2015
Verlag
Springer London
Erschienen in
Pattern Analysis and Applications / Ausgabe 2/2015
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-014-0427-1

Weitere Artikel der Ausgabe 2/2015

Pattern Analysis and Applications 2/2015 Zur Ausgabe