Skip to main content
Erschienen in: Cognitive Computation 4/2013

01.12.2013

A Perceptual Visual Feature Extraction Method Achieved by Imitating V1 and V4 of the Human Visual System

verfasst von: Sungho Kim, Soon Kwon, In So Kweon

Erschienen in: Cognitive Computation | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a new shape encoding method for object recognition. We first introduce a neuro-physiologically inspired visual part detector and shape encoder. The optimal form of the visual part detector is a combination of a circular symmetry detector and a corner-like structure detector. A perceptually novel shape descriptor, known as the curvature-orientation descriptor, is then discussed. This descriptor encodes the curvature as well as the dominant orientation. The perceptual shape encoder enhances the performance of feature matching and object recognition taken from standard test images. The results from the repeatability and object recognition tests validate the feasibility of the proposed perceptual feature extraction method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bay H, Tuytelaars T, Gool LV. SURF: speeded up robust features. In: Proceedings of European conference of computer vision (ECCV) 2006. Bay H, Tuytelaars T, Gool LV. SURF: speeded up robust features. In: Proceedings of European conference of computer vision (ECCV) 2006.
2.
Zurück zum Zitat Belongie S, Malik J, Puzicha J. Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell. 2002;24(24):509–22.CrossRef Belongie S, Malik J, Puzicha J. Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell. 2002;24(24):509–22.CrossRef
4.
Zurück zum Zitat Chomat O, de Verdière VC, Hall D, Crowley JL. Local scale selection for gaussian based description techniques. In: Proceedings of the European conference of computer vision (ECCV), 2000. p. 117–33. Chomat O, de Verdière VC, Hall D, Crowley JL. Local scale selection for gaussian based description techniques. In: Proceedings of the European conference of computer vision (ECCV), 2000. p. 117–33.
5.
Zurück zum Zitat Connor CE, Brincat SL, Pasupathy A. Transformation of shape information in the ventral pathway. Curr Opin Neurobiol. 2007;17(2):140–7. Connor CE, Brincat SL, Pasupathy A. Transformation of shape information in the ventral pathway. Curr Opin Neurobiol. 2007;17(2):140–7.
6.
Zurück zum Zitat Deng H, Zhang W, Mortensen E, Dietterich T, Shapiro L. Principal curvature-based region detector for object recognition. In: IEEE conference on computer vision and patter recognition (CVPR), 2007. p. 1–8. Deng H, Zhang W, Mortensen E, Dietterich T, Shapiro L. Principal curvature-based region detector for object recognition. In: IEEE conference on computer vision and patter recognition (CVPR), 2007. p. 1–8.
7.
Zurück zum Zitat Dobbins A, Zucker SW, Cynader MS. Endstopping and curvature. Vision Res. 1989;29(10):1371–87.PubMedCrossRef Dobbins A, Zucker SW, Cynader MS. Endstopping and curvature. Vision Res. 1989;29(10):1371–87.PubMedCrossRef
8.
Zurück zum Zitat Donias M, Baylou P, Keskes N. Curvature of oriented patterns: 2-D and 3-D estimation from differential geometry. In: ICIP (1), 1998. p. 236–40. Donias M, Baylou P, Keskes N. Curvature of oriented patterns: 2-D and 3-D estimation from differential geometry. In: ICIP (1), 1998. p. 236–40.
9.
Zurück zum Zitat Gawne T, Martin J. Responses of primate visual cortical V4 neurons to simultaneously presented stimuli. J Neurophysiol 2002;88:1128–35.PubMed Gawne T, Martin J. Responses of primate visual cortical V4 neurons to simultaneously presented stimuli. J Neurophysiol 2002;88:1128–35.PubMed
10.
Zurück zum Zitat van Ginkel M, van de Weijer J, van Vliet LJ, Verbeek PW. Curvature estimation from orientation fields. In: SCIA, 1999. p. 545–51. van Ginkel M, van de Weijer J, van Vliet LJ, Verbeek PW. Curvature estimation from orientation fields. In: SCIA, 1999. p. 545–51.
11.
Zurück zum Zitat Han JH, Poston T. Chord-to-point distance accumulatin and planar curvature: a new approach to discrte curvature. Patt Recognit Lett 2001;22:1133–44.CrossRef Han JH, Poston T. Chord-to-point distance accumulatin and planar curvature: a new approach to discrte curvature. Patt Recognit Lett 2001;22:1133–44.CrossRef
12.
Zurück zum Zitat Harris C, Stephens M. A combined corner and edge detector. In: Proceedings of the 4th alvey vision conference 1988. Harris C, Stephens M. A combined corner and edge detector. In: Proceedings of the 4th alvey vision conference 1988.
13.
Zurück zum Zitat Hoffman DD. Visual intelligence: how to create what we see. New York, NY: Norton; 1998. Hoffman DD. Visual intelligence: how to create what we see. New York, NY: Norton; 1998.
14.
Zurück zum Zitat Hubel D, Wiesel T. Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J Neurophysiol. 1965;28:229–89.PubMed Hubel D, Wiesel T. Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J Neurophysiol. 1965;28:229–89.PubMed
15.
Zurück zum Zitat Join C, Tabbone S. Robust curvature extrema detection based on new numerical derivation. Lect Notes Comput Sci. 2008;5259:485–93.CrossRef Join C, Tabbone S. Robust curvature extrema detection based on new numerical derivation. Lect Notes Comput Sci. 2008;5259:485–93.CrossRef
16.
Zurück zum Zitat Jones JP, Palmer L. An evaluation of the two-dimensional gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol. 1987;58:1233–58.PubMed Jones JP, Palmer L. An evaluation of the two-dimensional gabor filter model of simple receptive fields in cat striate cortex. J Neurophysiol. 1987;58:1233–58.PubMed
17.
Zurück zum Zitat Kass M, Witkin AP. Analyzing oriented patterns. Comput Vision Graph Image Process. 1987;37(3):362–85.CrossRef Kass M, Witkin AP. Analyzing oriented patterns. Comput Vision Graph Image Process. 1987;37(3):362–85.CrossRef
18.
Zurück zum Zitat Ke Y, Sukthankar R. PCA-SIFT: A more distinctive representation for local image descriptors. In: IEEE conference on computer vision and patter recognition (CVPR), 2004. p. 506–13. Ke Y, Sukthankar R. PCA-SIFT: A more distinctive representation for local image descriptors. In: IEEE conference on computer vision and patter recognition (CVPR), 2004. p. 506–13.
19.
Zurück zum Zitat Kopf S, Haenselmann T, Effelsberg W. Enhancing curvature scale space features for robust shape classification. In: Proceedings of IEEE international conference on multimedia and expo (ICME), 2005. p. 1–8. Kopf S, Haenselmann T, Effelsberg W. Enhancing curvature scale space features for robust shape classification. In: Proceedings of IEEE international conference on multimedia and expo (ICME), 2005. p. 1–8.
20.
Zurück zum Zitat Kouh M, Riesenhuber M. Investigating shape representation in area V4 with hmax: orientation and grating selectivities. Tech. Rep. AIM2003-021, Massachusetts Institute of Technology, 2003. Kouh M, Riesenhuber M. Investigating shape representation in area V4 with hmax: orientation and grating selectivities. Tech. Rep. AIM2003-021, Massachusetts Institute of Technology, 2003.
21.
Zurück zum Zitat Kuhnel W. Differential geometry: curves-surfaces-manifolds, vol. 2. Providence, RI: American Mathematical Society; 2002. Kuhnel W. Differential geometry: curves-surfaces-manifolds, vol. 2. Providence, RI: American Mathematical Society; 2002.
22.
Zurück zum Zitat Latecki L, Lakämper R. Convexity rule for shape decomposition based on discrete contour evolution. Int J Comput Vision Image Underst. 1999;73(3):441–54.CrossRef Latecki L, Lakämper R. Convexity rule for shape decomposition based on discrete contour evolution. Int J Comput Vision Image Underst. 1999;73(3):441–54.CrossRef
23.
Zurück zum Zitat Lin WY, Chiu YL, R.Widder K, Hu YH, Boston N. Robust and accurate curvature estimation using adaptive line integrals. EURASIP J Adv Signal Process. 2010;2010:485–493. Lin WY, Chiu YL, R.Widder K, Hu YH, Boston N. Robust and accurate curvature estimation using adaptive line integrals. EURASIP J Adv Signal Process. 2010;2010:485–493.
24.
Zurück zum Zitat Lowe D. Distinctive image features from scale-invariant keypoints. Int J Comput Vision. 2004;60(2):91–110CrossRef Lowe D. Distinctive image features from scale-invariant keypoints. Int J Comput Vision. 2004;60(2):91–110CrossRef
25.
Zurück zum Zitat Loy G, Zelinsky A. Fast radial symmetry transform for detecting points of interest. IEEE Trans Pattern Anal Mach Intell. 2003;25(8):959–73.CrossRef Loy G, Zelinsky A. Fast radial symmetry transform for detecting points of interest. IEEE Trans Pattern Anal Mach Intell. 2003;25(8):959–73.CrossRef
26.
Zurück zum Zitat Matas J, Chum O, Urban M, Pajdla T. Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British machine vision conference (BMVC), 2002. Matas J, Chum O, Urban M, Pajdla T. Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British machine vision conference (BMVC), 2002.
27.
Zurück zum Zitat Mikolajcyk K, Schmid C. An affine invariant interest point detector. In: Proceedins of the international conference on computer vision (ICCV) 2002. Mikolajcyk K, Schmid C. An affine invariant interest point detector. In: Proceedins of the international conference on computer vision (ICCV) 2002.
28.
Zurück zum Zitat Mikolajczyk K, Schmid C. Performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 2005;27(10):1615–30.PubMedCrossRef Mikolajczyk K, Schmid C. Performance evaluation of local descriptors. IEEE Trans Pattern Anal Mach Intell 2005;27(10):1615–30.PubMedCrossRef
29.
Zurück zum Zitat Mokhtarian F, Suomela R. Robust image corner detection through curvature scale space. IEEE Trans Pattern Anal Mach Intell 1998;20(12):1376–81.CrossRef Mokhtarian F, Suomela R. Robust image corner detection through curvature scale space. IEEE Trans Pattern Anal Mach Intell 1998;20(12):1376–81.CrossRef
30.
Zurück zum Zitat Papacostas GA, Boutalis YS, Karras DA, Mertzios BG. A new class of zernike moments for computer vision applications. Inf Sci 2007;177:2802–19.CrossRef Papacostas GA, Boutalis YS, Karras DA, Mertzios BG. A new class of zernike moments for computer vision applications. Inf Sci 2007;177:2802–19.CrossRef
31.
Zurück zum Zitat Pasupathy A, Connor C. Shape representation in area V4: position-specific tuning for boundary conformation. J Neurophysiol. 2001;86(5):2505–19.PubMed Pasupathy A, Connor C. Shape representation in area V4: position-specific tuning for boundary conformation. J Neurophysiol. 2001;86(5):2505–19.PubMed
32.
Zurück zum Zitat Qi H, Li K, Shen Y, Qu W. An effective solution for trademark image retrieval by combining shape description and feature matching. Pattern Recognit. 2010;43(6):2017–27. Qi H, Li K, Shen Y, Qu W. An effective solution for trademark image retrieval by combining shape description and feature matching. Pattern Recognit. 2010;43(6):2017–27.
33.
Zurück zum Zitat Qian G, Sural S, Gu Y, Pramanik S. Similarity between euclidean and cosine angle distance for nearest neighbor queries. In: Proceedings of 2004 ACM symposium on applied computing, 2004. p. 1232–7. New York: ACM Press. Qian G, Sural S, Gu Y, Pramanik S. Similarity between euclidean and cosine angle distance for nearest neighbor queries. In: Proceedings of 2004 ACM symposium on applied computing, 2004. p. 1232–7. New York: ACM Press.
34.
Zurück zum Zitat Raftopoulos KA, Kollias SD. Visual pathways for shape abstraction. Lect Notes Comput Sci. 2011;6791:291–8.CrossRef Raftopoulos KA, Kollias SD. Visual pathways for shape abstraction. Lect Notes Comput Sci. 2011;6791:291–8.CrossRef
35.
Zurück zum Zitat Raftopoulos KA, Papadakis N, Ntalianis K, Kollias S. A visual pathway for shape-based invariant classification of gray scale images. Integr Comput Aided Eng. 2007;14(4):365–78. Raftopoulos KA, Papadakis N, Ntalianis K, Kollias S. A visual pathway for shape-based invariant classification of gray scale images. Integr Comput Aided Eng. 2007;14(4):365–78.
36.
Zurück zum Zitat Rao RPN, Ballard DH. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci. 1999;20(1):79–87.CrossRef Rao RPN, Ballard DH. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci. 1999;20(1):79–87.CrossRef
37.
Zurück zum Zitat Reisfeld D, Wolfson H, Yeshurun Y. Context-free attentional operators: the generalized symmetry transform. Int J Comput Vision. 1995;14(2):119–30.CrossRef Reisfeld D, Wolfson H, Yeshurun Y. Context-free attentional operators: the generalized symmetry transform. Int J Comput Vision. 1995;14(2):119–30.CrossRef
38.
Zurück zum Zitat Ringach D. Spatial structure and symmetry of simple-cell receptive field in macaque primary visual cortex. J Neurophysiol. 2002;88:455–63.PubMed Ringach D. Spatial structure and symmetry of simple-cell receptive field in macaque primary visual cortex. J Neurophysiol. 2002;88:455–63.PubMed
39.
Zurück zum Zitat Rosten E, Drummond T. Machine learning for high speed corner detection. In: Proceedings of the European conference of computer vision (ECCV) 2006. Rosten E, Drummond T. Machine learning for high speed corner detection. In: Proceedings of the European conference of computer vision (ECCV) 2006.
40.
Zurück zum Zitat Schmid C, Mohr R, Bauckhage C. Evaluation of interest point detectors. Int J Comput Vision. 2000;37(2):151–72.CrossRef Schmid C, Mohr R, Bauckhage C. Evaluation of interest point detectors. Int J Comput Vision. 2000;37(2):151–72.CrossRef
41.
Zurück zum Zitat Serre T, Wolf L, Poggio T. Object recognition with features inspired by visual cortex. In: IEEE conference on computer vision and patter recognition (CVPR) 2005. Serre T, Wolf L, Poggio T. Object recognition with features inspired by visual cortex. In: IEEE conference on computer vision and patter recognition (CVPR) 2005.
42.
Zurück zum Zitat Stoker J. Differential geometry. New York: Wiley; 1969. Stoker J. Differential geometry. New York: Wiley; 1969.
43.
Zurück zum Zitat Tico M, Kuosmanen P. Fingerprint matching using an orientation-based minutia descriptor. IEEE Trans Pattern Anal Mach Intell. 2003;25(8):1009–14.CrossRef Tico M, Kuosmanen P. Fingerprint matching using an orientation-based minutia descriptor. IEEE Trans Pattern Anal Mach Intell. 2003;25(8):1009–14.CrossRef
44.
Zurück zum Zitat Toews M, III WMW. Sift-rank: ordinal description for invariant feature correspondence. In: IEEE conference on computer vision and pattern recognition, 2009. p. 172–7. Toews M, III WMW. Sift-rank: ordinal description for invariant feature correspondence. In: IEEE conference on computer vision and pattern recognition, 2009. p. 172–7.
45.
Zurück zum Zitat Winter JD, Wagemans J. Perceptual saliency of points along the contour of everyday objects: a large-scale study. Percept Psychophys. 2008;70(1):50–64.PubMedCrossRef Winter JD, Wagemans J. Perceptual saliency of points along the contour of everyday objects: a large-scale study. Percept Psychophys. 2008;70(1):50–64.PubMedCrossRef
46.
Zurück zum Zitat Yau JM, Pasupathy A, Brincat SL, Connor CE. Curvature processing dynamics in macaque area V4. Cerebral Cortex, 2012. Yau JM, Pasupathy A, Brincat SL, Connor CE. Curvature processing dynamics in macaque area V4. Cerebral Cortex, 2012.
47.
Zurück zum Zitat Zang D, Li J, Zhang D. Robust visual correspondence computation using monogenic curvature phase based mutual information. Opt Lett. 2012;37:10–2.PubMedCrossRef Zang D, Li J, Zhang D. Robust visual correspondence computation using monogenic curvature phase based mutual information. Opt Lett. 2012;37:10–2.PubMedCrossRef
Metadaten
Titel
A Perceptual Visual Feature Extraction Method Achieved by Imitating V1 and V4 of the Human Visual System
verfasst von
Sungho Kim
Soon Kwon
In So Kweon
Publikationsdatum
01.12.2013
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 4/2013
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-012-9194-8

Weitere Artikel der Ausgabe 4/2013

Cognitive Computation 4/2013 Zur Ausgabe

Premium Partner