Skip to main content
Erschienen in: Machine Vision and Applications 2/2016

01.02.2016 | Original Paper

Logo localization and recognition in natural images using homographic class graphs

verfasst von: Raluca Boia, Corneliu Florea, Laura Florea, Radu Dogaru

Erschienen in: Machine Vision and Applications | Ausgabe 2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a method for localization and classification of brand logos in natural images. The system has to overcome multiple challenges such as perspective deformations, warping, variations of the shape and colors, occlusions, background variations. To deal with perspective variation, we rely on homography matching between the SIFT keypoints of logo instances of the same class. To address the changes in color, we construct a weighted graph of logo interconnections that is further analyzed to extract potentially multiple instances of the class. The main instance is built by grouping the keypoints of the graph connected logos onto the central image. The secondary instance is needed for color inverted logos and is obtained by inverting the orientation of the main instance. The constructed logo recognition system is tested on two databases (FlickrLogos-32 and BelgaLogos), outperforming state of the art with more than 10 % accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Confusion matrix, and other supplementary results may be retrieved from the project page http://​imag.​pub.​ro/​common/​staff/​rboia/​logoRecognition/​.
 
Literatur
1.
Zurück zum Zitat Bagdanov, A., Ballan, L., Bertini, M., Del Bimbo, A.: Trademark matching and retrieval in sports video databases. In: ACM MIR, pp. 79–86 (2007) Bagdanov, A., Ballan, L., Bertini, M., Del Bimbo, A.: Trademark matching and retrieval in sports video databases. In: ACM MIR, pp. 79–86 (2007)
2.
Zurück zum Zitat Boia, R., Florea, C.: Homographic class template for logo localization and recognition. In: Proc. of IbPRIA (2015) Boia, R., Florea, C.: Homographic class template for logo localization and recognition. In: Proc. of IbPRIA (2015)
3.
Zurück zum Zitat Brown, M., Lowe, D.: Recognising panoramas. In: ICCV, pp. 1218–1225 (2003) Brown, M., Lowe, D.: Recognising panoramas. In: ICCV, pp. 1218–1225 (2003)
4.
Zurück zum Zitat Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)CrossRef Brown, M., Lowe, D.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)CrossRef
5.
Zurück zum Zitat Chan, D., Ge, R., Gershony, O., Hesterberg, T., Lambert, D.: Evaluating online ad campaigns in a pipeline: causal models at scale. In: ACM SIGKDD Int. Conf. on Knowledge discovery and data mining, pp. 7–16 (2010) Chan, D., Ge, R., Gershony, O., Hesterberg, T., Lambert, D.: Evaluating online ad campaigns in a pipeline: causal models at scale. In: ACM SIGKDD Int. Conf. on Knowledge discovery and data mining, pp. 7–16 (2010)
6.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, pp. 886–893 (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, pp. 886–893 (2005)
7.
Zurück zum Zitat Dorko, G., Schmid, C.: Object class recognition using discriminative local features. Tech. rep, INRIA (2005) Dorko, G., Schmid, C.: Object class recognition using discriminative local features. Tech. rep, INRIA (2005)
8.
Zurück zum Zitat Dubout, C., Fleuret, F.: Exact acceleration of linear object detectors. In: ECCV, pp. 310 – 311 (2012) Dubout, C., Fleuret, F.: Exact acceleration of linear object detectors. In: ECCV, pp. 310 – 311 (2012)
9.
Zurück zum Zitat Dubrofsky, E.: Homography estimation. Master’s thesis, Carleton University (2009) Dubrofsky, E.: Homography estimation. Master’s thesis, Carleton University (2009)
10.
Zurück zum Zitat Everingham, M., Van Gool, L., Williams, C., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 1, 303–338 (2010)CrossRef Everingham, M., Van Gool, L., Williams, C., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. Int. J. Comput. Vis. 1, 303–338 (2010)CrossRef
11.
Zurück zum Zitat Fergus, R., Perona, P., Zisserman, A.: Object class recognition by unsupervised scale-invariant learning. In: CVPR, pp. 264–271 (2003) Fergus, R., Perona, P., Zisserman, A.: Object class recognition by unsupervised scale-invariant learning. In: CVPR, pp. 264–271 (2003)
12.
Zurück zum Zitat Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)CrossRefMathSciNet Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)CrossRefMathSciNet
13.
Zurück zum Zitat Florea, L., Florea, C., Vranceanu, R., Vertan, C.: Can your eyes tell me how you think? a gaze directed estimation of the mental activity. In: BMVC (2013) Florea, L., Florea, C., Vranceanu, R., Vertan, C.: Can your eyes tell me how you think? a gaze directed estimation of the mental activity. In: BMVC (2013)
14.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press (2004) Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press (2004)
15.
Zurück zum Zitat Hauagge, D.C., Snavely, N.: Image matching using local symmetry features. In: CVPR, pp. 206–213 (2012) Hauagge, D.C., Snavely, N.: Image matching using local symmetry features. In: CVPR, pp. 206–213 (2012)
16.
Zurück zum Zitat Jin, Y., Tao, L., Di, H., Rao, N., Xu, G.: Background modeling from a free-moving camera by multi-layer homography algorithm. In: ICIP, pp. 1572–1575 (2008) Jin, Y., Tao, L., Di, H., Rao, N., Xu, G.: Background modeling from a free-moving camera by multi-layer homography algorithm. In: ICIP, pp. 1572–1575 (2008)
17.
Zurück zum Zitat Joly, A., Buisson, O.: Logo retrieval with a contrario visual query expansion. In: ACM MM, pp. 581–584 (2009) Joly, A., Buisson, O.: Logo retrieval with a contrario visual query expansion. In: ACM MM, pp. 581–584 (2009)
18.
Zurück zum Zitat Kleban, J., Xie, X., Ma, W.Y.: Spatial pyramid mining for logo detection in natural scenes. In: IEEE ICME, pp. 1470–1477 (2008) Kleban, J., Xie, X., Ma, W.Y.: Spatial pyramid mining for logo detection in natural scenes. In: IEEE ICME, pp. 1470–1477 (2008)
19.
Zurück zum Zitat Klein, G., Murray, D.: Parallel tracking and mapping on a camera phone. In: Int. Symp. on mixed and augmented reality, pp. 83–86 (2009) Klein, G., Murray, D.: Parallel tracking and mapping on a camera phone. In: Int. Symp. on mixed and augmented reality, pp. 83–86 (2009)
20.
Zurück zum Zitat Krapac, J., Perronnin, F., Furon, T., Jegou, H.: Instance classification with prototype selection. In: ACM ICMR, pp. 431–434 (2014) Krapac, J., Perronnin, F., Furon, T., Jegou, H.: Instance classification with prototype selection. In: ACM ICMR, pp. 431–434 (2014)
21.
Zurück zum Zitat Kumar, S., Hebert, M.: Discriminative fields for modeling spatial dependencies in natural images. In: NIPS, pp. 1531–1538 (2004) Kumar, S., Hebert, M.: Discriminative fields for modeling spatial dependencies in natural images. In: NIPS, pp. 1531–1538 (2004)
22.
Zurück zum Zitat Lewis, R., Rao, J., Reiley, D.: Measuring the effects of advertising: the digital frontier. In: Economics of digitization, pp. 1–5 (2014) Lewis, R., Rao, J., Reiley, D.: Measuring the effects of advertising: the digital frontier. In: Economics of digitization, pp. 1–5 (2014)
23.
Zurück zum Zitat Li, K., Chen, S., Su, S., Duh, D., Zhang, H., Li, S.: Logo detection with extendibility and discrimination. Multimed. Tools Appl. 72, 1285–1310 (2014)CrossRef Li, K., Chen, S., Su, S., Duh, D., Zhang, H., Li, S.: Logo detection with extendibility and discrimination. Multimed. Tools Appl. 72, 1285–1310 (2014)CrossRef
24.
Zurück zum Zitat Lin, Y., Medioni, G.: Map-enhanced uav image sequence registration and synchronization of multiple image sequences. In: CVPR, pp. 1–7 (2007) Lin, Y., Medioni, G.: Map-enhanced uav image sequence registration and synchronization of multiple image sequences. In: CVPR, pp. 1–7 (2007)
25.
Zurück zum Zitat Lowe, D.: Object recognition from local scale-invariant features. In: ICCV, pp. 1150–1157 (1999) Lowe, D.: Object recognition from local scale-invariant features. In: ICCV, pp. 1150–1157 (1999)
26.
Zurück zum Zitat Lowe, D.: Distinctive image features from scale-invariant keypoints. IJCV 62(2), 91–110 (2004)CrossRef Lowe, D.: Distinctive image features from scale-invariant keypoints. IJCV 62(2), 91–110 (2004)CrossRef
27.
Zurück zum Zitat Lu, V., Endres, I., Stroila, M., Hart, J.: Accelerating arrays of linear classifiers using approximate range queries. In: IEEE WACV, pp. 255–260 (2014) Lu, V., Endres, I., Stroila, M., Hart, J.: Accelerating arrays of linear classifiers using approximate range queries. In: IEEE WACV, pp. 255–260 (2014)
28.
Zurück zum Zitat McLauchlan, P.F., Jaenicke, A.: Image mosaicing using sequential bundle adjustment. Image Vis. Comput., pp. 751–759 (2002) McLauchlan, P.F., Jaenicke, A.: Image mosaicing using sequential bundle adjustment. Image Vis. Comput., pp. 751–759 (2002)
29.
Zurück zum Zitat Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. IJCV 62(1–2), 43–72 (2005) Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. IJCV 62(1–2), 43–72 (2005)
30.
Zurück zum Zitat Ng, A., Jordan, M.I.: On discriminative vs. generative classifiers: a comparison of logistic regression and naive bayes. In: NIPS, pp. 841–849 (2001) Ng, A., Jordan, M.I.: On discriminative vs. generative classifiers: a comparison of logistic regression and naive bayes. In: NIPS, pp. 841–849 (2001)
31.
Zurück zum Zitat Opelt, A., Fusseneger, M., Pinz, A., Auer, P.: Generic object recognition with boosting. IEEE T PAMI 28(3), 416–431 (2006)CrossRef Opelt, A., Fusseneger, M., Pinz, A., Auer, P.: Generic object recognition with boosting. IEEE T PAMI 28(3), 416–431 (2006)CrossRef
32.
Zurück zum Zitat Psyllos, A.P., Anagnostopoulos, C.N.E., Kayafas, E.: Vehicle logo recognition using a sift-based enhanced matching scheme. IEEE Trans. Intell. Transp. Syst. 11(2), 322–328 (2010)CrossRef Psyllos, A.P., Anagnostopoulos, C.N.E., Kayafas, E.: Vehicle logo recognition using a sift-based enhanced matching scheme. IEEE Trans. Intell. Transp. Syst. 11(2), 322–328 (2010)CrossRef
33.
Zurück zum Zitat Raguram, R., Frahm, J.M., Pollefeys, M.: A comparative analysis of ransac techniques leading to adaptive real-time random sample consensus. In: Proceedings of the 10th European conference on computer vision: part II, Berlin, Heidelberg, ECCV ’08, pp. 500–513 (2008) Raguram, R., Frahm, J.M., Pollefeys, M.: A comparative analysis of ransac techniques leading to adaptive real-time random sample consensus. In: Proceedings of the 10th European conference on computer vision: part II, Berlin, Heidelberg, ECCV ’08, pp. 500–513 (2008)
34.
Zurück zum Zitat Revaud, J., Douze, M., Schmid, C.: Correlation-based burstiness for logo retrieval. In: ACM MM, pp. 965–968 (2012) Revaud, J., Douze, M., Schmid, C.: Correlation-based burstiness for logo retrieval. In: ACM MM, pp. 965–968 (2012)
35.
Zurück zum Zitat Ries, C., Richter, F., Romberg, S., Lienhart, R.: Automatic object annotation from weakly labeled data with latent structured svm. In: CBMI, pp. 1–4 (2014) Ries, C., Richter, F., Romberg, S., Lienhart, R.: Automatic object annotation from weakly labeled data with latent structured svm. In: CBMI, pp. 1–4 (2014)
36.
Zurück zum Zitat Romberg, S., Lienhart, R.: Bundle min-hashing for logo recognition. In: ACM ICMR (2013) Romberg, S., Lienhart, R.: Bundle min-hashing for logo recognition. In: ACM ICMR (2013)
37.
Zurück zum Zitat Romberg, S., Garcia Pueyo, L., Lienhart, R., van Zwol, R.: Scalable logo recognition in real-world images. In: ACM ICMR, pp. 965–968 (2011) Romberg, S., Garcia Pueyo, L., Lienhart, R., van Zwol, R.: Scalable logo recognition in real-world images. In: ACM ICMR, pp. 965–968 (2011)
38.
Zurück zum Zitat Schneiderman, H., Kanade, T.: A statistical method for 3d ob-ject detection applied to faces and cars. In: CVPR, pp. 746–751 (2003) Schneiderman, H., Kanade, T.: A statistical method for 3d ob-ject detection applied to faces and cars. In: CVPR, pp. 746–751 (2003)
39.
Zurück zum Zitat Sheikh, Y., Javed, O., Kanade, T.: Background subtraction for freely moving cameras. In: ICCV, pp. 1219–1225 (2009) Sheikh, Y., Javed, O., Kanade, T.: Background subtraction for freely moving cameras. In: ICCV, pp. 1219–1225 (2009)
40.
Zurück zum Zitat Simon, G., Fitzgibbon, A., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Augmented reality, pp. 120–128 (2000) Simon, G., Fitzgibbon, A., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Augmented reality, pp. 120–128 (2000)
41.
Zurück zum Zitat Snavely, N., Seitz, S.M., Szeliski, R.: Modeling the world from internet photo collections. Int. J. Comput. Vis. pp. 189–210 (2008) Snavely, N., Seitz, S.M., Szeliski, R.: Modeling the world from internet photo collections. Int. J. Comput. Vis. pp. 189–210 (2008)
42.
Zurück zum Zitat Torii, A., Sivic, J., Pajdla, T., Okutomi, M.: Visual place recognition with repetitive structures. In: CVPR (2013) Torii, A., Sivic, J., Pajdla, T., Okutomi, M.: Visual place recognition with repetitive structures. In: CVPR (2013)
43.
Zurück zum Zitat Torralba, A., Murphy, K., Freeman, W.: Sharing visual fea-tures for multiclass and multiview object detection. In: CVPR, pp. 762–769 (2004) Torralba, A., Murphy, K., Freeman, W.: Sharing visual fea-tures for multiclass and multiview object detection. In: CVPR, pp. 762–769 (2004)
44.
Zurück zum Zitat Vedaldi, A., Fulkerson, B.: Vlfeat: an open and portable library of computer vision algorithms. In: ACM MM, pp. 1469–1472 (2010) Vedaldi, A., Fulkerson, B.: Vlfeat: an open and portable library of computer vision algorithms. In: ACM MM, pp. 1469–1472 (2010)
45.
Zurück zum Zitat Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. CVPR 1, 511–518 (2004) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. CVPR 1, 511–518 (2004)
46.
Zurück zum Zitat Zhu, G., Doermann, D.: Automatic document logo detection. In: ICDAR, pp. 864–868 (2007) Zhu, G., Doermann, D.: Automatic document logo detection. In: ICDAR, pp. 864–868 (2007)
Metadaten
Titel
Logo localization and recognition in natural images using homographic class graphs
verfasst von
Raluca Boia
Corneliu Florea
Laura Florea
Radu Dogaru
Publikationsdatum
01.02.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 2/2016
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-015-0741-7

Weitere Artikel der Ausgabe 2/2016

Machine Vision and Applications 2/2016 Zur Ausgabe