Skip to main content
Erschienen in: Machine Vision and Applications 4/2015

01.05.2015 | Original Paper

A comparative experimental study of image feature detectors and descriptors

Erschienen in: Machine Vision and Applications | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Feature detection and matching is a fundamental problem in many computer vision applications. In the past decades, various types of feature detectors and descriptors have been proposed in the literature. Although several comparative studies on feature detectors and descriptors have been performed in the past, few studies have been carried out concerning recently proposed descriptors such as BRISK, FREAK, etc. Also, previous comparisons were either application oriented or limited in experimentation or in the number of detectors and descriptors compared. This paper provides a comprehensive review of a large number of popular feature detectors developed in the last three decades. The study makes several contributions to the development of a generic comparison of feature detectors and descriptors. First, we conduct comparisons of invariance against image transformations such as illumination changes, blurring, rotation, scaling, viewpoint changes, exposure, JPEG compression, combined scaling and rotation, and combined viewpoint changes. Second, we provide a proper distinction between detectors and descriptors using separate comparisons. Third, a few detectors have been tested on the variation of parameter values. Fourth, we conduct a statistical analysis of invariance against four popular types of transformations: viewpoint changes, blurring, scaling, and rotation. Fifth, we carry out intuitive matching between detectors and descriptors, testing on simulated and practical scenarios. Last, we conduct exhaustive experiments on several datasets for each combination of detectors and descriptors to provide a ranking that can also be weighted to suit specific applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aanæs, H., Dahl, A., Steenstrup Pedersen, K.: Interesting interest points. Int. J. Comput. Vis. 97, 18–35 (2012)CrossRef Aanæs, H., Dahl, A., Steenstrup Pedersen, K.: Interesting interest points. Int. J. Comput. Vis. 97, 18–35 (2012)CrossRef
2.
Zurück zum Zitat Agrawal, M., Konolige, K., Blas, M.: CenSurE: center surround extremas for realtime feature detection and matching. In: Proceedings of European Conference on Computer Vision, pp. 102–115 (2008) Agrawal, M., Konolige, K., Blas, M.: CenSurE: center surround extremas for realtime feature detection and matching. In: Proceedings of European Conference on Computer Vision, pp. 102–115 (2008)
3.
Zurück zum Zitat Alahi, A., Ortiz, R., Vandergheynst, P.: Freak: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 510–517 (2012) Alahi, A., Ortiz, R., Vandergheynst, P.: Freak: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 510–517 (2012)
4.
Zurück zum Zitat Bay, H., Tuytelaars, T., Gool, L.V.: SURF: speeded up robust features. In: Proceedings of the European Conference on Computer Vision, pp. 404–417 (2006) Bay, H., Tuytelaars, T., Gool, L.V.: SURF: speeded up robust features. In: Proceedings of the European Conference on Computer Vision, pp. 404–417 (2006)
5.
Zurück zum Zitat Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision, pp. 778–792 (2010) Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision, pp. 778–792 (2010)
6.
Zurück zum Zitat Dahl, A.L., Aanæs, H., Pedersen, K.S.: Finding the best feature detector–descriptor combination. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 318–325 (2011) Dahl, A.L., Aanæs, H., Pedersen, K.S.: Finding the best feature detector–descriptor combination. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 318–325 (2011)
7.
Zurück zum Zitat Feng, Y., Ren, J., Jiang, J., Halvey, M., Jose, J.: Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization. Mach. Vis. Appl. 23(5), 1011–1027 (2012)CrossRef Feng, Y., Ren, J., Jiang, J., Halvey, M., Jose, J.: Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization. Mach. Vis. Appl. 23(5), 1011–1027 (2012)CrossRef
8.
Zurück zum Zitat Fernández, A., Ghita, O., González, E., Bianconi, F., Whelan, P.: Evaluation of robustness against rotation of LBP, CCR and ILBP features in granite texture classification. Mach. Vis. Appl. 22(6), 913–926 (2011)CrossRef Fernández, A., Ghita, O., González, E., Bianconi, F., Whelan, P.: Evaluation of robustness against rotation of LBP, CCR and ILBP features in granite texture classification. Mach. Vis. Appl. 22(6), 913–926 (2011)CrossRef
9.
Zurück zum Zitat Forstner, W.: A framework for low level feature extraction. In: Proceedings of the European Conference on Computer Vision, pp. 383–394 (1994) Forstner, W.: A framework for low level feature extraction. In: Proceedings of the European Conference on Computer Vision, pp. 383–394 (1994)
10.
Zurück zum Zitat Gao, J., Huang, X., Liu, B.: A quick scale-invariant interest point detecting approach. Mach. Vis. Appl. 21(3), 351–364 (2010)CrossRefMathSciNet Gao, J., Huang, X., Liu, B.: A quick scale-invariant interest point detecting approach. Mach. Vis. Appl. 21(3), 351–364 (2010)CrossRefMathSciNet
11.
Zurück zum Zitat Gauglitz, S., Höllerer, T., Turk, M.: Dataset and evaluation of interest point detectors for visual tracking. Technical Report, Department of Computer Science, University of California (2010) Gauglitz, S., Höllerer, T., Turk, M.: Dataset and evaluation of interest point detectors for visual tracking. Technical Report, Department of Computer Science, University of California (2010)
13.
Zurück zum Zitat Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The Kitti vision benchmark suite. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The Kitti vision benchmark suite. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2012)
14.
Zurück zum Zitat Geusebroek, J.M., Burghouts, G., Smeulders, A.M.: The Amsterdam library of object images. Int. J. Comput. Vis. 61(1), 103–112 (2005)CrossRef Geusebroek, J.M., Burghouts, G., Smeulders, A.M.: The Amsterdam library of object images. Int. J. Comput. Vis. 61(1), 103–112 (2005)CrossRef
15.
Zurück zum Zitat Gil, A., Mozos, O., Ballesta, M., Reinoso, O.: A comparative evaluation of interest point detectors and local descriptors for visual slam. Mach. Vis. Appl. 21(6), 905–920 (2010)CrossRef Gil, A., Mozos, O., Ballesta, M., Reinoso, O.: A comparative evaluation of interest point detectors and local descriptors for visual slam. Mach. Vis. Appl. 21(6), 905–920 (2010)CrossRef
16.
Zurück zum Zitat Govender, N.: Evaluation of feature detection algorithms for structure from motion. In: 3rd Robotics and Mechatronics Symposium (ROBMECH), pp. 1–4 (2009) Govender, N.: Evaluation of feature detection algorithms for structure from motion. In: 3rd Robotics and Mechatronics Symposium (ROBMECH), pp. 1–4 (2009)
17.
Zurück zum Zitat Goyette, N., Jodoin, P., Porikli, F., Konrad, J., Ishwar, P.: Changedetection.net: a new change detection benchmark dataset. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–8 (2012) Goyette, N., Jodoin, P., Porikli, F., Konrad, J., Ishwar, P.: Changedetection.net: a new change detection benchmark dataset. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1–8 (2012)
18.
Zurück zum Zitat Hall, D., Leibe, B., Schiele, B.: Saliency of interest points under scale changes. In: British Mach. Vis. Conf., pp. 646–655 (2002) Hall, D., Leibe, B., Schiele, B.: Saliency of interest points under scale changes. In: British Mach. Vis. Conf., pp. 646–655 (2002)
19.
Zurück zum Zitat Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of Alvey Vision Conference, pp. 147–151 (1988) Harris, C., Stephens, M.: A combined corner and edge detector. In: Proceedings of Alvey Vision Conference, pp. 147–151 (1988)
20.
Zurück zum Zitat Heinly, J., Dunn, E., Frahm, J.M.: Comparative evaluation of binary features. In: Proceedings of European Conference on Computer Vision, pp. 759–773 (2012) Heinly, J., Dunn, E., Frahm, J.M.: Comparative evaluation of binary features. In: Proceedings of European Conference on Computer Vision, pp. 759–773 (2012)
21.
Zurück zum Zitat Heitger, F., Rosenthaler, L., von der Heydt, R., Peterhans, E., Kuebler, O.: Simulation of neural contour mechanism: from simple to end-stopped cells. Vis. Res. 32(5), 963–981 (1992)CrossRef Heitger, F., Rosenthaler, L., von der Heydt, R., Peterhans, E., Kuebler, O.: Simulation of neural contour mechanism: from simple to end-stopped cells. Vis. Res. 32(5), 963–981 (1992)CrossRef
22.
Zurück zum Zitat Kaneva, B., Torralba, A., Freeman, W.T.: Evaluating image feaures using a photorealistic virtual world. In: Proceedings of IEEE International Conference on Computer Vision (2011) Kaneva, B., Torralba, A., Freeman, W.T.: Evaluating image feaures using a photorealistic virtual world. In: Proceedings of IEEE International Conference on Computer Vision (2011)
24.
Zurück zum Zitat Kitt, B., Geiger, A., Lategahn, H.: Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme. In: IEEE Intelligent Vehicles Symposium (IV), pp. 486–492 (2010) Kitt, B., Geiger, A., Lategahn, H.: Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme. In: IEEE Intelligent Vehicles Symposium (IV), pp. 486–492 (2010)
25.
Zurück zum Zitat Leutenegger, S., Chli, M., Siegwart, R.: BRISK: binary robust invariant scalable keypoints. In: Proceedings of IEEE International Conference on Computer Vision, pp. 2548–2555 (2011) Leutenegger, S., Chli, M., Siegwart, R.: BRISK: binary robust invariant scalable keypoints. In: Proceedings of IEEE International Conference on Computer Vision, pp. 2548–2555 (2011)
26.
Zurück zum Zitat Li, J., Allinson, N.M.: A comprehensive review of current local features for computer vision. Neurocomputing 71(10–12), 1771–1787 (2008)CrossRef Li, J., Allinson, N.M.: A comprehensive review of current local features for computer vision. Neurocomputing 71(10–12), 1771–1787 (2008)CrossRef
27.
Zurück zum Zitat Liao, K., Liu, G., Hui, Y.: An improvement to the SIFT descriptor for image representation and matching. Pattern Recognit. Lett. 34(11), 1211–1220 (2013)CrossRef Liao, K., Liu, G., Hui, Y.: An improvement to the SIFT descriptor for image representation and matching. Pattern Recognit. Lett. 34(11), 1211–1220 (2013)CrossRef
28.
Zurück zum Zitat Lindeberg, T.: Feature detection with automatic scale selection. Int. J. Comput. Vis. 30(2), 79–116 (1998)CrossRef Lindeberg, T.: Feature detection with automatic scale selection. Int. J. Comput. Vis. 30(2), 79–116 (1998)CrossRef
29.
Zurück zum Zitat Lowe, D.: Object recognition from local scale-invariant features. In: Proceedings of IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999) Lowe, D.: Object recognition from local scale-invariant features. In: Proceedings of IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)
30.
Zurück zum Zitat Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image Vis. Comput. 22(10), 761–767 (2004)CrossRef Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image Vis. Comput. 22(10), 761–767 (2004)CrossRef
31.
Zurück zum Zitat Mikolajczyk, K., Schmid, C.: Indexing based on scale invariant interest points. In: Proceedings of IEEE International Conference on Computer Vision, pp. 525–531 (2001) Mikolajczyk, K., Schmid, C.: Indexing based on scale invariant interest points. In: Proceedings of IEEE International Conference on Computer Vision, pp. 525–531 (2001)
32.
Zurück zum Zitat Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef
33.
Zurück zum Zitat Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. Int. J. Comput. Vis. 65(1–2), 43–72 (2005)CrossRef Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. Int. J. Comput. Vis. 65(1–2), 43–72 (2005)CrossRef
34.
Zurück zum Zitat Moravec, H.P.: Towards automatic visual obstacle avoidance. In: Proceedings of International Joint Conference on Artificial Intelligence, p. 584 (1977) Moravec, H.P.: Towards automatic visual obstacle avoidance. In: Proceedings of International Joint Conference on Artificial Intelligence, p. 584 (1977)
35.
Zurück zum Zitat Moreels, P., Perona, P.: Evaluation of features detectors and descriptors based on 3d objects. In: Proceedings of IEEE International Conference on Computer Vision, vol. 1, pp. 800–807 (2005) Moreels, P., Perona, P.: Evaluation of features detectors and descriptors based on 3d objects. In: Proceedings of IEEE International Conference on Computer Vision, vol. 1, pp. 800–807 (2005)
36.
Zurück zum Zitat Nistér, D., Stewénius, H.: Linear time maximally stable extremal regions. In: Proceedings of European Conference on Computer Vision, pp. 183–196 (2008) Nistér, D., Stewénius, H.: Linear time maximally stable extremal regions. In: Proceedings of European Conference on Computer Vision, pp. 183–196 (2008)
37.
Zurück zum Zitat Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Proceedings of European Conference on Computer Vision, pp. 430–443 (2006) Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: Proceedings of European Conference on Computer Vision, pp. 430–443 (2006)
38.
Zurück zum Zitat Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Proceedings of IEEE International Conference on Computer Vision, pp. 2564–2571 (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Proceedings of IEEE International Conference on Computer Vision, pp. 2564–2571 (2011)
39.
Zurück zum Zitat Schmid, C., Mohr, R., Bauckhage, C.: Comparing and evaluating interest points. In: Proceedings of IEEE International Conference on Computer Vision, pp. 230–235 (1998) Schmid, C., Mohr, R., Bauckhage, C.: Comparing and evaluating interest points. In: Proceedings of IEEE International Conference on Computer Vision, pp. 230–235 (1998)
40.
Zurück zum Zitat Schmid, C., Mohr, R., Bauckhage, C.: Evaluation of interest point detectors. Int. J. Comput. Vis. 37(2), 151–172 (2000)CrossRefMATH Schmid, C., Mohr, R., Bauckhage, C.: Evaluation of interest point detectors. Int. J. Comput. Vis. 37(2), 151–172 (2000)CrossRefMATH
41.
Zurück zum Zitat Shi, J., Tomasi, C.: Good features to track. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994) Shi, J., Tomasi, C.: Good features to track. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
42.
Zurück zum Zitat Smith, S.M., Brady, J.M.: SUSAN—a new approach to low level image processing. Int. J. Comput. Vis. 23(1), 45–78 (1995)CrossRef Smith, S.M., Brady, J.M.: SUSAN—a new approach to low level image processing. Int. J. Comput. Vis. 23(1), 45–78 (1995)CrossRef
43.
Zurück zum Zitat Strecha, C., Von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008) Strecha, C., Von Hansen, W., Van Gool, L., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
44.
Zurück zum Zitat Tomasi, C., Kanade, T.: Detection and tracking of point features. Tech. rep., Int. Jnl. of Comput. Vision, Carnegie Mellon, Tech. Rep. (1991) Tomasi, C., Kanade, T.: Detection and tracking of point features. Tech. rep., Int. Jnl. of Comput. Vision, Carnegie Mellon, Tech. Rep. (1991)
45.
Zurück zum Zitat Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends Comput. Graph. Vis. 3(3), 177–280 (2008)CrossRef Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends Comput. Graph. Vis. 3(3), 177–280 (2008)CrossRef
47.
Zurück zum Zitat Ziegler, A., Christiansen, E., Kriegman, D., Belongie, S.: Locally uniform comparison image descriptor. In: Neural Info. Proc. Sys., pp. 1–9 (2012) Ziegler, A., Christiansen, E., Kriegman, D., Belongie, S.: Locally uniform comparison image descriptor. In: Neural Info. Proc. Sys., pp. 1–9 (2012)
48.
Zurück zum Zitat Zuliani, M., Kennedy, C., Manjunath, B.: A mathematical comparison of point detectors. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 11, pp. 172–178 (2004) Zuliani, M., Kennedy, C., Manjunath, B.: A mathematical comparison of point detectors. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 11, pp. 172–178 (2004)
Metadaten
Titel
A comparative experimental study of image feature detectors and descriptors
Publikationsdatum
01.05.2015
Erschienen in
Machine Vision and Applications / Ausgabe 4/2015
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-015-0679-9

Weitere Artikel der Ausgabe 4/2015

Machine Vision and Applications 4/2015 Zur Ausgabe