Skip to main content
Erschienen in: International Journal of Computer Vision 2/2015

01.06.2015

SPHORB: A Fast and Robust Binary Feature on the Sphere

verfasst von: Qiang Zhao, Wei Feng, Liang Wan, Jiawan Zhang

Erschienen in: International Journal of Computer Vision | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose SPHORB, a new fast and robust binary feature detector and descriptor for spherical panoramic images. In contrast to state-of-the-art spherical features, our approach stems from the geodesic grid, a nearly equal-area hexagonal grid parametrization of the sphere used in climate modeling. It enables us to directly build fine-grained pyramids and construct robust features on the hexagonal spherical grid, thus avoiding the costly computation of spherical harmonics and their associated bandwidth limitation. We further study how to achieve scale and rotation invariance for the proposed SPHORB feature. Extensive experiments show that SPHORB consistently outperforms other existing spherical features in accuracy, efficiency and robustness to camera movements. The superior performance of SPHORB has also been validated by real-world matching tests.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
There exist binary descriptors that are not generated by intensity comparison, e.g. LDAHash (Strecha et al. 2012).
 
2
A direct workaround may be rotating the panorama so that the pentagons cover different regions of the original panorama and the transformed one. Then the keypoints from the transformed panorama are taken as the complements after removing the reduplicative keypoints.
 
Literatur
Zurück zum Zitat Alahi, A., Ortiz, R., & Vandergheynst, P. (2012). FREAK: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 510–517). IEEE Alahi, A., Ortiz, R., & Vandergheynst, P. (2012). FREAK: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 510–517). IEEE
Zurück zum Zitat Ambai, M., & Yoshida, Y. (2011). CARD: Compact and real-time descriptors. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 97–104). IEEE Ambai, M., & Yoshida, Y. (2011). CARD: Compact and real-time descriptors. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 97–104). IEEE
Zurück zum Zitat Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., et al. (2010). Google street view: Capturing the world at street level. Computer, 43(6), 32–38.CrossRef Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., et al. (2010). Google street view: Capturing the world at street level. Computer, 43(6), 32–38.CrossRef
Zurück zum Zitat Arican, Z., & Frossard, P. (2012). Scale-invariant features and polar descriptors in omnidirectional imaging. IEEE Transactions on Image Processing, 21(5), 2412–2423.CrossRefMathSciNet Arican, Z., & Frossard, P. (2012). Scale-invariant features and polar descriptors in omnidirectional imaging. IEEE Transactions on Image Processing, 21(5), 2412–2423.CrossRefMathSciNet
Zurück zum Zitat Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346–359.CrossRef Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346–359.CrossRef
Zurück zum Zitat Bulow, T. (2004). Spherical diffusion for 3D surface smoothing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12), 1650–1654.CrossRef Bulow, T. (2004). Spherical diffusion for 3D surface smoothing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12), 1650–1654.CrossRef
Zurück zum Zitat Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010). BRIEF: Binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision (ECCV, Vol. 6314, pp. 778–792). Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010). BRIEF: Binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision (ECCV, Vol. 6314, pp. 778–792).
Zurück zum Zitat Cruz-Mota, J., Bogdanova, I., Paquier, B., Bierlaire, M., & Thiran, J. P. (2012). Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision, 98(2), 217–241.CrossRefMATHMathSciNet Cruz-Mota, J., Bogdanova, I., Paquier, B., Bierlaire, M., & Thiran, J. P. (2012). Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision, 98(2), 217–241.CrossRefMATHMathSciNet
Zurück zum Zitat Hadj-Abdelkader, H., Malis, E., & Rives, P. (2008). Spherical image processing for accurate visual odometry with omnidirectional cameras. In: Proceedings of the 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras OMNIVIS. Hadj-Abdelkader, H., Malis, E., & Rives, P. (2008). Spherical image processing for accurate visual odometry with omnidirectional cameras. In: Proceedings of the 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras OMNIVIS.
Zurück zum Zitat Hansen, P., Corke, P., Boles, W., & Daniilidis, K. (2007). Scale-invariant features on the sphere. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp 1–8). IEEE Hansen, P., Corke, P., Boles, W., & Daniilidis, K. (2007). Scale-invariant features on the sphere. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp 1–8). IEEE
Zurück zum Zitat Hansen, P., Corke, P., & Boles, W. (2010). Wide-angle visual feature matching for outdoor localization. The International Journal of Robotics Research, 29(2–3), 267–297.CrossRef Hansen, P., Corke, P., & Boles, W. (2010). Wide-angle visual feature matching for outdoor localization. The International Journal of Robotics Research, 29(2–3), 267–297.CrossRef
Zurück zum Zitat Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In: Proceedings of the Fourth Alvey Vision Conference, (pp. 147–151). Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In: Proceedings of the Fourth Alvey Vision Conference, (pp. 147–151).
Zurück zum Zitat Leutenegger, S., Chli, M., & Siegwart, R. (2011). BRISK: Binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2548–2555). IEEE Leutenegger, S., Chli, M., & Siegwart, R. (2011). BRISK: Binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2548–2555). IEEE
Zurück zum Zitat Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef
Zurück zum Zitat Micusik, B., & Kosecka, J. (2009). Piecewise planar city 3D modeling from street view panoramic sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2906–2912). IEEE Micusik, B., & Kosecka, J. (2009). Piecewise planar city 3D modeling from street view panoramic sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2906–2912). IEEE
Zurück zum Zitat Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10), 1615–1630.CrossRef Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10), 1615–1630.CrossRef
Zurück zum Zitat Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., et al. (2005). A comparison of affine region detectors. International Journal of Computer Vision, 65(1–2), 43–72.CrossRef Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., et al. (2005). A comparison of affine region detectors. International Journal of Computer Vision, 65(1–2), 43–72.CrossRef
Zurück zum Zitat Puig, L., & Guerrero, J. (2011). Scale space for central catadioptric systems: Towards a generic camera feature extractor. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 1599–1606). IEEE Puig, L., & Guerrero, J. (2011). Scale space for central catadioptric systems: Towards a generic camera feature extractor. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 1599–1606). IEEE
Zurück zum Zitat Qin, X., & Li, S. (2012). Finding scale-invariant corner feature from full-view image based on discrete spherical model. In: International Conference on Systems and Informatics (ICSAI), (pp. 1914–1918). IEEE Qin, X., & Li, S. (2012). Finding scale-invariant corner feature from full-view image based on discrete spherical model. In: International Conference on Systems and Informatics (ICSAI), (pp. 1914–1918). IEEE
Zurück zum Zitat Randall, D., Ringler, T., Heikes, R., Jones, P., & Baumgardner, J. (2002). Climate modeling with spherical geodesic grids. Computing in Science Engineering, 4(5), 32–41.CrossRef Randall, D., Ringler, T., Heikes, R., Jones, P., & Baumgardner, J. (2002). Climate modeling with spherical geodesic grids. Computing in Science Engineering, 4(5), 32–41.CrossRef
Zurück zum Zitat Rosten, E., & Drummond, T. (2006). Machine learning for high speed corner detection. In: Proceedings of the European Conference on Computer Vision (ECCV), vol 1, (pp. 430–443). Springer, Berlin Rosten, E., & Drummond, T. (2006). Machine learning for high speed corner detection. In: Proceedings of the European Conference on Computer Vision (ECCV), vol 1, (pp. 430–443). Springer, Berlin
Zurück zum Zitat Rosten, E., Porter, R., & Drummond, T. (2010). Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1), 105–119.CrossRef Rosten, E., Porter, R., & Drummond, T. (2010). Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1), 105–119.CrossRef
Zurück zum Zitat Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011). ORB: An efficient alternative to sift or surf. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2564–2571). IEEE Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011). ORB: An efficient alternative to sift or surf. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2564–2571). IEEE
Zurück zum Zitat Taneja, A., Ballan, L., & Pollefeys, M. (2013). City-scale change detection in cadastral 3D models using images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 113–120). IEEE Taneja, A., Ballan, L., & Pollefeys, M. (2013). City-scale change detection in cadastral 3D models using images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 113–120). IEEE
Zurück zum Zitat Trzcinski, T., Christoudias, M., Lepetit, V., & Fua, P. (2013). Boosting binary keypoint descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2874–2881). IEEE Trzcinski, T., Christoudias, M., Lepetit, V., & Fua, P. (2013). Boosting binary keypoint descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2874–2881). IEEE
Zurück zum Zitat Valgren, C., & Lilienthal, A. J. (2007). SIFT, SURF and seasons: Long-term outdoor localization using local features. In: Proceedings of the European Conference on Mobile Robots (ECMR), (pp. 253–258). Valgren, C., & Lilienthal, A. J. (2007). SIFT, SURF and seasons: Long-term outdoor localization using local features. In: Proceedings of the European Conference on Mobile Robots (ECMR), (pp. 253–258).
Zurück zum Zitat Williamson, D. L. (1968). Integration of the barotropic vorticity equation on a spherical geodesic grid. Tellus, 20(4), 642–653.CrossRef Williamson, D. L. (1968). Integration of the barotropic vorticity equation on a spherical geodesic grid. Tellus, 20(4), 642–653.CrossRef
Zurück zum Zitat Xiao, J., Ehinger, K., Oliva, A., & Torralba, A. (2012). Recognizing scene viewpoint using panoramic place representation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2695–2702). IEEE Xiao, J., Ehinger, K., Oliva, A., & Torralba, A. (2012). Recognizing scene viewpoint using panoramic place representation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2695–2702). IEEE
Zurück zum Zitat Yagnik, J., Strelow, D., Ross, D., & Lin, R. S. (2011). The power of comparative reasoning. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2431–2438). IEEE Yagnik, J., Strelow, D., Ross, D., & Lin, R. S. (2011). The power of comparative reasoning. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2431–2438). IEEE
Zurück zum Zitat Zamir, A., & Shah, M. (2010). Accurate image localization based on google maps street view. In: Proceedings of the European Conference on Computer Vision (ECCV), (vol. 6314, pp. 255–268). Zamir, A., & Shah, M. (2010). Accurate image localization based on google maps street view. In: Proceedings of the European Conference on Computer Vision (ECCV), (vol. 6314, pp. 255–268).
Zurück zum Zitat Zhao, Q., Wan, L., Feng, W., Zhang, J., & Wong, T. T. (2013). Cube2Video: Navigate between cubic panoramas in real-time. IEEE Transactions on Multimedia, 15(8), 1745–1754.CrossRef Zhao, Q., Wan, L., Feng, W., Zhang, J., & Wong, T. T. (2013). Cube2Video: Navigate between cubic panoramas in real-time. IEEE Transactions on Multimedia, 15(8), 1745–1754.CrossRef
Zurück zum Zitat Ziegler, A., Christiansen, E., Kriegman, D., & Belongie, S. (2012). Locally uniform comparison image descriptor. In: Advances in Neural Information Processing Systems (NIPS, Vol. 25, pp. 1–9). Ziegler, A., Christiansen, E., Kriegman, D., & Belongie, S. (2012). Locally uniform comparison image descriptor. In: Advances in Neural Information Processing Systems (NIPS, Vol. 25, pp. 1–9).
Metadaten
Titel
SPHORB: A Fast and Robust Binary Feature on the Sphere
verfasst von
Qiang Zhao
Wei Feng
Liang Wan
Jiawan Zhang
Publikationsdatum
01.06.2015
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 2/2015
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-014-0787-4

Weitere Artikel der Ausgabe 2/2015

International Journal of Computer Vision 2/2015 Zur Ausgabe