Skip to main content
Top
Published in: International Journal of Computer Vision 2/2015

01-06-2015

SPHORB: A Fast and Robust Binary Feature on the Sphere

Authors: Qiang Zhao, Wei Feng, Liang Wan, Jiawan Zhang

Published in: International Journal of Computer Vision | Issue 2/2015

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose SPHORB, a new fast and robust binary feature detector and descriptor for spherical panoramic images. In contrast to state-of-the-art spherical features, our approach stems from the geodesic grid, a nearly equal-area hexagonal grid parametrization of the sphere used in climate modeling. It enables us to directly build fine-grained pyramids and construct robust features on the hexagonal spherical grid, thus avoiding the costly computation of spherical harmonics and their associated bandwidth limitation. We further study how to achieve scale and rotation invariance for the proposed SPHORB feature. Extensive experiments show that SPHORB consistently outperforms other existing spherical features in accuracy, efficiency and robustness to camera movements. The superior performance of SPHORB has also been validated by real-world matching tests.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
There exist binary descriptors that are not generated by intensity comparison, e.g. LDAHash (Strecha et al. 2012).
 
2
A direct workaround may be rotating the panorama so that the pentagons cover different regions of the original panorama and the transformed one. Then the keypoints from the transformed panorama are taken as the complements after removing the reduplicative keypoints.
 
Literature
go back to reference Alahi, A., Ortiz, R., & Vandergheynst, P. (2012). FREAK: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 510–517). IEEE Alahi, A., Ortiz, R., & Vandergheynst, P. (2012). FREAK: Fast retina keypoint. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 510–517). IEEE
go back to reference Ambai, M., & Yoshida, Y. (2011). CARD: Compact and real-time descriptors. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 97–104). IEEE Ambai, M., & Yoshida, Y. (2011). CARD: Compact and real-time descriptors. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 97–104). IEEE
go back to reference Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., et al. (2010). Google street view: Capturing the world at street level. Computer, 43(6), 32–38.CrossRef Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., et al. (2010). Google street view: Capturing the world at street level. Computer, 43(6), 32–38.CrossRef
go back to reference Arican, Z., & Frossard, P. (2012). Scale-invariant features and polar descriptors in omnidirectional imaging. IEEE Transactions on Image Processing, 21(5), 2412–2423.CrossRefMathSciNet Arican, Z., & Frossard, P. (2012). Scale-invariant features and polar descriptors in omnidirectional imaging. IEEE Transactions on Image Processing, 21(5), 2412–2423.CrossRefMathSciNet
go back to reference Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346–359.CrossRef Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3), 346–359.CrossRef
go back to reference Bulow, T. (2004). Spherical diffusion for 3D surface smoothing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12), 1650–1654.CrossRef Bulow, T. (2004). Spherical diffusion for 3D surface smoothing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12), 1650–1654.CrossRef
go back to reference Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010). BRIEF: Binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision (ECCV, Vol. 6314, pp. 778–792). Calonder, M., Lepetit, V., Strecha, C., & Fua, P. (2010). BRIEF: Binary robust independent elementary features. In: Proceedings of the European Conference on Computer Vision (ECCV, Vol. 6314, pp. 778–792).
go back to reference Cruz-Mota, J., Bogdanova, I., Paquier, B., Bierlaire, M., & Thiran, J. P. (2012). Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision, 98(2), 217–241.CrossRefMATHMathSciNet Cruz-Mota, J., Bogdanova, I., Paquier, B., Bierlaire, M., & Thiran, J. P. (2012). Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision, 98(2), 217–241.CrossRefMATHMathSciNet
go back to reference Hadj-Abdelkader, H., Malis, E., & Rives, P. (2008). Spherical image processing for accurate visual odometry with omnidirectional cameras. In: Proceedings of the 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras OMNIVIS. Hadj-Abdelkader, H., Malis, E., & Rives, P. (2008). Spherical image processing for accurate visual odometry with omnidirectional cameras. In: Proceedings of the 8th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras OMNIVIS.
go back to reference Hansen, P., Corke, P., Boles, W., & Daniilidis, K. (2007). Scale-invariant features on the sphere. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp 1–8). IEEE Hansen, P., Corke, P., Boles, W., & Daniilidis, K. (2007). Scale-invariant features on the sphere. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp 1–8). IEEE
go back to reference Hansen, P., Corke, P., & Boles, W. (2010). Wide-angle visual feature matching for outdoor localization. The International Journal of Robotics Research, 29(2–3), 267–297.CrossRef Hansen, P., Corke, P., & Boles, W. (2010). Wide-angle visual feature matching for outdoor localization. The International Journal of Robotics Research, 29(2–3), 267–297.CrossRef
go back to reference Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In: Proceedings of the Fourth Alvey Vision Conference, (pp. 147–151). Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In: Proceedings of the Fourth Alvey Vision Conference, (pp. 147–151).
go back to reference Leutenegger, S., Chli, M., & Siegwart, R. (2011). BRISK: Binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2548–2555). IEEE Leutenegger, S., Chli, M., & Siegwart, R. (2011). BRISK: Binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2548–2555). IEEE
go back to reference Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef
go back to reference Micusik, B., & Kosecka, J. (2009). Piecewise planar city 3D modeling from street view panoramic sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2906–2912). IEEE Micusik, B., & Kosecka, J. (2009). Piecewise planar city 3D modeling from street view panoramic sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2906–2912). IEEE
go back to reference Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10), 1615–1630.CrossRef Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10), 1615–1630.CrossRef
go back to reference Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., et al. (2005). A comparison of affine region detectors. International Journal of Computer Vision, 65(1–2), 43–72.CrossRef Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., et al. (2005). A comparison of affine region detectors. International Journal of Computer Vision, 65(1–2), 43–72.CrossRef
go back to reference Puig, L., & Guerrero, J. (2011). Scale space for central catadioptric systems: Towards a generic camera feature extractor. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 1599–1606). IEEE Puig, L., & Guerrero, J. (2011). Scale space for central catadioptric systems: Towards a generic camera feature extractor. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 1599–1606). IEEE
go back to reference Qin, X., & Li, S. (2012). Finding scale-invariant corner feature from full-view image based on discrete spherical model. In: International Conference on Systems and Informatics (ICSAI), (pp. 1914–1918). IEEE Qin, X., & Li, S. (2012). Finding scale-invariant corner feature from full-view image based on discrete spherical model. In: International Conference on Systems and Informatics (ICSAI), (pp. 1914–1918). IEEE
go back to reference Randall, D., Ringler, T., Heikes, R., Jones, P., & Baumgardner, J. (2002). Climate modeling with spherical geodesic grids. Computing in Science Engineering, 4(5), 32–41.CrossRef Randall, D., Ringler, T., Heikes, R., Jones, P., & Baumgardner, J. (2002). Climate modeling with spherical geodesic grids. Computing in Science Engineering, 4(5), 32–41.CrossRef
go back to reference Rosten, E., & Drummond, T. (2006). Machine learning for high speed corner detection. In: Proceedings of the European Conference on Computer Vision (ECCV), vol 1, (pp. 430–443). Springer, Berlin Rosten, E., & Drummond, T. (2006). Machine learning for high speed corner detection. In: Proceedings of the European Conference on Computer Vision (ECCV), vol 1, (pp. 430–443). Springer, Berlin
go back to reference Rosten, E., Porter, R., & Drummond, T. (2010). Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1), 105–119.CrossRef Rosten, E., Porter, R., & Drummond, T. (2010). Faster and better: A machine learning approach to corner detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(1), 105–119.CrossRef
go back to reference Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011). ORB: An efficient alternative to sift or surf. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2564–2571). IEEE Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011). ORB: An efficient alternative to sift or surf. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2564–2571). IEEE
go back to reference Taneja, A., Ballan, L., & Pollefeys, M. (2013). City-scale change detection in cadastral 3D models using images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 113–120). IEEE Taneja, A., Ballan, L., & Pollefeys, M. (2013). City-scale change detection in cadastral 3D models using images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 113–120). IEEE
go back to reference Trzcinski, T., Christoudias, M., Lepetit, V., & Fua, P. (2013). Boosting binary keypoint descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2874–2881). IEEE Trzcinski, T., Christoudias, M., Lepetit, V., & Fua, P. (2013). Boosting binary keypoint descriptors. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2874–2881). IEEE
go back to reference Valgren, C., & Lilienthal, A. J. (2007). SIFT, SURF and seasons: Long-term outdoor localization using local features. In: Proceedings of the European Conference on Mobile Robots (ECMR), (pp. 253–258). Valgren, C., & Lilienthal, A. J. (2007). SIFT, SURF and seasons: Long-term outdoor localization using local features. In: Proceedings of the European Conference on Mobile Robots (ECMR), (pp. 253–258).
go back to reference Williamson, D. L. (1968). Integration of the barotropic vorticity equation on a spherical geodesic grid. Tellus, 20(4), 642–653.CrossRef Williamson, D. L. (1968). Integration of the barotropic vorticity equation on a spherical geodesic grid. Tellus, 20(4), 642–653.CrossRef
go back to reference Xiao, J., Ehinger, K., Oliva, A., & Torralba, A. (2012). Recognizing scene viewpoint using panoramic place representation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2695–2702). IEEE Xiao, J., Ehinger, K., Oliva, A., & Torralba, A. (2012). Recognizing scene viewpoint using panoramic place representation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 2695–2702). IEEE
go back to reference Yagnik, J., Strelow, D., Ross, D., & Lin, R. S. (2011). The power of comparative reasoning. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2431–2438). IEEE Yagnik, J., Strelow, D., Ross, D., & Lin, R. S. (2011). The power of comparative reasoning. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), (pp. 2431–2438). IEEE
go back to reference Zamir, A., & Shah, M. (2010). Accurate image localization based on google maps street view. In: Proceedings of the European Conference on Computer Vision (ECCV), (vol. 6314, pp. 255–268). Zamir, A., & Shah, M. (2010). Accurate image localization based on google maps street view. In: Proceedings of the European Conference on Computer Vision (ECCV), (vol. 6314, pp. 255–268).
go back to reference Zhao, Q., Wan, L., Feng, W., Zhang, J., & Wong, T. T. (2013). Cube2Video: Navigate between cubic panoramas in real-time. IEEE Transactions on Multimedia, 15(8), 1745–1754.CrossRef Zhao, Q., Wan, L., Feng, W., Zhang, J., & Wong, T. T. (2013). Cube2Video: Navigate between cubic panoramas in real-time. IEEE Transactions on Multimedia, 15(8), 1745–1754.CrossRef
go back to reference Ziegler, A., Christiansen, E., Kriegman, D., & Belongie, S. (2012). Locally uniform comparison image descriptor. In: Advances in Neural Information Processing Systems (NIPS, Vol. 25, pp. 1–9). Ziegler, A., Christiansen, E., Kriegman, D., & Belongie, S. (2012). Locally uniform comparison image descriptor. In: Advances in Neural Information Processing Systems (NIPS, Vol. 25, pp. 1–9).
Metadata
Title
SPHORB: A Fast and Robust Binary Feature on the Sphere
Authors
Qiang Zhao
Wei Feng
Liang Wan
Jiawan Zhang
Publication date
01-06-2015
Publisher
Springer US
Published in
International Journal of Computer Vision / Issue 2/2015
Print ISSN: 0920-5691
Electronic ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-014-0787-4

Other articles of this Issue 2/2015

International Journal of Computer Vision 2/2015 Go to the issue

Premium Partner