Skip to main content
Top

2014 | OriginalPaper | Chapter

Lighting-Invariant Visual Odometry using Lidar Intensity Imagery and Pose Interpolation

Authors : Hang Dong, Timothy D. Barfoot

Published in: Field and Service Robotics

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recent studies have demonstrated that images constructed from lidar reflectance information exhibit superior robustness to lighting changes in outdoor environments in comparison to traditional passive stereo camera imagery. Moreover, for visual navigation methods originally developed using stereo vision, such as visual odometry (VO) and visual teach and repeat (VT&R), scanning lidar can serve as a direct replacement for the passive sensor. This results in systems that retain the efficiency of the sparse, appearance-based techniques while overcoming the dependence on adequate/consistent lighting conditions required by traditional cameras. However, due to the scanning nature of the lidar and assumptions made in previous implementations, data acquired during continuous vehicle motion suffer from geometric motion distortion and can subsequently result in poor metric VO estimates, even over short distances (e.g., 5–10 m). This paper revisits the measurement timing assumption made in previous systems, and proposes a frame-to-frame VO estimation framework based on a novel pose interpolation scheme that explicitly accounts for the exact acquisition time of each feature measurement. In this paper, we present the promising preliminary results of our new method using data generated from a lidar simulator and experimental data collected from a planetary analogue environment with a real scanning laser rangefinder.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef
2.
go back to reference M. Bosse, R. Zlot, Continuous 3d scan-matching with a spinning 2d laser. in Robotics and Automation (ICRA), 2009 IEEE International Conference on, (IEEE, 2009), pp. 4312–4319 M. Bosse, R. Zlot, Continuous 3d scan-matching with a spinning 2d laser. in Robotics and Automation (ICRA), 2009 IEEE International Conference on, (IEEE, 2009), pp. 4312–4319
3.
go back to reference J. Enright, T.D. Barfoot, M. Soto, Star tracking for planetary rovers. in Proceedings of the IEEE Aerospace Conference, (Big Sky, MT, 2012), pp. 1–13 J. Enright, T.D. Barfoot, M. Soto, Star tracking for planetary rovers. in Proceedings of the IEEE Aerospace Conference, (Big Sky, MT, 2012), pp. 1–13
4.
go back to reference P.E. Forssén, E. Ringaby, Rectifying rolling shutter video from hand-held devices. in IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, IEEE, San Francisco, USA, 2010) P.E. Forssén, E. Ringaby, Rectifying rolling shutter video from hand-held devices. in IEEE Conference on Computer Vision and Pattern Recognition, (IEEE Computer Society, IEEE, San Francisco, USA, 2010)
5.
go back to reference P.T. Furgale, T.D. Barfoot, G. Sibley, Continuous-time batch estimation using temporal basis functions. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), (St. Paul, USA, 2012), pp. 2088–2095 P.T. Furgale, T.D. Barfoot, G. Sibley, Continuous-time batch estimation using temporal basis functions. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), (St. Paul, USA, 2012), pp. 2088–2095
6.
go back to reference K. Gauss, Theory of the motion of the heavenly bodies moving about the sun in conic sections: Reprint 2004 (1809) K. Gauss, Theory of the motion of the heavenly bodies moving about the sun in conic sections: Reprint 2004 (1809)
7.
go back to reference F. Grassia, Practical parameterization of rotations using the exponential map. J. Graphics Tools 3, 29–48 (1998)CrossRef F. Grassia, Practical parameterization of rotations using the exponential map. J. Graphics Tools 3, 29–48 (1998)CrossRef
8.
go back to reference J. Guivant, E. Nebot, S. Baiker, Localization and map building using laser range sensors in outdoor applications. J. Robot. Syst. 17(10), 565–583 (2000)CrossRefMATH J. Guivant, E. Nebot, S. Baiker, Localization and map building using laser range sensors in outdoor applications. J. Robot. Syst. 17(10), 565–583 (2000)CrossRefMATH
9.
go back to reference A. Lambert, P.T. Furgale, T.D. Barfoot, J. Enright, Field testing of visual odometry aided by a sun sensor and inclinometer. J. Field Robot. (special issue) Space Robot. 29(3), 426–444 (2012) A. Lambert, P.T. Furgale, T.D. Barfoot, J. Enright, Field testing of visual odometry aided by a sun sensor and inclinometer. J. Field Robot. (special issue) Space Robot. 29(3), 426–444 (2012)
10.
go back to reference J. Levinson, Automatic laser calibration, mapping, and location for autonomous vehicles. Ph.D. thesis, Stanford University 2011 J. Levinson, Automatic laser calibration, mapping, and location for autonomous vehicles. Ph.D. thesis, Stanford University 2011
11.
go back to reference M. Magnusson, A. Lilienthal, T. Duckett, Scan registration for autonomous mining vehicles using 3d-ndt. J. Field Robot. 24(10), 803–827 (2007)CrossRef M. Magnusson, A. Lilienthal, T. Duckett, Scan registration for autonomous mining vehicles using 3d-ndt. J. Field Robot. 24(10), 803–827 (2007)CrossRef
12.
go back to reference L. Matthies, M. Maimone, A. Johnson, Y. Cheng, R. Willson, C. Villalpando, S. Goldberg, A. Huertas, A. Stein, A. Angelova, Computer vision on Mars. Int. J. Comput. Vision 75(1), 67–92 (2007)CrossRef L. Matthies, M. Maimone, A. Johnson, Y. Cheng, R. Willson, C. Villalpando, S. Goldberg, A. Huertas, A. Stein, A. Angelova, Computer vision on Mars. Int. J. Comput. Vision 75(1), 67–92 (2007)CrossRef
13.
go back to reference C. McManus, P.T. Furgale, T.D. Barfoot, Towards appearance-based methods for lidar sensors. in Robotics and Automation (ICRA), 2011 IEEE International Conference on, (Shanghai, China, 2011), pp. 1930–1935 C. McManus, P.T. Furgale, T.D. Barfoot, Towards appearance-based methods for lidar sensors. in Robotics and Automation (ICRA), 2011 IEEE International Conference on, (Shanghai, China, 2011), pp. 1930–1935
14.
go back to reference C. McManus, P.T. Furgale, B.E. Stenning, T.D. Barfoot, Visual teach and repeat using appearance-based lidar. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), (St. Paul, USA, 2012), pp. 389–396 C. McManus, P.T. Furgale, B.E. Stenning, T.D. Barfoot, Visual teach and repeat using appearance-based lidar. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), (St. Paul, USA, 2012), pp. 389–396
15.
go back to reference F. Moosmann, C. Stiller, Velodyne SLAM. in Intelligent Vehicles Symposium (IV), 2011 IEEE, (IEEE, 2011), pp. 393–398 F. Moosmann, C. Stiller, Velodyne SLAM. in Intelligent Vehicles Symposium (IV), 2011 IEEE, (IEEE, 2011), pp. 393–398
16.
go back to reference J. Neira, J. Tardós, J. Horn, G. Schmidt, Fusing range and intensity images for mobile robot localization. IEEE Trans. Robot. Autom. 15(1), 76–84 (1999)CrossRef J. Neira, J. Tardós, J. Horn, G. Schmidt, Fusing range and intensity images for mobile robot localization. IEEE Trans. Robot. Autom. 15(1), 76–84 (1999)CrossRef
17.
go back to reference A. Nüchter, K. Lingemann, J. Hertzberg, H. Surmann, 6D SLAM-3D mapping outdoor environments. J. Field Robot. 24(8–9), 699–722 (2007)CrossRefMATH A. Nüchter, K. Lingemann, J. Hertzberg, H. Surmann, 6D SLAM-3D mapping outdoor environments. J. Field Robot. 24(8–9), 699–722 (2007)CrossRefMATH
18.
go back to reference J. O’Neill, W. Moore, K. Williams, R. Bruce, Scanning system for lidar (Oct 30 2007), US Patent App. 12/447,937 J. O’Neill, W. Moore, K. Williams, R. Bruce, Scanning system for lidar (Oct 30 2007), US Patent App. 12/447,937
19.
go back to reference K. Shoemake, Animating rotation with quaternion curves. ACM SIGGRAPH Comput. Graphics 19(3), 245–254 (1985)CrossRef K. Shoemake, Animating rotation with quaternion curves. ACM SIGGRAPH Comput. Graphics 19(3), 245–254 (1985)CrossRef
21.
go back to reference C.H. Tong, P.T. Furgale, T.D. Barfoot, Gaussian process gauss-newton: Non-parametric state estimation. in 9th Canadian Conference on Computer and Robot Vision (CRV)(to appear), Toronto, Canada, 28–30 May 2012 C.H. Tong, P.T. Furgale, T.D. Barfoot, Gaussian process gauss-newton: Non-parametric state estimation. in 9th Canadian Conference on Computer and Robot Vision (CRV)(to appear), Toronto, Canada, 28–30 May 2012
Metadata
Title
Lighting-Invariant Visual Odometry using Lidar Intensity Imagery and Pose Interpolation
Authors
Hang Dong
Timothy D. Barfoot
Copyright Year
2014
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-40686-7_22