Skip to main content
Top

2020 | OriginalPaper | Chapter

14. Real-Time Egocentric Navigation Using 3D Sensing

Authors : Justin S. Smith, Shiyu Feng, Fanzhe Lyu, Patricio A. Vela

Published in: Machine Vision and Navigation

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter proposes a hierarchical navigation system combining the benefits of perception space local planning and allocentric global planning. Perception space permits computationally efficient 3D collision checking, enabling safe navigation in environments that do not meet the conditions assumed by traditional navigation systems based on planar laser scans. Contributions include approaches for scoring and collision checking trajectories in perception space. Benchmarking results show the advantages of perception space collision checking over popular alternatives in the context of real-time local planning. Simulated experiments with multiple robotic platforms in several environments demonstrate the importance of 3D collision checking and the utility of a mixed representation hierarchical navigation system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Choset, H., Lynch, K. M., Hutchinson, S., Kantor, G., Burgard, W., Kavraki, L. E., et al. (2005). Principles of robot motion: Theory, algorithms, and implementation. Cambridge: MIT Press.MATH Choset, H., Lynch, K. M., Hutchinson, S., Kantor, G., Burgard, W., Kavraki, L. E., et al. (2005). Principles of robot motion: Theory, algorithms, and implementation. Cambridge: MIT Press.MATH
3.
go back to reference Ivanov, M., Lindner, L., Sergiyenko, O., Rodríguez-Quiñonez, J. C., Flores-Fuentes, W., & Rivas-Lopez, M. (2019). Mobile robot path planning using continuous laser scanning (pp. 338–372). Hershey: IGI Global. Ivanov, M., Lindner, L., Sergiyenko, O., Rodríguez-Quiñonez, J. C., Flores-Fuentes, W., & Rivas-Lopez, M. (2019). Mobile robot path planning using continuous laser scanning (pp. 338–372). Hershey: IGI Global.
4.
go back to reference Hart, P. E., Nilsson, N. J., & Raphael, B. (1968, July). A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics, 4(2), 100–107.CrossRef Hart, P. E., Nilsson, N. J., & Raphael, B. (1968, July). A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics, 4(2), 100–107.CrossRef
6.
go back to reference Stentz, A. T. (1994, May). Optimal and efficient path planning for partially-known environments. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA ’94) (Vol. 4, pp. 3310–3317). Stentz, A. T. (1994, May). Optimal and efficient path planning for partially-known environments. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA ’94) (Vol. 4, pp. 3310–3317).
7.
go back to reference Koenig, S., & Likhachev, M. (2005, June). Fast replanning for navigation in unknown terrain. IEEE Transactions on Robotics, 21(3), 354–363.CrossRef Koenig, S., & Likhachev, M. (2005, June). Fast replanning for navigation in unknown terrain. IEEE Transactions on Robotics, 21(3), 354–363.CrossRef
9.
go back to reference García, F. M., Kapadia, M., & Badler, N. I. (2014, May). Gpu-based dynamic search on adaptive resolution grids. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1631–1638). García, F. M., Kapadia, M., & Badler, N. I. (2014, May). Gpu-based dynamic search on adaptive resolution grids. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1631–1638).
10.
go back to reference Tsardoulias, E. G., Iliakopoulou, A., Kargakos, A., & Petrou, L. (2016, December). A review of global path planning methods for occupancy grid maps regardless of obstacle density. Journal of Intelligent & Robotic Systems, 84(1), 829–858.CrossRef Tsardoulias, E. G., Iliakopoulou, A., Kargakos, A., & Petrou, L. (2016, December). A review of global path planning methods for occupancy grid maps regardless of obstacle density. Journal of Intelligent & Robotic Systems, 84(1), 829–858.CrossRef
11.
go back to reference Takahashi, O., & Schilling, R. J. (1989, April). Motion planning in a plane using generalized Voronoi diagrams. IEEE Transactions on Robotics and Automation, 5(2), 143–150.CrossRef Takahashi, O., & Schilling, R. J. (1989, April). Motion planning in a plane using generalized Voronoi diagrams. IEEE Transactions on Robotics and Automation, 5(2), 143–150.CrossRef
12.
go back to reference Kavraki, L. E., Kolountzakis, M. N., & Latombe, J. (1998, February). Analysis of probabilistic roadmaps for path planning. IEEE Transactions on Robotics and Automation, 14(1), 166–171.CrossRef Kavraki, L. E., Kolountzakis, M. N., & Latombe, J. (1998, February). Analysis of probabilistic roadmaps for path planning. IEEE Transactions on Robotics and Automation, 14(1), 166–171.CrossRef
13.
go back to reference Bohlin, R., & Kavraki, L. E. (2000, April). Path planning using lazy PRM. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 1, pp. 521–528). Bohlin, R., & Kavraki, L. E. (2000, April). Path planning using lazy PRM. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 1, pp. 521–528).
14.
go back to reference Belghith, K., Kabanza, F., Hartman, L., & Nkambou, R. (2006, May). Anytime dynamic path-planning with flexible probabilistic roadmaps. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 2372–2377). Belghith, K., Kabanza, F., Hartman, L., & Nkambou, R. (2006, May). Anytime dynamic path-planning with flexible probabilistic roadmaps. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 2372–2377).
15.
go back to reference van den Berg, J., Ferguson, D., & Kuffner, J. (2006, May). Anytime path planning and replanning in dynamic environments. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 2366–2371). van den Berg, J., Ferguson, D., & Kuffner, J. (2006, May). Anytime path planning and replanning in dynamic environments. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 2366–2371).
17.
go back to reference Kuffner, J. J., & LaValle, S. M. (2000, April). RRT-connect: An efficient approach to single-query path planning. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 2, pp. 995–1001). Kuffner, J. J., & LaValle, S. M. (2000, April). RRT-connect: An efficient approach to single-query path planning. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 2, pp. 995–1001).
19.
go back to reference Kuwata, Y., Fiore, G. A., Teo, J., Frazzoli, E., & How, J. P. (2008, September). Motion planning for urban driving using RRT. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 1681–1686). Kuwata, Y., Fiore, G. A., Teo, J., Frazzoli, E., & How, J. P. (2008, September). Motion planning for urban driving using RRT. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 1681–1686).
20.
go back to reference Ferguson, D., Kalra, N., & Stentz, A. (2006, May). Replanning with RRTs. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 1243–1248). Ferguson, D., Kalra, N., & Stentz, A. (2006, May). Replanning with RRTs. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006 (pp. 1243–1248).
21.
go back to reference Zucker, M., Kuffner, J., & Branicky, M. (2007, April). Multipartite RRTs for rapid replanning in dynamic environments. In Proceedings 2007 IEEE International Conference on Robotics and Automation (pp. 1603–1609). Zucker, M., Kuffner, J., & Branicky, M. (2007, April). Multipartite RRTs for rapid replanning in dynamic environments. In Proceedings 2007 IEEE International Conference on Robotics and Automation (pp. 1603–1609).
22.
go back to reference Bruce, J., & Veloso, M. (2002, September). Real-time randomized path planning for robot navigation. In IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 3, pp. 2383–2388). Bruce, J., & Veloso, M. (2002, September). Real-time randomized path planning for robot navigation. In IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 3, pp. 2383–2388).
24.
go back to reference Pivtoraiko, M., & Kelly, A. (2011). Kinodynamic motion planning with state lattice motion primitives. In Proceedings of the IEEE International Conference on Intelligent Robotic and Systems. Pivtoraiko, M., & Kelly, A. (2011). Kinodynamic motion planning with state lattice motion primitives. In Proceedings of the IEEE International Conference on Intelligent Robotic and Systems.
25.
go back to reference Hauser, K., Bretl, T., Harada, K., & Latombe, J.-C. (2008). Using motion primitives in probabilistic sample-based planning for humanoid robots. In S. Akella, N. Amato, W. Huang, & B. Mishra (Eds.), Algorithmic foundation of robotics VII. Springer Tracts in Advanced Robotics (Vol. 47, pp. 507–522). Berlin: Springer. Hauser, K., Bretl, T., Harada, K., & Latombe, J.-C. (2008). Using motion primitives in probabilistic sample-based planning for humanoid robots. In S. Akella, N. Amato, W. Huang, & B. Mishra (Eds.), Algorithmic foundation of robotics VII. Springer Tracts in Advanced Robotics (Vol. 47, pp. 507–522). Berlin: Springer.
26.
go back to reference Frazzoli, E., Dahleh, M., & Feron, E. (2005). Maneuver-based motion planning for nonlinear systems with symmetries. IEEE Transactions on Robotics, 21(6), 1077–1091.CrossRef Frazzoli, E., Dahleh, M., & Feron, E. (2005). Maneuver-based motion planning for nonlinear systems with symmetries. IEEE Transactions on Robotics, 21(6), 1077–1091.CrossRef
28.
go back to reference Paranjape, A. A., Meier, K. C., Shi, X., Chung, S., & Hutchinson, S. (2013, November). Motion primitives and 3-d path planning for fast flight through a forest. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2940–2947). Paranjape, A. A., Meier, K. C., Shi, X., Chung, S., & Hutchinson, S. (2013, November). Motion primitives and 3-d path planning for fast flight through a forest. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2940–2947).
29.
go back to reference Khatib, O. (1985, March). Real-time obstacle avoidance for manipulators and mobile robots. In Proceedings. 1985 IEEE International Conference on Robotics and Automation (Vol. 2, pp. 500–505). Khatib, O. (1985, March). Real-time obstacle avoidance for manipulators and mobile robots. In Proceedings. 1985 IEEE International Conference on Robotics and Automation (Vol. 2, pp. 500–505).
30.
go back to reference Rimon, E., & Koditschek, D. E. (1992). Exact robot navigation using artificial potential functions. IEEE Transactions on Robotics and Automation, 8(5), 501–518.CrossRef Rimon, E., & Koditschek, D. E. (1992). Exact robot navigation using artificial potential functions. IEEE Transactions on Robotics and Automation, 8(5), 501–518.CrossRef
31.
go back to reference Arslan, O., & Koditschek, D. (2016). Exact robot navigation using power diagrams. In IEEE International Conference on Robotics and Automation (pp. 1–8). Arslan, O., & Koditschek, D. (2016). Exact robot navigation using power diagrams. In IEEE International Conference on Robotics and Automation (pp. 1–8).
32.
go back to reference Hyun, N. P., Verriest, E. I., & Vela, P. A. (2015). Optimal obstacle avoidance trajectory generation using the root locus principle. In IEEE Conference on Decision and Control (pp. 626–631). Hyun, N. P., Verriest, E. I., & Vela, P. A. (2015). Optimal obstacle avoidance trajectory generation using the root locus principle. In IEEE Conference on Decision and Control (pp. 626–631).
33.
go back to reference Sethian, J. (1999). Level sets methods and fast marching methods. Cambridge: Cambridge University Press.MATH Sethian, J. (1999). Level sets methods and fast marching methods. Cambridge: Cambridge University Press.MATH
34.
go back to reference Osher, S., & Fedkiw, R. (2003). Level set methods and dynamic implicit surfaces. Berlin: Springer.MATHCrossRef Osher, S., & Fedkiw, R. (2003). Level set methods and dynamic implicit surfaces. Berlin: Springer.MATHCrossRef
35.
go back to reference Kelly, M. (2017). An introduction to trajectory optimization: How to do your own direct collocation. SIAM Review, 59(4), 849–904.MathSciNetMATHCrossRef Kelly, M. (2017). An introduction to trajectory optimization: How to do your own direct collocation. SIAM Review, 59(4), 849–904.MathSciNetMATHCrossRef
36.
go back to reference Ross, I. M., & Karpenko, M. (2012). A review of pseudospectral optimal control: From theory to flight. Annual Reviews in Control, 36(2), 182–197.CrossRef Ross, I. M., & Karpenko, M. (2012). A review of pseudospectral optimal control: From theory to flight. Annual Reviews in Control, 36(2), 182–197.CrossRef
37.
go back to reference Andersson, J., Gillis, J., Horn, G., Rawlings, J., & Diehl, M. (2018, July). CasADi: A software framework for nonlinear optimization and optimal control. Mathematical Programming Computation. Andersson, J., Gillis, J., Horn, G., Rawlings, J., & Diehl, M. (2018, July). CasADi: A software framework for nonlinear optimization and optimal control. Mathematical Programming Computation.
38.
go back to reference Deits, R., & Tedrake, R. (2015). Efficient mixed-integer planning for UAVs in cluttered environments. In IEEE International Conference on Robotics and Automation (pp. 42–49). Deits, R., & Tedrake, R. (2015). Efficient mixed-integer planning for UAVs in cluttered environments. In IEEE International Conference on Robotics and Automation (pp. 42–49).
39.
go back to reference Hyun, N., Vela, P., & Verriest, E. (2017). A new framework for optimal path planning of rectangular robots using a weighted l p norm. IEEE Robotics and Automation Letters, 2(3), 1460–1465.CrossRef Hyun, N., Vela, P., & Verriest, E. (2017). A new framework for optimal path planning of rectangular robots using a weighted l p norm. IEEE Robotics and Automation Letters, 2(3), 1460–1465.CrossRef
40.
go back to reference Mukadam, M., Dong, J., Yan, X., Dellaert, F., & Boots, B. (2018). Continuous-time Gaussian process motion planning via probabilistic inference. The International Journal of Robotics Research, 37(11), 1319–1340.CrossRef Mukadam, M., Dong, J., Yan, X., Dellaert, F., & Boots, B. (2018). Continuous-time Gaussian process motion planning via probabilistic inference. The International Journal of Robotics Research, 37(11), 1319–1340.CrossRef
41.
go back to reference Pham, Q. (2014). A general, fast, and robust implementation of the time-optimal path parameterization algorithm. IEEE Transactions on Robotics, 30(6), 1533–1540.CrossRef Pham, Q. (2014). A general, fast, and robust implementation of the time-optimal path parameterization algorithm. IEEE Transactions on Robotics, 30(6), 1533–1540.CrossRef
42.
go back to reference Schulman, J., Ho, J., Lee, A. X., Awwal, I., Bradlow, H., & Abbeel, P. (2013). Finding locally optimal, collision-free trajectories with sequential convex optimization. In Robotics: Science and Systems, 9(1), 1–10 (Citeseer). Schulman, J., Ho, J., Lee, A. X., Awwal, I., Bradlow, H., & Abbeel, P. (2013). Finding locally optimal, collision-free trajectories with sequential convex optimization. In Robotics: Science and Systems, 9(1), 1–10 (Citeseer).
43.
go back to reference Borenstein, J., & Koren, Y. (1989, September). Real-time obstacle avoidance for fast mobile robots. IEEE Transactions on Systems, Man, and Cybernetics, 19(5), 1179–1187.CrossRef Borenstein, J., & Koren, Y. (1989, September). Real-time obstacle avoidance for fast mobile robots. IEEE Transactions on Systems, Man, and Cybernetics, 19(5), 1179–1187.CrossRef
44.
go back to reference Borenstein, J., & Koren, Y. (1991, June). The vector field histogram-fast obstacle avoidance for mobile robots. IEEE Transactions on Robotics and Automation, 7(3), 278–288.CrossRef Borenstein, J., & Koren, Y. (1991, June). The vector field histogram-fast obstacle avoidance for mobile robots. IEEE Transactions on Robotics and Automation, 7(3), 278–288.CrossRef
45.
go back to reference Ulrich, I., & Borenstein, J. (2000, April). Vfh/sup */: Local obstacle avoidance with look-ahead verification. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 3, pp. 2505–2511). Ulrich, I., & Borenstein, J. (2000, April). Vfh/sup */: Local obstacle avoidance with look-ahead verification. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065) (Vol. 3, pp. 2505–2511).
46.
go back to reference Nepal, K., Fine, A., Imam, N., Pietrocola, D., Robertson, N., & Ahlgren, D. J. (2009). Combining a modified vector field histogram algorithm and real-time image processing for unknown environment navigation. In Intelligent Robots and Computer Vision XXVI: Algorithms and Techniques (Vol. 7252, p. 72520G). Bellingham: International Society for Optics and Photonics. Nepal, K., Fine, A., Imam, N., Pietrocola, D., Robertson, N., & Ahlgren, D. J. (2009). Combining a modified vector field histogram algorithm and real-time image processing for unknown environment navigation. In Intelligent Robots and Computer Vision XXVI: Algorithms and Techniques (Vol. 7252, p. 72520G). Bellingham: International Society for Optics and Photonics.
47.
go back to reference An, D., & Wang, H. (2004, June). VPH: A new laser radar based obstacle avoidance method for intelligent mobile robots. In Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No. 04EX788) (Vol. 5, pp. 4681–4685). An, D., & Wang, H. (2004, June). VPH: A new laser radar based obstacle avoidance method for intelligent mobile robots. In Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No. 04EX788) (Vol. 5, pp. 4681–4685).
48.
go back to reference Gong, J., Duan, Y., Man, Y., & Xiong, G. (2007, August). VPH+: An enhanced vector polar histogram method for mobile robot obstacle avoidance. In 2007 International Conference on Mechatronics and Automation (pp. 2784–2788). Gong, J., Duan, Y., Man, Y., & Xiong, G. (2007, August). VPH+: An enhanced vector polar histogram method for mobile robot obstacle avoidance. In 2007 International Conference on Mechatronics and Automation (pp. 2784–2788).
49.
go back to reference Minguez, J., & Montano, L. (2000, October). Nearness diagram navigation (ND): A new real time collision avoidance approach. In Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No. 00CH37113) (Vol. 3, pp. 2094–2100). Minguez, J., & Montano, L. (2000, October). Nearness diagram navigation (ND): A new real time collision avoidance approach. In Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No. 00CH37113) (Vol. 3, pp. 2094–2100).
50.
go back to reference Minguez, J., & Montano, L. (2004, February). Nearness diagram (ND) navigation: Collision avoidance in troublesome scenarios. IEEE Transactions on Robotics and Automation, 20(1), 45–59.CrossRef Minguez, J., & Montano, L. (2004, February). Nearness diagram (ND) navigation: Collision avoidance in troublesome scenarios. IEEE Transactions on Robotics and Automation, 20(1), 45–59.CrossRef
51.
go back to reference Durham, J. W., & Bullo, F. (2008, September). Smooth nearness-diagram navigation. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 690–695). Durham, J. W., & Bullo, F. (2008, September). Smooth nearness-diagram navigation. In 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 690–695).
52.
go back to reference Minguez, J., Montano, L., Simeon, T., & Alami, R. (2001, May). Global nearness diagram navigation (GND). In Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No. 01CH37164) (Vol. 1, pp. 33–39). Minguez, J., Montano, L., Simeon, T., & Alami, R. (2001, May). Global nearness diagram navigation (GND). In Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No. 01CH37164) (Vol. 1, pp. 33–39).
53.
go back to reference Mujahad, M., Fischer, D., Mertsching, B., & Jaddu, H. (2010, October). Closest Gap based (CG) reactive obstacle avoidance Navigation for highly cluttered environments. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 1805–1812). Mujahad, M., Fischer, D., Mertsching, B., & Jaddu, H. (2010, October). Closest Gap based (CG) reactive obstacle avoidance Navigation for highly cluttered environments. In 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 1805–1812).
54.
go back to reference Mujahed, M., Fischer, D., & Mertsching, B. (2013, September). Safe Gap based (SG) reactive navigation for mobile robots. In 2013 European Conference on Mobile Robots (ECMR) (pp. 325–330). Mujahed, M., Fischer, D., & Mertsching, B. (2013, September). Safe Gap based (SG) reactive navigation for mobile robots. In 2013 European Conference on Mobile Robots (ECMR) (pp. 325–330).
56.
go back to reference Mujahed, M., & Mertsching, B. (2017, May). The admissible gap (AG) method for reactive collision avoidance. In 2017 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1916–1921). Mujahed, M., & Mertsching, B. (2017, May). The admissible gap (AG) method for reactive collision avoidance. In 2017 IEEE International Conference on Robotics and Automation (ICRA) (pp. 1916–1921).
57.
go back to reference Bauer, R., Feiten, W., & Lawitzky, G. (1994). Steer angle fields: An approach to robust manoeuvring in cluttered, unknown environments. Robotics and Autonomous Systems, 12(3), 209–212.CrossRef Bauer, R., Feiten, W., & Lawitzky, G. (1994). Steer angle fields: An approach to robust manoeuvring in cluttered, unknown environments. Robotics and Autonomous Systems, 12(3), 209–212.CrossRef
58.
go back to reference Feiten, W., Bauer, R., & Lawitzky, G. (1994, May). Robust obstacle avoidance in unknown and cramped environments. In Proceedings of the 1994 IEEE International Conference on Robotics and Automation (Vol.3, pp. 2412–2417). Feiten, W., Bauer, R., & Lawitzky, G. (1994, May). Robust obstacle avoidance in unknown and cramped environments. In Proceedings of the 1994 IEEE International Conference on Robotics and Automation (Vol.3, pp. 2412–2417).
59.
go back to reference Buhmann, J., Burgard, W., Cremers, A., Fox, D., Hofmann, T., Schneider, F., et al. (1995). The Mobile Robot RHINO. AI Magazine, 16(1), 31–38. Buhmann, J., Burgard, W., Cremers, A., Fox, D., Hofmann, T., Schneider, F., et al. (1995). The Mobile Robot RHINO. AI Magazine, 16(1), 31–38.
60.
go back to reference Fox, D., Burgard, W., & Thrun, S. (1997, March). The dynamic window approach to collision avoidance. IEEE Robotics Automation Magazine, 4(1), 23–33.CrossRef Fox, D., Burgard, W., & Thrun, S. (1997, March). The dynamic window approach to collision avoidance. IEEE Robotics Automation Magazine, 4(1), 23–33.CrossRef
61.
go back to reference Stachniss, C., & Burgard, W. (2002). An integrated approach to goal-directed obstacle avoidance under dynamic constraints for dynamic environments. In IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 1, pp. 508–513). Stachniss, C., & Burgard, W. (2002). An integrated approach to goal-directed obstacle avoidance under dynamic constraints for dynamic environments. In IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 1, pp. 508–513).
62.
go back to reference Brock, O., & Khatib, O. (1999). High-speed navigation using the global dynamic window approach. In Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No. 99CH36288C) (Vol. 1, pp. 341–346). Brock, O., & Khatib, O. (1999). High-speed navigation using the global dynamic window approach. In Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No. 99CH36288C) (Vol. 1, pp. 341–346).
63.
go back to reference Marder-Eppstein, E., Berger, E., Foote, T., Gerkey, B., & Konolige, K. (2010). The Office Marathon: Robust navigation in an indoor office environment. In IEEE International Conference on Robotics and Automation (pp. 300–307). Marder-Eppstein, E., Berger, E., Foote, T., Gerkey, B., & Konolige, K. (2010). The Office Marathon: Robust navigation in an indoor office environment. In IEEE International Conference on Robotics and Automation (pp. 300–307).
64.
go back to reference Simmons, R. (1996, April). The curvature-velocity method for local obstacle avoidance. In Proceedings of IEEE International Conference on Robotics and Automation (Vol. 4, pp. 3375–3382). Simmons, R. (1996, April). The curvature-velocity method for local obstacle avoidance. In Proceedings of IEEE International Conference on Robotics and Automation (Vol. 4, pp. 3375–3382).
65.
go back to reference Ko, N. Y., & Simmons, R. (1998, October). The lane-curvature method for local obstacle avoidance. In Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No. 98CH36190) (Vol. 3, pp. 1615–1621). Ko, N. Y., & Simmons, R. (1998, October). The lane-curvature method for local obstacle avoidance. In Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No. 98CH36190) (Vol. 3, pp. 1615–1621).
66.
go back to reference Quinlan, S., & Khatib, O. (1993, May). Elastic bands: Connecting path planning and control. In [1993] Proceedings IEEE International Conference on Robotics and Automation (Vol. 2, pp. 802–807). Quinlan, S., & Khatib, O. (1993, May). Elastic bands: Connecting path planning and control. In [1993] Proceedings IEEE International Conference on Robotics and Automation (Vol. 2, pp. 802–807).
67.
go back to reference Khatib, M. (1996). Sensor-based motion control for mobile robots. Toulouse: LAAS-CNRS. Khatib, M. (1996). Sensor-based motion control for mobile robots. Toulouse: LAAS-CNRS.
68.
go back to reference Roesmann, C., Feiten, W., Woesch, T., Hoffmann, F., & Bertram, T. (2012, May). Trajectory modification considering dynamic constraints of autonomous robots. In ROBOTIK 2012; 7th German Conference on Robotics (pp. 1–6). Roesmann, C., Feiten, W., Woesch, T., Hoffmann, F., & Bertram, T. (2012, May). Trajectory modification considering dynamic constraints of autonomous robots. In ROBOTIK 2012; 7th German Conference on Robotics (pp. 1–6).
70.
go back to reference Lindner, L., Sergiyenko, O., Rivas-López, M., Hernández-Balbuena, D., Flores-Fuentes, W., Rodríguez-Quiñonez, J. C., et al. (2017). Exact laser beam positioning for measurement of vegetation vitality. Industrial Robot: The International Journal of Robotics Research and Application, 44(4), 532–541.CrossRef Lindner, L., Sergiyenko, O., Rivas-López, M., Hernández-Balbuena, D., Flores-Fuentes, W., Rodríguez-Quiñonez, J. C., et al. (2017). Exact laser beam positioning for measurement of vegetation vitality. Industrial Robot: The International Journal of Robotics Research and Application, 44(4), 532–541.CrossRef
71.
go back to reference Sergiyenko, O., Ivanov, M., Tyrsa, V., Kartashov, V., Rivas-López, M., Hernández-Balbuena, D., et al. (2016). Data transferring model determination in robotic group. Robotics and Autonomous Systems, 83, 251–260.CrossRef Sergiyenko, O., Ivanov, M., Tyrsa, V., Kartashov, V., Rivas-López, M., Hernández-Balbuena, D., et al. (2016). Data transferring model determination in robotic group. Robotics and Autonomous Systems, 83, 251–260.CrossRef
72.
go back to reference Ivanov, M., Sergiyenko, O., Tyrsa, V., Mercorelli, P., Kartashov, V., Perdomo, W., et al. (2018, October). Individual scans fusion in virtual knowledge base for navigation of mobile robotic group with 3D TVS. In IECON 2018-44th Annual Conference of the IEEE Industrial Electronics Society (pp. 3187–3192). Ivanov, M., Sergiyenko, O., Tyrsa, V., Mercorelli, P., Kartashov, V., Perdomo, W., et al. (2018, October). Individual scans fusion in virtual knowledge base for navigation of mobile robotic group with 3D TVS. In IECON 2018-44th Annual Conference of the IEEE Industrial Electronics Society (pp. 3187–3192).
73.
go back to reference Maier, D., Hornung, A., & Bennewitz, M. (2012, November). Real-time navigation in 3D environments based on depth camera data. In 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012) (pp. 692–697). Maier, D., Hornung, A., & Bennewitz, M. (2012, November). Real-time navigation in 3D environments based on depth camera data. In 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012) (pp. 692–697).
74.
go back to reference Murray, D., & Jennings, C. (1997, May). Stereo vision based mapping and navigation for mobile robots. In IEEE International Conference on Robotics Automation (Vol. 2, pp. 1694–1699). Murray, D., & Jennings, C. (1997, May). Stereo vision based mapping and navigation for mobile robots. In IEEE International Conference on Robotics Automation (Vol. 2, pp. 1694–1699).
75.
go back to reference Biswas, J., & Veloso, M. (2012, May). Depth camera based indoor mobile robot localization and navigation. In 2012 IEEE International Conference on Robotics and Automation (pp. 1697–1702). Biswas, J., & Veloso, M. (2012, May). Depth camera based indoor mobile robot localization and navigation. In 2012 IEEE International Conference on Robotics and Automation (pp. 1697–1702).
77.
go back to reference Wurm, K. M., Hornung, A., Bennewitz, M., Stachniss, C., & Burgard, W. (2010). OctoMap: A probabilistic, flexible, and compact 3D map representation for robotic systems. In Proceedings of the ICRA 2010 workshop. Wurm, K. M., Hornung, A., Bennewitz, M., Stachniss, C., & Burgard, W. (2010). OctoMap: A probabilistic, flexible, and compact 3D map representation for robotic systems. In Proceedings of the ICRA 2010 workshop.
78.
go back to reference Schmid, K., Tomic, T., Ruess, F., Hirschmuller, H., & Suppa, M. (2013). Stereo vision based indoor/outdoor navigation for flying robots. In IEEE International Conference on Intelligent Robots and Systems (pp. 3955–3962). Schmid, K., Tomic, T., Ruess, F., Hirschmuller, H., & Suppa, M. (2013). Stereo vision based indoor/outdoor navigation for flying robots. In IEEE International Conference on Intelligent Robots and Systems (pp. 3955–3962).
79.
go back to reference Lopez, B. T., & How, J. P. (2017, May). Aggressive 3-D collision avoidance for high-speed navigation. In 2017 IEEE International Conference on Robotics and Automation (ICRA) (pp. 5759–5765). Lopez, B. T., & How, J. P. (2017, May). Aggressive 3-D collision avoidance for high-speed navigation. In 2017 IEEE International Conference on Robotics and Automation (ICRA) (pp. 5759–5765).
80.
go back to reference Matthies, L., Brockers, R., Kuwata, Y., & Weiss, S. (2014, May). Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 3242–3249). Matthies, L., Brockers, R., Kuwata, Y., & Weiss, S. (2014, May). Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 3242–3249).
81.
go back to reference Cao, T., Xiang, Z., & Liu, J. (2015, October). Perception in disparity: An efficient navigation framework for autonomous vehicles with stereo cameras. IEEE Transactions on Intelligent Transportation Systems, 16(5), 2935–2948.CrossRef Cao, T., Xiang, Z., & Liu, J. (2015, October). Perception in disparity: An efficient navigation framework for autonomous vehicles with stereo cameras. IEEE Transactions on Intelligent Transportation Systems, 16(5), 2935–2948.CrossRef
82.
go back to reference Matthies, L., Brockers, R., Kuwata, Y., & Weiss, S. (2014, May). Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 3242–3249). Matthies, L., Brockers, R., Kuwata, Y., & Weiss, S. (2014, May). Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 3242–3249).
83.
go back to reference McGuire, K., de Croon, G., De Wagter, C., Tuyls, K., & Kappen, H. (2017, April). Efficient optical flow and stereo vision for velocity estimation and obstacle avoidance on an autonomous pocket drone. IEEE Robotics and Automation Letters, 2(2), 1070–1076.CrossRef McGuire, K., de Croon, G., De Wagter, C., Tuyls, K., & Kappen, H. (2017, April). Efficient optical flow and stereo vision for velocity estimation and obstacle avoidance on an autonomous pocket drone. IEEE Robotics and Automation Letters, 2(2), 1070–1076.CrossRef
84.
go back to reference Hrabar, S., Sukhatme, G. S., Corke, P., Usher, K., & Roberts, J. (2005, August). Combined optic-flow and stereo-based navigation of urban canyons for a UAV. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 3309–3316). Hrabar, S., Sukhatme, G. S., Corke, P., Usher, K., & Roberts, J. (2005, August). Combined optic-flow and stereo-based navigation of urban canyons for a UAV. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 3309–3316).
85.
go back to reference Cao, T., Xiang, Z., & Liu, J. (2015, October). Perception in disparity: An efficient navigation framework for autonomous vehicles with stereo cameras. IEEE Transactions on Intelligent Transportation Systems, 16(5), 2935–2948.CrossRef Cao, T., Xiang, Z., & Liu, J. (2015, October). Perception in disparity: An efficient navigation framework for autonomous vehicles with stereo cameras. IEEE Transactions on Intelligent Transportation Systems, 16(5), 2935–2948.CrossRef
86.
go back to reference Otte, M. W., Richardson, S. G., Mulligan, J., & Grudic, G. (2007, October). Local path planning in image space for autonomous robot navigation in unstructured environments. In 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2819–2826). Otte, M. W., Richardson, S. G., Mulligan, J., & Grudic, G. (2007, October). Local path planning in image space for autonomous robot navigation in unstructured environments. In 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2819–2826).
87.
go back to reference Cutting, J., Vishton, P., & Braren, P. (1995, October). How we avoid collisions with stationary and moving obstacles. Psychological Review, 102(4), 627–651.CrossRef Cutting, J., Vishton, P., & Braren, P. (1995, October). How we avoid collisions with stationary and moving obstacles. Psychological Review, 102(4), 627–651.CrossRef
88.
go back to reference Fajen, B. R. (2013, July). Guiding locomotion in complex, dynamic environments. Frontiers in Behavioral Neuroscience, 7, 85.CrossRef Fajen, B. R. (2013, July). Guiding locomotion in complex, dynamic environments. Frontiers in Behavioral Neuroscience, 7, 85.CrossRef
90.
go back to reference Dillon, M. R., Persichetti, A. S., Spelke, E. S., & Dilks, D. D. (2018). Places in the brain: Bridging layout and object geometry in scene-selective cortex. Cerebral Cortex, 28(7), 2365–2374.CrossRef Dillon, M. R., Persichetti, A. S., Spelke, E. S., & Dilks, D. D. (2018). Places in the brain: Bridging layout and object geometry in scene-selective cortex. Cerebral Cortex, 28(7), 2365–2374.CrossRef
91.
go back to reference Dilks, D. D., Julian, J. B., Paunov, A. M., & Kanwisher, N. (2013). The occipital place area is causally and selectively involved in scene perception. Journal of Neuroscience, 33(4), 1331–1336.CrossRef Dilks, D. D., Julian, J. B., Paunov, A. M., & Kanwisher, N. (2013). The occipital place area is causally and selectively involved in scene perception. Journal of Neuroscience, 33(4), 1331–1336.CrossRef
92.
go back to reference Greene, M. R., & Oliva, A. (2009). Recognition of natural scenes from global properties: Seeing the forest without representing the trees. Cognitive Psychology, 58(2), 137–176.CrossRef Greene, M. R., & Oliva, A. (2009). Recognition of natural scenes from global properties: Seeing the forest without representing the trees. Cognitive Psychology, 58(2), 137–176.CrossRef
93.
go back to reference Bonner, M., & Epstein, R. A. (2017). Coding of navigational affordances in the human visual system. Proceedings of the National Academy of Sciences, 114(18), 4793–4798.CrossRef Bonner, M., & Epstein, R. A. (2017). Coding of navigational affordances in the human visual system. Proceedings of the National Academy of Sciences, 114(18), 4793–4798.CrossRef
94.
go back to reference Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. Cambridge: MIT Press. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. Cambridge: MIT Press.
95.
go back to reference Galati, G., Lobel, E., Vallar, G., Berthoz, A., Pizzamiglio, L., & Le Bihan, D. (2000, July). The neural basis of egocentric and allocentric coding of space in humans: A functional magnetic resonance study. Experimental Brain Research, 133(2), 156–164. https://doi.org/10.1007/s002210000375.CrossRef Galati, G., Lobel, E., Vallar, G., Berthoz, A., Pizzamiglio, L., & Le Bihan, D. (2000, July). The neural basis of egocentric and allocentric coding of space in humans: A functional magnetic resonance study. Experimental Brain Research, 133(2), 156–164. https://​doi.​org/​10.​1007/​s002210000375.CrossRef
100.
go back to reference Smith, J., & Vela, P. (2017). Planning in perception space. In IEEE International Conference on Robotics and Automation (pp. 6204–6209). Smith, J., & Vela, P. (2017). Planning in perception space. In IEEE International Conference on Robotics and Automation (pp. 6204–6209).
101.
102.
go back to reference Rusu, R. B., & Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011. Rusu, R. B., & Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9–13 May 2011.
104.
go back to reference Pan, J., Chitta, S., & Manocha, D. (2012, May). FCL: A general purpose library for collision and proximity queries. In 2012 IEEE International Conference on Robotics and Automation (pp. 3859–3866). Pan, J., Chitta, S., & Manocha, D. (2012, May). FCL: A general purpose library for collision and proximity queries. In 2012 IEEE International Conference on Robotics and Automation (pp. 3859–3866).
105.
go back to reference Brockers, R., Fragoso, A., Matthies, L. (2016). Stereo vision-based obstacle avoidance for micro air vehicles using an egocylindrical image space representation. In Micro- and Nanotechnology Sensors, Systems, and Applications VIII (Vol. 9836). http://dx.doi.org/10.1117/12.2224695. Brockers, R., Fragoso, A., Matthies, L. (2016). Stereo vision-based obstacle avoidance for micro air vehicles using an egocylindrical image space representation. In Micro- and Nanotechnology Sensors, Systems, and Applications VIII (Vol. 9836). http://​dx.​doi.​org/​10.​1117/​12.​2224695.
106.
go back to reference Asada, M., Tanaka, T., & Hosoda, K. (2016, April). Adaptive binocular visual servoing for independently moving target tracking. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) (Vol. 3, pp. 2076–2081. http://ieeexplore.ieee.org/document/846335/. Asada, M., Tanaka, T., & Hosoda, K. (2016, April). Adaptive binocular visual servoing for independently moving target tracking. In Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) (Vol. 3, pp. 2076–2081. http://​ieeexplore.​ieee.​org/​document/​846335/​.
108.
go back to reference Hirschmuller, H. (2005, June). Accurate and efficient stereo processing by semi-global matching and mutual information. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) (Vol. 2, pp. 807–814). Hirschmuller, H. (2005, June). Accurate and efficient stereo processing by semi-global matching and mutual information. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) (Vol. 2, pp. 807–814).
109.
go back to reference Jin, S., Cho, J., Pham, X. D., Lee, K. M., Park, S. Kim, M., et al. (2010, January). FPGA design and implementation of a real-time stereo vision system. IEEE Transactions on Circuits and Systems for Video Technology, 20(1), 15–26.CrossRef Jin, S., Cho, J., Pham, X. D., Lee, K. M., Park, S. Kim, M., et al. (2010, January). FPGA design and implementation of a real-time stereo vision system. IEEE Transactions on Circuits and Systems for Video Technology, 20(1), 15–26.CrossRef
110.
go back to reference Li, Y., Yang, C., Zhong, W., Li, Z., & Chen, S. (2017, January). High throughput hardware architecture for accurate semi-global matching. In 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC) (pp. 641–646). Li, Y., Yang, C., Zhong, W., Li, Z., & Chen, S. (2017, January). High throughput hardware architecture for accurate semi-global matching. In 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC) (pp. 641–646).
111.
go back to reference Hernandez-Juarez, D., Chacón, A., Espinosa, A., Vázquez, D., Moure, J. C., & López, A. M. (2016). Embedded real-time stereo estimation via semi-global matching on the GPU. Procedia Computer Science, 80, 143–153.CrossRef Hernandez-Juarez, D., Chacón, A., Espinosa, A., Vázquez, D., Moure, J. C., & López, A. M. (2016). Embedded real-time stereo estimation via semi-global matching on the GPU. Procedia Computer Science, 80, 143–153.CrossRef
112.
go back to reference Sprunk, C., Röwekämper, J., Parent, G., Spinello, L., Tipaldi, G. D., Burgard, W., et al. (2016). An experimental protocol for benchmarking robotic indoor navigation. In Experimental Robotics (pp. 487–504). Berlin: Springer.CrossRef Sprunk, C., Röwekämper, J., Parent, G., Spinello, L., Tipaldi, G. D., Burgard, W., et al. (2016). An experimental protocol for benchmarking robotic indoor navigation. In Experimental Robotics (pp. 487–504). Berlin: Springer.CrossRef
Metadata
Title
Real-Time Egocentric Navigation Using 3D Sensing
Authors
Justin S. Smith
Shiyu Feng
Fanzhe Lyu
Patricio A. Vela
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-22587-2_14