Skip to main content

2017 | OriginalPaper | Buchkapitel

Experimental Evaluation of a Perceptual Pipeline for Hierarchical Affordance Extraction

verfasst von : Peter Kaiser, Eren E. Aksoy, Markus Grotz, Dimitrios Kanoulas, Nikos G. Tsagarakis, Tamim Asfour

Erschienen in: 2016 International Symposium on Experimental Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The perception of affordances in unknown environments is an essential prerequisite for autonomous humanoid robots. In our previous work we developed a perceptual pipeline for the extraction of affordances for loco-manipulation actions based on a simplified representation of the environment starting from RGB-D camera images. The feasibility of this approach has been demonstrated in various examples in simulation as well as on real robotic platforms. The overall goal of the perceptual pipeline is to provide a robust and reliable perceptual mechanism for affordance-based action execution.
In this work we evaluate the performance of the perceptual pipeline in combination with sensor systems other than RGB-D cameras, in order to utilize redundant sensor equipment of humanoid robots. This is particularly important when considering challenging scenarios where particular sensors are not applicable, e.g. due to intense sunlight or reflective surfaces. In this work we focus on stereo cameras and LIDAR laser scanners.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
SE(3) denotes the special Euclidean group.
 
2
WALK-MAN is equipped with a MultiSense SL sensor head from Carnegie Robotics containing a LIDAR sensor and a stereo camera system. The LIDAR scanner captures 1024 points per scan and was configured to rotate with 0.5 rad/sec. The stereo camera system produces point clouds using semi-global matching based on 1 Mpx camera images. No postprocessing filters have been applied in both cases.
 
3
In our experiments, we chose \(\varepsilon = 0.1\).
 
Literatur
1.
Zurück zum Zitat Gibson, J.J.: The Ecological Approach to Visual Perception (1978) Gibson, J.J.: The Ecological Approach to Visual Perception (1978)
2.
Zurück zum Zitat Şahin, E., Çakmak, M., Doǧar, M.R., Uǧur, E., Üçoluk, G.: To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adapt. Behav. 15, 447 (2007)CrossRef Şahin, E., Çakmak, M., Doǧar, M.R., Uǧur, E., Üçoluk, G.: To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adapt. Behav. 15, 447 (2007)CrossRef
3.
Zurück zum Zitat Krüger, N., Geib, C., Piater, J., Petrick, R., Steedman, M., Wörgötter, F., Ude, A., Asfour, T., Kraft, D., Omrčen, D., Agostini, A., Dillmann, R.: Object-action complexes: grounded abstractions of sensorimotor processes. Robot. Auton. Syst. 59(10), 740–757 (2011)CrossRef Krüger, N., Geib, C., Piater, J., Petrick, R., Steedman, M., Wörgötter, F., Ude, A., Asfour, T., Kraft, D., Omrčen, D., Agostini, A., Dillmann, R.: Object-action complexes: grounded abstractions of sensorimotor processes. Robot. Auton. Syst. 59(10), 740–757 (2011)CrossRef
4.
Zurück zum Zitat Romay, A., Kohlbrecher, S., Conner, D.C., von Stryk, O.: Achieving versatile manipulation tasks with unknown objects by supervised humanoid robots based on object templates. In: IEEE-RAS International Conference on Humanoid Robots, pp. 249–255 (2015) Romay, A., Kohlbrecher, S., Conner, D.C., von Stryk, O.: Achieving versatile manipulation tasks with unknown objects by supervised humanoid robots based on object templates. In: IEEE-RAS International Conference on Humanoid Robots, pp. 249–255 (2015)
5.
Zurück zum Zitat Fallon, M., Kuindersma, S., Karumanchi, S., Antone, M., Schneider, T., Dai, H., Pérez, C., D’Arpino, R., Deits, M., DiCicco, D., Fourie, T., Koolen, P., Marion, M., Posa, A., Valenzuela, K.-T., Yu, J., Shah, K., Iagnemma, R., Tedrake, R., Teller, S.: An architecture for online affordance-based perception and whole-body planning. J. Field Rob. 32(2), 229–254 (2015)CrossRef Fallon, M., Kuindersma, S., Karumanchi, S., Antone, M., Schneider, T., Dai, H., Pérez, C., D’Arpino, R., Deits, M., DiCicco, D., Fourie, T., Koolen, P., Marion, M., Posa, A., Valenzuela, K.-T., Yu, J., Shah, K., Iagnemma, R., Tedrake, R., Teller, S.: An architecture for online affordance-based perception and whole-body planning. J. Field Rob. 32(2), 229–254 (2015)CrossRef
6.
Zurück zum Zitat Hart, S., Dinh, P., Hambuchen, K.: The affordance template ROS package for robot task programming. In: IEEE International Conference on Robotics and Automation, pp. 6227–6234 (2015) Hart, S., Dinh, P., Hambuchen, K.: The affordance template ROS package for robot task programming. In: IEEE International Conference on Robotics and Automation, pp. 6227–6234 (2015)
7.
Zurück zum Zitat Fallon, M.F., Marion, P., Deits, R., Whelan, T., Antone, M., McDonald, J., Tedrake, R.: Continuous humanoid locomotion over uneven terrain using stereo fusion. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 881–888 (2015) Fallon, M.F., Marion, P., Deits, R., Whelan, T., Antone, M., McDonald, J., Tedrake, R.: Continuous humanoid locomotion over uneven terrain using stereo fusion. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 881–888 (2015)
8.
Zurück zum Zitat Stein, S.C., Schoeler, M., Papon, J., Wörgötter, F.: Object partitioning using local convexity. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 304–311 (2014) Stein, S.C., Schoeler, M., Papon, J., Wörgötter, F.: Object partitioning using local convexity. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 304–311 (2014)
9.
Zurück zum Zitat Kaiser, P., Gonzalez-Aguirre, D., Schültje, F., Borràs, J., Vahrenkamp, N., Asfour, T.: Extracting whole-body affordances from multimodal exploration. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 1036–1043 (2014) Kaiser, P., Gonzalez-Aguirre, D., Schültje, F., Borràs, J., Vahrenkamp, N., Asfour, T.: Extracting whole-body affordances from multimodal exploration. In: IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 1036–1043 (2014)
10.
Zurück zum Zitat Kaiser, P., Vahrenkamp, N., Schültje, F., Borràs, J., Asfour, T.: Extraction of whole-body affordances for loco-manipulation tasks. Int. J. Human. Rob. (IJHR) 12(3), 155031 (2015) Kaiser, P., Vahrenkamp, N., Schültje, F., Borràs, J., Asfour, T.: Extraction of whole-body affordances for loco-manipulation tasks. Int. J. Human. Rob. (IJHR) 12(3), 155031 (2015)
11.
Zurück zum Zitat Kaiser, P., Grotz, M., Aksoy, E.E., Do, M., Vahrenkamp, N., Asfour, T.: Validation of whole-body loco-manipulation affordances for pushability and liftability. In: IEEE/RAS International Conference on Humanoid Robots (Humanoids) (2015) Kaiser, P., Grotz, M., Aksoy, E.E., Do, M., Vahrenkamp, N., Asfour, T.: Validation of whole-body loco-manipulation affordances for pushability and liftability. In: IEEE/RAS International Conference on Humanoid Robots (Humanoids) (2015)
12.
Zurück zum Zitat Vahrenkamp, N., Wächter, M., Kröhnert, M., Welke, K., Asfour, T.: The robot software framework armarx. Inf. Technol. 57(2), 99–111 (2015) Vahrenkamp, N., Wächter, M., Kröhnert, M., Welke, K., Asfour, T.: The robot software framework armarx. Inf. Technol. 57(2), 99–111 (2015)
13.
Zurück zum Zitat Kaiser, P., Aksoy, E.E., Grotz, M., Asfour, T.: Towards a hierarchy of loco-manipulation affordances. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2016) Kaiser, P., Aksoy, E.E., Grotz, M., Asfour, T.: Towards a hierarchy of loco-manipulation affordances. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2016)
14.
Zurück zum Zitat Tsagarakis, N.G., Caldwell, D.G., Bicchi, A., Negrello, F., Garabini, M., Choi, W., Baccelliere, L., Loc, V., Noorden, J., Catalano, M., Ferrati, M., Muratore, L., Margan, A., Natale, L., Mingo, E., Dallali, H., Malzahn, J., Settimi, A., Rocchi, A., Varricchio, V., Pallottino, L., Pavan, C., Ajoudani, A., Lee, J., Kryczka, P., Kanoulas, D.: WALK-MAN: a high performance humanoid platform for realistic environments. J. Field Rob. (JFR) (2016) Tsagarakis, N.G., Caldwell, D.G., Bicchi, A., Negrello, F., Garabini, M., Choi, W., Baccelliere, L., Loc, V., Noorden, J., Catalano, M., Ferrati, M., Muratore, L., Margan, A., Natale, L., Mingo, E., Dallali, H., Malzahn, J., Settimi, A., Rocchi, A., Varricchio, V., Pallottino, L., Pavan, C., Ajoudani, A., Lee, J., Kryczka, P., Kanoulas, D.: WALK-MAN: a high performance humanoid platform for realistic environments. J. Field Rob. (JFR) (2016)
Metadaten
Titel
Experimental Evaluation of a Perceptual Pipeline for Hierarchical Affordance Extraction
verfasst von
Peter Kaiser
Eren E. Aksoy
Markus Grotz
Dimitrios Kanoulas
Nikos G. Tsagarakis
Tamim Asfour
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-50115-4_13

Neuer Inhalt