Skip to main content
Top
Published in:
Cover of the book

2017 | OriginalPaper | Chapter

1. Nadine: A Social Robot that Can Localize Objects and Grasp Them in a Human Way

Authors : Nadia Magnenat Thalmann, Li Tian, Fupin Yao

Published in: Frontiers in Electronic Technologies

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

What makes a social humanoid robot behave like a human? It needs to understand and show emotions, has a chat box, a memory and also a decision-making process. However, more than that, it needs to recognize objects and be able to grasp them in a human way. To become an intimate companion, social robots need to behave the same way as real humans in all areas and understand real situations in order they can react properly. In this chapter, we describe our ongoing research on social robotics. It includes the making of articulated hands of Nadine Robot, the recognition of objects and their signification, as well as how to grasp them in a human way. State of the art is presented as well as some early results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
5.
go back to reference Y. Sakagami, R. Watanabe, C. Aoyama et al., The intelligent ASIMO: system overview and integration, in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2002, vol. 3, (IEEE, 2002), pp. 2478-2483 Y. Sakagami, R. Watanabe, C. Aoyama et al., The intelligent ASIMO: system overview and integration, in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2002, vol. 3, (IEEE, 2002), pp. 2478-2483
6.
go back to reference G. Metta, G. Sandini, D. Vernon, L. Natale, F. Nori, The iCub humanoid robot: an open platform for research in embodied cognition, in PerMIS’08 Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, pp. 50–56 G. Metta, G. Sandini, D. Vernon, L. Natale, F. Nori, The iCub humanoid robot: an open platform for research in embodied cognition, in PerMIS’08 Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, pp. 50–56
10.
go back to reference R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in CVPR (2014) R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in CVPR (2014)
11.
go back to reference R. Girshick, Fast r-cnn, in Proceedings of the IEEE International Conference on Computer Vision (2015), pp. 1440–1448 R. Girshick, Fast r-cnn, in Proceedings of the IEEE International Conference on Computer Vision (2015), pp. 1440–1448
12.
go back to reference S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems (2015), pp. 91–99 S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems (2015), pp. 91–99
13.
go back to reference J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in CVPR (2016) J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in CVPR (2016)
15.
go back to reference A. Saxena, J. Driemeyer, A.Y. Ng, Robotic grasping of novel objects using vision. Int. J. Rob. Res. 27(2), 157–173 (2008) A. Saxena, J. Driemeyer, A.Y. Ng, Robotic grasping of novel objects using vision. Int. J. Rob. Res. 27(2), 157–173 (2008)
16.
go back to reference Q.V. Le, D. Kamm, A.F. Kara, A.Y. Ng, Learning to grasp objects with multiple contact points, in IEEE International Conference on Robotics and Automation (ICRA) (2010), pp. 5062–5069 Q.V. Le, D. Kamm, A.F. Kara, A.Y. Ng, Learning to grasp objects with multiple contact points, in IEEE International Conference on Robotics and Automation (ICRA) (2010), pp. 5062–5069
17.
go back to reference Ian Lenz, Honglak Lee, Ashutosh Saxena, Deep learning for detecting robotic grasps. Int. J. Rob. Res. 34(4–5), 705–724 (2015)CrossRef Ian Lenz, Honglak Lee, Ashutosh Saxena, Deep learning for detecting robotic grasps. Int. J. Rob. Res. 34(4–5), 705–724 (2015)CrossRef
18.
go back to reference Y. Jiang, S. Moseson, A. Saxena, Efficient grasping from rgbd images: learning using a new rectangle representation, in IEEE International Conference on Robotics and Automation (ICRA) (2011), pp. 3304–3311 Y. Jiang, S. Moseson, A. Saxena, Efficient grasping from rgbd images: learning using a new rectangle representation, in IEEE International Conference on Robotics and Automation (ICRA) (2011), pp. 3304–3311
19.
go back to reference J. Redmon, A. Angelova, Real-time grasp detection using convolutional neural networks, in IEEE International Conference on Robotics and Automation (ICRA) (2015), pp. 1316–1322 J. Redmon, A. Angelova, Real-time grasp detection using convolutional neural networks, in IEEE International Conference on Robotics and Automation (ICRA) (2015), pp. 1316–1322
20.
go back to reference D. Guo, T. Kong, F. Sun et al., Object discovery and grasp detection with a shared convolutional neural network, in 2016 IEEE International Conference on Robotics and Automation (ICRA). (IEEE, 2016), pp. 2038–2043 D. Guo, T. Kong, F. Sun et al., Object discovery and grasp detection with a shared convolutional neural network, in 2016 IEEE International Conference on Robotics and Automation (ICRA). (IEEE, 2016), pp. 2038–2043
22.
go back to reference G. Schreiber, A. Stemmer, R. Bischoff, The fast research interface for the kuka lightweight robot, in IEEE Workshop on Innovative Robot Control Architectures for Demanding (Research) Applications How to Modify and Enhance Commercial Controllers (ICRA 2010) (2010), pp. 15–21 G. Schreiber, A. Stemmer, R. Bischoff, The fast research interface for the kuka lightweight robot, in IEEE Workshop on Innovative Robot Control Architectures for Demanding (Research) Applications How to Modify and Enhance Commercial Controllers (ICRA 2010) (2010), pp. 15–21
25.
go back to reference P. Slade et al., Tack: design an performance of an open-source, affordable, myoelectric prosthetic hand, in 2015 IEEE ICRA P. Slade et al., Tack: design an performance of an open-source, affordable, myoelectric prosthetic hand, in 2015 IEEE ICRA
26.
go back to reference J.T. Belter et al., Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. J. Rehabil. Res. Dev. 50(5) 2013 J.T. Belter et al., Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. J. Rehabil. Res. Dev. 50(5) 2013
27.
go back to reference A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems (2012), pp. 1097–1105 A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems (2012), pp. 1097–1105
31.
go back to reference A.M.R Agur, M.J. Lee, Grant’s Atlas of Anatomy 10th ed (1999) A.M.R Agur, M.J. Lee, Grant’s Atlas of Anatomy 10th ed (1999)
32.
go back to reference J. Lin, Y. Wu, T.S. Huang, Modeling the constraints of human hand motion, in Workshop on Human Motion, 2000. Proceedings. (IEEE, 2000), pp. 121–126 J. Lin, Y. Wu, T.S. Huang, Modeling the constraints of human hand motion, in Workshop on Human Motion, 2000. Proceedings. (IEEE, 2000), pp. 121–126
Metadata
Title
Nadine: A Social Robot that Can Localize Objects and Grasp Them in a Human Way
Authors
Nadia Magnenat Thalmann
Li Tian
Fupin Yao
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-4235-5_1