Top

The International Journal of Advanced Manufacturing Technology

Published in:

03-07-2019 | ORIGINAL ARTICLE

3D object recognition for anthropomorphic robots performing tracking tasks

Authors: S. Satorres Martínez, A. Sánchez García, E. Estévez Estévez, J. Gómez Ortega, J. Gámez García

Published in: The International Journal of Advanced Manufacturing Technology | Issue 1-4/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Object recognition is still a major research issue of particular relevance in robotics. The new trend in industrial and mainly in service robotics is to perform manipulation tasks in an unstructured environment working in synergy with humans. To perform tasks in an environment that is not perfectly controlled, robots need adequate perceptual capabilities. Among various types of sensors available for robotic systems, the time-of-flight (ToF) camera is one of the most utilized since it simultaneously provides intensity and depth data at a high frame rate. Our proposal makes use of this technology exploiting both, depth and grey-scale information. Therefore, intensity and geometric features are fused together to allow 3D object recognition in real scenes in presence of partial occlusions. As a case study, an object tracking task for an anthropomorphic robot is presented. Experimental results demonstrate the effectiveness of the proposed method, not only providing reliable visual information about the object to be tracked but also recognizing potential obstacles which should be avoided during the robot arm movement.

previous article Numerical and experimental investigation of the discrete spot laser hardening of a graphite-coated hypereutectoid steel using a fibre laser

next article A cutting force model based on compensated chip thickness in five-axis flank milling

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Robla-Gómez S, Becerra VM, Llata JR, González-Sarabia E, Torre-Ferrero C, P3́rez-oria J (2017) Working together: a review on safe human-robot collaboration in industrial environments. IEEE Access 5:26754–26773

Alzarok H, Fletcher S, Longstaff A (2017) 3D Visual tracking of an articulated robot in precision automated tasks. Sensors 17(104):1–23

Hoiem D, Savarese S (2011) Representations and techniques for 3D object recognition and scene interpretation. Morgan & Claypool, San RafaelCrossRef

Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Pattern Anal Mach Intell 28(10):1584–1601CrossRef

Foix S, Aleny G, Torras C (2011) Lock-in time-of-flight (ToF) cameras: a survey. IEEE Sensors J 11 (9):1917–1926CrossRef

Jain AK, Dorai C (2000) 3D object recognition: representation and matching. Stat Comput 10:167–182CrossRef

Guo Y, Bennamoun M, Sohel F, Lu M, Wan J (2014) 3D Object recognition in cluttered scenes with local surface features: a survey. IEEE Trans Pattern Anal Mach Intell 36(11):2270–2287CrossRef

Hussmann S, Liepert T (2009) Three-dimensional TOF robot vision system. IEEE Trans Instrum Meas 58 (1):141–146CrossRef

Forsyth DA, Ponce J (2003) Computer Vision: a modern approach. Prentice Hall, Upper Saddle River

10.

Satorres Martínez S, Gómez Ortega J, Gámez García J, Sánchez García A, De la Casa cárdenas J (2013) Visual predictive control of robot manipulators using a 3D ToF camera. In: IEEE International Conference on Systems, Man, and Cybernetics, pp 3657–3662

11.

Satorres Martínez S, De la Casa cárdenas J, Gámez García J, Gómez Ortega J (2014) Position predictive control of an anthropomorphic robotic arm using a time-of-flight camera. IEEE Sensors pp 1718–1721

12.

Andreopoulos A, Tsotsos JK (2013) 50 years of object recognition: directions forward. Comput Vis Image Underst 117:827–891CrossRef

13.

Rusu RB, Blodow N, Beetz M (2009) Fast Point Feature Histograms (FPFH) for 3D registration. In: Proceedings of the International Conference on Robotics and Automation (ICRA)

14.

Rusu RB, Marton ZC, Blodow N, Beetz M (2008) Learning informative point classes for acquisition of object model maps. Proceedings of the 10th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp 17–20

15.

Rusu RB, Marton ZC, Blodow N, Dolha M, Beetz M (2008) Towards 3D point cloud based object maps for household environments. Robotics and Autonomous System Journal (Special Issue on Semantic Knowledge)

16.

Rusu RB, Holzbach A, Beetz M (2009) Detecting and segmenting objects for mobile manipulation. In: International Conference on Computer Vision Workshops, pp 47–54

17.

Rusu RB, Bradski G, Thibaux R, Hsu J (2010) Fast 3D recognition and pose using the Viewpoint Feature Histogram. In: International Conference on Intelligent Robots and Systems (IROS), pp 2155–2162

18.

Marton Z-C, Pangercic D, Blodow N, Kleinehellefort J, Beetz M (2010) General 3D modelling of novel objects from a single view. In: International Conference on Intelligent Robots and Systems (IROS), pp 3700–3705

19.

Johnson AE, Hebert M (1999) Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans Pattern Anal Mach Intell 21(5):433–449CrossRef

20.

Frome A, Huber D, Kolluri R, Bülow T, Malik J (2004) Recognizing objects in range data using regional points descriptors. ECCV 3:224–237MATH

21.

Tombari F, Salti S, Di Stefano L (2010) Unique shape context for 3D data description. In: Proceedings on the ACM workshop on 3D object retrieval, pp 57–62

22.

Arbeiter G, Fuchs S, Bormann R, Fischer J, Verl A (2012) Evaluation of 3D feature descriptors for classification of surface geometries in points clouds. In: International Conference on Intelligent Robots and Systems (IROS), pp 1644–1650

23.

Lazebnik S, Schmid C, Ponce J (2005) A Sparse texture representation using local affine regions. IEEE Trans Pattern Anal Mach Intell 27(8):1265–1278CrossRef

24.

Hussmann S, Liepert T (2009) Three-dimensional TOF robot vision system. IEEE Trans Instrum Meas 58 (1):141–146CrossRef

25.

Tang K, Song P, Chen X (2017) 3D object recognition in cluttered scenes with robust shape description and correspondence selection. IEEE access, Special Section on Trends and Advances for Ambient Intelligence with Internet Of Things (IOT) Systems 5:1833–1845

26.

Li Y, Wang S, Tian Q, Ding X (2015) Feature representation for statistical-learning-based object detection: a review. Pattern Recogn 48:3542–3559CrossRef

27.

Castellini C, Tommasi T, Noceti N, Odone F, Caputo B (2011) Using object affordances to improve object recognition. IEEE Trans Auton Ment Dev 3(3):207–215CrossRef

28.

Homberg BS, Katzschmann RK, Dogar MR (2015) Haptic identification of objects using a modular soft robotic gripper. In: International Conference on Intelligent Robots and Systems, IEEE, pp 1698–1705

29.

Andreopoulos A, Tsotsos JK (2013) A computational learning theory of active object recognition under uncertainty. Int J Comput Vis 101:95–142MathSciNetCrossRefMATH

30.

Saidi F, Stasse O, Yokoi K, Kanehiro F (2007) Online object search with a humanoid robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 1677–1682

31.

Sujan VA, Dubowsky S (2005) Efficient information-based visual robotic mapping in unstructured environments. Int J Robot Res 24(4):275–293CrossRef

32.

Ray PP (2016) Internet Of robotic things: concept, technologies, and challenges. IEEE Access 4:9489–9500CrossRef

33.

Pundlik S, Patii V, Navalgund M, Sahasrabudhe A, Shinde S (2018) Object tracking bot using on-board Jetson TK1: an approach to reduce communication overhead and time delay. In: International Conference on Big Data, IoT and Data Science. https://doi.org/10.1109/BID.2017.8336575

34.

Schnabel R, Wahl R, Klein R (2007) Efficient RANSAC for point-cloud shape detection. Comput Graphics Forum 26(2):214–226CrossRef

35.

Russ JC (2007) The image processing handbook. CRC Press Taylor & Francis Group, Chapman & HallMATH

36.

Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley, New YorkMATH

37.

Russell J, Cohn R (2012) ROS (robotic operating system). VSD

38.

Estévez E, Sánchez García A, Gámez García J, Gómez Ortega J (2018) ’ART2ool: a model-driven framework to generate target code for robot handling tasks. Int J Adv Manuf Technol 97(1):1195–1207CrossRef

Title: 3D object recognition for anthropomorphic robots performing tracking tasks
Authors: S. Satorres Martínez
A. Sánchez García
E. Estévez Estévez
J. Gómez Ortega
J. Gámez García
Publication date: 03-07-2019
Publisher: Springer London
Published in: The International Journal of Advanced Manufacturing Technology / Issue 1-4/2019
Print ISSN: 0268-3768
Electronic ISSN: 1433-3015
DOI: https://doi.org/10.1007/s00170-019-04058-6

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 1-4/2019

Research on the drilling micromechanical properties of TiBW/TC4 composites based on drilling force and temperature analysis

Numerical and experimental investigation of the discrete spot laser hardening of a graphite-coated hypereutectoid steel using a fibre laser

Research on homogenization and surface morphology of Ti-6Al-4V alloy by longitudinal-torsional coupled ultrasonic vibration ball-end milling

Study on the influence that hard water had in high-speed wire electrical discharge machining

A pose estimation system based on deep neural network and ICP registration for robotic spray painting application

A study on welding mode transition by electrical detection of laser-induced plasma at varying energy levels

Premium Partners