Skip to main content
Erschienen in: Neural Computing and Applications 7/2019

26.10.2017 | Original Article

Automatic single-view monocular camera calibration-based object manipulation using novel dexterous multi-fingered delta robot

verfasst von: Sachin Kansal, Sudipto Mukherjee

Erschienen in: Neural Computing and Applications | Ausgabe 7/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The approximation of 3D geometry through single image is a particular instance of 3D reconstruction from several images. The advance information or user input should be provided to retrieve or conclude depth information. This research presents a novel automatic method to enumerated 3D affine measurements from a single perspective image. The least geometric information has been resolute through the image of the scene. The vanishing line and a vanishing point are two required information to reconstruct from an image of a scene. The affine scene structure can be reconstructed through the image of a scene. The proposed approach has many advantages; there is no need of the camera’s intrinsic matrix and the explicit correlation among camera and scene (pose), no need for selecting Vx, Vy, Vz points, novel dexterous robot architecture for manipulation. In this paper, the following approaches have been implemented: (1) the three sets of vanishing points in X, Y, and Z axis; (2) the vanishing lines of the image; (3) distance among planes that parallel to the reference plane; (4) image wrapping; (5) corner detection (algorithm has been implemented in order to make the process automatic). The indigenous data set has been taken for the experiment. The results are compared with Zhang- and ArUco-based calibration. This novel approach has been used to perform tracking and manipulation of an object in real-time environment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kushal AM, Bansal V, Banerjee S (2002) A simple method for interactive 3D reconstruction and camera calibration from a single view. In: Proceedings of the Indian conference in computer vision graphics and image Kushal AM, Bansal V, Banerjee S (2002) A simple method for interactive 3D reconstruction and camera calibration from a single view. In: Proceedings of the Indian conference in computer vision graphics and image
2.
Zurück zum Zitat Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148CrossRefMATH Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148CrossRefMATH
3.
Zurück zum Zitat Criminisi A (2002) Single-view metrology: algorithms and applications. Invited paper, Microsoft Research, One Microsoft Way, Redmond, WA Criminisi A (2002) Single-view metrology: algorithms and applications. Invited paper, Microsoft Research, One Microsoft Way, Redmond, WA
4.
Zurück zum Zitat Wang G, Tsui H, Zhanyi H, Wu F (2005) Camera calibration and 3D reconstruction from a single view based on scene constraints. Image Vis Comput 23:311–323CrossRef Wang G, Tsui H, Zhanyi H, Wu F (2005) Camera calibration and 3D reconstruction from a single view based on scene constraints. Image Vis Comput 23:311–323CrossRef
5.
Zurück zum Zitat Wang G, Zhanyi H, Wu F, Tsui H (2005) Single view metrology from constraints. Image Vis Comput 23(2005):831–840CrossRef Wang G, Zhanyi H, Wu F, Tsui H (2005) Single view metrology from constraints. Image Vis Comput 23(2005):831–840CrossRef
6.
Zurück zum Zitat Wang G, Tsui H, Wu QMJ (2009) What can we learn about the scene structure from three orthogonal vanishing points in image. Pattern Recognit Lett 30(2009):192–202CrossRef Wang G, Tsui H, Wu QMJ (2009) What can we learn about the scene structure from three orthogonal vanishing points in image. Pattern Recognit Lett 30(2009):192–202CrossRef
7.
Zurück zum Zitat Miyagawa I, Arai H, Koike H (2010) Simple camera calibration from a single image using five points on two orthogonal 1D objects. IEEE Trans Image Process 19(6):1528–1538MathSciNetCrossRefMATH Miyagawa I, Arai H, Koike H (2010) Simple camera calibration from a single image using five points on two orthogonal 1D objects. IEEE Trans Image Process 19(6):1528–1538MathSciNetCrossRefMATH
8.
Zurück zum Zitat Upadhyay S, Singh SK, Gupta M, Nagawat AK (2011) Linear and non-linear camera calibration techniques. J Glob Res Comput Sci 2(5):81–85 Upadhyay S, Singh SK, Gupta M, Nagawat AK (2011) Linear and non-linear camera calibration techniques. J Glob Res Comput Sci 2(5):81–85
9.
Zurück zum Zitat Gupta M, Upadhyay S, Singh SK, Nagawat AK (2011) Camera calibration technique using Tsai’s algorithm. In: IJECBS, vol 1 Gupta M, Upadhyay S, Singh SK, Nagawat AK (2011) Camera calibration technique using Tsai’s algorithm. In: IJECBS, vol 1
10.
Zurück zum Zitat Kansal S, Mukherjee S (2016) An approach for vision based manipulation. In: 8th Asian conference on multibody dynamics, Japan, August Kansal S, Mukherjee S (2016) An approach for vision based manipulation. In: 8th Asian conference on multibody dynamics, Japan, August
11.
Zurück zum Zitat Tiwan P, Boby RA, Dutta RS, Saha SK, Chaudhury S (2013) Pose estimation of an object using single camera for its manipulation by a robot. In: 1st international conference on advances in robotics, 2013, Pune, India Tiwan P, Boby RA, Dutta RS, Saha SK, Chaudhury S (2013) Pose estimation of an object using single camera for its manipulation by a robot. In: 1st international conference on advances in robotics, 2013, Pune, India
12.
Zurück zum Zitat Boby RA, Saha SK (2016) Single image based camera calibration and pose estimation of the end-effector of a robot. In: IEEE international conference on robotics and automation (ICRA), Stockholm, Sweden, May 16–21 Boby RA, Saha SK (2016) Single image based camera calibration and pose estimation of the end-effector of a robot. In: IEEE international conference on robotics and automation (ICRA), Stockholm, Sweden, May 16–21
13.
Zurück zum Zitat Patel TP, Panchal SR (2014) Corner detection techniques: an introductory survey. IJEDR 2(4). ISSN: 2321-9939 Patel TP, Panchal SR (2014) Corner detection techniques: an introductory survey. IJEDR 2(4). ISSN: 2321-9939
14.
Zurück zum Zitat Malis E (2004) Visual serving invariant to changes in camera-intrinsic parameters. IEEE Trans Robot Autom 20(1):72–81CrossRef Malis E (2004) Visual serving invariant to changes in camera-intrinsic parameters. IEEE Trans Robot Autom 20(1):72–81CrossRef
15.
Zurück zum Zitat Kansal S, Mukherjee S (2016) Object manipulation by delta robot using multiple view based system. In: 4th joint international conference on multibody system dynamics, Montreal, Canada Kansal S, Mukherjee S (2016) Object manipulation by delta robot using multiple view based system. In: 4th joint international conference on multibody system dynamics, Montreal, Canada
16.
Zurück zum Zitat Drummond T (2002) Real-time visual tracking of complex structures. IEEE Trans Pattern Anal Mach Intell 24(7):932–946CrossRef Drummond T (2002) Real-time visual tracking of complex structures. IEEE Trans Pattern Anal Mach Intell 24(7):932–946CrossRef
17.
Zurück zum Zitat Kansal S, Mukherjee S (2015) Vision based manipulation of a regular shaped object. In: 5th international conference on human computer interaction, Allahabad, India Kansal S, Mukherjee S (2015) Vision based manipulation of a regular shaped object. In: 5th international conference on human computer interaction, Allahabad, India
18.
Zurück zum Zitat Xue Y, Deng W, Zhou D, Zhang H (2010) Single image super resolution for license plate. In: Sixth international conference on natural computation Xue Y, Deng W, Zhou D, Zhang H (2010) Single image super resolution for license plate. In: Sixth international conference on natural computation
19.
Zurück zum Zitat Zhao B, Wu X, Cheng Z-Q, Liu H, Feng J (2017) Multi-view image generation from a single-view. Comput Vis Pattern Recognit Zhao B, Wu X, Cheng Z-Q, Liu H, Feng J (2017) Multi-view image generation from a single-view. Comput Vis Pattern Recognit
20.
Zurück zum Zitat Rematas K, Nguyen C, Ritschel T, Fritz M, Tuytelaars T (2016) Novel views of objects from a single image. Comput Vis Pattern Recognit Rematas K, Nguyen C, Ritschel T, Fritz M, Tuytelaars T (2016) Novel views of objects from a single image. Comput Vis Pattern Recognit
21.
Zurück zum Zitat Yonemoto S, Taniguchi R (2002) Vision-based 3D direct manipulation interface for smart interaction. In: Proceedings of the IEEE international conference on pattern recognition, pp 655–658 Yonemoto S, Taniguchi R (2002) Vision-based 3D direct manipulation interface for smart interaction. In: Proceedings of the IEEE international conference on pattern recognition, pp 655–658
22.
Zurück zum Zitat Wei Y, Goodwine B (2002) Vision-based non-smooth kinematic stratified object manipulation. In: Seventh international conference on control, automation, robotics and vision (ICARCV’02) Wei Y, Goodwine B (2002) Vision-based non-smooth kinematic stratified object manipulation. In: Seventh international conference on control, automation, robotics and vision (ICARCV’02)
23.
Zurück zum Zitat Park CH, Ayanna MH (2007) Vision-based force guidance for improved human performance in a tele-operative manipulation system. In: Proceedings of the 2007 IEEE/RSJ international conference on intelligent robots and systems Park CH, Ayanna MH (2007) Vision-based force guidance for improved human performance in a tele-operative manipulation system. In: Proceedings of the 2007 IEEE/RSJ international conference on intelligent robots and systems
24.
Zurück zum Zitat Mkhitaryan A, Burschka D (2012) Vision based haptic multisensory for manipulation of soft, Fragile Object. In: IEEE Sensors, pp 1–4 Mkhitaryan A, Burschka D (2012) Vision based haptic multisensory for manipulation of soft, Fragile Object. In: IEEE Sensors, pp 1–4
25.
Zurück zum Zitat Chen SY, Zhang J, Zhang H, Kwok NM (2012) Intelligent lighting control for vision-based robotic manipulation. IEEE Trans Ind Electron 59:3254–3263CrossRef Chen SY, Zhang J, Zhang H, Kwok NM (2012) Intelligent lighting control for vision-based robotic manipulation. IEEE Trans Ind Electron 59:3254–3263CrossRef
26.
Zurück zum Zitat Astrom K, Hagglund T (1994) PID controllers: theory, design, and tuning. Instrument Society of America, Research Triangle Park Astrom K, Hagglund T (1994) PID controllers: theory, design, and tuning. Instrument Society of America, Research Triangle Park
27.
Zurück zum Zitat Dwyer AO (2009) Handbook of PI and PID controller tuning rules, 3rd edn. Imperial College Press, LondonCrossRef Dwyer AO (2009) Handbook of PI and PID controller tuning rules, 3rd edn. Imperial College Press, LondonCrossRef
28.
Zurück zum Zitat Ou C, Lin W (2006) Comparison between PSO and GA for parameters optimization of PID controller. In: Proceedings of the IEEE international conference on mechatronics and automation (ICMA’06). IEEE, Luoyang, China, pp 2471–2475 Ou C, Lin W (2006) Comparison between PSO and GA for parameters optimization of PID controller. In: Proceedings of the IEEE international conference on mechatronics and automation (ICMA’06). IEEE, Luoyang, China, pp 2471–2475
29.
Zurück zum Zitat Abachizadeh M, Yazdi MRH, Koma AY (2010) Optimal tuning of PID controllers using artificial bee colony algorithm. In: Proceedings of the advanced intelligent mechatronics conference, pp 379–384 Abachizadeh M, Yazdi MRH, Koma AY (2010) Optimal tuning of PID controllers using artificial bee colony algorithm. In: Proceedings of the advanced intelligent mechatronics conference, pp 379–384
Metadaten
Titel
Automatic single-view monocular camera calibration-based object manipulation using novel dexterous multi-fingered delta robot
verfasst von
Sachin Kansal
Sudipto Mukherjee
Publikationsdatum
26.10.2017
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 7/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-3221-3

Weitere Artikel der Ausgabe 7/2019

Neural Computing and Applications 7/2019 Zur Ausgabe

Theory and Applications of Soft Computing Methods

Attraction and diffusion in nature-inspired optimization algorithms