Skip to main content
Top
Published in:
Cover of the book

2017 | OriginalPaper | Chapter

On Recognizing Transparent Objects in Domestic Environments Using Fusion of Multiple Sensor Modalities

Authors : Alexander Hagg, Frederik Hegger, Paul G. Plöger

Published in: RoboCup 2016: Robot World Cup XX

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Current object recognition methods fail on object sets that include both diffuse, reflective and transparent materials, although they are very common in domestic scenarios. We show that a combination of cues from multiple sensor modalities, including specular reflectance and unavailable depth information, allows us to capture a larger subset of household objects by extending a state of the art object recognition method. This leads to a significant increase in robustness of recognition over a larger set of commonly used objects.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Albrecht, S., Marsland, S.: Seeing the unseen: simple reconstruction of transparent objects from point cloud data. In: Robotics: Science and Systems (2013) Albrecht, S., Marsland, S.: Seeing the unseen: simple reconstruction of transparent objects from point cloud data. In: Robotics: Science and Systems (2013)
2.
go back to reference Alt, N., Rives, P., Steinbach, E.: Reconstruction of transparent objects in unstructured scenes with a depth camera. In: IEEE International Conference on Image Processing, pp. 4131–4135. IEEE, September 2013 Alt, N., Rives, P., Steinbach, E.: Reconstruction of transparent objects in unstructured scenes with a depth camera. In: IEEE International Conference on Image Processing, pp. 4131–4135. IEEE, September 2013
3.
go back to reference Wang, T., He, X., Barnes, T.: Glass object segmentation by label transfer on joint depth and appearance manifolds. In: IEEE Conference on Image Processing (ICIP), pp. 2944–2948 (2013) Wang, T., He, X., Barnes, T.: Glass object segmentation by label transfer on joint depth and appearance manifolds. In: IEEE Conference on Image Processing (ICIP), pp. 2944–2948 (2013)
4.
go back to reference Blake, A., Bulthoff, H.: Shape from specularities: computation and psychophysics. Philos. Trans. Roy. Soc. 331(1260), 237–252 (1991)CrossRef Blake, A., Bulthoff, H.: Shape from specularities: computation and psychophysics. Philos. Trans. Roy. Soc. 331(1260), 237–252 (1991)CrossRef
5.
go back to reference Blei, D., Ng, A., Jordan, M.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3(3/1/2003), 993–1022 (2003)MATH Blei, D., Ng, A., Jordan, M.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3(3/1/2003), 993–1022 (2003)MATH
6.
go back to reference Chiu, W., Blanke, U., Fritz, M.: Improving the kinect by cross-modal stereo. Br. Mach. Vis. Conf. 1(2), 3 (2011) Chiu, W., Blanke, U., Fritz, M.: Improving the kinect by cross-modal stereo. Br. Mach. Vis. Conf. 1(2), 3 (2011)
7.
go back to reference Fritz, M., Bradski, G., Karayev, S.: An additive latent feature model for transparent object recognition. In: Advances in Neural Information Processing Systems, vol. 22, pp. 1–9 (2009) Fritz, M., Bradski, G., Karayev, S.: An additive latent feature model for transparent object recognition. In: Advances in Neural Information Processing Systems, vol. 22, pp. 1–9 (2009)
8.
go back to reference Heath, T.L.: A History of Greek Mathematics: vol. 2. From Aristarchus to Diophantus. A History of Greek Mathematics. Dover Publications, New York (2000)MATH Heath, T.L.: A History of Greek Mathematics: vol. 2. From Aristarchus to Diophantus. A History of Greek Mathematics. Dover Publications, New York (2000)MATH
9.
go back to reference Hinterstoisser, S., Cagniart, C.: Gradient response maps for real-time detection of textureless objects. IEEE Trans. Pattern Anal. Mach. Intell. 34, 876–888 (2012)CrossRef Hinterstoisser, S., Cagniart, C.: Gradient response maps for real-time detection of textureless objects. IEEE Trans. Pattern Anal. Mach. Intell. 34, 876–888 (2012)CrossRef
10.
go back to reference Klank, U., Carton, D., Beetz, M.: Transparent object detection and reconstruction on a mobile platform. In: IEEE Conference on Robotics and Automation (ICRA), pp. 5971–5978 (2011) Klank, U., Carton, D., Beetz, M.: Transparent object detection and reconstruction on a mobile platform. In: IEEE Conference on Robotics and Automation (ICRA), pp. 5971–5978 (2011)
11.
go back to reference Koshikawa, K., Shirai, Y.: A model-based recognition of glossy objects using their polarimetrical properties. Adv. Robot. 2(2), 137–147 (1987)CrossRef Koshikawa, K., Shirai, Y.: A model-based recognition of glossy objects using their polarimetrical properties. Adv. Robot. 2(2), 137–147 (1987)CrossRef
12.
go back to reference Lambert, J.: Photometria. Eberhard Klett Verlag, Augsburg (1760) Lambert, J.: Photometria. Eberhard Klett Verlag, Augsburg (1760)
13.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
14.
go back to reference Lysenkov, I., Rabaud, V.: Pose estimation of rigid transparent objects in transparent clutter. In: IEEE Conference on Robotics and Automation (ICRA), pp. 162–169 (2013) Lysenkov, I., Rabaud, V.: Pose estimation of rigid transparent objects in transparent clutter. In: IEEE Conference on Robotics and Automation (ICRA), pp. 162–169 (2013)
15.
go back to reference Maeno, K., Nagahara, H.: Light field distortion feature for transparent object recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2786–2793, June 2013 Maeno, K., Nagahara, H.: Light field distortion feature for transparent object recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2786–2793, June 2013
16.
go back to reference Mahendru, A., Sarkar, M.: Bio-inspired object classification using polarization imaging. In: International Conference on Sensing Technology, pp. 207–212. IEEE, December 2012 Mahendru, A., Sarkar, M.: Bio-inspired object classification using polarization imaging. In: International Conference on Sensing Technology, pp. 207–212. IEEE, December 2012
17.
go back to reference Marton, Z.C., Rusu, R.B., Jain, D., Klank, U., Beetz, M.: Probabilistic categorization of kitchen objects in table settings with a composite sensor. In: 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4777–4784. IEEE, October 2009 Marton, Z.C., Rusu, R.B., Jain, D., Klank, U., Beetz, M.: Probabilistic categorization of kitchen objects in table settings with a composite sensor. In: 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4777–4784. IEEE, October 2009
18.
go back to reference Netz, A., Osadchy, M.: Using specular highlights as pose invariant features for 2D–3D pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 721–728 (2011) Netz, A., Osadchy, M.: Using specular highlights as pose invariant features for 2D–3D pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 721–728 (2011)
19.
go back to reference Osadchy, M.: Using specularities for recognition. In: IEEE International Conference on Computer Vision, vol. 2, pp. 1512–1519. IEEE (2003) Osadchy, M.: Using specularities for recognition. In: IEEE International Conference on Computer Vision, vol. 2, pp. 1512–1519. IEEE (2003)
20.
go back to reference Saito, M., Sato, Y., Ikeuchi, K., Kashiwagi, H.: Measurement of surface orientations of transparent objects by use of polarization in highlight. Syst. Comput. Jpn. 32(5), 64–71 (2001)CrossRef Saito, M., Sato, Y., Ikeuchi, K., Kashiwagi, H.: Measurement of surface orientations of transparent objects by use of polarization in highlight. Syst. Comput. Jpn. 32(5), 64–71 (2001)CrossRef
21.
go back to reference Zhang, L., Hancock, E.: A comprehensive polarisation model for surface orientation recovery. In: IEEE Conference on Pattern Recognition, pp. 3791–3794 (2012) Zhang, L., Hancock, E.: A comprehensive polarisation model for surface orientation recovery. In: IEEE Conference on Pattern Recognition, pp. 3791–3794 (2012)
Metadata
Title
On Recognizing Transparent Objects in Domestic Environments Using Fusion of Multiple Sensor Modalities
Authors
Alexander Hagg
Frederik Hegger
Paul G. Plöger
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-68792-6_1

Premium Partner