Skip to main content
Erschienen in: Autonomous Robots 4/2017

12.04.2016

A method of classifying crumpled clothing based on image features derived from clothing fabrics and wrinkles

verfasst von: Kimitoshi Yamazaki

Erschienen in: Autonomous Robots | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes a method of clothing classification using a single image. The method is intended to be used for building autonomous systems, that can recognize casually thrown ordinary clothing. A set of Gabor filters is applied to an input image, and image features invariant to translation, rotation and scale are then generated. In this paper, we propose descriptions of the features, focusing on clothing fabrics, wrinkles, and cloth overlaps. In addition, to deal with situations involving clumped clothing, the description is extended by combining with superpixel representation. Experiments using a state description and classification using real clothing demonstrate the effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
Literatur
Zurück zum Zitat Bay, Herbert, Ess, Andreas, Tuytelaars, Tinne, & Van Gool, Luc. (2008). SURF: Speeded Up Robust Features. Computer Vision and Image Understanding (CVIU), 110(3), 346–359.CrossRef Bay, Herbert, Ess, Andreas, Tuytelaars, Tinne, & Van Gool, Luc. (2008). SURF: Speeded Up Robust Features. Computer Vision and Image Understanding (CVIU), 110(3), 346–359.CrossRef
Zurück zum Zitat Bigü, J., & du buf, J. M. (1994). N-folded symmetries by complex moments in gabor space and their application to unsupervised texture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI, 16(1), 80–87.CrossRef Bigü, J., & du buf, J. M. (1994). N-folded symmetries by complex moments in gabor space and their application to unsupervised texture segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI, 16(1), 80–87.CrossRef
Zurück zum Zitat Christoudias, C., Geogescu, B. & Meer, P. (2002). Synergism on low level vision. In International Conference on Pattern Recognition, pp. 150–155. Christoudias, C., Geogescu, B. & Meer, P. (2002). Synergism on low level vision. In International Conference on Pattern Recognition, pp. 150–155.
Zurück zum Zitat Comanicui, D., & Meer, P. (2002). Mean shift: A robust approach towead feature space analysis. IEEE Transaction on Pattern Analysis and Machine Intelligence, 24(5), 603–619.CrossRef Comanicui, D., & Meer, P. (2002). Mean shift: A robust approach towead feature space analysis. IEEE Transaction on Pattern Analysis and Machine Intelligence, 24(5), 603–619.CrossRef
Zurück zum Zitat Csurka, G., Bray, C., Dance, C. & Fan, L. (2004). Visual categorization with bags of keypoints. In Proceedings of ECCV Workshop on Statistical Learning in Computer Vision, pp. 59–74. Csurka, G., Bray, C., Dance, C. & Fan, L. (2004). Visual categorization with bags of keypoints. In Proceedings of ECCV Workshop on Statistical Learning in Computer Vision, pp. 59–74.
Zurück zum Zitat Cuén-Rochín, S., Andrade-Cetto, J. & Torras, C. (2008) Action selection for robotic manipulation of deformable planar objects. In Proceedings of Frontier Science Conference Series for Young Researchers: Experimental Cognitive Robotics, pp. 1–6. Cuén-Rochín, S., Andrade-Cetto, J. & Torras, C. (2008) Action selection for robotic manipulation of deformable planar objects. In Proceedings of Frontier Science Conference Series for Young Researchers: Experimental Cognitive Robotics, pp. 1–6.
Zurück zum Zitat Cusumano-Towner, M., Singh, A., Miller, S., O’Brien, J.F. & Abbeel P. (2011) Bringing clothing into desired configurations with limited perception. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1–8. Cusumano-Towner, M., Singh, A., Miller, S., O’Brien, J.F. & Abbeel P. (2011) Bringing clothing into desired configurations with limited perception. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1–8.
Zurück zum Zitat Doumanoglou, A., Kargakos, A., Kim, T-K. & Malassiotis, S. (2014). Autonomous active recognition and unfolding of clothes using random decision forests and probabilistic Planning. In Proceedings of IEEE International Conference on Robotics and Automation. Doumanoglou, A., Kargakos, A., Kim, T-K. & Malassiotis, S. (2014). Autonomous active recognition and unfolding of clothes using random decision forests and probabilistic Planning. In Proceedings of IEEE International Conference on Robotics and Automation.
Zurück zum Zitat Galun, M., Sharon, E., Basri, R. & Brandt, A. (2003). Texture segmentation by multiscale aggregation of filter responses and shape elements. In Proceedings of IEEE International Conference on Computer Vision, pp. 716–723. Galun, M., Sharon, E., Basri, R. & Brandt, A. (2003). Texture segmentation by multiscale aggregation of filter responses and shape elements. In Proceedings of IEEE International Conference on Computer Vision, pp. 716–723.
Zurück zum Zitat Geusebroek, J., Smeulders, A., & Weijer, J. (2003). Fast anisotropic Gauss filtering. IEEE Transactions on Image Processing, 12(8), 938–943.MathSciNetCrossRefMATH Geusebroek, J., Smeulders, A., & Weijer, J. (2003). Fast anisotropic Gauss filtering. IEEE Transactions on Image Processing, 12(8), 938–943.MathSciNetCrossRefMATH
Zurück zum Zitat Hamajima, K. & Kakikura, M. (2000) Planning strategy for unfolding task of clothes: Isolation of clothes from washed mass. In Proceedings of International Conference on Robots and Systems, pp. 1237–1242. Hamajima, K. & Kakikura, M. (2000) Planning strategy for unfolding task of clothes: Isolation of clothes from washed mass. In Proceedings of International Conference on Robots and Systems, pp. 1237–1242.
Zurück zum Zitat Kita, Y., Saito F. & Kita, N. (2004). A deformable model driven method for handling clothes. In Proceedings of International Conference on Pattern Recognition. Kita, Y., Saito F. & Kita, N. (2004). A deformable model driven method for handling clothes. In Proceedings of International Conference on Pattern Recognition.
Zurück zum Zitat Leung, T., & Malik, J. (2001). Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal of Computer Vision, 43(1), 29–44.CrossRefMATH Leung, T., & Malik, J. (2001). Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal of Computer Vision, 43(1), 29–44.CrossRefMATH
Zurück zum Zitat Levinshtein, A., Stere, A., Kutulakos, K., Fleet, D., Dickinson, S., & Siddiqi, K. (2009). TurboPixels: Fast superpixels using geometric flows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12), 2290–2297.CrossRef Levinshtein, A., Stere, A., Kutulakos, K., Fleet, D., Dickinson, S., & Siddiqi, K. (2009). TurboPixels: Fast superpixels using geometric flows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(12), 2290–2297.CrossRef
Zurück zum Zitat Li, Y., Chen, C.-F. & Allen, P.K. (2014).Recognition of deformable object category and pose. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 5558–5564 Li, Y., Chen, C.-F. & Allen, P.K. (2014).Recognition of deformable object category and pose. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 5558–5564
Zurück zum Zitat Li, Y., Wang, Y., Case, M., Chang, S.-F. & Allen, P.K. (2014). Real-time pose estimation of deformable objects using a volumetric approach. In Proceedings of IEEE/RSJ International Conference on Robots and Systems, pp. 1046–1052. Li, Y., Wang, Y., Case, M., Chang, S.-F. & Allen, P.K. (2014). Real-time pose estimation of deformable objects using a volumetric approach. In Proceedings of IEEE/RSJ International Conference on Robots and Systems, pp. 1046–1052.
Zurück zum Zitat Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.CrossRef
Zurück zum Zitat Maitin-Sphepard, J., Cusumano-Towner, M., Lei, J. & Abbeel, P. (2010) Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding. In International Conference on Robotics and Automation, pp. 2308–2315. Maitin-Sphepard, J., Cusumano-Towner, M., Lei, J. & Abbeel, P. (2010) Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding. In International Conference on Robotics and Automation, pp. 2308–2315.
Zurück zum Zitat Martin, D., Fowlkes, C., & Marik, J. (2004). Learning to detect natural image boundary using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(5), 530–549.CrossRef Martin, D., Fowlkes, C., & Marik, J. (2004). Learning to detect natural image boundary using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(5), 530–549.CrossRef
Zurück zum Zitat Mikolajczyk, K., & Schmid, C. (2004). Scale and affine invariant interest point detectors. International Journal of Computer Vision, 60(1), 63–86.CrossRef Mikolajczyk, K., & Schmid, C. (2004). Scale and affine invariant interest point detectors. International Journal of Computer Vision, 60(1), 63–86.CrossRef
Zurück zum Zitat Ono, E., Okabe, H., Ichijo, H. & Aisaka, N. (1990). Robot hand with sensor for cloth handling. In Proceedings 1990, Japan, USA Symposium on Flexible Automation, pp. 1363–1366. Ono, E., Okabe, H., Ichijo, H. & Aisaka, N. (1990). Robot hand with sensor for cloth handling. In Proceedings 1990, Japan, USA Symposium on Flexible Automation, pp. 1363–1366.
Zurück zum Zitat Oren, M., & Nayar, S. (1992). Generalization of the lambertian model and implications for machine vision. International Journal of Computer Vision, 14(3), 227–251.CrossRef Oren, M., & Nayar, S. (1992). Generalization of the lambertian model and implications for machine vision. International Journal of Computer Vision, 14(3), 227–251.CrossRef
Zurück zum Zitat Osawa, F., Seki, H., & Kamiya, Y. (2007). Unfolding of massive laundry and classification types by dual manipulator. Journal of Advanced Computational Intelligence and Intelligent Informatics, 11(5), 457–463.CrossRef Osawa, F., Seki, H., & Kamiya, Y. (2007). Unfolding of massive laundry and classification types by dual manipulator. Journal of Advanced Computational Intelligence and Intelligent Informatics, 11(5), 457–463.CrossRef
Zurück zum Zitat Osher, S., & Sethian, J. A. (1998). Fronts propageting with curvature dependent speed: Algorithm based on Hamilton–Jacobi formation. Journal of Computational Physics, 79, 12–49.CrossRefMATH Osher, S., & Sethian, J. A. (1998). Fronts propageting with curvature dependent speed: Algorithm based on Hamilton–Jacobi formation. Journal of Computational Physics, 79, 12–49.CrossRefMATH
Zurück zum Zitat Ramisa, A., Alenya, G., Moreno-Noguer, F. & Torras, C. (2012) Using depth and appearance features for informed robot grasping of highly wrinkled clothes. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1703–1708. Ramisa, A., Alenya, G., Moreno-Noguer, F. & Torras, C. (2012) Using depth and appearance features for informed robot grasping of highly wrinkled clothes. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1703–1708.
Zurück zum Zitat Ren, X., & Malik, J. (2003). Learning a classification model for segmentation. In Proceedings of 9th International Conference Computer Vision, vol. 1, pp. 10–17. Ren, X., & Malik, J. (2003). Learning a classification model for segmentation. In Proceedings of 9th International Conference Computer Vision, vol. 1, pp. 10–17.
Zurück zum Zitat Rubner, Y., Tomasi, C. (1996) Coalescing texture descriptors. In ARPA Image Understanding Workshop, pp. 927–935 Rubner, Y., Tomasi, C. (1996) Coalescing texture descriptors. In ARPA Image Understanding Workshop, pp. 927–935
Zurück zum Zitat Schmid, C. (2001). Constructing models for content-based image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 39–45. Schmid, C. (2001). Constructing models for content-based image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 39–45.
Zurück zum Zitat Sun, L., Aragon-Camarasa, G., Rogers, S. & Siebert, P. (2015). Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 185–192. Sun, L., Aragon-Camarasa, G., Rogers, S. & Siebert, P. (2015). Accurate garment surface analysis using an active stereo robot head with application to dual-arm flattening. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 185–192.
Zurück zum Zitat Varma, M., & Zisserman, A. (2005). A statistical approach to texture classification from single images. International Journal of Computer Vision, 62(1–2), 61–81.CrossRef Varma, M., & Zisserman, A. (2005). A statistical approach to texture classification from single images. International Journal of Computer Vision, 62(1–2), 61–81.CrossRef
Zurück zum Zitat Vincent, L., & Soille, P. (1991). Watersheds in digital spaces: An efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6), 583–598.CrossRef Vincent, L., & Soille, P. (1991). Watersheds in digital spaces: An efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(6), 583–598.CrossRef
Zurück zum Zitat Willimon, B., Birchfleld, S. & Walker, I. (2011). Classification of clothing using interactive perception. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1862–1868. Willimon, B., Birchfleld, S. & Walker, I. (2011). Classification of clothing using interactive perception. In Proceedings of IEEE International Conference on Robotics and Automation, pp. 1862–1868.
Zurück zum Zitat Yamazaki, K., (2015). Instance recognition of clumped clothing using image features focusing on clothing fabrics and wrinkles. In Proceedings of IEEE International Conference on Robotics and Biomimetics, pp.1102–1108. Yamazaki, K., (2015). Instance recognition of clumped clothing using image features focusing on clothing fabrics and wrinkles. In Proceedings of IEEE International Conference on Robotics and Biomimetics, pp.1102–1108.
Zurück zum Zitat Yamazaki, K., & Inaba, M. (2009). A cloth detection method based on image wrinkle feature for a daily assistive robots. In IAPR Conferene on Machine Vision Applications, pp. 366–369. Yamazaki, K., & Inaba, M. (2009). A cloth detection method based on image wrinkle feature for a daily assistive robots. In IAPR Conferene on Machine Vision Applications, pp. 366–369.
Zurück zum Zitat Yamazaki, K., & Inaba, M. (2013). Clothing classification using image features derived from clothing fabrics, wrinkles and cloth overlaps. In Proceedings of IEEE/RSJ International Conference on Robots and Systems, pp. 2710–2717. Yamazaki, K., & Inaba, M. (2013). Clothing classification using image features derived from clothing fabrics, wrinkles and cloth overlaps. In Proceedings of IEEE/RSJ International Conference on Robots and Systems, pp. 2710–2717.
Zurück zum Zitat Yu, S., & Shi, J. (2003). Multiclass spectral clustering. In IEEE International Conference on Computer Vision, vol. 1, pp. 313–319. Yu, S., & Shi, J. (2003). Multiclass spectral clustering. In IEEE International Conference on Computer Vision, vol. 1, pp. 313–319.
Zurück zum Zitat Zhao, Y., & Karypis, G. (2002). Comparison of agglomerative and partitional document clustering algorithms. University of Minnesota—Computer Science and Engineering Technical Report, No. 02-014. Zhao, Y., & Karypis, G. (2002). Comparison of agglomerative and partitional document clustering algorithms. University of Minnesota—Computer Science and Engineering Technical Report, No. 02-014.
Metadaten
Titel
A method of classifying crumpled clothing based on image features derived from clothing fabrics and wrinkles
verfasst von
Kimitoshi Yamazaki
Publikationsdatum
12.04.2016
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 4/2017
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-016-9559-z

Weitere Artikel der Ausgabe 4/2017

Autonomous Robots 4/2017 Zur Ausgabe