Skip to main content
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

Image-Based Virtual Try-On System with Garment Reshaping and Color Correction

Authors : Yoshihiro Kanamori, Hiroki Yamada, Masaki Hirose, Jun Mitani, Yukio Fukui

Published in: Transactions on Computational Science XXVI

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose an image-based virtual try-on system for garments in order to reproduce the appearance of try-on during online shopping. Given whole-body images of a fashion model and a customer, we cut out a garment image from the fashion model image and reshape it so that it fits to the body shape of the customer. The reshaping function is estimated automatically from the body contours of the fashion model and the customer. The fitting result is refined further by automatic color correction with reference to the facial regions and a method of retouching parts that protrude from the rear of the garment image. We verified the effectiveness of our system through a user test.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: shape completion and animation of people. In: ACM SIGGRAPH 2005 Papers, pp. 408–416 (2005) Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: shape completion and animation of people. In: ACM SIGGRAPH 2005 Papers, pp. 408–416 (2005)
2.
go back to reference Bianco, S., Schettini, R.: Color constancy using faces. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 65–72 (2012) Bianco, S., Schettini, R.: Color constancy using faces. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 65–72 (2012)
3.
go back to reference Brouet, R., Sheffer, A., Boissieux, L., Cani, M.P.: Design preserving garment transfer. ACM Trans. Graph. 31(4), 36:1–36:11 (2012)CrossRef Brouet, R., Sheffer, A., Boissieux, L., Cani, M.P.: Design preserving garment transfer. ACM Trans. Graph. 31(4), 36:1–36:11 (2012)CrossRef
4.
go back to reference Cordier, F., Lee, W., Seo, H., Magnenat-Thalmann, N.: From 2D photos of yourself to virtual try-on dress on the web. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds.) People and Computers XV—Interaction Without Frontiers, pp. 31–46. Springer, London (2001)CrossRef Cordier, F., Lee, W., Seo, H., Magnenat-Thalmann, N.: From 2D photos of yourself to virtual try-on dress on the web. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds.) People and Computers XV—Interaction Without Frontiers, pp. 31–46. Springer, London (2001)CrossRef
5.
go back to reference Cordier, F., Seo, H., Magnenat-Thalmann, N.: Made-to-measure technologies for an online clothing store. IEEE Comput. Graph. Appl. 23(1), 38–48 (2003)CrossRef Cordier, F., Seo, H., Magnenat-Thalmann, N.: Made-to-measure technologies for an online clothing store. IEEE Comput. Graph. Appl. 23(1), 38–48 (2003)CrossRef
7.
go back to reference Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 300–305 (1998) Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 300–305 (1998)
8.
go back to reference Ehara, J., Saito, H.: Texture overlay for virtual clothing based on PCA of silhouettes. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 139–142. IEEE Computer Society (2006) Ehara, J., Saito, H.: Texture overlay for virtual clothing based on PCA of silhouettes. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 139–142. IEEE Computer Society (2006)
9.
go back to reference Guan, P., Freifeld, O., Black, M.J.: A 2D human body model dressed in eigen clothing. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 285–298. Springer, Heidelberg (2010)CrossRef Guan, P., Freifeld, O., Black, M.J.: A 2D human body model dressed in eigen clothing. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 285–298. Springer, Heidelberg (2010)CrossRef
10.
go back to reference Guan, P., Reiss, L., Hirshberg, D.A., Weiss, A., Black, M.J.: DRAPE: DRessing Any PErson. ACM Trans. Graph. 31(4), 35:1–35:10 (2012)CrossRef Guan, P., Reiss, L., Hirshberg, D.A., Weiss, A., Black, M.J.: DRAPE: DRessing Any PErson. ACM Trans. Graph. 31(4), 35:1–35:10 (2012)CrossRef
11.
go back to reference Hauswiesner, S., Straka, M., Reitmayr, G.: Free viewpoint virtual try-on with commodity depth cameras. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 23–30 (2011) Hauswiesner, S., Straka, M., Reitmayr, G.: Free viewpoint virtual try-on with commodity depth cameras. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 23–30 (2011)
12.
go back to reference Hilsmann, A., Fechteler, P., Eisert, P.: Pose space image based rendering. Comput. Graph. Forum 32(2), 265–274 (2013). Proceedings of EurographicsCrossRef Hilsmann, A., Fechteler, P., Eisert, P.: Pose space image based rendering. Comput. Graph. Forum 32(2), 265–274 (2013). Proceedings of EurographicsCrossRef
13.
go back to reference Jain, V., Zhang, H.: Robust 2D shape correspondence using geodesic shape context. In: Proceedings of Pacific Graphics, pp. 121–124 (2005) Jain, V., Zhang, H.: Robust 2D shape correspondence using geodesic shape context. In: Proceedings of Pacific Graphics, pp. 121–124 (2005)
14.
go back to reference von Kries, J.: Influence of adaptation on the effects produced by luminous stimuli. In: MacAdam, D. (ed.) Sources of Color Science, pp. 109–119. MIT Press, Cambridge (1970) von Kries, J.: Influence of adaptation on the effects produced by luminous stimuli. In: MacAdam, D. (ed.) Sources of Color Science, pp. 109–119. MIT Press, Cambridge (1970)
15.
go back to reference Protopsaltou, D., Luible, C., Arevalo-Poizat, M., Magnenat-Thalmann, N.: A body and garment creation method for an internet based virtual fitting room. In: Proceedings of Computer Graphics International (CGI 2002), pp. 105–122. Springer (2002) Protopsaltou, D., Luible, C., Arevalo-Poizat, M., Magnenat-Thalmann, N.: A body and garment creation method for an internet based virtual fitting room. In: Proceedings of Computer Graphics International (CGI 2002), pp. 105–122. Springer (2002)
16.
go back to reference Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. In: ACM SIGGRAPH 2006 Papers, pp. 533–540. ACM, New York (2006) Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. In: ACM SIGGRAPH 2006 Papers, pp. 533–540. ACM, New York (2006)
18.
go back to reference Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. 23(3), 399–405 (2004). Proceedings of SIGGRAPH 2004CrossRef Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. 23(3), 399–405 (2004). Proceedings of SIGGRAPH 2004CrossRef
19.
go back to reference Tong, J., Zhou, J., Liu, L., Pan, Z., Yan, H.: Scanning 3D full human bodies using kinects. IEEE Trans. Visual. Comput. Graph. 18(4), 643–650 (2012). Proceedings of IEEE Virtual RealityCrossRef Tong, J., Zhou, J., Liu, L., Pan, Z., Yan, H.: Scanning 3D full human bodies using kinects. IEEE Trans. Visual. Comput. Graph. 18(4), 643–650 (2012). Proceedings of IEEE Virtual RealityCrossRef
20.
go back to reference Wang, H., Hecht, F., Ramamoorthi, R., O’Brien, J.: Example-based wrinkle synthesis for clothing animation. In: ACM SIGGRAPH 2010 Papers, pp. 107:1–107:8 (2010) Wang, H., Hecht, F., Ramamoorthi, R., O’Brien, J.: Example-based wrinkle synthesis for clothing animation. In: ACM SIGGRAPH 2010 Papers, pp. 107:1–107:8 (2010)
21.
go back to reference Weng, Y., Xu, W., Wu, Y., Zhou, K., Guo, B.: 2D shape deformation using nonlinear least squares optimization. Vis. Comput. 22(9), 653–660 (2006)CrossRef Weng, Y., Xu, W., Wu, Y., Zhou, K., Guo, B.: 2D shape deformation using nonlinear least squares optimization. Vis. Comput. 22(9), 653–660 (2006)CrossRef
22.
go back to reference Xu, W., Umentani, N., Chao, Q., Mao, J., Jin, X., Tong, X.: Sensitivity-optimized rigging for example-based real-time clothing synthesis. In: ACM Transactions on Graphics (Proceedings of SIGGRAPH 2014), vol. 33, no. 4, August 2014 Xu, W., Umentani, N., Chao, Q., Mao, J., Jin, X., Tong, X.: Sensitivity-optimized rigging for example-based real-time clothing synthesis. In: ACM Transactions on Graphics (Proceedings of SIGGRAPH 2014), vol. 33, no. 4, August 2014
23.
go back to reference Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. In: ACM SIGGRAPH 2010 Papers, pp. 126:1–126:10 (2010) Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. In: ACM SIGGRAPH 2010 Papers, pp. 126:1–126:10 (2010)
24.
go back to reference Zhou, Z., Shu, B., Zhuo, S., Deng, X., Tan, P., Lin, S.: Image-based clothes animation for virtual fitting. In: SIGGRAPH Asia 2012 Technical Briefs, pp. 33:1–33:4 (2012) Zhou, Z., Shu, B., Zhuo, S., Deng, X., Tan, P., Lin, S.: Image-based clothes animation for virtual fitting. In: SIGGRAPH Asia 2012 Technical Briefs, pp. 33:1–33:4 (2012)
Metadata
Title
Image-Based Virtual Try-On System with Garment Reshaping and Color Correction
Authors
Yoshihiro Kanamori
Hiroki Yamada
Masaki Hirose
Jun Mitani
Yukio Fukui
Copyright Year
2016
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-49247-5_1

Premium Partner