Skip to main content
Top

2015 | OriginalPaper | Chapter

Online Smart Face Morphing Engine with Prior Constraints and Local Geometry Preservation

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present an online system for automatic smart face morphing, which can be accessed at http://​facewarping.​com. This system morphs the user-uploaded image to “beautify” it by embedding features from a user-selected celebrity. This system consists of three major modules: facial feature point detection, geometry embedding, and image warping. To embed the features of a celebrity face and at the same time preserve the features of the original face, we formulate an optimization problem which we call prior multidimensional scaling (prior MDS). We propose an iterated Levenberg-Marquardt algorithm (ILMA) to efficiently solve prior MDS in the general case. This online system allows the user to configure the morphing parameters, and has been tested under different conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kagian, A., Dror, G., Leyvand, T., Cohen-Or, D., Ruppin, E.: A humanlike predictor of facial attractiveness. In: Advances in Neural Information Processing Systems (NIPS), Vancouver, B.C., Canada, pp. 649–656 (2006) Kagian, A., Dror, G., Leyvand, T., Cohen-Or, D., Ruppin, E.: A humanlike predictor of facial attractiveness. In: Advances in Neural Information Processing Systems (NIPS), Vancouver, B.C., Canada, pp. 649–656 (2006)
2.
go back to reference Eisenthal, Y., Dror, G., Ruppin, E.: Facial attractiveness: beauty and the machine. Neural Comput. 18(1), 119–142 (2006)CrossRef Eisenthal, Y., Dror, G., Ruppin, E.: Facial attractiveness: beauty and the machine. Neural Comput. 18(1), 119–142 (2006)CrossRef
3.
go back to reference Altwaijry, H., Belongie, S.: Relative ranking of facial attractiveness. In: Workshop on the Applications of Computer Vision (WACV), Clearwater Beach, FL, USA, pp. 117–124. IEEE (2013) Altwaijry, H., Belongie, S.: Relative ranking of facial attractiveness. In: Workshop on the Applications of Computer Vision (WACV), Clearwater Beach, FL, USA, pp. 117–124. IEEE (2013)
4.
go back to reference Leyvand, T., Cohen-Or, D., Dror, G., Lischinski, D.: Data-driven enhancement of facial attractiveness. ACM Trans. Graph. (TOG) 27(3), 38 (2008)CrossRef Leyvand, T., Cohen-Or, D., Dror, G., Lischinski, D.: Data-driven enhancement of facial attractiveness. ACM Trans. Graph. (TOG) 27(3), 38 (2008)CrossRef
5.
go back to reference Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)CrossRef Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)CrossRef
6.
go back to reference Zhou, Y., Gu, L., Zhang, H.J.: Bayesian tangent shape model: Estimating shape and pose parameters via Bayesian inference. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, USA, vol. 1, pp. I–109. IEEE (2003) Zhou, Y., Gu, L., Zhang, H.J.: Bayesian tangent shape model: Estimating shape and pose parameters via Bayesian inference. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, USA, vol. 1, pp. I–109. IEEE (2003)
7.
go back to reference Bookstein, F.L.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. PAMI 11(6), 567–585 (1989)CrossRefMATH Bookstein, F.L.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. PAMI 11(6), 567–585 (1989)CrossRefMATH
8.
go back to reference Lee, S., Wolberg, G., Chwa, K.Y., Shin, S.Y.: Image metamorphosis with scattered feature constraints. IEEE Trans. Vis. Comput. Graph. 2(4), 337–354 (1996)CrossRef Lee, S., Wolberg, G., Chwa, K.Y., Shin, S.Y.: Image metamorphosis with scattered feature constraints. IEEE Trans. Vis. Comput. Graph. 2(4), 337–354 (1996)CrossRef
9.
go back to reference Martinez, A.M.: The AR face database. CVC Technical Report 24 (1998) Martinez, A.M.: The AR face database. CVC Technical Report 24 (1998)
10.
go back to reference Zhang, X., Zhang, L., Wang, X.J., Shum, H.Y.: Finding celebrities in billions of web images. IEEE Trans. Multimedia 14(4), 995–1007 (2012)CrossRef Zhang, X., Zhang, L., Wang, X.J., Shum, H.Y.: Finding celebrities in billions of web images. IEEE Trans. Multimedia 14(4), 995–1007 (2012)CrossRef
11.
go back to reference Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)CrossRefMathSciNet Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)CrossRefMathSciNet
12.
go back to reference Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE International Conference on Computer Vision Workshops (ICCVW), Sydney, NSW, Australia, pp. 386–391. IEEE (2013) Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q.: Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In: IEEE International Conference on Computer Vision Workshops (ICCVW), Sydney, NSW, Australia, pp. 386–391. IEEE (2013)
13.
go back to reference Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)CrossRef Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)CrossRef
14.
go back to reference Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recogn. Assoc. S. Afr. 201 (2010) Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recogn. Assoc. S. Afr. 201 (2010)
15.
go back to reference Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA, vol. 1, p. I-511. IEEE (2001) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA, vol. 1, p. I-511. IEEE (2001)
16.
go back to reference Borg, I., Groenen, P.J.F.: Modern Multidimensional Scaling: Theory and Applications. Springer Series in Statistics, 2nd edn. Springer, New York (2005) Borg, I., Groenen, P.J.F.: Modern Multidimensional Scaling: Theory and Applications. Springer Series in Statistics, 2nd edn. Springer, New York (2005)
17.
18.
go back to reference de Leeuw, J.: Applications of convex analysis to multidimensional scaling. In: Barra, J.R., Brodeau, F., Romier, G., Cutsem, B.V. (eds.) Recent Developments in Statistics, pp. 133–146. North Holland Publishing Company, Amsterdam (1977) de Leeuw, J.: Applications of convex analysis to multidimensional scaling. In: Barra, J.R., Brodeau, F., Romier, G., Cutsem, B.V. (eds.) Recent Developments in Statistics, pp. 133–146. North Holland Publishing Company, Amsterdam (1977)
19.
go back to reference Williams, C.K.: On a connection between kernel PCA and metric multidimensional scaling. Mach. Learn. 46(1), 11–19 (2002)CrossRefMATH Williams, C.K.: On a connection between kernel PCA and metric multidimensional scaling. Mach. Learn. 46(1), 11–19 (2002)CrossRefMATH
20.
go back to reference Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2, 164–168 (1944)MathSciNetMATH Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 2, 164–168 (1944)MathSciNetMATH
21.
22.
go back to reference Arun, K.S., Huang, T.S., Blostein, S.D.: Least-squares fitting of two 3-D point sets. IEEE Trans. PAMI 9(5), 698–700 (1987)CrossRef Arun, K.S., Huang, T.S., Blostein, S.D.: Least-squares fitting of two 3-D point sets. IEEE Trans. PAMI 9(5), 698–700 (1987)CrossRef
Metadata
Title
Online Smart Face Morphing Engine with Prior Constraints and Local Geometry Preservation
Authors
Quan Wang
Yu Wang
Zuoguan Wang
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-14899-1_13

Premium Partner