Skip to main content
Top
Published in: International Journal of Computer Vision 6/2020

17-12-2019

A Face Fairness Framework for 3D Meshes

Authors: Sk. Mohammadul Haque, Venu Madhav Govindu

Published in: International Journal of Computer Vision | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we present a face fairness framework for 3D meshes that preserves the regular shape of faces and is applicable to a variety of 3D mesh restoration tasks. Specifically, we present a number of desirable properties for any mesh restoration method and show that our framework satisfies them. We then apply our framework to two different tasks—mesh-denoising and mesh-refinement, and present comparative results for these two tasks showing improvement over other relevant methods in the literature.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Babuška, I., & Aziz, A. K. (1976). On the angle condition in the finite element method. SIAM Journal on Numerical Analysis, 13(2), 214–226.MathSciNetCrossRef Babuška, I., & Aziz, A. K. (1976). On the angle condition in the finite element method. SIAM Journal on Numerical Analysis, 13(2), 214–226.MathSciNetCrossRef
go back to reference Chatterjee, A., & Govindu, V. M. (2015). Photometric refinement of depth maps for multi-albedo objects. In IEEE conference on computer vision and pattern recognition, IEEE (pp. 933–941). Chatterjee, A., & Govindu, V. M. (2015). Photometric refinement of depth maps for multi-albedo objects. In IEEE conference on computer vision and pattern recognition, IEEE (pp. 933–941).
go back to reference Cheng, X., Zeng, M., & Liu, X. (2014). Feature-preserving filtering with \(\ell _0\)-gradient minimization. Computers & Graphics, 38, 150–157.CrossRef Cheng, X., Zeng, M., & Liu, X. (2014). Feature-preserving filtering with \(\ell _0\)-gradient minimization. Computers & Graphics, 38, 150–157.CrossRef
go back to reference Curless, B., & Levoy, M. (1996). A volumetric method for building complex models from range images. In 23rd Annual conference on computer graphics and interactive techniques, ACM (pp. 303–312). Curless, B., & Levoy, M. (1996). A volumetric method for building complex models from range images. In 23rd Annual conference on computer graphics and interactive techniques, ACM (pp. 303–312).
go back to reference Desbrun, M., Meyer, M., Schröder, P., & Barr, A. H. (1999). Implicit fairing of irregular meshes using diffusion and curvature flow. In 26th Annual conference on computer graphics and interactive techniques (pp. 317–324). ACM Press/Addison-Wesley Publishing Co. Desbrun, M., Meyer, M., Schröder, P., & Barr, A. H. (1999). Implicit fairing of irregular meshes using diffusion and curvature flow. In 26th Annual conference on computer graphics and interactive techniques (pp. 317–324). ACM Press/Addison-Wesley Publishing Co.
go back to reference Du, D. Z., & Hwang, F. (1995). Computing in Euclidean geometry (Vol. 4). Singapore: World Scientific.CrossRef Du, D. Z., & Hwang, F. (1995). Computing in Euclidean geometry (Vol. 4). Singapore: World Scientific.CrossRef
go back to reference El Ouafdi, A., & Ziou, D. (2008). A global physical method for manifold smoothing. In IEEE international conference on shape modeling and applications, 2008. SMI 2008 (pp. 11–17). El Ouafdi, A., & Ziou, D. (2008). A global physical method for manifold smoothing. In IEEE international conference on shape modeling and applications, 2008. SMI 2008 (pp. 11–17).
go back to reference Fan, H., Yu, Y., & Peng, Q. (2010). Robust feature-preserving mesh denoising based on consistent subneighborhoods. IEEE Transactions on Visualization and Computer Graphics, 16(2), 312–324.CrossRef Fan, H., Yu, Y., & Peng, Q. (2010). Robust feature-preserving mesh denoising based on consistent subneighborhoods. IEEE Transactions on Visualization and Computer Graphics, 16(2), 312–324.CrossRef
go back to reference Field, D. A. (1988). Laplacian smoothing and delaunay triangulations. Communications in Applied Numerical Methods, 4(6), 709–712.CrossRef Field, D. A. (1988). Laplacian smoothing and delaunay triangulations. Communications in Applied Numerical Methods, 4(6), 709–712.CrossRef
go back to reference Fleishman, S., Drori, I., & Cohen-Or, D. (2003). Bilateral mesh denoising. ACM Transactions on Graphics, 22(3), 950–953.CrossRef Fleishman, S., Drori, I., & Cohen-Or, D. (2003). Bilateral mesh denoising. ACM Transactions on Graphics, 22(3), 950–953.CrossRef
go back to reference Fried, I. (1960). Condition of finite element matrices generated from nonuniform meshes. Communications on Pure and Applied Mathematics, 13, 217–237.MathSciNetCrossRef Fried, I. (1960). Condition of finite element matrices generated from nonuniform meshes. Communications on Pure and Applied Mathematics, 13, 217–237.MathSciNetCrossRef
go back to reference Furukawa, Y., & Ponce, J. (2010). Accurate, dense, and robust multi-view stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1362–1376.CrossRef Furukawa, Y., & Ponce, J. (2010). Accurate, dense, and robust multi-view stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1362–1376.CrossRef
go back to reference Haque, S. M., & Govindu, V. M. (2015). Global mesh denoising with fairness. In 3rd international conference on 3D vision. Haque, S. M., & Govindu, V. M. (2015). Global mesh denoising with fairness. In 3rd international conference on 3D vision.
go back to reference Haque, S. M., & Govindu, V. M. (2017). Multi-view non-rigid refinement and normal selection for high quality 3D reconstruction. In IEEE international conference on computer vision. Haque, S. M., & Govindu, V. M. (2017). Multi-view non-rigid refinement and normal selection for high quality 3D reconstruction. In IEEE international conference on computer vision.
go back to reference Haque, S. M., Chatterjee, A., & Govindu, V. M. (2014). High quality photometric reconstruction using a depth camera. In IEEE conference on computer vision and pattern recognition (pp. 2275–2282). Haque, S. M., Chatterjee, A., & Govindu, V. M. (2014). High quality photometric reconstruction using a depth camera. In IEEE conference on computer vision and pattern recognition (pp. 2275–2282).
go back to reference He, L., & Schaefer, S. (2013). Mesh denoising via \(\ell _0\)-minimization. ACM Transactions on Graphics, 32(4), 64. He, L., & Schaefer, S. (2013). Mesh denoising via \(\ell _0\)-minimization. ACM Transactions on Graphics, 32(4), 64.
go back to reference Hoppe, H., DeRose, T., Duchamp, T., & McDonald, J., & Stuetzle, W. (1993). Mesh optimization. In: 20th Annual conference on Computer graphics and interactive techniques (pp. 19–26), ACM. Hoppe, H., DeRose, T., Duchamp, T., & McDonald, J., & Stuetzle, W. (1993). Mesh optimization. In: 20th Annual conference on Computer graphics and interactive techniques (pp. 19–26), ACM.
go back to reference Innmann, M., Zollhöfer, M., Nießner, M., Theobalt, C., & Stamminger, M. (2016) Volumedeform: Real-time volumetric non-rigid reconstruction. In European conference on computer vision (pp. 362–379), Springer. Innmann, M., Zollhöfer, M., Nießner, M., Theobalt, C., & Stamminger, M. (2016) Volumedeform: Real-time volumetric non-rigid reconstruction. In European conference on computer vision (pp. 362–379), Springer.
go back to reference Ji, Z., Liu, L., & Wang, G. (2005). A global Laplacian smoothing approach with feature preservation. In Ninth International Conference on Computer Aided Design and Computer Graphics (pp. 269–274). IEEE Computer Society. Ji, Z., Liu, L., & Wang, G. (2005). A global Laplacian smoothing approach with feature preservation. In Ninth International Conference on Computer Aided Design and Computer Graphics (pp. 269–274). IEEE Computer Society.
go back to reference Jones, T. R., Durand, F., & Desbrun, M. (2003). Non-iterative, feature-preserving mesh smoothing. ACM Transactions on Graphics, 22(3), 943–949.CrossRef Jones, T. R., Durand, F., & Desbrun, M. (2003). Non-iterative, feature-preserving mesh smoothing. ACM Transactions on Graphics, 22(3), 943–949.CrossRef
go back to reference Kim, K., Torii, A., & Okutomi, M. (2016) Multi-view inverse rendering under arbitrary illumination and albedo. In European conference on computer vision (pp. 750–767). Springer International Publishing Kim, K., Torii, A., & Okutomi, M. (2016) Multi-view inverse rendering under arbitrary illumination and albedo. In European conference on computer vision (pp. 750–767). Springer International Publishing
go back to reference Liu, L., Tai, C. L., Ji, Z., & Wang, G. (2007). Non-iterative approach for global mesh optimization. Computer Aided Design, 39(9), 772–782.CrossRef Liu, L., Tai, C. L., Ji, Z., & Wang, G. (2007). Non-iterative approach for global mesh optimization. Computer Aided Design, 39(9), 772–782.CrossRef
go back to reference Lu, X., Chen, W., & Schaefer, S. (2017a). Robust mesh denoising via vertex pre-filtering and l1-median normal filtering. Computer Aided Geometric Design. Lu, X., Chen, W., & Schaefer, S. (2017a). Robust mesh denoising via vertex pre-filtering and l1-median normal filtering. Computer Aided Geometric Design.
go back to reference Lu, X., Deng, Z., & Chen, W. (2016). A robust scheme for feature-preserving mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 22(3), 1181–1194.CrossRef Lu, X., Deng, Z., & Chen, W. (2016). A robust scheme for feature-preserving mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 22(3), 1181–1194.CrossRef
go back to reference Lu, X., Liu, X., Deng, Z., & Chen, W. (2017b). An efficient approach for feature-preserving mesh denoising. Optics and Lasers in Engineering, 90, 186–195.CrossRef Lu, X., Liu, X., Deng, Z., & Chen, W. (2017b). An efficient approach for feature-preserving mesh denoising. Optics and Lasers in Engineering, 90, 186–195.CrossRef
go back to reference Max, N. (1999). Weights for computing vertex normals from facet normals. Journal of Graphics Tools, 4(2), 1–6.CrossRef Max, N. (1999). Weights for computing vertex normals from facet normals. Journal of Graphics Tools, 4(2), 1–6.CrossRef
go back to reference Meyer, M., Desbrun, M., Schröder, P., & Barr, A. H. (2003). Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and mathematics III (pp. 35–57). Springer Meyer, M., Desbrun, M., Schröder, P., & Barr, A. H. (2003). Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and mathematics III (pp. 35–57). Springer
go back to reference Nealen, A., Igarashi, T., Sorkine, O., & Alexa, M. (2006) Laplacian mesh optimization. In: 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia, ACM (pp. 381–389). Nealen, A., Igarashi, T., Sorkine, O., & Alexa, M. (2006) Laplacian mesh optimization. In: 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia, ACM (pp. 381–389).
go back to reference Nehab, D., Rusinkiewicz, S., Davis, J. E., & Ramamoorthi, R. (2005). Efficiently combining positions and normals for precise 3D geometry. ACM Transactions on Graphics, 24(3), 536–543.CrossRef Nehab, D., Rusinkiewicz, S., Davis, J. E., & Ramamoorthi, R. (2005). Efficiently combining positions and normals for precise 3D geometry. ACM Transactions on Graphics, 24(3), 536–543.CrossRef
go back to reference Ohtake, Y., Belyaev, A., & Seidel, H. (2002) Mesh smoothing by adaptive and anisotropic Gaussian filter applied to mesh normals. In Vision modeling and visualization. Ohtake, Y., Belyaev, A., & Seidel, H. (2002) Mesh smoothing by adaptive and anisotropic Gaussian filter applied to mesh normals. In Vision modeling and visualization.
go back to reference Or El, R., Rosman, G., Wetzler, A., Kimmel, R., & Bruckstein, A. M. (2015) Rgbd-fusion: Real-time high precision depth recovery. In IEEE conference on computer vision and pattern recognition. Or El, R., Rosman, G., Wetzler, A., Kimmel, R., & Bruckstein, A. M. (2015) Rgbd-fusion: Real-time high precision depth recovery. In IEEE conference on computer vision and pattern recognition.
go back to reference Sun, X., Rosin, P. L., Martin, R. R., & Langbein, F. C. (2008). Random walks for feature-preserving mesh denoising. Computer Aided Geometric Design, 25(7), 437–456.MathSciNetCrossRef Sun, X., Rosin, P. L., Martin, R. R., & Langbein, F. C. (2008). Random walks for feature-preserving mesh denoising. Computer Aided Geometric Design, 25(7), 437–456.MathSciNetCrossRef
go back to reference Sun, X., Rosin, P., Martin, R., & Langbein, F. (2007). Fast and effective feature-preserving mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 13(5), 925–938.CrossRef Sun, X., Rosin, P., Martin, R., & Langbein, F. (2007). Fast and effective feature-preserving mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 13(5), 925–938.CrossRef
go back to reference Taubin, G. (1995). A signal processing approach to fair surface design. In 22nd annual conference on computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH ’95 (pp. 351–358). Taubin, G. (1995). A signal processing approach to fair surface design. In 22nd annual conference on computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH ’95 (pp. 351–358).
go back to reference Taubin, G. (2001). Linear anisotropic mesh filtering. Res Rep RC2213 IBM. Taubin, G. (2001). Linear anisotropic mesh filtering. Res Rep RC2213 IBM.
go back to reference Thürrner, G., & Wüthrich, C. A. (1998). Computing vertex normals from polygonal facets. Journal of Graphics Tools, 3(1), 43–46.CrossRef Thürrner, G., & Wüthrich, C. A. (1998). Computing vertex normals from polygonal facets. Journal of Graphics Tools, 3(1), 43–46.CrossRef
go back to reference Wang, P. S., Liu, Y., & Tong, X. (2016). Mesh denoising via cascaded normal regression. ACM Transactions on Graphics (SIGGRAPH Asia), 35(6), 232. Wang, P. S., Liu, Y., & Tong, X. (2016). Mesh denoising via cascaded normal regression. ACM Transactions on Graphics (SIGGRAPH Asia), 35(6), 232.
go back to reference Wang, R., Yang, Z., Liu, L., Deng, J., & Chen, F. (2014). Decoupling noise and features via weighted \(\ell _1\)-analysis compressed sensing. ACM Transactions on Graphics, 33(2), 18:1–18:12.CrossRef Wang, R., Yang, Z., Liu, L., Deng, J., & Chen, F. (2014). Decoupling noise and features via weighted \(\ell _1\)-analysis compressed sensing. ACM Transactions on Graphics, 33(2), 18:1–18:12.CrossRef
go back to reference Wei, M., Yu, J., Pang, W. M., Wang, J., Qin, J., Liu, L., et al. (2015). Bi-normal filtering for mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 21(1), 43–55.CrossRef Wei, M., Yu, J., Pang, W. M., Wang, J., Qin, J., Liu, L., et al. (2015). Bi-normal filtering for mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 21(1), 43–55.CrossRef
go back to reference Wu, C., Liu, Y., Dai, Q., & Wilburn, B. (2011a). Fusing multiview and photometric stereo for 3d reconstruction under uncalibrated illumination. IEEE Transactions on Visualization and Computer Graphics, 17(8), 1082–1095.CrossRef Wu, C., Liu, Y., Dai, Q., & Wilburn, B. (2011a). Fusing multiview and photometric stereo for 3d reconstruction under uncalibrated illumination. IEEE Transactions on Visualization and Computer Graphics, 17(8), 1082–1095.CrossRef
go back to reference Wu, C., Wilburn, B., Matsushita, Y., & Theobalt, C. (2011b) High-quality shape from multi-view stereo and shading under general illumination. In IEEE conference on computer vision and pattern recognition (pp. 969–976). Wu, C., Wilburn, B., Matsushita, Y., & Theobalt, C. (2011b) High-quality shape from multi-view stereo and shading under general illumination. In IEEE conference on computer vision and pattern recognition (pp. 969–976).
go back to reference Zhang, H., Wu, C., Zhang, J., & Deng, J. (2015a). Variational mesh denoising using total variation and piecewise constant function space. IEEE Transactions on Visualization and Computer Graphics, 21(7), 873–886.CrossRef Zhang, H., Wu, C., Zhang, J., & Deng, J. (2015a). Variational mesh denoising using total variation and piecewise constant function space. IEEE Transactions on Visualization and Computer Graphics, 21(7), 873–886.CrossRef
go back to reference Zhang, W., Deng, B., Zhang, J., Bouaziz, S., & Liu, L. (2015b). Guided mesh normal filtering. Computer Graphics Forum, 34(7), 23–34.CrossRef Zhang, W., Deng, B., Zhang, J., Bouaziz, S., & Liu, L. (2015b). Guided mesh normal filtering. Computer Graphics Forum, 34(7), 23–34.CrossRef
go back to reference Zheng, Y., Fu, H., Au, O. C., & Tai, C. L. (2011). Bilateral normal filtering for mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 17(10), 1521–1530.CrossRef Zheng, Y., Fu, H., Au, O. C., & Tai, C. L. (2011). Bilateral normal filtering for mesh denoising. IEEE Transactions on Visualization and Computer Graphics, 17(10), 1521–1530.CrossRef
Metadata
Title
A Face Fairness Framework for 3D Meshes
Authors
Sk. Mohammadul Haque
Venu Madhav Govindu
Publication date
17-12-2019
Publisher
Springer US
Published in
International Journal of Computer Vision / Issue 6/2020
Print ISSN: 0920-5691
Electronic ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-019-01268-z

Other articles of this Issue 6/2020

International Journal of Computer Vision 6/2020 Go to the issue

Premium Partner