Menglei Chai
Yizhou Yu
Abstract
Human hair is known to be very difficult to model or reconstruct. In this paper, we focus on applications related to portrait manipulation and take an application-driven approach to hair modeling. To enable an average user to achieve interesting portrait manipulation results, we develop a single-view hair modeling technique with modest user interaction to meet the unique requirements set by portrait manipulation. Our method relies on heuristics to generate a plausible high-resolution strand-based 3D hair model. This is made possible by an effective high-precision 2D strand tracing algorithm, which explicitly models uncertainty and local layering during tracing. The depth of the traced strands is solved through an optimization, which simultaneously considers depth constraints, layering constraints as well as regularization terms. Our single-view hair modeling enables a number of interesting applications that were previously challenging, including transferring the hairstyle of one subject to another in a potentially different pose, rendering the original portrait in a novel view and image-space hair editing.
Supplemental Material
Available for Download
Supplemental material.
- Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 3, 24:1--24:11. Google Scholar
Digital Library
- Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P. N., and Nayar, S. K. 2008. Face Swapping: Automatically replacing faces in photographs. ACM Trans. Graph. 27, 39:1--39:8. Google ScholarDigital Library
- Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of SIGGRAPH '99, 187--194. Google ScholarDigital Library
- Bonneel, N., Paris, S., Panne, M. V. D., Durand, F., and Drettakis, G. 2009. Single photo estimation of hair appearance. Computer Graphics Forum 28, 1171--1180. Google ScholarDigital Library
- Canny, J. 1983. Finding Edges and Lines in Images. Master's thesis, MIT. http://hdl.handle.net/1721.1/6939.Google Scholar
- Dale, K., Sunkavalli, K., Johnson, M. K., Vlasic, D., Matusik, W., and Pfister, H. 2011. Video face replacement. ACM Trans. Graph. 30, 6, 130:1--130:10. Google ScholarDigital Library
- Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577--584. Google ScholarDigital Library
- Jain, A. K., and Farrokhnia, F. 1991. Unsupervised texture segmentation using Gabor filters. Pattern Recognition 24, 12, 1167--1186. Google ScholarDigital Library
- Jain, A., Thormählen, T., Seidel, H.-P., and Theobalt, C. 2010. MovieReshape: Tracking and reshaping of humans in videos. ACM Trans. Graph. 29, 6, 148:1--148:10. Google ScholarDigital Library
- Jakob, W., Moon, J. T., and Marschner, S. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5, 164:1--164:9. Google ScholarDigital Library
- Joshi, N., Matusik, W., Adelson, E. H., and Kriegman, D. J. 2010. Personal photo enhancement using example images. ACM Trans. Graph. 29, 3, 12:1--12:15. Google ScholarDigital Library
- Levin, A., Lischinski, D., and Weiss, Y. 2008. A closed-form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 2, 228--242. Google ScholarDigital Library
- Leyvand, T., Cohen-Or, D., Dror, G., and Lischinski, D. 2008. Data-driven enhancement of facial attractiveness. ACM Trans. Graph. 27, 3, 38:1--38:9. Google ScholarDigital Library
- Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. ACM Trans. Graph. 23, 3, 303--308. Google ScholarDigital Library
- Marschner, S., Jensen, H. W., Cammarano, M., Worley, S., and Hanrahan, P. 2003. Light scattering from human hair fibers. ACM Trans. Graph. 22, 3, 780--791. Google ScholarDigital Library
- Milborrow, S., and Nicolls, F. 2008. Locating facial features with an extended active shape model. In Proceedings of ECCV '08, Springer, 504--513. Google ScholarDigital Library
- Nguyen, H., and Donnelly, W. 2004. Hair animation and rendering in the Nalu demo. In GPU Gems 2. Addison-Wesley Professional.Google Scholar
- Öztireli, A. C., Uyumaz, U., Popa, T., Sheffer, A., and Gross, M. 2011. 3D modeling with a symmetric sketch. In Proceedings of SBIM, 23--30. Google ScholarDigital Library
- Paris, S., Briceño, H., and Sillion, F. 2004. Capture of hair geometry from multiple images. ACM Trans. Graph. 23, 3, 712--719. Google ScholarDigital Library
- Paris, S., Chang, W., Kozhushnyan, O. I., Jarosz, W., Matusik, W., Zwicker, M., and Durand, F. 2008. Hair photobooth: geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3, 30:1--30:9. Google ScholarDigital Library
- Pighin, F., and Lewis, J. P. 2006. Performance-driven facial animation. In ACM SIGGRAPH 2006 Courses.Google Scholar
- Rivers, A., Igarashi, T., and Durand, F. 2010. 2.5D cartoon models. ACM Trans. Graph. 29, 4, 59:1--59:7. Google ScholarDigital Library
- Shlizerman, I. K., Shechtman, E., Garg, R., and Seitz, S. M. 2010. Being John Malkovich. In Proceedings of ECCV '10, 341--353. Google ScholarDigital Library
- Shlizerman, I. K., Shechtman, E., Garg, R., and Seitz, S. M. 2011. Exploring photobios. ACM Trans. Graph. 30, 4, 61:1--61:9. Google ScholarDigital Library
- Ward, K., Bertails, F., Kim, T.-Y., Marschner, S. R., Cani, M.-P., and Lin, M. C. 2007. A survey on hair modeling: styling, simulation, and rendering. IEEE Transactions on Visualization and Computer Graphics 13, 2, 213--234. Google ScholarDigital Library
- Wei, Y., Ofek, E., Quan, L., and Shum, H.-Y. 2005. Modeling hair from multiple views. ACM Trans. Graph. 24, 3, 816--820. Google ScholarDigital Library
- Xu, K., Ma, L.-Q., Ren, B., Wang, R., and Hu, S.-M. 2011. Interactive hair rendering and appearance editing under environment lighting. ACM Trans. Graph. 30, 6, 173:1--173:10. Google ScholarDigital Library
- Yang, F., Wang, J., Shechtman, E., Bourdev, L., and Metaxas, D. 2011. Expression flow for 3D-aware face component transfer. ACM Trans. Graph. 30, 4, 60:1--60:10. Google ScholarDigital Library
- Yu, Y. 2001. Modeling realistic virtual hairstyles. In Proceedings of Pacific Graphics '01, 295--304. Google ScholarDigital Library
- Zhou, S., Fu, H., Liu, L., Cohen-Or, D., and Han, X. 2010. Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 4, 126:1--126:10. Google ScholarDigital Library
Recommendations
Single-view hair modeling using a hairstyle database
Human hair presents highly convoluted structures and spans an extraordinarily wide range of hairstyles, which is essential for the digitization of compelling virtual avatars but also one of the most challenging to create. Cutting-edge hair modeling ...
High-quality hair modeling from a single portrait photo
We propose a novel system to reconstruct a high-quality hair depth map from a single portrait photo with minimal user input. We achieve this by combining depth cues such as occlusions, silhouettes, and shading, with a novel 3D helical structural prior ...
Single View Facial Hair 3D Reconstruction
Pattern Recognition and Image AnalysisAbstractIn this work, we introduce a novel energy-based framework that addresses the challenging problem of 3D reconstruction of facial hair from a single RGB image. To this end, we identify hair pixels over the image via texture analysis and then ...
Comments