skip to main content
10.1145/2614028.2615407acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Digital ira and beyond: creating real-time photoreal digital actors

Published:27 July 2014Publication History
First page image
Skip Supplemental Material Section

Supplemental Material

a1-sidebyside.mp4

mp4

223.1 MB

References

  1. Alexander, O., Rogers, M., Lambeth, W., Chiang, M., and Debevec, P. 2009. Thedigital emily project: photoreal facial modeling and animation. In ACM SIGGRAPH 2009 Courses, ACM, New York, NY, USA, SIGGRAPH '09, 12:1--12:15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Ghosh, A., Fyffe, G., Tunwattanapong, B., Busch, J., Yu, X., and Debevec, P. 2011. Multiview face capture using polarized spherical gradient illumination. ACM Trans. Graph. 30, 6 (Dec.), 129:1--129:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jimenez, J., Jarabo, A., Gutierrez, D., Danvoye, E., and von der Pahlen, J. 2012. Separable subsurface scattering and photorealistic eyes rendering. In ACM SIGGRAPH 2012 Courses, ACM, New York, NY, USA, SIGGRAPH 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ekman, P., and Friesen, W. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto.Google ScholarGoogle Scholar
  5. Ghosh, A., Fyffe, G., Tunwattanapong, B., Busch, J., Yu, X., and Debevec, P. 2011. Multiview face capture using polarized spherical gradient illumination. ACM Trans. Graph. 30, 6 (Dec.), 129:1--129:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Alexander, O., Rogers, M., Lambeth, W., Chiang, M., and Debevec, P. 2009. Creating a photoreal digital actor: The digital emily project. In Visual Media Production, 2009. CVMP '09. Conference for, 176--187. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., and Szeliski, R. 2011. A database and evaluation methodology for optical flow. International Journal of Computer Vision 92, 1 (Mar.), 1--31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Beeler, T., Bickel, B., Beardsley, P., Sumner, B., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Trans. on Graphics (Proc. SIGGRAPH) 29, 3, 40:1--40:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R. W., and Gross, M. 2011. High-quality passive facial performance capture using anchor frames. In ACM SIGGRAPH 2011 papers, ACM, New York, NY, USA, SIGGRAPH '11, 75:1--75:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Bickel, B., Lang, M., Botsch, M., Otaduy, M. A., and Gross, M. 2008. Pose-space animation and transfer of facial details. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '08, 57--66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Borshukov, G., Piponi, D., Larsen, O., Lewis, J. P., and Tempelaar-lietz, C. 2003. Universal capture: image-based facial animation for "the matrix reloaded". In SIGGRAPH, ACM, A. P. Rockwood, Ed. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Bradley, D., Heidrich, W., Popa, T., and Sheffer, A. 2010. High resolution passive facial performance capture. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 41:1--41:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Cootes, T. F., Edwards, G. J., and Taylor, C. J. 1998. Active appearance models. In IEEE Transactions on Pattern Analysis and Machine Intelligence, Springer, 484--498. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '98, 189--198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. DeCarlo, D., and Metaxas, D. 1996. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96), IEEE Computer Society, Washington, DC, USA, CVPR '96, 231--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Ekman, P., and Friesen, W. 1978. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto.Google ScholarGoogle Scholar
  17. Ghosh, A., Fyffe, G., Tunwattanapong, B., Busch, J., Yu, X., and Debevec, P. 2011. Multiview face capture using polarized spherical gradient illumination. In Proceedings of the 2011 SIGGRAPH Asia Conference, ACM, New York, NY, USA, SA '11, 129:1--129:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Guenter, B., Grimm, C., Wood, D., Malvar, H., and Pighin, F. 1998. Making faces. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, SIGGRAPH '98, 55--66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Hawkins, T., Wenger, A., Tchou, C., Gardner, A., Göransson, F., and Debevec, P. 2004. Animatable facial reflectance fields. In Rendering Techniques 2004: 15th Eurographics Workshop on Rendering, 309--320. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Huang, H., Chai, J., Tong, X., and Wu, H.-T. 2011. Leveraging motion capture and 3d scanning for high-fidelity facial performance acquisition. ACM Trans. Graph. 30, 4 (July), 74:1--74:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jimenez, J., Jarabo, A., Gutierrez, D., Danvoye, E., and von der Pahlen, J. 2012. Separable subsurface scattering and photorealistic eyes rendering. In ACM SIGGRAPH 2012 Courses, ACM, New York, NY, USA, SIGGRAPH 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Klaudiny, M., and Hilton, A. 2012. High-detail 3d capture and non-sequential alignment of facial performance. In 3DIMPVT. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Klaudiny, M., Hilton, A., and Edge, J. 2010. High-detail 3d capture of facial performance. In 3DPVT.Google ScholarGoogle Scholar
  24. Kolmogorov, V. 2006. Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10, 1568--1583. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Li, H., Roivainen, P., and Forcheimer, R. 1993. 3-d motion estimation in model-based facial image coding. IEEE Trans. Pattern Anal. Mach. Intell. 15, 6 (June), 545--555. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ma, W.-C., Jones, A., Chiang, J.-Y., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., and Debevec, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. ACM Trans. Graph. 27, 5 (Dec.), 121:1--121:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nishino, K., and Nayar, S. K. 2004. Eyes for relighting. ACM Trans. Graph. 23, 3, 704--711. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Park, M., Kashyap, S., Collins, R., and Liu, Y. 2010. Data driven mean-shift belief propagation for non-gaussian mrfs. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, 3547--3554.Google ScholarGoogle Scholar
  29. Popa, T., South-dickinson, I., Bradley, D., Sheffer, A., and Heidrich, W. 2010. Globally consistent space-time reconstruction. Computer Graphics Forum (Proc. SGP).Google ScholarGoogle Scholar
  30. Seol, Y., Lewis, J., Seo, J., Choi, B., Anjyo, K., and Noh, J. 2012. Spacetime expression cloning for blendshapes. ACM Trans. Graph. 31, 2 (Apr.), 14:1--14:12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Valgaerts, L., Wu, C., Bruhn, A., Seidel, H.-P., and Theobalt, C. 2012. Lightweight binocular facial performance capture under uncontrolled lighting. ACM Trans. Graph. 31, 6 (Nov.), 187:1--187:11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Weise, T., Bouaziz, S., Li, H., and Pauly, M. 2011. Realtime performance-based facial animation. In ACM SIGGRAPH 2011 papers, ACM, New York, NY, USA, SIGGRAPH '11, 77:1--77:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Werlberger, M. 2012. Convex Approaches for High Performance Video Processing. PhD thesis, Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria.Google ScholarGoogle Scholar
  34. Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: high resolution capture for modeling and animation. In SIGGRAPH '04: ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, 548--558. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Zhu, X., and Ramanan, D. 2012. Face detection, pose estimation, and landmark localization in the wild. In CVPR, 2879--2886. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Balogh, T., Kovács, P., and Megyesi, Z. 2007. Holovizio 3d display system. In Proceedings of the First International Conference on Immersive Telecommunications, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Jones, A., McDowall, I., Yamada, H., Bolas, M., and Debevec, P. 2007. Rendering for an interactive 360 light field display. ACM Transactions on Graphics (TOG) 26, 3, 40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jones, A., Lang, M., Fyffe, G., Yu, X., Busch, J., McDowall, I., Bolas, M., and Debevec, P. 2009. Achieving eye contact in a one-to-many 3d video teleconferencing system. In ACM Transactions on Graphics (TOG), vol. 28, ACM, 64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Jurik, J., Jones, A., Bolas, M., and Debevec, P. 2011. Prototyping a light field display involving direct observation of a video projector array. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, IEEE, 15--20.Google ScholarGoogle Scholar

Index Terms

  1. Digital ira and beyond: creating real-time photoreal digital actors

                Recommendations

                Comments

                Login options

                Check if you have access through your login credentials or your institution to get full access on this article.

                Sign in
                • Published in

                  cover image ACM Conferences
                  SIGGRAPH '14: ACM SIGGRAPH 2014 Courses
                  July 2014
                  2191 pages
                  ISBN:9781450329620
                  DOI:10.1145/2614028

                  Copyright © 2014 Owner/Author

                  Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

                  Publisher

                  Association for Computing Machinery

                  New York, NY, United States

                  Publication History

                  • Published: 27 July 2014

                  Check for updates

                  Qualifiers

                  • research-article

                  Acceptance Rates

                  Overall Acceptance Rate1,822of8,601submissions,21%

                  Upcoming Conference

                  SIGGRAPH '24

                PDF Format

                View or Download as a PDF file.

                PDF

                eReader

                View online with eReader.

                eReader