Abstract
Many different techniques for measuring material appearance have been proposed in the last few years. These have produced large public datasets, which have been used for accurate, data-driven appearance modeling. However, although these datasets have allowed us to reach an unprecedented level of realism in visual appearance, editing the captured data remains a challenge. In this paper, we present an intuitive control space for predictable editing of captured BRDF data, which allows for artistic creation of plausible novel material appearances, bypassing the difficulty of acquiring novel samples. We first synthesize novel materials, extending the existing MERL dataset up to 400 mathematically valid BRDFs. We then design a large-scale experiment, gathering 56,000 subjective ratings on the high-level perceptual attributes that best describe our extended dataset of materials. Using these ratings, we build and train networks of radial basis functions to act as functionals mapping the perceptual attributes to an underlying PCA-based representation of BRDFs. We show that our functionals are excellent predictors of the perceived attributes of appearance. Our control space enables many applications, including intuitive material editing of a wide range of visual properties, guidance for gamut mapping, analysis of the correlation between perceptual attributes, or novel appearance similarity metrics. Moreover, our methodology can be used to derive functionals applicable to classic analytic BRDF representations. We release our code and dataset publicly, in order to support and encourage further research in this direction.
Supplemental Material
Available for Download
Supplemental file.
- Aittala, M., Weyrich, T., and Lehtinen, J. 2015. Two-shot SVBRDF capture for stationary materials. ACM Trans. Graph. 34, 4 (July), 110:1--13. Google ScholarDigital Library
- An, X., Tong, X., Denning, J. D., and Pellacini, F. 2011. Appwarp: Retargeting measured materials by appearance-space warping. ACM Trans. Graph. 30, 6 (Dec.), 147:1--147:10. Google ScholarDigital Library
- Ashikhmin, M., Premože, S., and Shirley, P. 2000. A Microfacet-based BRDF Generator. In Proc. of SIGGRAPH '00, 65--74. Google ScholarDigital Library
- Bell, S., Upchurch, P., Snavely, N., and Bala, K. 2013. Opensurfaces: a richly annotated catalog of surface appearance. ACM Trans. Graph. 32, 4 (July), 111:1--111:17. Google ScholarDigital Library
- Ben-Artzi, A., Overbeck, R., and Ramamoorthi, R. 2006. Real-time BRDF editing in complex lighting. ACM Trans. Graph. 25, 3 (July), 945--954. Google ScholarDigital Library
- Ben-Artzi, A., Egan, K., Durand, F., and Ramamoorthi, R. 2008. A Precomputed Polynomial Representation for Interactive BRDF Editing with Global Illumination. ACM Trans. Graph. 27, 2 (May), 13:1--13:13. Google ScholarDigital Library
- Bousseau, A., O'shea, J. P., Durand, F., Ramamoorthi, R., and Agrawala, M. 2013. Gloss perception in painterly and cartoon rendering. ACM Trans. Graph. 32, 2 (Apr.), 18:1--18:13. Google ScholarDigital Library
- Boyadzhiev, I., Bala, K., Paris, S., and Adelson, E. 2015. Band-sifting decomposition for image-based material editing. ACM Trans. Graph. 34, 5 (Oct.), 163. Google ScholarDigital Library
- Burley, B. 2012. Physically based shading at Disney. In ACM SIGGRAPH Courses.Google Scholar
- Chaudhuri, S., Kalogerakis, E., Giguere, S., and Funkhouser, T. 2013. AttribIt: Content creation with semantic attributes. In Proc. UIST, ACM. Google ScholarDigital Library
- Cheslack-Postava, E., Wang, R., Akerlund, O., and Pellacini, F. 2008. Fast, realistic lighting and material design using nonlinear cut approximation. ACM Trans. Graph. 27, 5 (Dec.), 128:1--128:10. Google ScholarDigital Library
- Colbert, M., and Pattanaik, S. 2006. BRDF-Shop: Creating Physically Correct Bidirectional Reflectance Distribution Functions. IEEE Computer Graphics and Applications, 30--36. Google ScholarDigital Library
- Cornell, 2001. Reflectance Database - Cornell University Program of Computer Graphics. http://www.graphics.cornell.edu/online/measurements/reflectance/index.html.Google Scholar
- Du, S.-P., Masia, B., Hu, S.-M., and Gutierrez, D. 2013. A Metric of Visual Comfort for Stereoscopic Motion. ACM Trans. Graph. 32, 6 (Nov.), 222:1--9. Google ScholarDigital Library
- Ershov, S., Kolchin, K., and Myszkowski, K. 2001. A realistic lighting model for computer animators. Computer Graphics Forum 20, 3.Google ScholarCross Ref
- Filip, J., and Vávra, R. 2014. Template-based sampling of anisotropic BRDFs. Computer Graphics Forum (Proc. of Pacific Graphics 2014). Google ScholarDigital Library
- Fleming, R. W., Wiebel, C., and Gegenfurtner, K. 2013. Perceptual qualities and material classes. Journal of Vision 13, 8, 9--9.Google ScholarCross Ref
- Fores, A., Ferwerda, J., Gu, J., and Zhao, X. 2012. Toward a perceptually based metric for BRDF modeling. In 20th Color and Imaging Conference, CIC'12, 142--148.Google Scholar
- Garces, E., Agarwala, A., Gutierrez, D., and Hertzmann, A. 2014. A similarity measure for illustration style. ACM Trans. Graph. 33, 4 (July). Google ScholarDigital Library
- Gkioulekas, I., Xiao, B., Zhao, S., Adelson, E. H., Zickler, T., and Bala, K. 2013. Understanding the role of phase function in translucent appearance. ACM Trans. Graph. 32, 5 (Oct.), 147:1--147:19. Google ScholarDigital Library
- Heer, J., and Bostock, M. 2010. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proc. of CHI'10, CHI '10, 203--212. Google ScholarDigital Library
- Hunter, R. S., and Harold, R. W. 1987. The Measurement of Appearance (2nd Edition). Wiley.Google Scholar
- ITU. 2002. ITU-R.REC.BT.500-11. Methodology for the subjective assessment of the quality for television pictures. Tech. rep.Google Scholar
- ITU. 2008. ITU-R.REC.P.910. Subjective audivisual quality assessment methods for multimedia applications. Tech. rep.Google Scholar
- Jarabo, A., Wu, H., Dorsey, J., Rushmeier, H., and Gutierrez, D. 2014. Effects of approximate filtering on the appearance of bidirectional texture functions. IEEE Transactions on Visualization and Computer Graphics 20, 6. Google ScholarDigital Library
- Keelan, B. 2003. ISO 20462: A psychophysical image quality measurement standard. In Proc. of the SPIE, vol. 5294, 181--189.Google Scholar
- Kerr, W. B., and Pellacini, F. 2010. Toward evaluating material design interface paradigms for novice users. ACM Trans. Graph. 29, 4 (July), 35:1--35:10. Google ScholarDigital Library
- Koyama, Y., Sakamoto, D., and Igarashi, T. 2014. Crowd-powered parameter analysis for visual design exploration. In Proc. of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST '14, 65--74. Google ScholarDigital Library
- Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Trans. Graph. 25, 3 (July), 735--745. Google ScholarDigital Library
- Mantiuk, R. K., Tomaszewska, A., and Mantiuk, R. 2012. Comparison of four subjective methods for image quality assessment. Computer Graphics Forum 31, 8, 2478--2491. Google ScholarDigital Library
- Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Trans. Graph. 22, 3 (July), 759--769. Google ScholarDigital Library
- Matusik, W. 2003. A Data-Driven Reflectance Model. PhD thesis, MIT. Google ScholarDigital Library
- McCool, M. D., Ang, J., and Ahmad, A. 2001. Homomorphic Factorization of BRDFs for High-performance Rendering. In Proc. of SIGGRAPH '01, 171--178. Google ScholarDigital Library
- McNamara, A., Mania, K., and Gutierrez, D. 2011. Perception in graphics, visualization, virtual environments and animation. In SIGGRAPH Asia 2011 Courses. Google ScholarDigital Library
- Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. 1953. Equation of state calculations by fast computing machines. The Journal of Chemical Physics 21, 6, 1087--1092.Google ScholarCross Ref
- Ngan, A., Durand, F., and Matusik, W. 2005. Experimental Analysis of BRDF Models. In Proc. of EGSR'05, 117--126. Google ScholarDigital Library
- Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven Navigation of Analytical BRDF Models. In Proc. of EGSR'06. Google ScholarDigital Library
- Nguyen, C. H., Kyung, M.-H., Lee, J.-H., and Nam, S.-W. 2010. A PCA Decomposition for Real-time BRDF Editing and Relighting with Global Illumination. In Eurographics Symposium on Rendering, 1469--1478. Google ScholarDigital Library
- Nielsen, J. B., Jensen, H. W., and Ramamoorthi, R. 2015. On Optimal, Minimal BRDF Sampling for Reflectance Acquisition. ACM Trans. Graph. 34, 6 (Nov.). Google ScholarDigital Library
- Parikh, D., and Grauman, K. 2011. Relative attributes. In IEEE International Conference on Computer Vision (ICCV), 503--510. Google ScholarDigital Library
- Park, J., and Sandberg, I. W. 1991. Universal approximation using radial-basis-function networks. Neural Comput. 3, 2 (June), 246--257.Google ScholarCross Ref
- Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proc. of SIGGRAPH'00, 55--64. Google ScholarDigital Library
- Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: Towards a new standard for image fidelity. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. 2010. A comparative study of image retargeting. ACM Trans. Graph. 29, 6 (Dec.), 160:1--160:10. Google ScholarDigital Library
- Sigal, L., Mahler, M., Diaz, S., McIntosh, K., Carter, E., Richards, T., and Hodgins, J. 2015. A perceptual control space for garment simulation. ACM Trans. Graph. 34, 4 (July), 117:1--117:10. Google ScholarDigital Library
- Silverstein, D. A., and Farrell, J. E. 2001. Efficient method for paired comparison. J. Electronic Imaging 10, 2, 394--398.Google ScholarCross Ref
- Sun, X., Zhou, K., Chen, Y., Lin, S., Shi, J., and Guo, B. 2007. Interactive Relighting with Dynamic BRDFs. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Talton, J. O., Gibson, D., Yang, L., Hanrahan, P., and Koltun, V. 2009. Exploratory modeling with collaborative design spaces. ACM Trans. Graph. 28, 5 (Dec.), 167:1--167:10. Google ScholarDigital Library
- Tominaga, T., Hayashi, T., Okamoto, J., and Takahashi, A. 2010. Performance comparisons of subjective quality assessment methods for mobile video. In 2nd. International Workshop on Quality Multimedia Experience (QoMEX).Google Scholar
- Vangorp, P., Laurijssen, J., and Dutré, P. 2007. The influence of shape on the perception of material reflectance. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
- Westlund, H. B., and Meyer, G. W. 2001. Applying appearance standards to light reflection models. In Proc. of SIGGRAPH '01, 501--510. Google ScholarDigital Library
- Wills, J., Agarwal, S., Kriegman, D., and Belongie, S. 2009. Toward a perceptual space for gloss. ACM Trans. Graph. 28, 4 (Sept.), 103:1--103:15. Google ScholarDigital Library
- Yumer, M., Chaudhuri, S., Hodgins, J., and Kara, L. 2015. Semantic shape editing using deformation handles. ACM Trans. Graph. 34 (July), 86:1--12. Google ScholarDigital Library
- Zell, E., Aliaga, C., Jarabo, A., Zibrek, K., Gutierrez, D., McDonnell, R., and Botsch, M. 2015. To stylize or not to stylize?: The effect of shape and material stylization on the perception of computer-generated faces. ACM Trans. Graph. 34, 6 (Oct.), 184:1--184:12. Google ScholarDigital Library
- Zickler, T., Ramamoorthi, R., Enrique, S., and Belhumeur, P. N. 2006. Reflectance sharing: Predicting appearance from a sparse set of images of a known shape. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 8, 1287--1302. Google ScholarDigital Library
Index Terms
- An intuitive control space for material appearance
Recommendations
Intuitive editing of material appearance
SIGGRAPH '16: ACM SIGGRAPH 2016 PostersMany different techniques for measuring material appearance have been proposed in the last few years. These have produced large public datasets, which have been used for accurate, data-driven appearance modeling. However, although these datasets have ...
AppIm: linear spaces for image-based appearance editing
Editing spatially-varying appearance is commonplace in most graphics applications. In this paper, we focus on materials whose appearance is described by BRDFs or BSSRDFs, with parameters specified by textures, and with local frame perturbations, namely ...
Interactive hair rendering and appearance editing under environment lighting
SA '11: Proceedings of the 2011 SIGGRAPH Asia ConferenceWe present an interactive algorithm for hair rendering and appearance editing under complex environment lighting represented as spherical radial basis functions (SRBFs). Our main contribution is to derive a compact 1D circular Gaussian representation ...
Comments