Norimichi Tsumura
Abstract
This paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is removed by a simple color vector analysis in the optical density domain as an inverse lighting technique. The image without shading is analyzed by a previously introduced technique that extracts hemoglobin and melanin components by independent component analysis. Experimental results using UV-B irradiation and the application of methyl nicotinate on the arms support the physiological validity of the analysis and the effectiveness of the proposed shading removal. We synthesized the way facial images changed due to tanning or alcohol consumption, and compared the synthesized images with images of actual changes in skin color. The comparison shows an excellent match between the synthesized and actual images of changes due to tanning and alcohol consumption. We also proposed a technique to synthesize the change of texture in pigment due to aging or the application of cosmetics. The pyramid-based texture analysis/synthesis technique was used for the spatial processing of texture. Using the proposed technique, we could realistically change the skin color and texture of a 50 year-old woman to that of a 20 year-old woman.
Supplemental Material
- BLANZ V. AND VETTER T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH'99, 187--194. Google Scholar
Digital Library
- DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.-P., SAROKIN W., AND SAGAR M. 2000. Acquiring the reflectance field of a human face. In Proceedings of SIGGRAPH 2000, 145--156. Google ScholarDigital Library
- DREW M. S., CHEN C., HORDLEY S. D., AND FINLAYSON G, D. 2002. Sensor transforms for invariant image enhancement. In Proceeding of IS&T /SID's Tenth Color Imaging Conference, IS&T and SID, 325--330.Google Scholar
- DUDA R. O. AND HART, P. E. 1973. Pattern Classification and Scene Analysis. Wiley & Sons, Inc.Google Scholar
- FREEFBERG I. M., EISEN A. Z., WOLFF K., AUSTEN F. K, GOLDSMITH L. A., KATZ S. I., AND FITSPATRICK T. B. 1999 Fitzpatrick's Dermatology in General Medicine, McGraw HillGoogle Scholar
- GEMERT M. J. C. V, JACQUES S. L., STERBORG H. J. C. M, AND STAR W. M. 1989. Skin Optics. IEEE Trans. Biomed. Eng., 36 1146--1154.Google ScholarCross Ref
- HANRAHAN P. AND KRUEGER W. 1993. Reflection from layered surfaces due to subsurface scattering. In Proceedings of ACM SIGGRAPH '93, ACM Press / Computer Graphics Proceedings, Annual Conference Series, ACM, 187--194. Google ScholarDigital Library
- HEEGER D. J. AND BERGEN J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 95, 229--238. Google ScholarDigital Library
- HIRAOKA M., FIRBANK M., ESSENPREIS M., COPE M., ARRIGE S. R., ZEE P. V. D., AND DELPY D. T. 1993. A Monte Carlo investigation of optical pathlength in inhomogeneous tissue and its application to near-infrared spectroscopy. Phys. Med. Biol. 38, 1859--1876.Google ScholarCross Ref
- HUNT, R. W. G. H. 1995. The Reproduction of Colour, Fifth edition, Fountain Press.Google Scholar
- HYVARINEN A., KARHUNEN J., AND OJA E. 2001. Independent Component Analysis, Wiley Inter-Science.Google Scholar
- HYVARINEN A. AND OJA E. 1997. A fast fixed-point algorithm for independent component analysis. Neural Computation 9, 1483--1492. Google ScholarDigital Library
- ICC (International Color Consortium) 1998. Spec ICC.1:1998-09, File Format for Color Profiles. ICC.Google Scholar
- IEC 61966-2-1 1999. Multimedia Systems and Equipment - Colour Measurement and Management - Part 2--1: Colour Management - Default RGB Colour Space -sRGB, IEC.Google Scholar
- ISHII T., YASUDA T., YOKOI S., AND TORIWAKI J. 1993. A generation model for human skin texture. In Proceedings of CG International., Springer-Verlag, 139--150.Google Scholar
- JENSEN H. W., MAESHNER S. R., LEVOY M., AND HANRAHAN P. 2001. A practical model of subsurface light transport. In Proceedings of ACM SIGGRAPH 2001, 551--518. Google ScholarDigital Library
- JENSEN H. W. AND BUHLER J. 2002. A rapid hierarchical rendering technique for translucent materials. In Proceedings of SIGGRAPH 2002 576--581. Google ScholarDigital Library
- KLINKER G. J., SHAFER S. A. AND KANADE T. 1990. A Physical Approach to Color Image Understanding", International Journal on Computer Vision, 4(1) 7--38. Google ScholarDigital Library
- MARSHNER S. R. AND GREENBERG D. P. 1997. Inverse lighting for photography. In Proceeding of Fifth IS&T/SID Color Imaging Conference, IS&T and SID, 262--265.Google Scholar
- MARSHNER S. R. 1998. Inverse Rendering for Computer Graphics. Ph.D. thesis, Cornell. Google ScholarDigital Library
- MARSCHNER S. R., WESTIN S. H., LAFORTUNE E. P. F., TORRANCE K. E., AND GREENBERG D. P. 1999. Imagebased BRDF measurement including human skin. In Proceedings of 10th Eurographics Workshop on Rendering, 139--152. Google ScholarDigital Library
- NUMATA K., RI K., AND KIRA K., 1999. "E-Make"; A real-time HD skin-make-up machine. IEICE Technical report 23, 76, 11--16. http://www.nhk.or.jp/strl/open2001/en/tenji/id17/index.html.Google Scholar
- OJIMA N., MINAMI T., AND KAWAI M. 1997. Transmittance measurement of cosmetic layer applied on skin by using image processing. In Proceeding of The 3rd Scientific Conference of the Asian Societies of Cosmetic Scientists, 114.Google Scholar
- OJIMA N., YOSHIDA K., OSANAI O., AND AKAZAKI S. 2002. Image synthesis of cosmetic applied skin based on optical properties of foundation layers. In Proceedings of International Congress of Imaging Science, 467--468.Google Scholar
- RAMAMOORTHI R. AND HANRAHAN P. 2001. A signal processing framework for inverse rendering. In Proceedings of ACM SIGGRAPH 2001, 117--128. Google ScholarDigital Library
- SATO Y. AND IKEUCHI K. 1994. Temporal-color space analysis of reflection. Journal of Optical Society of America A 11, 11, 2990--3002.Google ScholarCross Ref
- TOMINAGA S. AND WANDELL B. 1989. The standard reflectance model and illuminant estimation. Journal of Optical Society of America A, Vol. 6, No.4, 576--584.Google ScholarCross Ref
- TSUMURA N., KAWABUCHI M., HANEISHI H., AND MIYAKE Y. 2001. Mapping pigmentation in human skin from multi-channel visible spectrum image by inverse optical scattering technique. Journal of Imaging Science and Technology 45, 5, 444--450.Google ScholarCross Ref
- TSUMURA N., HANEISHI H., AND MIYAKE Y. 1999. Independent component analysis of skin color image. Journal of Optical Society of America A 16, 9, 2169--2176.Google ScholarCross Ref
Index Terms
- Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin
Recommendations
Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin
SIGGRAPH '03: ACM SIGGRAPH 2003 PapersThis paper proposes an E-cosmetic function for digital images based on physics and physiologically-based image processing. A practical skin color and texture analysis/synthesis technique is introduced for this E-cosmetic function. Shading on the face is ...
Illumination Invariant Measuring of Skin Pigmentation
CGIV '14: Proceedings of the 2014 11th International Conference on Computer Graphics, Imaging and VisualizationThis paper proposes a new method for measuring concentration of skin pigmentation using nothing but a standard RGB camera. Since RGB signals are easily affected by change in illumination, all conventional methods require a prior knowledge about the ...
Hemoglobin and melanin quantification on skin images
ICIAR'12: Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part IIIn this paper, we propose and compare four different approaches for quantification of hemoglobin and melanin on skin color image. The first method is to extract erythema/melanin indices based on skin absorbance theories. The second method is based on ...
Comments