Jian Sun
Sing Bing Kang
Abstract
In this paper, we propose a novel approach to extract mattes using a pair of flash/no-flash images. Our approach, which we call flash matting, was inspired by the simple observation that the most noticeable difference between the flash and no-flash images is the foreground object if the background scene is sufficiently distant. We apply a new matting algorithm called joint Bayesian flash matting to robustly recover the matte from flash/no-flash images, even for scenes in which the foreground and the background are similar or the background is complex. Experimental results involving a variety of complex indoors and outdoors scenes show that it is easy to extract high-quality mattes using an off-the-shelf, flash-equipped camera. We also describe extensions to flash matting for handling more general scenes.
Supplemental Material
- Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. In Proceedings of ACM SIGGRAPH 2005, 828--835. Google Scholar
Digital Library
- Berman, A., Vlahos, P., and Dadourian, A. 2000. Comprehensive method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,345.Google Scholar
- Bolle, R. M., Connell, J. H., Haas, N., Mohan, R., and Taubin, G. 1994. Object imaging system. U. S. Patent 5,631,976.Google Scholar
- Canny, J. 1986. A computational approach to edge detection. IEEE Trans. on PAMI. 8, 6, 679--698. Google ScholarDigital Library
- Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A bayesian approach to digital matting. In Proceedings of CVPR 2001, vol. II, 264--271.Google Scholar
- Chuang, Y.-Y., Agarwala, A., Curless, B., Salesin, D. H., and Szeliski, R. 2002. Video matting of complex scenes. In Proceedings of ACM SIGGRAPH 2002, 243--248. Google ScholarDigital Library
- Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. In Proceedings of ACM SIGGRAPH 2004, 673--678. Google ScholarDigital Library
- Feris, R., Raskar, R., Chen, L., Tan, K., and Turk, M. 2005. Discontinuity preserving stereo with small baseline multi-flash illumination. In Proceedings of ICCV 2005, vol. I, 412--419. Google ScholarDigital Library
- Fielding, R. 1972. The technique of special effects cinematography. In Focal/Hastings House, London, 3rd edition, 220--243.Google Scholar
- Hillman, P., Hannah, J., and Renshaw, D. 2001. Alpha channel estimation in high resolution images and image sequences. In Proceedings of CVPR 2001, Vol. I, 1063--1068.Google Scholar
- McGuire, M., Matusik, W., Pfister, H., Hughes, J. F., and Durand, F. 2005. Defocus video matting. In Proceedings of ACM SIGGRAPH, 567--576. Google ScholarDigital Library
- Nayar, S. K., and Narasimhan, S. G. 2002. Assorted pixels: Multi-sampled imaging with structural models. In Proceedings of ECCV 2002, vol. IV, 636--652. Google ScholarDigital Library
- Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama., K. 2004. Digital photography with flash and no-flash image pairs. In Proceedings of ACM SIGGRAPH 2004, 664--672. Google ScholarDigital Library
- Raskar, R., Han Tan, K., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging. In Proceedings of ACM SIGGRAPH 2004, 673--678. Google ScholarDigital Library
- Ruzon, M. A., and Tomasi, C. 2000. Alpha estimation in natural images. In Proceedings of CVPR 2000, 18--25.Google Scholar
- Smith, A. R., and Blinn, J. F. 1996. Blue screen matting. In Proceedings of ACM SIGGRAPH 1996, 259--268. Google ScholarDigital Library
- Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In Proceedings of ACM SIGGRAPH, 315--321. Google ScholarDigital Library
- Vlahos, P. 1958. Composite photography utilizing sodium vapor illumination. U. S. Patent 3,095,304.Google Scholar
- Wang, J., and Cohen, M. 2005. An iterative optimization approach for unified image segmentation and matting. In Proceedings of ICCV 2005, vol. II, 936--943. Google ScholarDigital Library
Index Terms
- Flash matting
Recommendations
Flash matting
SIGGRAPH '06: ACM SIGGRAPH 2006 PapersIn this paper, we propose a novel approach to extract mattes using a pair of flash/no-flash images. Our approach, which we call flash matting, was inspired by the simple observation that the most noticeable difference between the flash and no-flash ...
Unsupervised and reliable image matting based on modified spectral matting
Spectral matting is the state-of-the-art image matting and also a milestone in theoretic matting research. For spectral matting without user intervention, the accuracy of alpha matte is low and the computational cost is high. Therefore, this paper ...
Automatic image matting using component-hue-difference-based spectral matting
ACIIDS'12: Proceedings of the 4th Asian conference on Intelligent Information and Database Systems - Volume Part IIThis paper presents automatic image matting using component-hue-difference-based spectral matting to obtain accurate alpha mattes. Spectral matting is the state-of-the-art image matting and it is also a milestone in theoretic matting research. However, ...
Comments