Skip to main content

2013 | OriginalPaper | Buchkapitel

12. A Cluster-Based Boosting Strategy for Red Eye Removal

verfasst von : Sebastiano Battiato, Giovanni Maria Farinella, Daniele Ravì, Mirko Guarnera, Giuseppe Messina

Erschienen in: Computational Intelligence in Image Processing

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Red eye artifact is caused by the flash light reflected off a person’s retina. This effect often occurs when the flash light is very close to the camera lens, as in most compact imaging devices. To reduce these artifacts, most cameras have a red eye flash mode which fires a series of preflashes prior to picture capture. The major disadvantage of the preflash approach is power consumption (e.g., flash is the most power-consuming device on the camera). Alternatively, red eyes can be detected after photo acquisition. Some photo-editing softwares make use of red eye removal tools that require considerable user interaction. To overcome this problem, different techniques have been proposed in literature. Due to the growing interest of industry, many automatic algorithms, embedded on commercial software, have been patented in the last decade. The huge variety of approaches has permitted research to explore different aspects and problems of red eyes identification and correction. The big challenge now is to obtain the best results with the minimal number of visual errors. This chapter critically reviews some of the state-of-the-art approaches for red eye removal. We also discuss a recent technique whose strength is due to a multimodal classifier which is obtained by combining clustering and boosting in order to recognize red eyes represented in the gray codes feature space.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Corel Paint Shop Pro red eye removal tool.
 
2
Picture taken from Petschnigg et al. [36].
 
Literatur
1.
Zurück zum Zitat Mir, J. M.: Apparatus & method for minimizing red-eye in flash photography. U.S. Patent, no. US4285588 (1981) Mir, J. M.: Apparatus & method for minimizing red-eye in flash photography. U.S. Patent, no. US4285588 (1981)
2.
Zurück zum Zitat Battiato, S., Bruna, A. R., Messina, G., Puglisi, G.: Image Processing for Embedded Devices. Bentham Science Publisher, Karachi (2010) Battiato, S., Bruna, A. R., Messina, G., Puglisi, G.: Image Processing for Embedded Devices. Bentham Science Publisher, Karachi (2010)
6.
Zurück zum Zitat Gasparini, F., Schettini, R.: Automatic red-eye removal for digital photography. In: Lukac, R. (ed.) Single-Sensor Imaging: Methods and Applications For Digital Cameras, pp. 429–457. CRC Press, Boston (2008) Gasparini, F., Schettini, R.: Automatic red-eye removal for digital photography. In: Lukac, R. (ed.) Single-Sensor Imaging: Methods and Applications For Digital Cameras, pp. 429–457. CRC Press, Boston (2008)
7.
Zurück zum Zitat Messina, G., Meccio, T.: Red eye removal. In: Battiato, S., Bruna, A.R., Messina, G., Puglisi, G. (eds.) Image Processing for Embedded Devices. Applied Digital Imaging Ebook Series. Bentham Science, Karachi (2010) Messina, G., Meccio, T.: Red eye removal. In: Battiato, S., Bruna, A.R., Messina, G., Puglisi, G. (eds.) Image Processing for Embedded Devices. Applied Digital Imaging Ebook Series. Bentham Science, Karachi (2010)
8.
Zurück zum Zitat Gasparini, F., Schettini, R.: A review of redeye detection and removal in digital images through patents. Recent Pat. Electr. Eng. 2(1), 45–53 (2009)CrossRef Gasparini, F., Schettini, R.: A review of redeye detection and removal in digital images through patents. Recent Pat. Electr. Eng. 2(1), 45–53 (2009)CrossRef
9.
Zurück zum Zitat Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Red-eyes removal through cluster based linear discriminant analysis. In: International Conference on Image Processing (ICIP 2010), Hong Kong (2010) Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Red-eyes removal through cluster based linear discriminant analysis. In: International Conference on Image Processing (ICIP 2010), Hong Kong (2010)
10.
Zurück zum Zitat Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Boosting gray codes for red eyes removal. In: International Conference on Pattern Recognition (ICPR 2010), Instanbul (TK) (2010) Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Boosting gray codes for red eyes removal. In: International Conference on Pattern Recognition (ICPR 2010), Instanbul (TK) (2010)
11.
Zurück zum Zitat Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Red-eyes removal through cluster based boosting on gray codes. EURASIP Journal on Image and Video Processing, Special Issue on Emerging Methods for Color Image and Video Quality Enhancement, 2010, pp. 1–11 (2010) Battiato, S., Farinella, G.M., Guarnera, M., Messina, G., Ravì, D.: Red-eyes removal through cluster based boosting on gray codes. EURASIP Journal on Image and Video Processing, Special Issue on Emerging Methods for Color Image and Video Quality Enhancement, 2010, pp. 1–11 (2010)
12.
Zurück zum Zitat Zhang, L., Sun, Y., Li, M., Zhang, H.: Automated red-eye detection and correction in digital photographs. In: International Conference on Image Processing (2004) Zhang, L., Sun, Y., Li, M., Zhang, H.: Automated red-eye detection and correction in digital photographs. In: International Conference on Image Processing (2004)
13.
Zurück zum Zitat Held, A.: Model-based correction of red-eye defects. In: IS&T Color Imaging Conference (CIC-02), pp. 223–228 (2002) Held, A.: Model-based correction of red-eye defects. In: IS&T Color Imaging Conference (CIC-02), pp. 223–228 (2002)
14.
Zurück zum Zitat Gaubatz, M., Ulichney, R.: Automatic red-eye detection and correction. In: International Conference on Image Processing (2002) Gaubatz, M., Ulichney, R.: Automatic red-eye detection and correction. In: International Conference on Image Processing (2002)
15.
Zurück zum Zitat Smolka, B., Czubin, K., Hardeberg, J.Y., Plataniotis, K.N., Szczepanski, M., Wojciechowski, K.W.: Towards automatic redeye effect removal. Pattern Recognit. Lett. 24(11), 1767–1785 (2003)CrossRef Smolka, B., Czubin, K., Hardeberg, J.Y., Plataniotis, K.N., Szczepanski, M., Wojciechowski, K.W.: Towards automatic redeye effect removal. Pattern Recognit. Lett. 24(11), 1767–1785 (2003)CrossRef
16.
Zurück zum Zitat Gasparini, F., Schettini, R.: Automatic redeye removal for smart enhancement of photos of unknown origin. In: Visual Information and Information Systems (VISUAL-2005). Lecture Notes in Computer Science, vol. 3736, pp. 226–233 (2005) Gasparini, F., Schettini, R.: Automatic redeye removal for smart enhancement of photos of unknown origin. In: Visual Information and Information Systems (VISUAL-2005). Lecture Notes in Computer Science, vol. 3736, pp. 226–233 (2005)
17.
Zurück zum Zitat Willamowski, J., Csurka, G.: Probabilistic automatic red eye detection and correction. In: IEEE International Conference on Pattern Recognition (ICPR-06), pp. 762–765 (2006) Willamowski, J., Csurka, G.: Probabilistic automatic red eye detection and correction. In: IEEE International Conference on Pattern Recognition (ICPR-06), pp. 762–765 (2006)
18.
Zurück zum Zitat Patti, A. J., Konstantinides, K., Tretter, D., Lin, Q.: Automatic digital redeye reduction. In: International Conference on Image Processing, Chicago (1998) Patti, A. J., Konstantinides, K., Tretter, D., Lin, Q.: Automatic digital redeye reduction. In: International Conference on Image Processing, Chicago (1998)
19.
Zurück zum Zitat Benati, P., Gray, R., Cosgrove, P.: Automated detection and correction of eye color defects due to flash illumination. U.S. Patent, no. US5748764 (1998) Benati, P., Gray, R., Cosgrove, P.: Automated detection and correction of eye color defects due to flash illumination. U.S. Patent, no. US5748764 (1998)
20.
Zurück zum Zitat Volken, F., Terrier, J., Vandewalle, P.: Automatic red-eye removal based on sclera and skin tone detection. In: European Conference on Color in Graphics, Imaging and Vision, pp. 359–364 (2006) Volken, F., Terrier, J., Vandewalle, P.: Automatic red-eye removal based on sclera and skin tone detection. In: European Conference on Color in Graphics, Imaging and Vision, pp. 359–364 (2006)
21.
Zurück zum Zitat Ferman, A. M.: Automatic detection of red-eye artifacts in digital color photos. In: International Conference on Image Processing (2008) Ferman, A. M.: Automatic detection of red-eye artifacts in digital color photos. In: International Conference on Image Processing (2008)
22.
Zurück zum Zitat Luo, H., Yen, J., Tretter, D.: An efficient automatic redeye detection and correction algorithm. In: International Conference on Pattern Recognition (2004) Luo, H., Yen, J., Tretter, D.: An efficient automatic redeye detection and correction algorithm. In: International Conference on Pattern Recognition (2004)
23.
Zurück zum Zitat Safonov, I.V.: Automatic red-eye detection. In: International conference on the Computer Graphics and Vision (2007) Safonov, I.V.: Automatic red-eye detection. In: International conference on the Computer Graphics and Vision (2007)
24.
Zurück zum Zitat Schildkraut, J. S., Gray, R. T.: A fully automatic redeye detection and correction algorithm. In: International Conference on Image Processing (2002) Schildkraut, J. S., Gray, R. T.: A fully automatic redeye detection and correction algorithm. In: International Conference on Image Processing (2002)
25.
Zurück zum Zitat Yang, M.-H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)CrossRef Yang, M.-H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)CrossRef
26.
Zurück zum Zitat Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 696–706 (2002)CrossRef Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 696–706 (2002)CrossRef
27.
Zurück zum Zitat Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef
28.
Zurück zum Zitat Hongliang, L., Ngan, K.N., Qiang, L.: Faceseg: automatic face segmentation for real-time video. IEEE Trans. Multimed. 11(1), 77–88 (2009)CrossRef Hongliang, L., Ngan, K.N., Qiang, L.: Faceseg: automatic face segmentation for real-time video. IEEE Trans. Multimed. 11(1), 77–88 (2009)CrossRef
29.
Zurück zum Zitat Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)CrossRef Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)CrossRef
30.
Zurück zum Zitat Corcoran, P., Bigioi, P., Steinberg, E., Pososin, A.: Automated in-camera detection of flash eye-defects. In: International Conference on Consumer Electronics (2005) Corcoran, P., Bigioi, P., Steinberg, E., Pososin, A.: Automated in-camera detection of flash eye-defects. In: International Conference on Consumer Electronics (2005)
31.
Zurück zum Zitat Safonov, I.V., Rychagova, M.N., Kang, K., Kim, S.H.: Automatic red eye correction and its quality metric. In: SPIE Electronic Imaging (2008) Safonov, I.V., Rychagova, M.N., Kang, K., Kim, S.H.: Automatic red eye correction and its quality metric. In: SPIE Electronic Imaging (2008)
32.
Zurück zum Zitat Marchesotti, L., Bressan, M., Csurka, G.: Safe red-eye correction plug-in using adaptive methods. In: International Conference on Image Analysis and Processing—Workshops (ICIAPW-07), pp. 192–165 (2007) Marchesotti, L., Bressan, M., Csurka, G.: Safe red-eye correction plug-in using adaptive methods. In: International Conference on Image Analysis and Processing—Workshops (ICIAPW-07), pp. 192–165 (2007)
33.
Zurück zum Zitat Hardeberg, J.Y.: Red eye removal using digital color image processing. Image Processing, Image Quality, Image Capture, System Conference, Montreal, Canada, pp. 283–287 (2001) Hardeberg, J.Y.: Red eye removal using digital color image processing. Image Processing, Image Quality, Image Capture, System Conference, Montreal, Canada, pp. 283–287 (2001)
34.
Zurück zum Zitat Yoo, S., Park, R.-H.: Red-eye detection and correction using inpainting in digital photographs. IEEE Trans. Consum. Electr. 55(3), 1006–1014 (2009)CrossRef Yoo, S., Park, R.-H.: Red-eye detection and correction using inpainting in digital photographs. IEEE Trans. Consum. Electr. 55(3), 1006–1014 (2009)CrossRef
35.
Zurück zum Zitat Miao, X.-P., Sim, T.: Automatic red-eye detection and removal. In: International Conference on Multimedia and Expo (2004) Miao, X.-P., Sim, T.: Automatic red-eye detection and removal. In: International Conference on Multimedia and Expo (2004)
36.
Zurück zum Zitat Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M. F., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 21(3), 673–678 (2004) Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M. F., Hoppe, H., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 21(3), 673–678 (2004)
37.
Zurück zum Zitat Saaty, T.L.: Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World, vol. 2. Analytic Hierarchy Process Series, New Edition (2001) Saaty, T.L.: Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World, vol. 2. Analytic Hierarchy Process Series, New Edition (2001)
38.
Zurück zum Zitat Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley-Interscience, Hoboken (2000) Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley-Interscience, Hoboken (2000)
39.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice Hall, Upper Saddle River (2008) Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice Hall, Upper Saddle River (2008)
40.
Zurück zum Zitat Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 32, 102–107 (2000) Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Ann. Stat. 32, 102–107 (2000)
41.
Zurück zum Zitat Schapire, R.E.: The boosting approach to machine learning: an overview. In: MSRI Workshop on Nonlinear Estimation and Classification (2001) Schapire, R.E.: The boosting approach to machine learning: an overview. In: MSRI Workshop on Nonlinear Estimation and Classification (2001)
42.
Zurück zum Zitat Schapire, R.E.: The strength of weak learnability. In: Machine Learning, pp. 197–227 (1990) Schapire, R.E.: The strength of weak learnability. In: Machine Learning, pp. 197–227 (1990)
43.
Zurück zum Zitat Lienhart, R., Kuranov, E., Pisarevsky, V.: Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: DAGM 25th Pattern Recognition Symposium, pp. 297–304 (2003) Lienhart, R., Kuranov, E., Pisarevsky, V.: Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: DAGM 25th Pattern Recognition Symposium, pp. 297–304 (2003)
44.
Zurück zum Zitat Torralba, A., Murphy, K.P.: Sharing visual features for multiclass and multiview object detection. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 854–869 (2007)CrossRef Torralba, A., Murphy, K.P.: Sharing visual features for multiclass and multiview object detection. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 854–869 (2007)CrossRef
Metadaten
Titel
A Cluster-Based Boosting Strategy for Red Eye Removal
verfasst von
Sebastiano Battiato
Giovanni Maria Farinella
Daniele Ravì
Mirko Guarnera
Giuseppe Messina
Copyright-Jahr
2013
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-30621-1_12