Skip to main content

2015 | OriginalPaper | Buchkapitel

12. Overview of Grayscale Image Colorization Techniques

verfasst von : Adam Popowicz, Bogdan Smolka

Erschienen in: Color Image and Video Enhancement

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Colorization is the process of adding color information to grayscale images. This operation may be performed in various ways. The colorization may be automatic, without the user’s effort, however, the semi-automatic methods are usually more flexible and useful. In this chapter, we start with a literature overview, where we enumerate and shortly characterize numerous state-of-the-art methods. Then, we present the details of one fully automatic and three semi-automatic techniques. We also show exemplary algorithms outcomes for several colorization applications such as medicine or astronomy. Finally, we present the methodology of assessing the results of the colorization algorithms. We describe the three most important quality measures and we evaluate their usefulness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bezrukov, I., Charpiat, G., Hofmann, M.: Computational photography methods and applications. Machine learning methods for automatic image colorization. Boca Raton: CRC Press (2010) Bezrukov, I., Charpiat, G., Hofmann, M.: Computational photography methods and applications. Machine learning methods for automatic image colorization. Boca Raton: CRC Press (2010)
2.
Zurück zum Zitat Chen, T., Wang, Y., Schillings, V., Meinel, Ch.: Grayscale image matting and colorization. In: Proceedings of Asian Conference on Computer Vision (ACCV 2004), pp.1164–1169 (2004) Chen, T., Wang, Y., Schillings, V., Meinel, Ch.: Grayscale image matting and colorization. In: Proceedings of Asian Conference on Computer Vision (ACCV 2004), pp.1164–1169 (2004)
4.
Zurück zum Zitat Ding, X., Xu, Y., Deng, L., Yang, X. Colorization using quaternion algebra with automatic scribble generation. In: Proceedings of the 18th International Conference on Advances in Multimedia Modeling, MMM’12, pp.103–114. Springer-Verlag, Berlin (2012) Ding, X., Xu, Y., Deng, L., Yang, X. Colorization using quaternion algebra with automatic scribble generation. In: Proceedings of the 18th International Conference on Advances in Multimedia Modeling, MMM’12, pp.103–114. Springer-Verlag, Berlin (2012)
5.
Zurück zum Zitat Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vision 59(2):167–181 (2004)CrossRef Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vision 59(2):167–181 (2004)CrossRef
6.
Zurück zum Zitat Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp.327–340. ACM, New York (2001)CrossRef Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp.327–340. ACM, New York (2001)CrossRef
7.
Zurück zum Zitat Horiuchi, T.: Estimation of color for gray-level image by probabilistic relaxation. In: Proceedings of the 16th International Conference on Pattern Recognition, 2002., vol.3, pp.867–870 (2002) Horiuchi, T.: Estimation of color for gray-level image by probabilistic relaxation. In: Proceedings of the 16th International Conference on Pattern Recognition, 2002., vol.3, pp.867–870 (2002)
8.
Zurück zum Zitat Horiuchi, T., Hirano, S.: Colorization algorithm for grayscale image by propagating seed pixels. In: Proceedings of International Conference on Image Processing, 2003. ICIP 2003., vol.1, pp.I–457–60 (Sept 2003) Horiuchi, T., Hirano, S.: Colorization algorithm for grayscale image by propagating seed pixels. In: Proceedings of International Conference on Image Processing, 2003. ICIP 2003., vol.1, pp.I–457–60 (Sept 2003)
9.
Zurück zum Zitat Irony, R., Cohen-Or, D., Lischinski, D.: Colorization by example. In: Proceedings of the Sixteenth Eurographics Conference on Rendering Techniques, EGSR ’05, pp.201–210. Eurographics Association, Aire-la-Ville (2005) Irony, R., Cohen-Or, D., Lischinski, D.: Colorization by example. In: Proceedings of the Sixteenth Eurographics Conference on Rendering Techniques, EGSR ’05, pp.201–210. Eurographics Association, Aire-la-Ville (2005)
10.
Zurück zum Zitat Jacob, V.G., Gupta, S.: Colorization of grayscale images and videos using a semiautomatic approach. In: Proceedings of the 16th IEEE International Conference on Image Processing, ICIP’09, pp.1653–1656. IEEE Press, Piscataway (2009) Jacob, V.G., Gupta, S.: Colorization of grayscale images and videos using a semiautomatic approach. In: Proceedings of the 16th IEEE International Conference on Image Processing, ICIP’09, pp.1653–1656. IEEE Press, Piscataway (2009)
11.
Zurück zum Zitat Kawulok, M., Kawulok, J., Smolka, B.: Discriminative textural features for image and video colorization. IEICE Trans. Inf. Syst. 95, 1722–1730 (2012)CrossRef Kawulok, M., Kawulok, J., Smolka, B.: Discriminative textural features for image and video colorization. IEICE Trans. Inf. Syst. 95, 1722–1730 (2012)CrossRef
12.
Zurück zum Zitat Kawulok, M., Smolka, B.: Competitive image colorization. In: 17th IEEE International Conference on Image Processing (ICIP 2010), pp.405–408 (Sept 2010) Kawulok, M., Smolka, B.: Competitive image colorization. In: 17th IEEE International Conference on Image Processing (ICIP 2010), pp.405–408 (Sept 2010)
13.
Zurück zum Zitat Kawulok, M., Smolka, B.: Texture-adaptive image colorization framework. EURASIP J. Adv. Sig. Proc. 2011, 99 (2011) Kawulok, M., Smolka, B.: Texture-adaptive image colorization framework. EURASIP J. Adv. Sig. Proc. 2011, 99 (2011)
14.
Zurück zum Zitat Kim, T.H., Lee, K.M., Lee, S.U.: Edge-preserving colorization using data-driven random walks with restart. In: 16th IEEE International Conference on Image Processing (ICIP 2009), pp.1661–1664 (Nov 2009) Kim, T.H., Lee, K.M., Lee, S.U.: Edge-preserving colorization using data-driven random walks with restart. In: 16th IEEE International Conference on Image Processing (ICIP 2009), pp.1661–1664 (Nov 2009)
15.
Zurück zum Zitat Konushin, V., Vezhnevets, V.: Interactive image colorization and recoloring based on coupled map lattices. In: GraphiCon, pp.231–234 (2006) Konushin, V., Vezhnevets, V.: Interactive image colorization and recoloring based on coupled map lattices. In: GraphiCon, pp.231–234 (2006)
16.
Zurück zum Zitat Lagodzinski, P., Smolka, B.: Application of the extended distance transformation in digital image colorization. Multimed. Tool Appl. 69(1), 111–137 (2014) Lagodzinski, P., Smolka, B.: Application of the extended distance transformation in digital image colorization. Multimed. Tool Appl. 69(1), 111–137 (2014)
17.
Zurück zum Zitat Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. 23(3), 689–694 (Aug 2004)CrossRef Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. 23(3), 689–694 (Aug 2004)CrossRef
18.
Zurück zum Zitat Lezoray, O., Ta, V.T., Elmoataz, A.: Nonlocal graph regularization for image colorization. In: 19th International Conference on Pattern Recognition (ICPR 2008), pp.1–4 (Dec 2008) Lezoray, O., Ta, V.T., Elmoataz, A.: Nonlocal graph regularization for image colorization. In: 19th International Conference on Pattern Recognition (ICPR 2008), pp.1–4 (Dec 2008)
19.
Zurück zum Zitat Lipowezky, U.: Grayscale aerial and space image colorization using texture classification. Pattern Recognit. Lett. 27(4), 275–286 (2006)CrossRef Lipowezky, U.: Grayscale aerial and space image colorization using texture classification. Pattern Recognit. Lett. 27(4), 275–286 (2006)CrossRef
20.
Zurück zum Zitat Liu, X., Liu, J., Feng, Z.: Colorization using segmentation with random walk. In: Jiang, X., Petkov, N. (eds.) Computer analysis of images and patterns, volume 5702 of Lecture Notes in Computer Science, pp.468–475. Springer, Berlin (2009) Liu, X., Liu, J., Feng, Z.: Colorization using segmentation with random walk. In: Jiang, X., Petkov, N. (eds.) Computer analysis of images and patterns, volume 5702 of Lecture Notes in Computer Science, pp.468–475. Springer, Berlin (2009)
21.
Zurück zum Zitat Luan, Q., Wen, F., Cohen-Or, D., Liang, L., Xu, Y.Q., Shum, H.Y.: Natural image colorization. In: Proceedings of the 18th Eurographics Conference on Rendering Techniques, EGSR’07, pp.309–320, Aire-la-Ville, Switzerland, Switzerland (2007) Luan, Q., Wen, F., Cohen-Or, D., Liang, L., Xu, Y.Q., Shum, H.Y.: Natural image colorization. In: Proceedings of the 18th Eurographics Conference on Rendering Techniques, EGSR’07, pp.309–320, Aire-la-Ville, Switzerland, Switzerland (2007)
22.
Zurück zum Zitat Lukac, R., Smolka, B., Martin, K., Plataniotis, K. N., Venetsanopoulos, A.N.: Vector filtering for color imaging. Sign. Process. Mag., IEEE, 22(1), 74–86 (Jan 2005) Lukac, R., Smolka, B., Martin, K., Plataniotis, K. N., Venetsanopoulos, A.N.: Vector filtering for color imaging. Sign. Process. Mag., IEEE, 22(1), 74–86 (Jan 2005)
23.
Zurück zum Zitat Plataniotis, K.N., Venetsanopoulos, A.N.: Color Image Processing and Applications. Springer-Verlag, Berlin (2000)CrossRef Plataniotis, K.N., Venetsanopoulos, A.N.: Color Image Processing and Applications. Springer-Verlag, Berlin (2000)CrossRef
24.
Zurück zum Zitat Popowicz, A., Smolka, B.: Isoline based image colorization. In: Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation, UKSIM ’14, pp.280–285. IEEE Computer Society, Washington, DC (2014) Popowicz, A., Smolka, B.: Isoline based image colorization. In: Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation, UKSIM ’14, pp.280–285. IEEE Computer Society, Washington, DC (2014)
25.
Zurück zum Zitat Qu, Y., Wong, T.T., Heng, P.A.: Manga colorization. ACM Trans. Graph. 25(3), 1214–1220 (July 2006)CrossRef Qu, Y., Wong, T.T., Heng, P.A.: Manga colorization. ACM Trans. Graph. 25(3), 1214–1220 (July 2006)CrossRef
26.
Zurück zum Zitat Rao Veeravasarapu, V.S., Sivaswamy, J.: Fast and fully automated video colorization. In: International Conference on Signal Processing and Communications (SPCOM 2012), pp.1–5 (July 2012) Rao Veeravasarapu, V.S., Sivaswamy, J.: Fast and fully automated video colorization. In: International Conference on Signal Processing and Communications (SPCOM 2012), pp.1–5 (July 2012)
27.
Zurück zum Zitat Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. Comput. Gr. Appl., IEEE 21(5), 34–41 (Sep 2001) Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. Comput. Gr. Appl., IEEE 21(5), 34–41 (Sep 2001)
28.
29.
Zurück zum Zitat Ruderman, D.L., Cronin, T.W., Chiao, C.C.: Statistics of cone responses to natural images: Implications for visual coding. J. Opt. Soc. Am. A 15, 2036–2045 (1998)CrossRef Ruderman, D.L., Cronin, T.W., Chiao, C.C.: Statistics of cone responses to natural images: Implications for visual coding. J. Opt. Soc. Am. A 15, 2036–2045 (1998)CrossRef
30.
Zurück zum Zitat Russo, F.: Performance evaluation of noise reduction filters for color images through normalized color difference (NCD) decomposition. ISRN Machine Vision (2014) Russo, F.: Performance evaluation of noise reduction filters for color images through normalized color difference (NCD) decomposition. ISRN Machine Vision (2014)
31.
Zurück zum Zitat Sapiro, G.: Inpainting the colors. In: IEEE International Conference on Image Processing, (ICIP 2005), vol.2, pp.II–698–701 (Sept 2005) Sapiro, G.: Inpainting the colors. In: IEEE International Conference on Image Processing, (ICIP 2005), vol.2, pp.II–698–701 (Sept 2005)
32.
Zurück zum Zitat Shah, A., Gandhi, M., Shah, K.: Medical image colorization using optimization technique. Int. J. Sci. Res. Publ. 3(3), 1–6 (2013) Shah, A., Gandhi, M., Shah, K.: Medical image colorization using optimization technique. Int. J. Sci. Res. Publ. 3(3), 1–6 (2013)
33.
Zurück zum Zitat Sýkora, D., Buriánek, J., Žára, J.: Unsupervised colorization of black-and-white cartoons. In: Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, NPAR ’04, pp.121–127. ACM, New York (2004)CrossRef Sýkora, D., Buriánek, J., Žára, J.: Unsupervised colorization of black-and-white cartoons. In: Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, NPAR ’04, pp.121–127. ACM, New York (2004)CrossRef
34.
Zurück zum Zitat Wang, Z.B., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Imag. Process. 13(4), 600–612 (April 2004)CrossRef Wang, Z.B., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Imag. Process. 13(4), 600–612 (April 2004)CrossRef
35.
Zurück zum Zitat Wei-Qi, Y., Kankanhalli, M.S.: Colorizing infrared home videos. In: Proceedings of International Conference on Multimedia and Expo, (ICME 2003), vol.1, pp.I–97–100 (July 2003) Wei-Qi, Y., Kankanhalli, M.S.: Colorizing infrared home videos. In: Proceedings of International Conference on Multimedia and Expo, (ICME 2003), vol.1, pp.I–97–100 (July 2003)
36.
Zurück zum Zitat Welsh, T., Ashikhmin, M., Mueller, K.: Transferring color to greyscale images. ACM Trans. Graph. 21(3), 277–280 (July 2002)CrossRef Welsh, T., Ashikhmin, M., Mueller, K.: Transferring color to greyscale images. ACM Trans. Graph. 21(3), 277–280 (July 2002)CrossRef
37.
Zurück zum Zitat Xiang, Y., Zou, B., Li, H.: Selective color transfer with multi-source images. Pattern Recognit. Lett. 30(7), 682–689 (2009)CrossRef Xiang, Y., Zou, B., Li, H.: Selective color transfer with multi-source images. Pattern Recognit. Lett. 30(7), 682–689 (2009)CrossRef
38.
Zurück zum Zitat Yatziv, L., Sapiro, G.: Fast image and video colorization using chrominance blending. IEEE Trans. Imag. Process. 15(5), 1120–1129 (May 2006)CrossRef Yatziv, L., Sapiro, G.: Fast image and video colorization using chrominance blending. IEEE Trans. Imag. Process. 15(5), 1120–1129 (May 2006)CrossRef
39.
Zurück zum Zitat Zhang, Z., Cui, H., Lu, H., Chen, R., Yan, Y.: A colorization method based on fuzzy clustering and distance transformation. In: 2nd International Congress on Image and Signal Processing 2009 (CISP 2009), pp.1–5 (Oct 2009) Zhang, Z., Cui, H., Lu, H., Chen, R., Yan, Y.: A colorization method based on fuzzy clustering and distance transformation. In: 2nd International Congress on Image and Signal Processing 2009 (CISP 2009), pp.1–5 (Oct 2009)
40.
Zurück zum Zitat Zhao, Y., Wang, L., Jin, W., Shi, S.: Colorizing biomedical images based on color transfer. In: International Conference on Complex Medical Engineering (CME 2007), pp.820–823 (May 2007) Zhao, Y., Wang, L., Jin, W., Shi, S.: Colorizing biomedical images based on color transfer. In: International Conference on Complex Medical Engineering (CME 2007), pp.820–823 (May 2007)
41.
Zurück zum Zitat Zhen, Z., Yan, G., Lizhuang, M.: An automatic image and video colorization algorithm based on pattern continuity. In: International Conference on Audio, Language and Image Processing (ICALIP 2012), pp.531–536 (July 2012) Zhen, Z., Yan, G., Lizhuang, M.: An automatic image and video colorization algorithm based on pattern continuity. In: International Conference on Audio, Language and Image Processing (ICALIP 2012), pp.531–536 (July 2012)
Metadaten
Titel
Overview of Grayscale Image Colorization Techniques
verfasst von
Adam Popowicz
Bogdan Smolka
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-09363-5_12