Skip to main content
Top

2020 | OriginalPaper | Chapter

Surpassing Traditional Image-Colorization Problems with Conditional Generative Adversarial Networks

Authors : Vishnu Teja Yalakuntla, Rahul Kanojia, Kushagra Chauhan, Rohit Gurnani, Mukesh A. Zaveri

Published in: Emerging Trends in Electrical, Communications, and Information Technologies

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Color helps to understand the semantic information of the image more accurately and reveals a lot more details which grayscale images cannot. By looking at an image, humans can automatically segment different objects present in an image making it easier for us to color an image. We propose a completely automated system to colorize grayscale images which learns to segment and color images in a realistic manner. We leverage the recent advancements in deep learning, Generative Adversarial Networks and improved cost functions, to overcome the problems of traditional Convolutional Neural Networks with image colorization. Given the unconstrained nature of the problem, we propose this algorithm to make a colorization model that achieves realistic colorizations. We have experimented different deep network architectures with various training algorithms and cost functions to come up with this network where we can clearly see realistic colors for given gray scale image and differentiate the characteristics of generative adversarial network from a traditional convolutional neural network.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: Proceedings of international conference on learning representations Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: Proceedings of international conference on learning representations
2.
go back to reference Lisin DA, Mattar MA, Blaschko MB, Benfield MC, Learned-Mille EG (2005) Combining local and global image features for object class recognition. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), p 47. https://doi.org/10.1109/CVPR.2005.433 Lisin DA, Mattar MA, Blaschko MB, Benfield MC, Learned-Mille EG (2005) Combining local and global image features for object class recognition. In: IEEE computer society conference on computer vision and pattern recognition (CVPR), p 47. https://​doi.​org/​10.​1109/​CVPR.​2005.​433
3.
go back to reference Ng JY-H, Yang F, Davis LS (2015) Exploiting local features from deep networks for image retrieval. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW), pp 53–61 Ng JY-H, Yang F, Davis LS (2015) Exploiting local features from deep networks for image retrieval. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW), pp 53–61
4.
go back to reference Iizuka S, Simo-Serra E, Ishikawa H (2016) Let there be Color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans Graph (Proc SIGGRAPH 2016) 35(4)CrossRef Iizuka S, Simo-Serra E, Ishikawa H (2016) Let there be Color!: joint end-to-end learning of global and local image priors for automatic image colorization with simultaneous classification. ACM Trans Graph (Proc SIGGRAPH 2016) 35(4)CrossRef
5.
go back to reference Zhang R, Zhu J-Y, Isola P, Geng X, Lin AS, Yu T, Efros AA (2017) Real-time user-guided image colorization with learned deep priors. In: SIGGRAPH Zhang R, Zhu J-Y, Isola P, Geng X, Lin AS, Yu T, Efros AA (2017) Real-time user-guided image colorization with learned deep priors. In: SIGGRAPH
6.
go back to reference Charpiat G, Hofmann M, Schlkopf B (2008) Automatic image colorization via multimodal predictions. In: Forsyth D, Torr P, Zisserman A (eds) ECCV 2008, Part III. LNCS, vol 5304. Springer, Heidelberg, p 126139 Charpiat G, Hofmann M, Schlkopf B (2008) Automatic image colorization via multimodal predictions. In: Forsyth D, Torr P, Zisserman A (eds) ECCV 2008, Part III. LNCS, vol 5304. Springer, Heidelberg, p 126139
7.
go back to reference Chia AYS, Zhuo S, Gupta RK, Tai YW, Cho SY, Tan P, Lin S (2011) Semantic colorization with internet images. ACM Trans Graph (TOG) 30:6. ACMCrossRef Chia AYS, Zhuo S, Gupta RK, Tai YW, Cho SY, Tan P, Lin S (2011) Semantic colorization with internet images. ACM Trans Graph (TOG) 30:6. ACMCrossRef
8.
go back to reference Gupta RK, Chia AYS, Rajan D, Ng ES, Zhiyong H (2012) Image colorization using similar images. In: Proceedings of the 20th ACM international conference on multimedia. ACM Gupta RK, Chia AYS, Rajan D, Ng ES, Zhiyong H (2012) Image colorization using similar images. In: Proceedings of the 20th ACM international conference on multimedia. ACM
9.
go back to reference Irony R, Cohen-Or D, Lischinski D (2005) Colorization by example. In: Eurographics symposium on rendering Irony R, Cohen-Or D, Lischinski D (2005) Colorization by example. In: Eurographics symposium on rendering
10.
go back to reference Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. In: SIG-GRAPH Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. In: SIG-GRAPH
11.
go back to reference Sapiro G (2005) Inpainting the colors. In: IEEE international conference on image processing (ICIP). Genova Sapiro G (2005) Inpainting the colors. In: IEEE international conference on image processing (ICIP). Genova
12.
go back to reference Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680 Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
13.
go back to reference Wang X, Gupta A (2016) Generative image modeling using style and structure adversarial networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision ECCV 2016. Lecture notes in computer science, vol 9908. Springer, ChamCrossRef Wang X, Gupta A (2016) Generative image modeling using style and structure adversarial networks. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision ECCV 2016. Lecture notes in computer science, vol 9908. Springer, ChamCrossRef
15.
go back to reference Hariharan B, Arbelaez P, Girshick R (2015) Hypercolumns for object segmentation and fine-grained localization. In: Proceedings of conference on computer vision and pattern recognition (CVPR) Hariharan B, Arbelaez P, Girshick R (2015) Hypercolumns for object segmentation and fine-grained localization. In: Proceedings of conference on computer vision and pattern recognition (CVPR)
18.
go back to reference Nazeri K, Ng E, Ebrahimi M (2018) Image colorization with generative adversarial networks. In: Perales F, Kittler J (eds) Articulated motion and deformable objects. AMDO 2018. Lecture notes in computer science, vol 10945. Springer, Cham. arXiv:1803.05400 Nazeri K, Ng E, Ebrahimi M (2018) Image colorization with generative adversarial networks. In: Perales F, Kittler J (eds) Articulated motion and deformable objects. AMDO 2018. Lecture notes in computer science, vol 10945. Springer, Cham. arXiv:​1803.​05400
19.
go back to reference Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality, stability, and variation. In: Proceeedings of international conference on learning representations (ICLR). Vancouver Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality, stability, and variation. In: Proceeedings of international conference on learning representations (ICLR). Vancouver
Metadata
Title
Surpassing Traditional Image-Colorization Problems with Conditional Generative Adversarial Networks
Authors
Vishnu Teja Yalakuntla
Rahul Kanojia
Kushagra Chauhan
Rohit Gurnani
Mukesh A. Zaveri
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-8942-9_4