Skip to main content
Top

2018 | OriginalPaper | Chapter

RGBN Multispectral Images: A Novel Color Restoration Approach

Authors : Cristhian Aguilera, Xavier Soria, Angel D. Sappa, Ricardo Toledo

Published in: Trends in Cyber-Physical Multi-Agent Systems. The PAAMS Collection - 15th International Conference, PAAMS 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper describes a color restoration technique used to remove NIR information from single sensor cameras where color and near-infrared images are simultaneously acquired—referred to in the literature as RGBN images. The proposed approach is based on a neural network architecture that learns the NIR information contained in the RGBN images. The proposed approach is evaluated on real images obtained by using a pair of RGBN cameras. Additionally, qualitative comparisons with a naïve color correction technique based on mean square error minimization are provided.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Demosaicking refers to obtaining the {R,G,B,NIR} components from a given pixel, where all the information is attached together is a single square array {B,G} in top and {IR,R} from the bottom, see an illustration of this pixel composition in Fig. 2.
 
Literature
1.
go back to reference Salamati, N., Fredembach, C., Süsstrunk, S.: Material classification using color and NIR images. In: Color and Imaging Conference, Society for Imaging Science and Technology, vol. 2009, pp. 216–222 (2009) Salamati, N., Fredembach, C., Süsstrunk, S.: Material classification using color and NIR images. In: Color and Imaging Conference, Society for Imaging Science and Technology, vol. 2009, pp. 216–222 (2009)
2.
go back to reference Ricaurte, P., Chilán, C., Aguilera-Carrasco, C.A., Vintimilla, B.X., Sappa, A.D.: Feature point descriptors: infrared and visible spectra. Sensors 14, 3690–3701 (2014)CrossRef Ricaurte, P., Chilán, C., Aguilera-Carrasco, C.A., Vintimilla, B.X., Sappa, A.D.: Feature point descriptors: infrared and visible spectra. Sensors 14, 3690–3701 (2014)CrossRef
3.
go back to reference Barrera, F., Lumbreras, F., Sappa, A.D.: Evaluation of similarity functions in multimodal stereo. In: International Conference Image Analysis and Recognition, pp. 320–329, Springer (2012) Barrera, F., Lumbreras, F., Sappa, A.D.: Evaluation of similarity functions in multimodal stereo. In: International Conference Image Analysis and Recognition, pp. 320–329, Springer (2012)
4.
go back to reference Mouats, T., Aouf, N., Sappa, A.D., Aguilera, C., Toledo, R.: Multispectral stereo odometry. IEEE Trans. Intell. Trans. Syst. 16, 1210–1224 (2015)CrossRef Mouats, T., Aouf, N., Sappa, A.D., Aguilera, C., Toledo, R.: Multispectral stereo odometry. IEEE Trans. Intell. Trans. Syst. 16, 1210–1224 (2015)CrossRef
5.
go back to reference Mountrakis, G., Im, J., Ogole, C.: Support vector machines in remote sensing: a review. ISPRS J. Photogrammetry Remote Sens. 66, 247–259 (2011)CrossRef Mountrakis, G., Im, J., Ogole, C.: Support vector machines in remote sensing: a review. ISPRS J. Photogrammetry Remote Sens. 66, 247–259 (2011)CrossRef
6.
go back to reference Adam, E., Mutanga, O., Rugege, D.: Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: a review. Wetlands Ecol. Manag. 18, 281–296 (2010)CrossRef Adam, E., Mutanga, O., Rugege, D.: Multispectral and hyperspectral remote sensing for identification and mapping of wetland vegetation: a review. Wetlands Ecol. Manag. 18, 281–296 (2010)CrossRef
7.
go back to reference Barnard, K., Cardei, V., Funt, B.: A comparison of computational color constancy algorithms. I: methodology and experiments with synthesized data. IEEE Trans. Image Process. 11, 972–984 (2002)CrossRef Barnard, K., Cardei, V., Funt, B.: A comparison of computational color constancy algorithms. I: methodology and experiments with synthesized data. IEEE Trans. Image Process. 11, 972–984 (2002)CrossRef
8.
go back to reference Chen, Z., Zhu, N., Pacheco, S., Wang, X., Liang, R.: Single camera imaging system for color and near-infrared fluorescence image guided surgery. Biomed. Opt. Express 5, 2791–2797 (2014)CrossRef Chen, Z., Zhu, N., Pacheco, S., Wang, X., Liang, R.: Single camera imaging system for color and near-infrared fluorescence image guided surgery. Biomed. Opt. Express 5, 2791–2797 (2014)CrossRef
9.
go back to reference Chen, Z., Wang, X., Liang, R.: RGB-NIR multispectral camera. Opt. Express 22, 4985–4994 (2014)CrossRef Chen, Z., Wang, X., Liang, R.: RGB-NIR multispectral camera. Opt. Express 22, 4985–4994 (2014)CrossRef
10.
go back to reference Martinello, M., Wajs, A., Quan, S., Lee, H., Lim, C., Woo, T., Lee, W., Kim, S.S., Lee, D.: Dual aperture photography: image and depth from a mobile camera. In: 2015 IEEE International Conference on Computational Photography (ICCP), pp. 1–10 (2015) Martinello, M., Wajs, A., Quan, S., Lee, H., Lim, C., Woo, T., Lee, W., Kim, S.S., Lee, D.: Dual aperture photography: image and depth from a mobile camera. In: 2015 IEEE International Conference on Computational Photography (ICCP), pp. 1–10 (2015)
11.
go back to reference Park, C.H., Oh, H.M., Kang, M.G.: Color restoration for infrared cutoff filter removed RGBN multispectral filter array image sensor. In: VISAPP, (1), pp. 30–37 (2015) Park, C.H., Oh, H.M., Kang, M.G.: Color restoration for infrared cutoff filter removed RGBN multispectral filter array image sensor. In: VISAPP, (1), pp. 30–37 (2015)
12.
go back to reference Park, C., Kang, M.G.: Color restoration of rgbn multispectral filter array sensor images based on spectral decomposition. Sensors 16, 719 (2016)CrossRef Park, C., Kang, M.G.: Color restoration of rgbn multispectral filter array sensor images based on spectral decomposition. Sensors 16, 719 (2016)CrossRef
13.
go back to reference Teranaka, H., Monno, Y., Tanaka, M., Ok, M.: Single-sensor RGB and NIR image acquisition: toward optimal performance by taking account of CFA pattern, demosaicking, and color correction. Electronic Imaging 2016, pp. 1–6 (2016) Teranaka, H., Monno, Y., Tanaka, M., Ok, M.: Single-sensor RGB and NIR image acquisition: toward optimal performance by taking account of CFA pattern, demosaicking, and color correction. Electronic Imaging 2016, pp. 1–6 (2016)
Metadata
Title
RGBN Multispectral Images: A Novel Color Restoration Approach
Authors
Cristhian Aguilera
Xavier Soria
Angel D. Sappa
Ricardo Toledo
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-61578-3_15

Premium Partner