Skip to main content

2016 | OriginalPaper | Buchkapitel

A Software Platform for Manipulating the Camera Imaging Pipeline

verfasst von : Hakki Can Karaimer, Michael S. Brown

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There are a number of processing steps applied onboard a digital camera that collectively make up the camera imaging pipeline. Unfortunately, the imaging pipeline is typically embedded in a camera’s hardware making it difficult for researchers working on individual components to do so within the proper context of the full pipeline. This not only hinders research, it makes evaluating the effects from modifying an individual pipeline component on the final camera output challenging, if not impossible. This paper presents a new software platform that allows easy access to each stage of the camera imaging pipeline. The platform allows modification of the parameters for individual components as well as the ability to access and manipulate the intermediate images as they pass through different stages. We detail our platform design and demonstrate its usefulness on a number of examples.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adams, A., Talvala, E.V., Park, S.H., Jacobs, D.E., Ajdin, B., Gelfand, N., Dolson, J., Vaquero, D., Baek, J., Tico, M., et al.: The FrankenCamera: an experimental platform for computational photography. ACM Trans. Graph. 29(4), 29:1–29:12 (2010)CrossRef Adams, A., Talvala, E.V., Park, S.H., Jacobs, D.E., Ajdin, B., Gelfand, N., Dolson, J., Vaquero, D., Baek, J., Tico, M., et al.: The FrankenCamera: an experimental platform for computational photography. ACM Trans. Graph. 29(4), 29:1–29:12 (2010)CrossRef
4.
Zurück zum Zitat Baek, J., Pajak, D., Kim, K., Pulli, K., Levoy, M.: WYSIWYG computational photography via viewfinder editing. ACM Trans. Graph. 32(6), 198:1–198:10 (2013)CrossRef Baek, J., Pajak, D., Kim, K., Pulli, K., Levoy, M.: WYSIWYG computational photography via viewfinder editing. ACM Trans. Graph. 32(6), 198:1–198:10 (2013)CrossRef
5.
Zurück zum Zitat Bastani, P., Funt, B.: Simplifying irradiance independent color calibration. In: Color Imaging XIX: Displaying, Processing, Hardcopy, and Applications (2014) Bastani, P., Funt, B.: Simplifying irradiance independent color calibration. In: Color Imaging XIX: Displaying, Processing, Hardcopy, and Applications (2014)
6.
Zurück zum Zitat Bianco, S., Bruna, A., Naccari, F., Schettini, R.: Color space transformations for digital photography exploiting information about the illuminant estimation process. J. Opt. Soc. Am. A 29(3), 374–384 (2012)CrossRef Bianco, S., Bruna, A., Naccari, F., Schettini, R.: Color space transformations for digital photography exploiting information about the illuminant estimation process. J. Opt. Soc. Am. A 29(3), 374–384 (2012)CrossRef
7.
Zurück zum Zitat Bianco, S., Bruna, A.R., Naccari, F., Schettini, R.: Color correction pipeline optimization for digital cameras. J. Electron. Imaging 22(2), 023014:1–023014:10 (2013)CrossRef Bianco, S., Bruna, A.R., Naccari, F., Schettini, R.: Color correction pipeline optimization for digital cameras. J. Electron. Imaging 22(2), 023014:1–023014:10 (2013)CrossRef
8.
Zurück zum Zitat Buchsbaum, G.: A spatial processor model for object colour perception. J. Frankl. Inst. 310(1), 1–26 (1980)MathSciNetCrossRef Buchsbaum, G.: A spatial processor model for object colour perception. J. Frankl. Inst. 310(1), 1–26 (1980)MathSciNetCrossRef
9.
Zurück zum Zitat Chakrabarti, A., Hirakawa, K., Zickler, T.: Color constancy with spatio-spectral statistics. IEEE Trans. Pattern Anal. Mach. Intell. 34(8), 1509–1519 (2012)CrossRef Chakrabarti, A., Hirakawa, K., Zickler, T.: Color constancy with spatio-spectral statistics. IEEE Trans. Pattern Anal. Mach. Intell. 34(8), 1509–1519 (2012)CrossRef
10.
Zurück zum Zitat Chakrabarti, A., Scharstein, D., Zickler, T.: An empirical camera model for internet color vision. In: BMVC (2009) Chakrabarti, A., Scharstein, D., Zickler, T.: An empirical camera model for internet color vision. In: BMVC (2009)
11.
12.
Zurück zum Zitat Cheng, D., Price, B., Cohen, S., Brown, M.S.: Effective learning-based illuminant estimation using simple features. In: CVPR (2015) Cheng, D., Price, B., Cohen, S., Brown, M.S.: Effective learning-based illuminant estimation using simple features. In: CVPR (2015)
13.
Zurück zum Zitat Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRef Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRef
14.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River (2006) Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River (2006)
16.
Zurück zum Zitat Gunturk, B.K., Altunbasak, Y., Mersereau, R.M.: Color plane interpolation using alternating projections. IEEE Trans. Image Process. 11(9), 997–1013 (2002)CrossRef Gunturk, B.K., Altunbasak, Y., Mersereau, R.M.: Color plane interpolation using alternating projections. IEEE Trans. Image Process. 11(9), 997–1013 (2002)CrossRef
17.
Zurück zum Zitat Heide, F., Steinberger, M., Tsai, Y.T., Rouf, M., Pajak, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., Kautz, J., Pulli, K.: FlexISP: a flexible camera image processing framework. ACM Trans. Graph. 33(6), 231:1–231:13 (2014)CrossRef Heide, F., Steinberger, M., Tsai, Y.T., Rouf, M., Pajak, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., Kautz, J., Pulli, K.: FlexISP: a flexible camera image processing framework. ACM Trans. Graph. 33(6), 231:1–231:13 (2014)CrossRef
18.
Zurück zum Zitat Kim, S.J., Lin, H.T., Lu, Z., Susstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2289–2302 (2012)CrossRef Kim, S.J., Lin, H.T., Lu, Z., Susstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2289–2302 (2012)CrossRef
19.
Zurück zum Zitat Lin, H.T., Lu, Z., Kim, S.J., Brown, M.S.: Nonuniform lattice regression for modeling the camera imaging pipeline. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 556–568. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33718-5_40 Lin, H.T., Lu, Z., Kim, S.J., Brown, M.S.: Nonuniform lattice regression for modeling the camera imaging pipeline. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7572, pp. 556–568. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33718-5_​40
20.
Zurück zum Zitat Lin, H., Kim, S.J., Süsstrunk, S., Brown, M.S.: Revisiting radiometric calibration for color computer vision. In: ICCV (2011) Lin, H., Kim, S.J., Süsstrunk, S., Brown, M.S.: Revisiting radiometric calibration for color computer vision. In: ICCV (2011)
21.
Zurück zum Zitat Nam, S., Hwang, Y., Matsushita, Y., Kim, S.J.: A holistic approach to cross-channel image noise modeling and its application to image denoising. In: CVPR (2016) Nam, S., Hwang, Y., Matsushita, Y., Kim, S.J.: A holistic approach to cross-channel image noise modeling and its application to image denoising. In: CVPR (2016)
22.
Zurück zum Zitat Ramanath, R., Snyder, W.E., Yoo, Y., Drew, M.S.: Color image processing pipeline. IEEE Signal Process. Mag. 22(1), 34–43 (2005)CrossRef Ramanath, R., Snyder, W.E., Yoo, Y., Drew, M.S.: Color image processing pipeline. IEEE Signal Process. Mag. 22(1), 34–43 (2005)CrossRef
23.
Zurück zum Zitat Rowe, A., Goode, A., Goel, D., Nourbakhsh, I.: CMUcam3: an open programmable embedded vision sensor. Technical report CMU-RI-TR-07-13 (2007) Rowe, A., Goode, A., Goel, D., Nourbakhsh, I.: CMUcam3: an open programmable embedded vision sensor. Technical report CMU-RI-TR-07-13 (2007)
24.
Zurück zum Zitat Serrano, A., Heide, F., Gutierrez, D., Wetzstein, G., Masia, B.: Convolutional sparse coding for high dynamic range imaging. Comput. Graph. Forum 35(2), 153–163 (2016)CrossRef Serrano, A., Heide, F., Gutierrez, D., Wetzstein, G., Masia, B.: Convolutional sparse coding for high dynamic range imaging. Comput. Graph. Forum 35(2), 153–163 (2016)CrossRef
25.
Zurück zum Zitat Tai, Y.W., Chen, X., Kim, S., Kim, S.J., Li, F., Yang, J., Yu, J., Matsushita, Y., Brown, M.S.: Nonlinear camera response functions and image deblurring: theoretical analysis and practice. IEEE Trans. Pattern Anal. Mach. Intell. 35(10), 2498–2512 (2013)CrossRef Tai, Y.W., Chen, X., Kim, S., Kim, S.J., Li, F., Yang, J., Yu, J., Matsushita, Y., Brown, M.S.: Nonlinear camera response functions and image deblurring: theoretical analysis and practice. IEEE Trans. Pattern Anal. Mach. Intell. 35(10), 2498–2512 (2013)CrossRef
26.
Zurück zum Zitat van de Weijer, J., Gevers, T., Gijsenij, A.: Edge-based color constancy. IEEE Trans. Image Process. 16(9), 2207–2214 (2007)MathSciNetCrossRef van de Weijer, J., Gevers, T., Gijsenij, A.: Edge-based color constancy. IEEE Trans. Image Process. 16(9), 2207–2214 (2007)MathSciNetCrossRef
27.
Zurück zum Zitat Wong, T.S., Milanfar, P.: Turbo denoising for mobile photographic applications. In: ICIP (2016) Wong, T.S., Milanfar, P.: Turbo denoising for mobile photographic applications. In: ICIP (2016)
30.
Zurück zum Zitat Xiong, Y., Saenko, K., Darrell, T., Zickler, T.: From pixels to physics: probabilistic color de-rendering. In: CVPR (2012) Xiong, Y., Saenko, K., Darrell, T., Zickler, T.: From pixels to physics: probabilistic color de-rendering. In: CVPR (2012)
Metadaten
Titel
A Software Platform for Manipulating the Camera Imaging Pipeline
verfasst von
Hakki Can Karaimer
Michael S. Brown
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46448-0_26