Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2007

01-08-2007 | Theoretical Advances

Joint estimation of motion and radiometry of rotating camera for HDR global mosaic

Authors: Dae-Woong Kim, Ki-Sang Hong

Published in: Pattern Analysis and Applications | Issue 3/2007

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we present a global approach for constructing high dynamic range mosaics from multiple images with large exposure differences. To minimize registration errors caused by intensity mismatches in the image intensity space with low dynamic range, we propose the use of a scene radiance space with high dynamic range. By relating image intensities to scene radiances with a convenient distortion model, we robustly estimate registration parameters for the high dynamic range global mosaic, simultaneously estimating scene radiances and distortion parameters in a single framework using a computationally optimized Levenberg–Marquardt approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kim DW, Hong KS (2006) High dynamic range global mosaic. In: Asian conference on computer vision, pp 744–753 Kim DW, Hong KS (2006) High dynamic range global mosaic. In: Asian conference on computer vision, pp 744–753
2.
go back to reference Szeliski R (1996) Video mosaics for virtual environments. IEEE Comput Graphics Appl 16:22–30CrossRef Szeliski R (1996) Video mosaics for virtual environments. IEEE Comput Graphics Appl 16:22–30CrossRef
3.
go back to reference Kumar R, Anandan P, Irani M, Bergen J, Hanna K (1995) Representation of scenes from collection of images. Workshop on representation of visual scenes Kumar R, Anandan P, Irani M, Bergen J, Hanna K (1995) Representation of scenes from collection of images. Workshop on representation of visual scenes
4.
go back to reference Xiong Y, Turkowski K (1998) Registration, calibration and blending in creating high quality panoramas. Workshop on applications of computer vision, pp 69–74 Xiong Y, Turkowski K (1998) Registration, calibration and blending in creating high quality panoramas. Workshop on applications of computer vision, pp 69–74
5.
go back to reference Kim DW, Hong KS (2003) Fast global registration for image mosaicing. Int Conf Image Process 2:14–17 Kim DW, Hong KS (2003) Fast global registration for image mosaicing. Int Conf Image Process 2:14–17
6.
go back to reference Davis J (1998) Mosaics of scenes with moving objects. In: International conference on computer vision and pattern recognition, pp 354–360 Davis J (1998) Mosaics of scenes with moving objects. In: International conference on computer vision and pattern recognition, pp 354–360
7.
go back to reference Sawhney HS, Kumar R, Gendel G, Bergen J, Dixon D, Paragano V (1998) Videobrush: experiences with consumer video mosaicing. Workshop on application of computer vision, pp 56–62 Sawhney HS, Kumar R, Gendel G, Bergen J, Dixon D, Paragano V (1998) Videobrush: experiences with consumer video mosaicing. Workshop on application of computer vision, pp 56–62
8.
go back to reference Sawhney HS, Hsu S, Kumar R (1998) Robust video mosaicing through topology inference and local to global alignment. In: European conference on computer vision, vol 2, pp 103–119 Sawhney HS, Hsu S, Kumar R (1998) Robust video mosaicing through topology inference and local to global alignment. In: European conference on computer vision, vol 2, pp 103–119
9.
go back to reference Nicolas H (2001) New methods for dynamic mosaicking. IEEE Trans Image Process 10:1239–1251MATHCrossRef Nicolas H (2001) New methods for dynamic mosaicking. IEEE Trans Image Process 10:1239–1251MATHCrossRef
10.
go back to reference Sawhney HS, Kumar R (1999) True multi-image alignment and its application to mosaicing and lens distortion correction. IEEE Trans Pattern Anal Mach Intell 21:235–243CrossRef Sawhney HS, Kumar R (1999) True multi-image alignment and its application to mosaicing and lens distortion correction. IEEE Trans Pattern Anal Mach Intell 21:235–243CrossRef
11.
go back to reference Kim HW, Hong KS (2000) Soccer video mosaicing using self-calibration and line tracking. In: International conference on pattern recognition, pp 592–596 Kim HW, Hong KS (2000) Soccer video mosaicing using self-calibration and line tracking. In: International conference on pattern recognition, pp 592–596
12.
go back to reference Shum H, Szeliski R (1998) Construction and refinement of panoramic mosaics with global and local alignment. In: International conference on computer vision, pp 953–958 Shum H, Szeliski R (1998) Construction and refinement of panoramic mosaics with global and local alignment. In: International conference on computer vision, pp 953–958
13.
go back to reference Kang EY, Cohen I, Medioni G (2000) A graph-based global registration for 2d mosaics. In: International conference on pattern recognition, pp 256–260 Kang EY, Cohen I, Medioni G (2000) A graph-based global registration for 2d mosaics. In: International conference on pattern recognition, pp 256–260
14.
go back to reference McLauchlan PF, Jaenickel A (2000) Image mosaicing using sequential bundle adjustment. Workshop on biologically motivated computer vision, pp 616–625 McLauchlan PF, Jaenickel A (2000) Image mosaicing using sequential bundle adjustment. Workshop on biologically motivated computer vision, pp 616–625
15.
go back to reference Brown M, Lowe DG (2003) Recognising panoramas. In: International conference on computer vision, vol 2, pp 1218–1225 Brown M, Lowe DG (2003) Recognising panoramas. In: International conference on computer vision, vol 2, pp 1218–1225
16.
go back to reference Mann S, Picard R (1995) Being undigital with digital cameras: extending dynamic range by combining differently exposed pictures. In: IS&T, Society for Imaging Science and Technology 46th Annual Conference, pp 422–428 Mann S, Picard R (1995) Being undigital with digital cameras: extending dynamic range by combining differently exposed pictures. In: IS&T, Society for Imaging Science and Technology 46th Annual Conference, pp 422–428
17.
go back to reference Debevec PE, Malik J (1997) Recovering high dynamic range radiance maps from photographs. In: Proceedings of ACM SIGGRAPH, pp 369–378 Debevec PE, Malik J (1997) Recovering high dynamic range radiance maps from photographs. In: Proceedings of ACM SIGGRAPH, pp 369–378
18.
go back to reference Mitsunaga T, Nayar SK (1999) Radiometric self calibration. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 374–380 Mitsunaga T, Nayar SK (1999) Radiometric self calibration. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 374–380
19.
go back to reference Mann S (2000) Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans Image Process 9:1389–1406MATHCrossRef Mann S (2000) Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans Image Process 9:1389–1406MATHCrossRef
20.
go back to reference Mann S (2001) Quantigraphic imaging: estimating the camera response and exposures from differently exposed images. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 842–849 Mann S (2001) Quantigraphic imaging: estimating the camera response and exposures from differently exposed images. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 1, pp 842–849
21.
go back to reference Tsin Y, Ramesh V, Kanade T (2001) Statistical calibration of ccd imaging process. In: IEEE international conference on computer vision, vol 1, pp 480–487 Tsin Y, Ramesh V, Kanade T (2001) Statistical calibration of ccd imaging process. In: IEEE international conference on computer vision, vol 1, pp 480–487
22.
go back to reference Robertson MA, Borman S, Stevenson RL (2003) Estimation-theoretic approach to dynamic range enhancement using multiple exposures. J Electron Imaging 12:219–228CrossRef Robertson MA, Borman S, Stevenson RL (2003) Estimation-theoretic approach to dynamic range enhancement using multiple exposures. J Electron Imaging 12:219–228CrossRef
23.
go back to reference Grossberg MD, Nayar SK (2004) Modeling the space of camera response functions. IEEE Trans Pattern Anal Mach Intell 26:1272–1282CrossRef Grossberg MD, Nayar SK (2004) Modeling the space of camera response functions. IEEE Trans Pattern Anal Mach Intell 26:1272–1282CrossRef
24.
go back to reference Pal C, Szeliski R, Uyttendaele M, Jojic N (2004) Probability models for high dynamic range imaging. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 173–180 Pal C, Szeliski R, Uyttendaele M, Jojic N (2004) Probability models for high dynamic range imaging. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 173–180
25.
go back to reference Aggarwal M, Ahuja N (2001) High dynamic range panoramic imaging. In: IEEE international conference on computer vision, vol 1, pp 2–9 Aggarwal M, Ahuja N (2001) High dynamic range panoramic imaging. In: IEEE international conference on computer vision, vol 1, pp 2–9
26.
go back to reference Schechner YY, Nayar SK (2003) Generalized mosaicing: high dynamic range in a wide field of view. Int J Comput Vis 53:245–267CrossRef Schechner YY, Nayar SK (2003) Generalized mosaicing: high dynamic range in a wide field of view. Int J Comput Vis 53:245–267CrossRef
27.
go back to reference Grossberg MD, Nayar SK (2002) What can be known about the radiometric response from images? In: European conference on computer vision, vol 2353, pp 189–205 Grossberg MD, Nayar SK (2002) What can be known about the radiometric response from images? In: European conference on computer vision, vol 2353, pp 189–205
28.
go back to reference Ward G (2003) Fast, robust image registration for compsiting hight dynamic range photogrphs from hand-held exposures. J Graphics Tools, pp 17–33 Ward G (2003) Fast, robust image registration for compsiting hight dynamic range photogrphs from hand-held exposures. J Graphics Tools, pp 17–33
29.
go back to reference Hasler D, Süsstrunk S (2004) Mapping colour in image stitching applications. J Vis Commun Image Rep 15:65–90CrossRef Hasler D, Süsstrunk S (2004) Mapping colour in image stitching applications. J Vis Commun Image Rep 15:65–90CrossRef
30.
go back to reference Litvinov A, Schechner YY (2005) Addressing radiometric nonidealities: a unified framework. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 52–59 Litvinov A, Schechner YY (2005) Addressing radiometric nonidealities: a unified framework. In: IEEE Computer Society conference on computer vision and pattern recognition, vol 2, pp 52–59
31.
go back to reference Candocia FM (2002) A least squares approach for the joint domain and range registration of images. In: IEEE internaltional conference on acoustics, speech, and signal processing, vol 4, pp 3237–3240 Candocia FM (2002) A least squares approach for the joint domain and range registration of images. In: IEEE internaltional conference on acoustics, speech, and signal processing, vol 4, pp 3237–3240
32.
go back to reference Horn BKP (1958) Robot vision. MIT Press, Cambridge Horn BKP (1958) Robot vision. MIT Press, Cambridge
33.
go back to reference Tordoff B, Murray D (2000) Violating rotating camera geometry: the effect of radial distortion on self-calibration. In: International conference on pattern recognition, vol 1, pp 423–427 Tordoff B, Murray D (2000) Violating rotating camera geometry: the effect of radial distortion on self-calibration. In: International conference on pattern recognition, vol 1, pp 423–427
34.
go back to reference Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA (1986) Robust statistics: the approach based on influence function. Wiley, New YorkMATH Hampel FR, Ronchetti EM, Rousseeuw PJ, Stahel WA (1986) Robust statistics: the approach based on influence function. Wiley, New YorkMATH
35.
go back to reference Meer P, Mintz D, Rosenfeld A, Kim DY (1991) Robust regression methods for computer vision: a review. Int J Comput Vis 6:57–70CrossRef Meer P, Mintz D, Rosenfeld A, Kim DY (1991) Robust regression methods for computer vision: a review. Int J Comput Vis 6:57–70CrossRef
36.
go back to reference Black MJ, Rangarajan A (1996) On the unification of line process, outlier rejection, and robust statistics with applications in early vision. Int J Comput Vis 19(1):57–91CrossRef Black MJ, Rangarajan A (1996) On the unification of line process, outlier rejection, and robust statistics with applications in early vision. Int J Comput Vis 19(1):57–91CrossRef
37.
go back to reference Black MJ, Sapiro G, Marimont DH, Heeger D (1998) Robust anisotropic diffusion. IEEE Trans Image Process 7(3):421–432CrossRef Black MJ, Sapiro G, Marimont DH, Heeger D (1998) Robust anisotropic diffusion. IEEE Trans Image Process 7(3):421–432CrossRef
38.
go back to reference de Agapito L, Hayman E, Reid I (2001) Self-calibration of rotating and zooming cameras. Int J Comput Vis 42:107–127CrossRef de Agapito L, Hayman E, Reid I (2001) Self-calibration of rotating and zooming cameras. Int J Comput Vis 42:107–127CrossRef
39.
go back to reference Fletcher P (1987) Practical methods of optimization. Wiley, New YorkMATH Fletcher P (1987) Practical methods of optimization. Wiley, New YorkMATH
40.
go back to reference Reddy BS, Chatterji BN (1996) An fft-based technique for translation, rotation, and scale-invariant image registration. IEEE Trans Image Process 5:1266–1271CrossRef Reddy BS, Chatterji BN (1996) An fft-based technique for translation, rotation, and scale-invariant image registration. IEEE Trans Image Process 5:1266–1271CrossRef
41.
go back to reference Fattal R, Lischinski D, Werman M (2002) Gradient domain high dynamic range compression. In: Proceedings of ACM SIGGRAPH, vol 21, pp 249–256 Fattal R, Lischinski D, Werman M (2002) Gradient domain high dynamic range compression. In: Proceedings of ACM SIGGRAPH, vol 21, pp 249–256
42.
go back to reference Reinhard E, Stark M, Shirley P, Ferwerda J (2002) Photographic tone reproduction for digital images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 267–276 Reinhard E, Stark M, Shirley P, Ferwerda J (2002) Photographic tone reproduction for digital images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 267–276
43.
go back to reference Durand F, Dorsey J (2002) Fast bilateral filtering for the display of high-dynamic-range images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 257–266 Durand F, Dorsey J (2002) Fast bilateral filtering for the display of high-dynamic-range images. In: Proceedings of ACM SIGGRAPH, vol 21, pp 257–266
44.
go back to reference Meylan L, Süsstrunk S (2006) High dynamic range image rendering using a retinex-based adaptive filter. IEEE Trans Image Process 15:2820–2830CrossRef Meylan L, Süsstrunk S (2006) High dynamic range image rendering using a retinex-based adaptive filter. IEEE Trans Image Process 15:2820–2830CrossRef
45.
go back to reference Li Y, Sharan L, Adelson EH (2005) Compressing and companding high dynamic range images with subband architectures. In: Proceedings of ACM SIGGRAPH, vol 24, pp 836–844 Li Y, Sharan L, Adelson EH (2005) Compressing and companding high dynamic range images with subband architectures. In: Proceedings of ACM SIGGRAPH, vol 24, pp 836–844
Metadata
Title
Joint estimation of motion and radiometry of rotating camera for HDR global mosaic
Authors
Dae-Woong Kim
Ki-Sang Hong
Publication date
01-08-2007
Publisher
Springer-Verlag
Published in
Pattern Analysis and Applications / Issue 3/2007
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-007-0063-0

Other articles of this Issue 3/2007

Pattern Analysis and Applications 3/2007 Go to the issue

Premium Partner