Top

Published in:

2018 | OriginalPaper | Chapter

Large Parallax Image Stitching Using an Edge-Preserving Diffeomorphic Warping Process

Authors : Geethu Miriam Jacob, Sukhendu Das

Published in: Advanced Concepts for Intelligent Vision Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Image Stitching is a hard task to solve in the presence of large parallax in video frames. In many cases, video frames shot using hand-held cameras have low resolution, blur and large parallax errors. Most recent works fail to align such a sequence of images accurately. The proposed method aims to accurately align image frames, by employing a novel demon-based, edge-preserving diffeomorphic registration for image stitching, termed as “DiffeoWarps”. The first stage aligns the images globally using a mesh-based perspective (homography) transformation. At the second stage, an alternating method of minimization of correspondence energy and TV-regularization improves the alignment. The “diffeowarped” images are then blended to obtain good quality stitched results. We experimented on two standard datasets as well as on a dataset comprising of 10 sets of images/frames collected from unconstrained videos. Both qualitative and quantitative performance analysis show the superiority of our proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Reconfigurable FPGA Implementation of the AVC Quantiser and De-quantiser Blocks

next chapter A Wavelet Based Image Fusion Method Using Local Multiscale Image Regularity

Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)CrossRef

Burt, P.J., Adelson, E.H.: A multiresolution spline with application to image mosaics. ACM Trans. Graph. (TOG) 2(4), 217–236 (1983)CrossRef

Cachier, P., Bardinet, E., Dormont, D., Pennec, X., Ayache, N.: Iconic feature based nonrigid registration: the PASHA algorithm. Comput. Vis. Image Underst. 89(2), 272–298 (2003)CrossRefMATH

Chang, C.H., Sato, Y., Chuang, Y.Y.: Shape-preserving half-projective warps for image stitching. In: CVPR, pp. 3254–3261 (2014)

Chen, Y.-S., Chuang, Y.-Y.: Natural image stitching with the global similarity prior. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9909, pp. 186–201. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46454-1_12CrossRef

Demirović, D., Šerifović-Trbalić, A., Prljača, N., Cattin, P.C.: Total variation filtered demons for improved registration of sliding organs. ISRN Biomathematics 2013 (2013)

Gao, J., Kim, S.J., Brown, M.S.: Constructing image panoramas using dual-homography warping. In: CVPR, pp. 49–56. IEEE (2011)

Goldstein, T., Studer, C., Baraniuk, R.: A field guide to forward-backward splitting with a FASTA implementation. arXiv eprint arXiv:abs/1411.3406 (2014)

Goldstein, T., Studer, C., Baraniuk, R.: FASTA: a generalized implementation of forward-backward splitting, January 2015. http://arxiv.org/abs/1501.04979

10.

Li, N., Xu, Y., Wang, C.: Quasi-homography warps in image stitching. arXiv preprint arXiv:1701.08006 (2017)

11.

Li, Y., Monga, V.: SIASM: sparsity-based image alignment and stitching method for robust image mosaicking. In: ICIP, pp. 1828–1832. IEEE (2016)

12.

Lin, C.C., Pankanti, S.U., Natesan Ramamurthy, K., Aravkin, A.Y.: Adaptive as-natural-as-possible image stitching. In: CVPR, pp. 1155–1163 (2015)

13.

Lin, K., Jiang, N., Cheong, L.-F., Do, M., Lu, J.: SEAGULL: seam-guided local alignment for parallax-tolerant image stitching. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 370–385. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46487-9_23CrossRef

14.

Lin, W.Y., Liu, S., Matsushita, Y., Ng, T.T., Cheong, L.F.: Smoothly varying affine stitching. In: CVPR, pp. 345–352. IEEE (2011)

15.

Liu, F., Gleicher, M., Jin, H., Agarwala, A.: Content-preserving warps for 3D video stabilization. ACM Trans. Graph. (TOG) 28(3), 44 (2009)CrossRef

16.

Liu, S., Yuan, L., Tan, P., Sun, J.: Bundled camera paths for video stabilization. ACM Trans. Graph. (TOG) 32(4), 78 (2013)CrossRef

17.

Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef

18.

Nesterov, Y.: A method for unconstrained convex minimization problem with the rate of convergence o (1/k\(\hat{\,}\) 2). Dokl. AN USSR 269, 543–547 (1983)

19.

Santos-Ribeiro, A., Nutt, D.J., McGonigle, J.: Inertial demons: a momentum-based diffeomorphic registration framework. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 37–45. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46726-9_5CrossRef

20.

Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trends® Comput. Graph. Vis. 2(1), 1–104 (2006)MathSciNetMATH

21.

Szeliski, R., Shum, H.Y.: Creating full view panoramic image mosaics and environment maps. In: SIGGRAPH, pp. 251–258. ACM Press/Addison-Wesley Publishing Co. (1997)

22.

Thirion, J.P.: Image matching as a diffusion process: an analogy with Maxwell’s demons. Med. Image Anal. 2(3), 243–260 (1998)CrossRef

23.

Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: efficient non-parametric image registration. NeuroImage 45(1), S61–S72 (2009)CrossRef

24.

Vishnevskiy, V., Gass, T., Szekely, G., Tanner, C., Goksel, O.: Isotropic total variation regularization of displacements in parametric image registration. IEEE Trans. Med. Imaging 36(2), 385–395 (2017)CrossRef

25.

Xiang, T., Xia, G.S., Bai, X., Zhang, L.: Image stitching by line-guided local warping with global similarity constraint. arXiv preprint arXiv:1702.07935 (2017)

26.

Zaragoza, J., Chin, T.J., Brown, M.S., Suter, D.: As-projective-as-possible image stitching with moving DLT. In: CVPR, pp. 2339–2346 (2013)

27.

Zhang, F., Liu, F.: Parallax-tolerant image stitching. In: CVPR, pp. 3262–3269 (2014)

Title: Large Parallax Image Stitching Using an Edge-Preserving Diffeomorphic Warping Process
Authors: Geethu Miriam Jacob
Sukhendu Das
Publisher: Springer International Publishing
Book: Advanced Concepts for Intelligent Vision Systems
Print ISBN: 978-3-030-01448-3

Electronic ISBN: 978-3-030-01449-0

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-030-01449-0_44

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner