nach oben

Erschienen in:

2015 | OriginalPaper | Buchkapitel

4. Panorama Construction from Multi-view Cameras in Outdoor Scenes

verfasst von : Lakhmi C. Jain, Margarita N. Favorskaya, Dmitry Novikov

Erschienen in: Computer Vision in Control Systems-2

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The applications of panoramic images are wide spread in computer vision including navigation systems, object tracking, virtual environment creation, among others. In this chapter, the problems of multi-view shooting and the models of geometrical distortions are investigated under the panorama construction in the outdoor scenes. Our contribution are the development of procedure for selection of “good” frames from video sequences provided by several cameras, more accurate estimation of projective parameters in top, middle, and bottom regions in the overlapping area during frames stitching, and also the lighting improvement of the result panoramic image by a point-based blending in a stitching area. Most proposed algorithms have high computer cost because of mega-pixel sizes of initial frames. The reduction of frames sizes, the use of CUDA technique, or the hardware implementation will improve these results. The experiments show good visibility results with high stitching accuracy, if the initial frames were selected well.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel The Application of Machine Learning Techniques to Real Time Audience Analysis System

Nächstes Kapitel A New Real-Time Method of Contextual Image Description and Its Application in Robot Navigation and Intelligent Control

Briggs AJ, Detweiler C, Li Y, Mullen PC, Scharstein D (2006) Matching scale-space features in 1D panoramas. Comput Vis Image Underst 103(3):184–195CrossRef

Dang TK, Worring M, Bui TD (2011) A semi-interactive panorama based 3D reconstruction framework for indoor scenes. Comput Vis Image Underst 115(11):1516–1524CrossRef

Zhang W, Cham WK (2012) Reference-guided exposure fusion in dynamic scenes. J Vis Commun Image Represent 23(3):467–475CrossRef

Chen H (2008) Focal length and registration correction for building panorama from photographs. Comput Vis Image Underst 112(2):225–230CrossRef

Ni D, Chui YP, Qu Y, Yang X, Qin J, Wong TT, Ho SSH, Heng PA (2009) Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT. Comput Med Imaging Graph 33(7):559–566CrossRef

Powell I (1994) Panoramic lens. Appl Opt 33(31):7356–7361CrossRef

Xiong Y, Turkowski K (1997) Creating image-based VR using a self-calibrating fisheye lens. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 237–243

Luong HQ, Goossens B, Philips W (2011) Joint photometric and geometric image registration in the total least square sense. Pattern Recogn Lett 32(15):2061–2067CrossRef

Fan BJ, Du YK, Zhu LL, Tang YD (2011) A robust template tracking algorithm with weighted active drift correction. Pattern Recogn Lett 32(9):1317–1327CrossRef

10.

Zhao G, Lin L, Tang Y (2013) A new optimal seam finding method based on tensor analysis for automatic panorama construction. Pattern Recogn Lett 34(3):308–314CrossRef

11.

Beier T, Neely S (1992) Feature-based image metamorphosis. In: Procedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH’92, vol 26, no 2. pp 35–42

12.

Haenselmann T, Busse M, Kopf S, King T, Effelsberg W (2009) Multi perspective panoramic imaging. Image Vis Comput 27(4):391–401CrossRef

13.

Pazzi RW, Boukerche A, Feng J, Huang Y (2010) A novel image mosaicking technique for enlarging the field of view of images transmitted over wireless image sensor networks. J Mob Netw Appl 15(4):589–606CrossRef

14.

Jain DK, Saxena G, Singh VK (2012) Image mosaicking using corner techniques, Int Conf on Communication Systems and Network Technologies 79–84

15.

Yang J, Wei L, Zhang Z, Tang H (2012) Image mosaic based on phase correlation and Harris operator. J Comput Inf Syst 8(6):2647–2655

16.

Kwon OS, Ha YH (2010) Panoramic video using scale invariant feature transform with embedded color-Invariant values. IEEE Trans Consum Electron 56(2):792–798CrossRef

17.

Kim D, Hong KS (2008) Practical background estimation for mosaic blending with patch-based Markov random fields. Pattern Recogn 41(7):2145–2155MATHCrossRef

18.

Bao P, Xu D (1999) Complex wavelet-based image mosaics using edge-preserving visual perception modeling. Comput Graph 23(3):309–321CrossRef

19.

Bhosle U, Roy SD, Chaudhuri S (2005) Multispectral panoramic mosaicing. Pattern Recogn Lett 26(4):471–482CrossRef

20.

Agarwala A, Zheng C, Pal C, Agrawala M, Cohen M, Curless B, Salesin D, Szeliski R (2005) Panoramic video textures. ACM Trans Graph 24(3):821–827CrossRef

21.

Brown M, Lowe DG (2007) Automatic panoramic image stitching using invariant features. Int J Comput Vis 74(1):59–73CrossRef

22.

Li C, Ma L (2009) A new framework for feature descriptor based on SIFT. Pattern Recogn Lett 30(5):544–557CrossRef

23.

Deng H, Zhang L, Ma J, Kang Z (2011) Interactive panoramic map-like views for 3D mountain navigation. Comput Geosci 37(11):1816–1824CrossRef

24.

Fiala M, Basu A (2002) Hough transform for feature detection in panoramic images. Pattern Recogn Lett 23(14):1863–1874MATHCrossRef

25.

Kim DH, Yoon YI, Choi JS (2003) An efficient method to build panoramic image mosaics. Pattern Recogn Lett 24(14):2421–2429MATHCrossRef

26.

Zhu Z, Xu G, Riseman EM, Hanson AR (2006) Fast construction of dynamic and multi-resolution 360° panoramas from video sequences. Image Vis Comput 24(1):13–26CrossRef

27.

Zhu Z, Riseman EM, Hanson AR (2004) Generalized parallel-perspective stereo mosaics from airborne videos. IEEE Trans Pattern Anal Mach Intell 26(2):226–237CrossRef

28.

Steedly D, Pal C, Szeliski R (2005) Efficiently registering video into panoramic mosaics. In: IEEE International Conference on Computer Vision (ICCV’2005), vol 2. pp 15–21

29.

Langlotz T, Degendorfer C, Mulloni A, Schall G, Reitmayr G, Schmalstieg D (2011) Robust detection and tracking of annotations for outdoor augmented reality browsing. Comput Graph 35(4):831–840CrossRef

30.

Seitz SM, Dyer CR (1997) Viewing morphing: uniquely predicting scene appearance from basis images. DARPA Image Understanding Workshop, pp 881–887

31.

Hernández-Mier Y, Blondel WCPM, Daula C, Wolf D, Guillemin F (2010) Fast construction of panoramic images for cystoscopic exploration. Comput Med Imaging Graph 34(7):579–592CrossRef

32.

Fathima AA, Karthik R, Vaidehi V (2013) Image stitching with combined moment invariants and SIFT features. Procedia Comput Sci 19:420–427CrossRef

33.

Fischler MA, Bolles RC (1881) Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24(6):381–395MathSciNetCrossRef

34.

Yan Q, Xu Y, Yang X, Nguyen T (2014) HEASK: Robust homography estimation based on appearance similarity and keypoint correspondences. Pattern Recognit 47(1):368–387CrossRef

35.

Torr PHS, Zisserman A (2000) MLESAC: a new robust estimator with application to estimating image geometry. Comput Vis Image Underst 78(1):138–156CrossRef

36.

Chum O, Matas J, Obdrzalek S (2004) Enhancing RANSAC by generalized model optimization. In: Asian Conference on Computer Vision, ACCV. pp 812–817

37.

Nashat S, Abdullah A, Abdullah MZ (2012) Unimodal thresholding for Laplacian-based Canny-Deriche filter. Pattern Recogn Lett 33(10):1269–1286CrossRef

38.

Shen F, Zhao Y, Jiang X, Suwa M (2009) Recovering high dynamic range by multi-exposure retinex. J Vis Commun Image Represent 20(8):521–531CrossRef

39.

Dokládal P, Dokládalová E (2011) Computationally efficient, one-pass algorithm for morphological filters. J Vis Commun Image Represent 22(5):411–420CrossRef

40.

Fernandes LAF, Oliveira MM (2008) Real-time line detection through an improved Hough transform voting scheme. Pattern Recogn 41(1):299–314MATHCrossRef

41.

Maxwell EA (1946) Methods of plane projective geometry based on the use of general homogeneous coordinates. Cambridge University Press, Cambridge

42.

Maxwell EA (1951) General homogeneous coordinates in space of three dimensions. Cambridge University Press, CambridgeMATH

43.

Roberts LG (1965) Homogeneous matrix representations and manipulations of n-dimensional constructs, Technical Representation Document MS 1405, Lincoln Laboratory, MIT, Cambridge

44.

Chum O, Matas J (2002) Randomized ransack with t(d,d) test. British Machine Vision Conference (BMVC’2002), vol 2. pp 448–457

45.

Capel D (2005) An effective bail-out test for ransack consensus scoring. British Machine Vision Conference (BMVC’2005). pp 629–638

46.

Matas J, Chum O (2005) Randomized RANSAC with sequential probability ratio test. In: 10th IEEE International Conference on Computer Vision, vol 2, pp 1727–1732

47.

Chum O, Matas J (2008) Optimal randomized ransac. IEEE Trans Pattern Anal Image Underst 30(8):1472–1482CrossRef

48.

Raguram R, Frahm JM, Pollefeys M (2008) A comparative analysis of RANSAC techniques leading to adaptive real-time random sample consensus. In: 10th European Conference on Computer Vision, vol 2. pp 500–513

49.

Cheng CM, Lai SH (2009) A consensus sampling technique for fast and robust model fitting. Pattern Recogn 42(7):1318–1329MATHCrossRef

50.

Kiciak P (2011) Bicubic B-spline blending patches with optimized shape. Comput Aided Des 43(2):133–144MathSciNetCrossRef

51.

Kineri Y, Wang M, Lin H, Maekawa T (2012) B-spline surface fitting by iterative geometric interpolation/approximation algorithms. Comput Aided Des 44(7):697–708CrossRef

52.

Meylan L, Alleysson D, Süsstrunk S (2007) Model of retinal local adaptation for the tone mapping of color filter array images. J Opt Soc Am A: 24(9):2807–2816CrossRef

53.

Favorskaya M, Pakhirka A (2012) A way for color image enhancement under complex luminance conditions. In: Watanabe T, Watada J, Takahashi N, Howlett RJ, Jain LC (eds) Intelligent interactive multimedia: systems and services. Springer, Berlin

54.

Zhang Y, Pajarola R (2007) Deferred blending: Image composition for single-pass point rendering. Comput and Graph 31(2):175–189CrossRef

55.

Sun J, Zhu H, Xu Z, Han C (2013) Poisson image fusion based on Markov random field fusion model. Inf Fusion 14(3):241–254CrossRef

56.

Mills A, Dudek G (2009) Image stitching with dynamic elements. Image Vis Comput 27(10):1593–1602CrossRef

57.

Gómez F, Romero E (2011) Rotation invariant texture characterization using a curvelet based descriptor. Pattern Recogn Lett 32(16):2178–2186CrossRef

58.

Yang S, Wang M, Jiao L, Wua R, Wang Z (2010) Image fusion based on a new contourlet packet. Inf Fusion 11(2):78–84CrossRef

59.

Gracias N, Mahoor M, Negahdaripour S, Gleason A (2009) Fast image blending using watersheds and graph cuts. Image Vis Comput 27(5):597–607CrossRef

Titel: Panorama Construction from Multi-view Cameras in Outdoor Scenes
verfasst von: Lakhmi C. Jain
Margarita N. Favorskaya
Dmitry Novikov
Verlag: Springer International Publishing
Buch: Computer Vision in Control Systems-2
Print ISBN: 978-3-319-11429-3

Electronic ISBN: 978-3-319-11430-9

Copyright-Jahr: 2015
DOI: https://doi.org/10.1007/978-3-319-11430-9_4

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner