Skip to main content
Erschienen in: Machine Vision and Applications 5/2014

01.07.2014 | Special Issue Paper

Dynamic image mosaic via SIFT and dynamic programming

verfasst von: Lin Zeng, Shengping Zhang, Jun Zhang, Yunlu Zhang

Erschienen in: Machine Vision and Applications | Ausgabe 5/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Image mosaic is a useful preprocessing step for background subtraction in videos recorded by a moving camera. To avoid the ghosting effect and mosaic failure due to huge exposure difference and big parallax between adjacent images, this paper proposes an effective mosaic algorithm named Combined SIFT and Dynamic Programming (CSDP). Based on SIFT matching and dynamic programming, CSDP uses an improved optimal seam searching criterion that provides “protection mechanisms” for moving objects with an edge-enhanced weighting intensity difference operator and ultimately solves the ghosting and incomplete effect induced by moving objects. The proposed method was compared to three widely used mosaic softwares (i.e., AutoStitch, Microsoft ICE, and Panorama Maker) and Mills’ approach in multiple scenes. Experimental results show the feasibility and effectiveness of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bouwmans, T.: Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Pat. Comput. Sci. 4(3), (2011) Bouwmans, T.: Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Pat. Comput. Sci. 4(3), (2011)
2.
Zurück zum Zitat Brown, M., Lowe, D.: Recognising panorama. In: Proceedings of international conference on computer vision, pp. 1218–1225 (2003) Brown, M., Lowe, D.: Recognising panorama. In: Proceedings of international conference on computer vision, pp. 1218–1225 (2003)
3.
Zurück zum Zitat Davis, J.: Mosaics of scenes with moving objects. In: Proceedings of international conference on computer vision and, pattern recognition, pp. 354–360 (1998) Davis, J.: Mosaics of scenes with moving objects. In: Proceedings of international conference on computer vision and, pattern recognition, pp. 354–360 (1998)
4.
Zurück zum Zitat Debevec, P., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of the 24th annual conference on computer graphics and interactive, techniques, pp. 369–378 (1997) Debevec, P., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of the 24th annual conference on computer graphics and interactive, techniques, pp. 369–378 (1997)
6.
Zurück zum Zitat Duplaquet, M.: Building large image mosaies with invisible sema-lines. In: Proceedings of SPIE aerosense, pp. 369–377 (1998) Duplaquet, M.: Building large image mosaies with invisible sema-lines. In: Proceedings of SPIE aerosense, pp. 369–377 (1998)
7.
Zurück zum Zitat Echigo, T., Radke, R., Ramadge, P., Miyamori, H., Lisaku, S.: Ghost error elimination and superimposition of moving objects in video mosaicing. Proc. Int. Conf. Image Process. 4, 128–132 (1999) Echigo, T., Radke, R., Ramadge, P., Miyamori, H., Lisaku, S.: Ghost error elimination and superimposition of moving objects in video mosaicing. Proc. Int. Conf. Image Process. 4, 128–132 (1999)
8.
Zurück zum Zitat Farcas, D., Marghes, C., Bouwmans, T.: Background subtraction via incremental maximum margin criterion: a discriminative subspace approach. Mach. Vis. Appl. 23(6), 1083–1101 (2012)CrossRef Farcas, D., Marghes, C., Bouwmans, T.: Background subtraction via incremental maximum margin criterion: a discriminative subspace approach. Mach. Vis. Appl. 23(6), 1083–1101 (2012)CrossRef
9.
Zurück zum Zitat Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)CrossRefMathSciNet Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)CrossRefMathSciNet
10.
Zurück zum Zitat Garg, R., Seitz, S.M.: Dynamic mosaics. 3DIMPVT 2012, pp. 65–72 (2012) Garg, R., Seitz, S.M.: Dynamic mosaics. 3DIMPVT 2012, pp. 65–72 (2012)
11.
Zurück zum Zitat Hartley, R., Zisserma, A.: Multiple view geometry in computer vision. Cambridge University Press, Cambridge (2004)CrossRefMATH Hartley, R., Zisserma, A.: Multiple view geometry in computer vision. Cambridge University Press, Cambridge (2004)CrossRefMATH
12.
Zurück zum Zitat He, Y., Chung, R.: Image mosaicking for polyhedral scene and in particular singly visible surfaces. Pattern Recogn. 41(3), 1200–1213 (2008)CrossRefMATH He, Y., Chung, R.: Image mosaicking for polyhedral scene and in particular singly visible surfaces. Pattern Recogn. 41(3), 1200–1213 (2008)CrossRefMATH
13.
Zurück zum Zitat Irani, M., Anandan, P., Bergen, J., Kumar, R., Hsu, S.: Efficient representations of video sequences and their applications. Signal Process. Image Commun. 8, 327–351 (1996)CrossRef Irani, M., Anandan, P., Bergen, J., Kumar, R., Hsu, S.: Efficient representations of video sequences and their applications. Signal Process. Image Commun. 8, 327–351 (1996)CrossRef
14.
Zurück zum Zitat Jia, J., Tang, C.K.: Eliminating structure and intensity misliagnment in image stitching. In: Proceedings of international conference on computer vision, pp. 1651–1658 (2005) Jia, J., Tang, C.K.: Eliminating structure and intensity misliagnment in image stitching. In: Proceedings of international conference on computer vision, pp. 1651–1658 (2005)
15.
Zurück zum Zitat Kohandani, A., Basir, O., Kamel, M.: A fast algorithm for template matching. Image Anal. Recogn. 4142, 398–409 (2006)CrossRef Kohandani, A., Basir, O., Kamel, M.: A fast algorithm for template matching. Image Anal. Recogn. 4142, 398–409 (2006)CrossRef
16.
Zurück zum Zitat Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
17.
Zurück zum Zitat Mann, S., Piccard, R. : Being ‘undigital’ with digital cameras: extending the dynamic range by combining differently exposed pictures. In: Proceedings of the 4th Annual Conference on IS &T, pp. 422–428 (1995) Mann, S., Piccard, R. : Being ‘undigital’ with digital cameras: extending the dynamic range by combining differently exposed pictures. In: Proceedings of the 4th Annual Conference on IS &T, pp. 422–428 (1995)
18.
Zurück zum Zitat Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005) Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
19.
Zurück zum Zitat Mills, A., Dudek, G.: Image stitching with dynamic elements. Image Vis. Comput. 27(10), 1593–1602 (2009)CrossRef Mills, A., Dudek, G.: Image stitching with dynamic elements. Image Vis. Comput. 27(10), 1593–1602 (2009)CrossRef
20.
Zurück zum Zitat Mitsunaga, T., Nayar, S.: Radiometric self calibratio. In: Proceedings of international conference on computer vision and, pattern recognition, pp. 374–380 (1999) Mitsunaga, T., Nayar, S.: Radiometric self calibratio. In: Proceedings of international conference on computer vision and, pattern recognition, pp. 374–380 (1999)
21.
Zurück zum Zitat Shum, H., Szeliski, R.: Construction of panoramic image mosaics with global and local alignment. Int. J. Comput. Vis. 36(2), 101–130 (2000)CrossRef Shum, H., Szeliski, R.: Construction of panoramic image mosaics with global and local alignment. Int. J. Comput. Vis. 36(2), 101–130 (2000)CrossRef
22.
Zurück zum Zitat Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trends Comput. Gr. Vis. 2(1), 1–105 (2006)CrossRef Szeliski, R.: Image alignment and stitching: a tutorial. Found. Trends Comput. Gr. Vis. 2(1), 1–105 (2006)CrossRef
23.
Zurück zum Zitat Szeliski, R., Shum, H.: Creating full view panoramic image mosaics and environment mapsn. In: Proceedings of the 24th annual conference on computer graphics and interactive, techniques, pp. 251–258 (1997) Szeliski, R., Shum, H.: Creating full view panoramic image mosaics and environment mapsn. In: Proceedings of the 24th annual conference on computer graphics and interactive, techniques, pp. 251–258 (1997)
24.
Zurück zum Zitat Zeng, L., Deng, D., Chen, X., Zhang, Y.: A self-adaptive and real-time panoramic video mosaicing system. J. Comput. 7(1), 218–225 (2012)CrossRef Zeng, L., Deng, D., Chen, X., Zhang, Y.: A self-adaptive and real-time panoramic video mosaicing system. J. Comput. 7(1), 218–225 (2012)CrossRef
25.
Zurück zum Zitat Zhang, S., Yao, H., Liu, S.: Dynamic background subtraction based on local dependency histogram. Int. J. Pattern Recogn. Artif. Intell. 23(7), 1397–1419 (2009)CrossRef Zhang, S., Yao, H., Liu, S.: Dynamic background subtraction based on local dependency histogram. Int. J. Pattern Recogn. Artif. Intell. 23(7), 1397–1419 (2009)CrossRef
26.
Zurück zum Zitat Zhang, S., Yao, H., Sun, X., Lu, X.: Sparse coding based visual tracking: Review and experimental comparison. Pattern Recogn. 46(7), 1772–1788 (2013a)CrossRef Zhang, S., Yao, H., Sun, X., Lu, X.: Sparse coding based visual tracking: Review and experimental comparison. Pattern Recogn. 46(7), 1772–1788 (2013a)CrossRef
27.
Zurück zum Zitat Zhang, S., Yao, H., Zhou, H., Sun, X., Liu, S.: Robust visual tracking based on online learning sparse representation. Neurocomputing 100(1), 31–40 (2013b)CrossRef Zhang, S., Yao, H., Zhou, H., Sun, X., Liu, S.: Robust visual tracking based on online learning sparse representation. Neurocomputing 100(1), 31–40 (2013b)CrossRef
28.
Zurück zum Zitat Zhao, L., Yang, Y.: Mosaic image method: a local and global method. Pattern Recogn. 32(8), 1421–1433 (1999)CrossRef Zhao, L., Yang, Y.: Mosaic image method: a local and global method. Pattern Recogn. 32(8), 1421–1433 (1999)CrossRef
29.
Zurück zum Zitat Zhou, H., Liu, T., Lin, F., Pang, Y., Wu, J., Wu, J.: Towards efficient registration of medical images. Comput. Med. Imaging Gr. 31(6), 374–382 (2007)CrossRef Zhou, H., Liu, T., Lin, F., Pang, Y., Wu, J., Wu, J.: Towards efficient registration of medical images. Comput. Med. Imaging Gr. 31(6), 374–382 (2007)CrossRef
30.
Zurück zum Zitat Zhou, H., Green, P.R., Wallace, A.M.: Estimation of epipolar geometry by linear mixed-effect modelling. Neurocomputing 72(16–18), 3881–3890 (2009)CrossRef Zhou, H., Green, P.R., Wallace, A.M.: Estimation of epipolar geometry by linear mixed-effect modelling. Neurocomputing 72(16–18), 3881–3890 (2009)CrossRef
Metadaten
Titel
Dynamic image mosaic via SIFT and dynamic programming
verfasst von
Lin Zeng
Shengping Zhang
Jun Zhang
Yunlu Zhang
Publikationsdatum
01.07.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 5/2014
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-013-0551-8

Weitere Artikel der Ausgabe 5/2014

Machine Vision and Applications 5/2014 Zur Ausgabe

Premium Partner