Skip to main content

2016 | OriginalPaper | Buchkapitel

Video Synchronization with Trajectory Pulse

verfasst von : Xue Wang, Qing Wang

Erschienen in: Intelligent Visual Surveillance

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a method to temporally synchronize two independently moving cameras with overlapping views. Temporal variations between image frames (such as moving objects) are powerful cues for alignment. We first generate pulse images by tracking moving objects and examining the trajectories for changes in speed. We then integrate a rank-based constraint and the pulse-based matching, to derive a robust approximation of spatio-temporal alignment quality for all pairs of frames. By folding both spatial and temporal cues into a single alignment framework, finally, the nonlinear temporal mapping is found using a graph-based approach that supports partial temporal overlap between sequences. We verify the robustness and performance of the proposed approach on several challenging real video sequences. Compared to state-of-the-art techniques, our approach is robust to tracking error and can handle non-rigid scene alignment in complex dynamic scenes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. Int. J. Comput. Vis. 68, 53–64 (2006)CrossRef Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. Int. J. Comput. Vis. 68, 53–64 (2006)CrossRef
2.
Zurück zum Zitat Dai, C., Zheng, Y., Li, X.: Accurate video alignment using phase correlation. IEEE Signal Process. Lett. 13(12), 737–740 (2006)CrossRef Dai, C., Zheng, Y., Li, X.: Accurate video alignment using phase correlation. IEEE Signal Process. Lett. 13(12), 737–740 (2006)CrossRef
3.
Zurück zum Zitat Lu, C., Mandal, M.: A robust technique for motion-based video sequences temporal alignment. IEEE Trans. Multimedia 15, 70–82 (2013)CrossRef Lu, C., Mandal, M.: A robust technique for motion-based video sequences temporal alignment. IEEE Trans. Multimedia 15, 70–82 (2013)CrossRef
4.
Zurück zum Zitat Pundik, D., Moses, Y.: Video synchronization using temporal signals from epipolar lines. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 15–28. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15558-1_2 CrossRef Pundik, D., Moses, Y.: Video synchronization using temporal signals from epipolar lines. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 15–28. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15558-1_​2 CrossRef
5.
Zurück zum Zitat Pádua, F., Carceroni, R., Santos, G., Kutulakos, K.: Linear sequence-to-sequence alignment. IEEE Trans. Pattern Anal. Mach. Intell. 32, 304–320 (2010)CrossRef Pádua, F., Carceroni, R., Santos, G., Kutulakos, K.: Linear sequence-to-sequence alignment. IEEE Trans. Pattern Anal. Mach. Intell. 32, 304–320 (2010)CrossRef
6.
Zurück zum Zitat Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002) Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002)
7.
Zurück zum Zitat Wolf, L., Zomet, A.: Wide baseline matching between unsynchronized video sequences. Int. J. Comput. Vis. 68, 43–52 (2006)CrossRef Wolf, L., Zomet, A.: Wide baseline matching between unsynchronized video sequences. Int. J. Comput. Vis. 68, 43–52 (2006)CrossRef
8.
Zurück zum Zitat Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: International Conference on Computer Vision (2003) Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: International Conference on Computer Vision (2003)
9.
Zurück zum Zitat Whitehead, A., Laganiere, R., Bose, P.: Temporal synchronization of video sequences in theory and in practice. In: Applications of Computer Vision and the IEEE Workshop on Motion and Video Computing, pp. 132–137(2005) Whitehead, A., Laganiere, R., Bose, P.: Temporal synchronization of video sequences in theory and in practice. In: Applications of Computer Vision and the IEEE Workshop on Motion and Video Computing, pp. 132–137(2005)
10.
Zurück zum Zitat Singh, M., Cheng, I., Mandal, M., Basu, A.: Optimization of symmetric transfer error for sub-frame video synchronization. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 554–567. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88688-4_41 CrossRef Singh, M., Cheng, I., Mandal, M., Basu, A.: Optimization of symmetric transfer error for sub-frame video synchronization. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 554–567. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-88688-4_​41 CrossRef
11.
Zurück zum Zitat Tresadern, P.A., Reid, I.D.: Video synchronization from human motion using rank constraints. Comput. Vis. Image Underst. 113, 891–906 (2009)CrossRef Tresadern, P.A., Reid, I.D.: Video synchronization from human motion using rank constraints. Comput. Vis. Image Underst. 113, 891–906 (2009)CrossRef
12.
Zurück zum Zitat Tuytelaars, T., Gool, L.V.: Synchronizing video sequences. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2004) Tuytelaars, T., Gool, L.V.: Synchronizing video sequences. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2004)
13.
Zurück zum Zitat Dexter, E., Pérez, P., Laptev, I.: Multi-view synchronization of human actions and dynamic scenes. In: Proceedings of the British Machine Vision Conference (2009) Dexter, E., Pérez, P., Laptev, I.: Multi-view synchronization of human actions and dynamic scenes. In: Proceedings of the British Machine Vision Conference (2009)
14.
Zurück zum Zitat Lei, C., Yang, Y.: Trifocal tensor-based multiple video synchronization with subframe optimization. IEEE Trans. Image Process. 15, 2473–2480 (2006)CrossRef Lei, C., Yang, Y.: Trifocal tensor-based multiple video synchronization with subframe optimization. IEEE Trans. Image Process. 15, 2473–2480 (2006)CrossRef
15.
Zurück zum Zitat Evangelidis, G., Bauckhage, C.: Efficient subframe video alignment using short descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2371–2386 (2013)CrossRef Evangelidis, G., Bauckhage, C.: Efficient subframe video alignment using short descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2371–2386 (2013)CrossRef
16.
Zurück zum Zitat Wang, O., Schroers, C., Zimmer, H., Gross, M., Sorkine-Hornung, A.: Videosnapping: interactive synchronization of multiple videos. In: SIGGRAPH (2014) Wang, O., Schroers, C., Zimmer, H., Gross, M., Sorkine-Hornung, A.: Videosnapping: interactive synchronization of multiple videos. In: SIGGRAPH (2014)
17.
Zurück zum Zitat Diego, F., Ponsa, D., Serrat, J., López, A.: Video alignment for change detection. IEEE Trans. Image Process. 20, 1858–1869 (2011)MathSciNetCrossRef Diego, F., Ponsa, D., Serrat, J., López, A.: Video alignment for change detection. IEEE Trans. Image Process. 20, 1858–1869 (2011)MathSciNetCrossRef
18.
Zurück zum Zitat Diego, F., Serrat, J., López, A.: Joint spatio-temporal alignment of sequences. IEEE Trans. Multimedia 15, 1377–1387 (2013)CrossRef Diego, F., Serrat, J., López, A.: Joint spatio-temporal alignment of sequences. IEEE Trans. Multimedia 15, 1377–1387 (2013)CrossRef
19.
Zurück zum Zitat Ye, G., Liu, Y., Hasler, N., Ji, X.: Performance capture of interacting characters with handheld kinects. In: Proceedings of European Conference on Computer Vision (2012) Ye, G., Liu, Y., Hasler, N., Ji, X.: Performance capture of interacting characters with handheld kinects. In: Proceedings of European Conference on Computer Vision (2012)
Metadaten
Titel
Video Synchronization with Trajectory Pulse
verfasst von
Xue Wang
Qing Wang
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3476-3_2