Skip to main content
Top

2016 | OriginalPaper | Chapter

Video Synchronization with Trajectory Pulse

Authors : Xue Wang, Qing Wang

Published in: Intelligent Visual Surveillance

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a method to temporally synchronize two independently moving cameras with overlapping views. Temporal variations between image frames (such as moving objects) are powerful cues for alignment. We first generate pulse images by tracking moving objects and examining the trajectories for changes in speed. We then integrate a rank-based constraint and the pulse-based matching, to derive a robust approximation of spatio-temporal alignment quality for all pairs of frames. By folding both spatial and temporal cues into a single alignment framework, finally, the nonlinear temporal mapping is found using a graph-based approach that supports partial temporal overlap between sequences. We verify the robustness and performance of the proposed approach on several challenging real video sequences. Compared to state-of-the-art techniques, our approach is robust to tracking error and can handle non-rigid scene alignment in complex dynamic scenes.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. Int. J. Comput. Vis. 68, 53–64 (2006)CrossRef Caspi, Y., Simakov, D., Irani, M.: Feature-based sequence-to-sequence matching. Int. J. Comput. Vis. 68, 53–64 (2006)CrossRef
2.
go back to reference Dai, C., Zheng, Y., Li, X.: Accurate video alignment using phase correlation. IEEE Signal Process. Lett. 13(12), 737–740 (2006)CrossRef Dai, C., Zheng, Y., Li, X.: Accurate video alignment using phase correlation. IEEE Signal Process. Lett. 13(12), 737–740 (2006)CrossRef
3.
go back to reference Lu, C., Mandal, M.: A robust technique for motion-based video sequences temporal alignment. IEEE Trans. Multimedia 15, 70–82 (2013)CrossRef Lu, C., Mandal, M.: A robust technique for motion-based video sequences temporal alignment. IEEE Trans. Multimedia 15, 70–82 (2013)CrossRef
4.
go back to reference Pundik, D., Moses, Y.: Video synchronization using temporal signals from epipolar lines. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 15–28. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15558-1_2 CrossRef Pundik, D., Moses, Y.: Video synchronization using temporal signals from epipolar lines. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 15–28. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-15558-1_​2 CrossRef
5.
go back to reference Pádua, F., Carceroni, R., Santos, G., Kutulakos, K.: Linear sequence-to-sequence alignment. IEEE Trans. Pattern Anal. Mach. Intell. 32, 304–320 (2010)CrossRef Pádua, F., Carceroni, R., Santos, G., Kutulakos, K.: Linear sequence-to-sequence alignment. IEEE Trans. Pattern Anal. Mach. Intell. 32, 304–320 (2010)CrossRef
6.
go back to reference Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002) Wolf, L., Zomet, A.: Correspondence-free synchronization and reconstruction in a non-rigid scene. In: Workshop on Vision and Modelling of Dynamic Scenes (2002)
7.
go back to reference Wolf, L., Zomet, A.: Wide baseline matching between unsynchronized video sequences. Int. J. Comput. Vis. 68, 43–52 (2006)CrossRef Wolf, L., Zomet, A.: Wide baseline matching between unsynchronized video sequences. Int. J. Comput. Vis. 68, 43–52 (2006)CrossRef
8.
go back to reference Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: International Conference on Computer Vision (2003) Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View-invariant alignment and matching of video sequences. In: International Conference on Computer Vision (2003)
9.
go back to reference Whitehead, A., Laganiere, R., Bose, P.: Temporal synchronization of video sequences in theory and in practice. In: Applications of Computer Vision and the IEEE Workshop on Motion and Video Computing, pp. 132–137(2005) Whitehead, A., Laganiere, R., Bose, P.: Temporal synchronization of video sequences in theory and in practice. In: Applications of Computer Vision and the IEEE Workshop on Motion and Video Computing, pp. 132–137(2005)
10.
go back to reference Singh, M., Cheng, I., Mandal, M., Basu, A.: Optimization of symmetric transfer error for sub-frame video synchronization. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 554–567. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88688-4_41 CrossRef Singh, M., Cheng, I., Mandal, M., Basu, A.: Optimization of symmetric transfer error for sub-frame video synchronization. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 554–567. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-88688-4_​41 CrossRef
11.
go back to reference Tresadern, P.A., Reid, I.D.: Video synchronization from human motion using rank constraints. Comput. Vis. Image Underst. 113, 891–906 (2009)CrossRef Tresadern, P.A., Reid, I.D.: Video synchronization from human motion using rank constraints. Comput. Vis. Image Underst. 113, 891–906 (2009)CrossRef
12.
go back to reference Tuytelaars, T., Gool, L.V.: Synchronizing video sequences. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2004) Tuytelaars, T., Gool, L.V.: Synchronizing video sequences. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2004)
13.
go back to reference Dexter, E., Pérez, P., Laptev, I.: Multi-view synchronization of human actions and dynamic scenes. In: Proceedings of the British Machine Vision Conference (2009) Dexter, E., Pérez, P., Laptev, I.: Multi-view synchronization of human actions and dynamic scenes. In: Proceedings of the British Machine Vision Conference (2009)
14.
go back to reference Lei, C., Yang, Y.: Trifocal tensor-based multiple video synchronization with subframe optimization. IEEE Trans. Image Process. 15, 2473–2480 (2006)CrossRef Lei, C., Yang, Y.: Trifocal tensor-based multiple video synchronization with subframe optimization. IEEE Trans. Image Process. 15, 2473–2480 (2006)CrossRef
15.
go back to reference Evangelidis, G., Bauckhage, C.: Efficient subframe video alignment using short descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2371–2386 (2013)CrossRef Evangelidis, G., Bauckhage, C.: Efficient subframe video alignment using short descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2371–2386 (2013)CrossRef
16.
go back to reference Wang, O., Schroers, C., Zimmer, H., Gross, M., Sorkine-Hornung, A.: Videosnapping: interactive synchronization of multiple videos. In: SIGGRAPH (2014) Wang, O., Schroers, C., Zimmer, H., Gross, M., Sorkine-Hornung, A.: Videosnapping: interactive synchronization of multiple videos. In: SIGGRAPH (2014)
17.
go back to reference Diego, F., Ponsa, D., Serrat, J., López, A.: Video alignment for change detection. IEEE Trans. Image Process. 20, 1858–1869 (2011)MathSciNetCrossRef Diego, F., Ponsa, D., Serrat, J., López, A.: Video alignment for change detection. IEEE Trans. Image Process. 20, 1858–1869 (2011)MathSciNetCrossRef
18.
go back to reference Diego, F., Serrat, J., López, A.: Joint spatio-temporal alignment of sequences. IEEE Trans. Multimedia 15, 1377–1387 (2013)CrossRef Diego, F., Serrat, J., López, A.: Joint spatio-temporal alignment of sequences. IEEE Trans. Multimedia 15, 1377–1387 (2013)CrossRef
19.
go back to reference Ye, G., Liu, Y., Hasler, N., Ji, X.: Performance capture of interacting characters with handheld kinects. In: Proceedings of European Conference on Computer Vision (2012) Ye, G., Liu, Y., Hasler, N., Ji, X.: Performance capture of interacting characters with handheld kinects. In: Proceedings of European Conference on Computer Vision (2012)
Metadata
Title
Video Synchronization with Trajectory Pulse
Authors
Xue Wang
Qing Wang
Copyright Year
2016
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-3476-3_2

Premium Partner