Skip to main content
Erschienen in: Machine Vision and Applications 1/2014

01.01.2014 | Special Issue Paper

Key observation selection-based effective video synopsis for camera network

verfasst von: Xiaobin Zhu, Jing Liu, Jinqiao Wang, Hanqing Lu

Erschienen in: Machine Vision and Applications | Ausgabe 1/2014

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, tremendous amount of video is captured endlessly from increased numbers of video cameras distributed around the world. Since needless information is abundant in the raw videos, making video browsing and retrieval is inefficient and time consuming. Video synopsis is an effective way to browse and index such video, by producing a short video representation, while keeping the essential activities of the original video. However, video synopsis for single camera is limited in its view scope, while understanding and monitoring overall activity for large scenarios is valuable and demanding. To solve the above issues, we propose a novel video synopsis algorithm for partially overlapping camera network. Our main contributions reside in three aspects: First, our algorithm can generate video synopsis for large scenarios, which can facilitate understanding overall activities. Second, for generating overall activity, we adopt a novel unsupervised graph matching algorithm to associate trajectories across cameras. Third, a novel multiple kernel similarity is adopted in selecting key observations for eliminating content redundancy in video synopsis. We have demonstrated the effectiveness of our approach on real surveillance videos captured by our camera network.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amato, A., Haj, M.A., Mozerov, M., Gonzlez, J.: Trajectory fusion for multiple camera tracking. In: Computer Recognition Systems 2, pp. 19–26 (2008) Amato, A., Haj, M.A., Mozerov, M., Gonzlez, J.: Trajectory fusion for multiple camera tracking. In: Computer Recognition Systems 2, pp. 19–26 (2008)
2.
Zurück zum Zitat Anjum, N., Cavallaro, A.: Trajectory association and fusion across partially overlapping cameras. In: AVSS, pp. 201–206 (2009) Anjum, N., Cavallaro, A.: Trajectory association and fusion across partially overlapping cameras. In: AVSS, pp. 201–206 (2009)
3.
Zurück zum Zitat Bashir, F.I., Khokhar, A.A., Schonfeld, D.: Distinctive image features from scale-invariant keypoints. Multimedia Syst. 12(1), 45–54 (2006) Bashir, F.I., Khokhar, A.A., Schonfeld, D.: Distinctive image features from scale-invariant keypoints. Multimedia Syst. 12(1), 45–54 (2006)
4.
Zurück zum Zitat Brown, M., Lowe, D.: Recognising panoramas. In: ICCV, pp. 1218–1225 (2003) Brown, M., Lowe, D.: Recognising panoramas. In: ICCV, pp. 1218–1225 (2003)
5.
Zurück zum Zitat Cho, M., Lee, J., Lee, K.M.: Reweighted random walks for graph matching. In: ECCV, pp. 492–505 (2010) Cho, M., Lee, J., Lee, K.M.: Reweighted random walks for graph matching. In: ECCV, pp. 492–505 (2010)
6.
Zurück zum Zitat Conte, D., Foggia, P., Sansone, C., Vento, M.: Thirty years of graph matching in pattern recognition. In: IJPRAI, pp. 265–298 (2004) Conte, D., Foggia, P., Sansone, C., Vento, M.: Thirty years of graph matching in pattern recognition. In: IJPRAI, pp. 265–298 (2004)
7.
Zurück zum Zitat Du, W., bernard Hayet, J., Piater, J., Verly, J.: Collaborative multi-camera tracking of athletes in team sports. In: Workshop on Computer Vision Based Analysis in Sport, Environments, pp. 2–13 (2006) Du, W., bernard Hayet, J., Piater, J., Verly, J.: Collaborative multi-camera tracking of athletes in team sports. In: Workshop on Computer Vision Based Analysis in Sport, Environments, pp. 2–13 (2006)
8.
Zurück zum Zitat Gori, M., Maggini, M., Sarti, L.: Exact and approximate graph mathcing using random walks. TPAMI 27(7), 1100–1111 (2005)CrossRef Gori, M., Maggini, M., Sarti, L.: Exact and approximate graph mathcing using random walks. TPAMI 27(7), 1100–1111 (2005)CrossRef
9.
Zurück zum Zitat Hamid, R., Kumar, R.K., Grundmann, M., Kim, K., Essa, I.A., Hodgins, J.K.: Player localization using multiple static cameras for sports visualization. In: CVPR, pp. 731–738 (2010) Hamid, R., Kumar, R.K., Grundmann, M., Kim, K., Essa, I.A., Hodgins, J.K.: Player localization using multiple static cameras for sports visualization. In: CVPR, pp. 731–738 (2010)
10.
Zurück zum Zitat Javed, O., Rasheed, Z., Shafique, K., Shah, M.: Tracking across multiple cameras with disjoint views. In: ICCV, pp. 952–957 (2003) Javed, O., Rasheed, Z., Shafique, K., Shah, M.: Tracking across multiple cameras with disjoint views. In: ICCV, pp. 952–957 (2003)
11.
Zurück zum Zitat Junejo, I.N., Foroosh, H.: Trajectory rectification and path modeling for video surveillance. In: ICCV, pp. 1–7 (2007) Junejo, I.N., Foroosh, H.: Trajectory rectification and path modeling for video surveillance. In: ICCV, pp. 1–7 (2007)
12.
Zurück zum Zitat Kang, H., Chen, X., Matsushita, Y., Tang, X.: Space-time video montage. In: CVPR, pp. 1331–1338 (2006) Kang, H., Chen, X., Matsushita, Y., Tang, X.: Space-time video montage. In: CVPR, pp. 1331–1338 (2006)
13.
Zurück zum Zitat Kang, J., Cohen, I., Medioni, G.: Tracking people in crowded scenes across multiple cameras. In: ACCV, pp. 157–168 (2004) Kang, J., Cohen, I., Medioni, G.: Tracking people in crowded scenes across multiple cameras. In: ACCV, pp. 157–168 (2004)
14.
Zurück zum Zitat Kayumbi, G., Anjum, N., Cavallaro, A.: Global trajectory reconstruction from distributed visual sensors. In: ICDSC, pp. 1–8 (2008) Kayumbi, G., Anjum, N., Cavallaro, A.: Global trajectory reconstruction from distributed visual sensors. In: ICDSC, pp. 1–8 (2008)
15.
Zurück zum Zitat Keogh, E.: Exact indexing of dynamic time warping. In: Very Large Data, Bases, pp. 406–417 (2002) Keogh, E.: Exact indexing of dynamic time warping. In: Very Large Data, Bases, pp. 406–417 (2002)
16.
Zurück zum Zitat Kim, C., Hwang, J.N.: An integrated scheme for object-based video abstraction. In: ACMMM, pp. 303–311 (2000) Kim, C., Hwang, J.N.: An integrated scheme for object-based video abstraction. In: ACMMM, pp. 303–311 (2000)
17.
Zurück zum Zitat Kuo, C.H., Huang, C., Nevatia, R.: Inter-camera association of multi-target tracks by on-line learned appearance affinity models. In: ECCV, pp. 383–396 (2010) Kuo, C.H., Huang, C., Nevatia, R.: Inter-camera association of multi-target tracks by on-line learned appearance affinity models. In: ECCV, pp. 383–396 (2010)
18.
Zurück zum Zitat Lee, J., Oh, J., Hwang, S.: Scenario based dynamic video abstractions using graph matching. In: ACM MM, pp. 810–819 (2005) Lee, J., Oh, J., Hwang, S.: Scenario based dynamic video abstractions using graph matching. In: ACM MM, pp. 810–819 (2005)
19.
Zurück zum Zitat Lowe, D.G.: View-invariant motion trajectory-based activity classification and recognition. IJCV 60(2), 91–110 (2004)CrossRef Lowe, D.G.: View-invariant motion trajectory-based activity classification and recognition. IJCV 60(2), 91–110 (2004)CrossRef
20.
Zurück zum Zitat de Meneses, Y., Roduit, P., Luisier, F., Jacot, J.: Trajectory analysis for sport and video surveillance. ELCVIA 5(3), 148–156 (2005) de Meneses, Y., Roduit, P., Luisier, F., Jacot, J.: Trajectory analysis for sport and video surveillance. ELCVIA 5(3), 148–156 (2005)
21.
Zurück zum Zitat Ngo, C.W., Ma, Y.F., Zhang, H.J.: Automatic video summarization by graph modeling. In: ICCV, pp. 104–109 (2003) Ngo, C.W., Ma, Y.F., Zhang, H.J.: Automatic video summarization by graph modeling. In: ICCV, pp. 104–109 (2003)
22.
Zurück zum Zitat Nummiaro, K., Koller-Meier, E., Svoboda, T., Roth, D., Gool, L.V.: Color-based object tracking in multi-camera environments. Lect. Note. Comput. Sci. 2781, 591–599 (2003)CrossRef Nummiaro, K., Koller-Meier, E., Svoboda, T., Roth, D., Gool, L.V.: Color-based object tracking in multi-camera environments. Lect. Note. Comput. Sci. 2781, 591–599 (2003)CrossRef
23.
Zurück zum Zitat Perez, P., Gangnet, M., Black, A.: Poisson image editing. In: SIGGRAPH, pp. 313–318 (2003) Perez, P., Gangnet, M., Black, A.: Poisson image editing. In: SIGGRAPH, pp. 313–318 (2003)
24.
Zurück zum Zitat Pritch, Y., Ratovitch, S., Hendel, A., Peleg, S.: Clustered synopsis of surveillance video. In: AVSS, pp. 195–200 (2009) Pritch, Y., Ratovitch, S., Hendel, A., Peleg, S.: Clustered synopsis of surveillance video. In: AVSS, pp. 195–200 (2009)
25.
Zurück zum Zitat Pritch, Y., Rav-Ach, A., Peleg, S.: Webcam synopsis: peeking around the world. In: ICCV, pp. 1–8 (2007) Pritch, Y., Rav-Ach, A., Peleg, S.: Webcam synopsis: peeking around the world. In: ICCV, pp. 1–8 (2007)
26.
Zurück zum Zitat Pritch, Y., Rav-Ach, A., Peleg, S.: Nonchronological video synopsis and indexing. TPAMI 30(11), 1971–1984 (2008) Pritch, Y., Rav-Ach, A., Peleg, S.: Nonchronological video synopsis and indexing. TPAMI 30(11), 1971–1984 (2008)
27.
Zurück zum Zitat Rav-Ach, A., Pritch, Y., Peleg, S.: Making a long video short: dynamic video synopsis. In: CVPR, pp. 435–441 (2006) Rav-Ach, A., Pritch, Y., Peleg, S.: Making a long video short: dynamic video synopsis. In: CVPR, pp. 435–441 (2006)
28.
Zurück zum Zitat Rodriguez, M.D.: Cram: compact representation of actions in movies. In: CVPR, pp. 3328–3335 (2010) Rodriguez, M.D.: Cram: compact representation of actions in movies. In: CVPR, pp. 3328–3335 (2010)
29.
Zurück zum Zitat Sheikh, Y., Shah, M.: Trajectory association across multiple airborne cameras. TPAMI 30(2), 361–367 (2008)CrossRef Sheikh, Y., Shah, M.: Trajectory association across multiple airborne cameras. TPAMI 30(2), 361–367 (2008)CrossRef
30.
Zurück zum Zitat Smith, M.A., Kanade, T.: Video skimming and characterization through the combination of image and language understanding techniques. In: CVPR, pp. 775–781 (1997) Smith, M.A., Kanade, T.: Video skimming and characterization through the combination of image and language understanding techniques. In: CVPR, pp. 775–781 (1997)
31.
Zurück zum Zitat Sun, J., Zhang, W., Tang, X., Shum, H.: Background cut. In: ECCV, pp. 628–641 (2006) Sun, J., Zhang, W., Tang, X., Shum, H.: Background cut. In: ECCV, pp. 628–641 (2006)
32.
Zurück zum Zitat Taj, M., Maggio, E., Cavallaro, A.: Multi-feature graph-based object tracking. In: Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships, Southampton, pp. 190–199 (2006) Taj, M., Maggio, E., Cavallaro, A.: Multi-feature graph-based object tracking. In: Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships, Southampton, pp. 190–199 (2006)
33.
Zurück zum Zitat Tian, Z., Xue, J., Lan, X., Li, C., Zheng, N.: Key object-based static video summarization. In: ACMMM, pp. 1301–1304 (2011) Tian, Z., Xue, J., Lan, X., Li, C., Zheng, N.: Key object-based static video summarization. In: ACMMM, pp. 1301–1304 (2011)
34.
Zurück zum Zitat Wang, H., Klaser, A., Schmid, C., Cheng-Lin, L.: Action recognition by dense trajectories. In: CVPR, pp. 3169–3176 (2011) Wang, H., Klaser, A., Schmid, C., Cheng-Lin, L.: Action recognition by dense trajectories. In: CVPR, pp. 3169–3176 (2011)
35.
Zurück zum Zitat Wang, X.: Intelligent multi-camera video surveillance: A review. PR Letters 34(1), 3C19 (2011) Wang, X.: Intelligent multi-camera video surveillance: A review. PR Letters 34(1), 3C19 (2011)
36.
Zurück zum Zitat Wu, Z., Hristov, N.I., Hedrick, T.L., Kunz, T.H., Betke, M.: Tracking a large number of objects from multiple views. In: ICCV, pp. 1546–1553 (2009) Wu, Z., Hristov, N.I., Hedrick, T.L., Kunz, T.H., Betke, M.: Tracking a large number of objects from multiple views. In: ICCV, pp. 1546–1553 (2009)
37.
Zurück zum Zitat Xu, M., Li, S., Li, B., Yuan, X., Xiang, S.: A set theoretical method for video synopsis. In: Multimedia, Information Retrieval, pp. 366–370 (2008) Xu, M., Li, S., Li, B., Yuan, X., Xiang, S.: A set theoretical method for video synopsis. In: Multimedia, Information Retrieval, pp. 366–370 (2008)
38.
Zurück zum Zitat Yongduek, S.C., Choi, S., Seo, Y., Kim, H., sang Hong, K.: Where are the ball and players? soccer game analysis with color based tracking and image mosaick. In: ICIAP, pp. 196–203 (1997) Yongduek, S.C., Choi, S., Seo, Y., Kim, H., sang Hong, K.: Where are the ball and players? soccer game analysis with color based tracking and image mosaick. In: ICIAP, pp. 196–203 (1997)
39.
Zurück zum Zitat Zhang, T., Liu, S., Xu, C., Lu, H.: Mining semantic context information for intelligent visual surveillance. TII 9(1), 149–160 (2012) Zhang, T., Liu, S., Xu, C., Lu, H.: Mining semantic context information for intelligent visual surveillance. TII 9(1), 149–160 (2012)
40.
Zurück zum Zitat Zhang, T., Lu, H., Li, S.Z.: Learning semantic scene models by object classification and trajectory clustering. In: CVPR, pp. 1940–1947 (2009) Zhang, T., Lu, H., Li, S.Z.: Learning semantic scene models by object classification and trajectory clustering. In: CVPR, pp. 1940–1947 (2009)
41.
Zurück zum Zitat Zhu, X., Wu, X., Fan, J., Elmagarmid, A.K., Aref, W.G.: Exploring video content structure for heirarchical summarization. In. Multimedia Syst., pp. 98–115 (2004) Zhu, X., Wu, X., Fan, J., Elmagarmid, A.K., Aref, W.G.: Exploring video content structure for heirarchical summarization. In. Multimedia Syst., pp. 98–115 (2004)
Metadaten
Titel
Key observation selection-based effective video synopsis for camera network
verfasst von
Xiaobin Zhu
Jing Liu
Jinqiao Wang
Hanqing Lu
Publikationsdatum
01.01.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 1/2014
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-013-0519-8

Weitere Artikel der Ausgabe 1/2014

Machine Vision and Applications 1/2014 Zur Ausgabe