Skip to main content

2017 | OriginalPaper | Buchkapitel

Action Graph Decomposition Based on Sparse Coding

verfasst von : Wengang Feng, Huawei Tian, Yanhui Xiao, Jianwei Ding, Yunqi Tang

Erschienen in: Image and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A video can be thought of as a visual document which may be represented from different dimensions such as frames, objects and other different levels of features. Action recognition is usually one of the most important and popular tasks, and requires the understanding of temporal and spatial cues in videos. What structures do the temporal relationships share in common inter- and intra-classes of actions? What is the best representation for those temporal relationships? We propose a new temporal relationship representation, called action graphs based on Laplacian matrices and Allen’s temporal relationships. Recognition framework based on sparse coding, which also mimics human vision system to represent and infer knowledge. To our best knowledge, “action graphs” is put forward to represent the temporal relationships. we are the first using sparse graph coding for event analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yuan, F., Xia, G.-S., Sahbi, H., Prinet, V.: Mid-level features and spatio-temporal context for activity recognition. Pattern Recogn. 45(12), 4182–4191 (2012)CrossRef Yuan, F., Xia, G.-S., Sahbi, H., Prinet, V.: Mid-level features and spatio-temporal context for activity recognition. Pattern Recogn. 45(12), 4182–4191 (2012)CrossRef
2.
Zurück zum Zitat Liu, J., Kuipers, B., Savarese, S.: Recognizing human actions by attributes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3337–3344 (2011) Liu, J., Kuipers, B., Savarese, S.: Recognizing human actions by attributes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3337–3344 (2011)
3.
Zurück zum Zitat Cheng, Y., Fan, Q., Pankanti, S., Choudhary, A.: Temporal sequence modeling for video event detection. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2235–2242 (2014) Cheng, Y., Fan, Q., Pankanti, S., Choudhary, A.: Temporal sequence modeling for video event detection. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2235–2242 (2014)
4.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013) Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
5.
Zurück zum Zitat Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T.S., Yan, S.: Sparse representation for computer vision and pattern recognition. Proc. IEEE 98(6), 1031–1044 (2010)CrossRef Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T.S., Yan, S.: Sparse representation for computer vision and pattern recognition. Proc. IEEE 98(6), 1031–1044 (2010)CrossRef
6.
Zurück zum Zitat Lee, H.: Unsupervised feature learning via sparse hierarchical representations, Ph.D. thesis, Stanford University (2010) Lee, H.: Unsupervised feature learning via sparse hierarchical representations, Ph.D. thesis, Stanford University (2010)
7.
Zurück zum Zitat Olshausen, B.A., et al.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583), 607–609 (1996)CrossRef Olshausen, B.A., et al.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381(6583), 607–609 (1996)CrossRef
9.
Zurück zum Zitat Zhao, B., Fei-Fei, L., Xing, E.P.: Online detection of unusual events in videos via dynamic sparse coding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3313–3320 (2011) Zhao, B., Fei-Fei, L., Xing, E.P.: Online detection of unusual events in videos via dynamic sparse coding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3313–3320 (2011)
10.
Zurück zum Zitat Zheng, M., Jiajun, B., Chen, C., Wang, C., Zhang, L., Qiu, G., Cai, D.: Graph regularized sparse coding for image representation. IEEE Trans. Image Process. 20(5), 1327–1336 (2011)MathSciNetCrossRefMATH Zheng, M., Jiajun, B., Chen, C., Wang, C., Zhang, L., Qiu, G., Cai, D.: Graph regularized sparse coding for image representation. IEEE Trans. Image Process. 20(5), 1327–1336 (2011)MathSciNetCrossRefMATH
11.
Zurück zum Zitat Sivalingam, R., Boley, D., Morellas, V., Papanikolopoulos, N.: Tensor sparse coding for positive definite matrices. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(3), 592–605 (2014)CrossRef Sivalingam, R., Boley, D., Morellas, V., Papanikolopoulos, N.: Tensor sparse coding for positive definite matrices. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(3), 592–605 (2014)CrossRef
12.
Zurück zum Zitat Cheng, G., Wan, Y., Santiteerakul, W., Tang, S., Buckles, B.: Action recognition with temporal relationships. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 671–675 (2013) Cheng, G., Wan, Y., Santiteerakul, W., Tang, S., Buckles, B.: Action recognition with temporal relationships. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 671–675 (2013)
13.
Zurück zum Zitat Gaur, U., Zhu, Y., Song, B., Roy-Chowdhury, A.: A string of feature graphs model for recognition of complex activities in natural videos. In: IEEE International Conference on Computer Vision (ICCV), pp. 2595–2602 (2011) Gaur, U., Zhu, Y., Song, B., Roy-Chowdhury, A.: A string of feature graphs model for recognition of complex activities in natural videos. In: IEEE International Conference on Computer Vision (ICCV), pp. 2595–2602 (2011)
14.
Zurück zum Zitat Ta, A.P., Wolf, C., Lavoue, G., Baskurt, A.: Recognizing and localizing individual activities through graph matching. In: IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 196–203 (2010) Ta, A.P., Wolf, C., Lavoue, G., Baskurt, A.: Recognizing and localizing individual activities through graph matching. In: IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 196–203 (2010)
15.
Zurück zum Zitat Brendel, W., Todorovic, S.: Learning spatiotemporal graphs for human activities. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 778–785 (2011) Brendel, W., Todorovic, S.: Learning spatiotemporal graphs for human activities. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 778–785 (2011)
16.
Zurück zum Zitat Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: IEEE Conference Computer Vision on Pattern Recognition (CVPR), pp. 3169–3176 (2011) Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: IEEE Conference Computer Vision on Pattern Recognition (CVPR), pp. 3169–3176 (2011)
17.
Zurück zum Zitat Vandenberghe, L., Boyd, S., Shaopo, W.: Determinant maximization with linear matrix inequality constraints. SIAM J. Matrix Anal. Appl. 19(2), 499–533 (1998)MathSciNetCrossRefMATH Vandenberghe, L., Boyd, S., Shaopo, W.: Determinant maximization with linear matrix inequality constraints. SIAM J. Matrix Anal. Appl. 19(2), 499–533 (1998)MathSciNetCrossRefMATH
Metadaten
Titel
Action Graph Decomposition Based on Sparse Coding
verfasst von
Wengang Feng
Huawei Tian
Yanhui Xiao
Jianwei Ding
Yunqi Tang
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-71607-7_5