skip to main content
10.1145/2072298.2072025acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Human group activity analysis with fusion of motion and appearance information

Authors Info & Claims
Published:28 November 2011Publication History

ABSTRACT

Human activity analysis is an important and challenging task in video content analysis and understanding. In this paper, we focus on the activity of small human group, which involves countable persons and complex interactions. To cope with the variant number of participants and inherent interactions within the activity, we propose a hierarchical model with three layers to depict the characteristics at different granularities. In traditional methods, group activity is represented mainly based on motion information, such as human trajectories, but ignoring discriminative appearance information, e.g. the rough sketch of a pose style. In our approach, we take advantage of both the motion and the appearance information in the spatiotemporal activity context under the hierarchical model. These features are inhomogeneous. Therefore, we employ multiple kernel learning methods to fuse the features for group activity recognition. Experiments on a surveillance-like human group activity database demonstrate the validity of our approach and the recognition performance is promising.

References

  1. Aggarwal, J.K. and Ryoo, M.S. 2011. Human activity analysis: A Review. ACM Computing Surveys (CSUR), v.43 n.3, p.1--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Niebles, J.C., Wang, H. and Fei-Fei, L. 2008. Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision (IJCV) 79, 3(Sep). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ryoo, M.S. and Aggarwal, J.K. 2009. Spatio-temporal relationship match: Video structure comparison for recognition of complex human activities. In ICCV.Google ScholarGoogle Scholar
  4. Mahadevan, V., Li,W., Bhalodia, V. and Vasconcelos, N. 2010. Anomaly Detection in Crowded Scenes. In IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarGoogle Scholar
  5. Ni, B., Yan, S. and Kassim, A. 2009. Recognizing Human Group Activities with Localized Causalities. In IEEE Conference on Computer Vision and Pattern Recognition.Google ScholarGoogle Scholar
  6. Zhu, G., Yan, S., Han, T.X. and Xu, C. 2011. Generative group activity analysis with quaternion descriptor. In International Conference on Advances in Multimedia Modeling. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Lan, T., Wang, Y., Yang, W. and Mori, G. 2010. Beyond Actions: Discriminative Models for Contextual Group Activities. In Annual Conference on Neural Information Processing Systems.Google ScholarGoogle Scholar
  8. Cheng, Z., Qin, L., Huang, Q., Jiang, S. and Tian, Q. 2010. Group Activity Recognition by Gaussian Process Estimation. In International Conference on Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Rasmussen, C. E. and Williams, C. K. I.2006. Gaussian Processes for Machine Learning. The MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Dalal, N. and Triggs, B. 2005. Histograms of oriented gradients for human detection. In IEEE Conference on Computer Vision and Pattern Recognition. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Human group activity analysis with fusion of motion and appearance information

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MM '11: Proceedings of the 19th ACM international conference on Multimedia
          November 2011
          944 pages
          ISBN:9781450306164
          DOI:10.1145/2072298

          Copyright © 2011 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 28 November 2011

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • short-paper

          Acceptance Rates

          Overall Acceptance Rate995of4,171submissions,24%

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader