Jiang Bian
Skip Abstract Section
Abstract
This article comprehensively surveys the development of trajectory data classification. Considering the critical role of trajectory data classification in modern intelligent systems for surveillance security, abnormal behavior detection, crowd behavior analysis, and traffic control, trajectory data classification has attracted growing attention. According to the availability of manual labels, which is critical to the classification performances, the methods can be classified into three categories, i.e., unsupervised, semi-supervised, and supervised. Furthermore, classification methods are divided into some sub-categories according to what extracted features are used. We provide a holistic understanding and deep insight into three types of trajectory data classification methods and present some promising future directions.
- Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade. 2011. Trajectory space: A dual representation for nonrigid structure from motion. IEEE Trans. Pattern Anal. Mach. Intell. 33, 7 (2011), 1442--1456. Google Scholar
Digital Library
- Alexandre Alahi, Kratarth Goel, Vignesh Ramanathan, Alexandre Robicquet, Li Fei-Fei, and Silvio Savarese. 2016. Social lstm: Human trajectory prediction in crowded spaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 961--971.Google ScholarCross Ref
- Aris Anagnostopoulos, Michail Vlachos, Marios Hadjieleftheriou, Eamonn Keogh, and Philip S. Yu. 2006. Global distance-based segmentation of trajectories. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 34--43. Google ScholarDigital Library
- Gennady Andrienko, Natalia Andrienko, Salvatore Rinzivillo, Mirco Nanni, Dino Pedreschi, and Fosca Giannotti. 2009. Interactive visual clustering of large collections of trajectories. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (VAST’09). IEEE, 3--10.Google ScholarCross Ref
- Gianluca Antonini, Santiago Venegas Martinez, Michel Bierlaire, and Jean Philippe Thiran. 2006. Behavioral priors for detection and tracking of pedestrians in video sequences. Int. J. Comput. Vision 69, 2 (2006), 159--180. Google ScholarDigital Library
- Gianluca Antonini and Jean-Philippe Thiran. 2006. Counting pedestrians in video sequences using trajectory clustering. IEEE Trans. Circ. Syst. Video Technol. 16, 8 (2006), 1008--1020. Google ScholarDigital Library
- Stefan Atev, Osama Masoud, and Nikolaos Papanikolopoulos. 2006. Learning traffic patterns at intersections by spectral clustering of motion trajectories. In Proceedings of the International Conference on Intelligent Robots and Systems (IROS’06). 4851--4856.Google ScholarCross Ref
- Stefan Atev, Grant Miller, and Nikolaos P. Papanikolopoulos. 2010. Clustering of vehicle trajectories. IEEE Trans. Intell. Transport. Syst. 11, 3 (2010), 647--657. Google ScholarDigital Library
- Petko Bakalov, Marios Hadjieleftheriou, and Vassilis J. Tsotras. 2005. Time relaxed spatiotemporal trajectory joins. In Proceedings of the 13th Annual ACM International Workshop on Geographic Information Systems. ACM, 182--191. Google ScholarDigital Library
- Faisal I. Bashir, Ashfaq A. Khokhar, and Dan Schonfeld. 2007. Object trajectory-based activity classification and recognition using hidden Markov models. IEEE Trans. Image Process. 16, 7 (2007), 1912--1919. Google ScholarDigital Library
- Faisal I. Bashir, Ashfaq A. Khokhar, and Dan Schonfeld. 2007. Real-time motion trajectory-based indexing and retrieval of video sequences. IEEE Trans. Multimedia 9, 1 (2007), 58--65. Google ScholarDigital Library
- Miguel Angel Bautista, Antonio Hernández-Vela, Sergio Escalera, Laura Igual, Oriol Pujol, Josep Moya, Verónica Violant, and María T. Anguera. 2016. A gesture recognition system for detecting behavioral patterns of ADHD. IEEE Trans. Cybernet. 46, 1 (2016), 136--147.Google ScholarCross Ref
- Norbert Brandle, Dietmar Bauer, and Stefan Seer. 2006. Track-based finding of stopping pedestrians-a practical approach for analyzing a public infrastructure. In Proceedings of the IEEE Intelligent Transportation Systems Conference. IEEE, 115--120.Google ScholarCross Ref
- Thomas Brinkhoff. 2002. A framework for generating network-based moving objects. GeoInformatica 6, 2 (2002), 153--180. Google ScholarDigital Library
- Andries E. Brouwer and Willem H. Haemers. 2011. Spectra of Graphs. Springer Science 8 Business Media.Google Scholar
- Thomas Brox and Jitendra Malik. 2010. Object segmentation by long term analysis of point trajectories. In Proceedings of the European Conference on Computer Vision. Springer, 282--295. Google ScholarDigital Library
- Emma Brunskill, Thomas Kollar, and Nicholas Roy. 2007. Topological mapping using spectral clustering and classification. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 3491--3496.Google ScholarCross Ref
- Yingyi Bu, Lei Chen, Ada Wai-Chee Fu, and Dawei Liu. 2009. Efficient anomaly monitoring over moving object trajectory streams. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 159--168. Google ScholarDigital Library
- Judith Butepage, Michael J. Black, Danica Kragic, and Hedvig Kjellstrom. 2017. Deep representation learning for human motion prediction and classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6158--6166.Google ScholarCross Ref
- Guochen Cai, Kyungmi Lee, and Ickjai Lee. 2016. A framework for mining semantic-level tourist movement behaviours from geo-tagged photos. In Proceedings of the Australasian Joint Conference on Artificial Intelligence. Springer, 519--524.Google ScholarCross Ref
- Olivier Cappé, Simon J. Godsill, and Eric Moulines. 2007. An overview of existing methods and recent advances in sequential Monte Carlo. Proc. IEEE 95, 5 (2007), 899--924.Google ScholarCross Ref
- Rima Chaker, Zaher Al Aghbari, and Imran N. Junejo. 2017. Social network model for crowd anomaly detection and localization. Pattern Recogn. 61 (2017), 266--281. Google ScholarDigital Library
- Guangliang Chen and Gilad Lerman. 2009. Spectral curvature clustering (SCC). Int. J. Comput. Vision 81, 3 (2009), 317--330. Google ScholarDigital Library
- Jinyang Chen, Rangding Wang, Liangxu Liu, and Jiatao Song. 2011. Clustering of trajectories based on Hausdorff distance. In Proceedings of the International Conference on Electronics, Communications and Control (ICECC’11). IEEE, 1940--1944.Google ScholarCross Ref
- Wei Chen and Jason J. Corso. 2015. Action detection by implicit intentional motion clustering. In Proceedings of the IEEE International Conference on Computer Vision. 3298--3306. Google ScholarDigital Library
- Zaiben Chen, Heng Tao Shen, Xiaofang Zhou, Yu Zheng, and Xing Xie. 2010. Searching trajectories by locations: An efficiency study. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 255--266. Google ScholarDigital Library
- Kyunghyun Cho and Xi Chen. 2014. Classifying and visualizing motion capture sequences using deep neural networks. In Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP’14), Vol. 2. IEEE, 122--130.Google Scholar
- Minsu Cho and Kyoung MuLee. 2010. Authority-shift clustering: Hierarchical clustering by authority seeking on graphs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’10). IEEE, 3193--3200.Google ScholarCross Ref
- Dong-Wan Choi, Jian Pei, and Thomas Heinis. 2017. Efficient mining of regional movement patterns in semantic trajectories. Proc. VLDB Endow. 10, 13 (2017), 2073--2084. Google ScholarDigital Library
- César Roberto De Souza, Adrien Gaidon, Eleonora Vig, and Antonio Manuel López. 2016. Sympathy for the details: Dense trajectories and hybrid classification architectures for action recognition. In Proceedings of the European Conference on Computer Vision. Springer, 697--716.Google ScholarCross Ref
- Ke Deng, Kexin Xie, Kevin Zheng, and Xiaofang Zhou. 2011. Trajectory indexing and retrieval. In Computing with Spatial Trajectories. Springer, 35--60.Google Scholar
- Maxime Devanne, Stefano Berretti, Pietro Pala, Hazem Wannous, Mohamed Daoudi, and Alberto Del Bimbo. 2017. Motion segment decomposition of RGB-D sequences for human behavior understanding. Pattern Recogn. 61 (2017), 222--233. Google ScholarDigital Library
- Maxime Devanne, Hazem Wannous, Stefano Berretti, Pietro Pala, Mohamed Daoudi, and Alberto Del Bimbo. 2015. 3D human action recognition by shape analysis of motion trajectories on riemannian manifold. IEEE Trans. Cybernet. 45, 7 (2015), 1340--1352.Google ScholarCross Ref
- Jeffrey Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko, and Trevor Darrell. 2015. Long-term recurrent convolutional networks for visual recognition and description. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2625--2634.Google ScholarCross Ref
- Ehsan Elhamifar and René Vidal. 2009. Sparse subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 2790--2797.Google ScholarCross Ref
- Hamza Ergezer and Kemal Leblebicioğlu. 2016. Anomaly detection and activity perception using covariance descriptor for trajectories. In Proceedings of the European Conference on Computer Vision. Springer, 728--742.Google ScholarCross Ref
- Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the Conference on Knowledge Discovery and Data Mining (KDD’96), Vol. 96. 226--231. Google ScholarDigital Library
- Diego R. Faria and Jorge Dias. 2009. 3D hand trajectory segmentation by curvatures and hand orientation for classification through a probabilistic approach. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 1284--1289. Google ScholarDigital Library
- Nivan Ferreira, James T. Klosowski, Carlos E. Scheidegger, and Cláudio T. Silva. 2013. Vector field k-means: Clustering trajectories by fitting multiple vector fields. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 201--210. Google ScholarDigital Library
- Katerina Fragkiadaki, Pablo Arbelaez, Panna Felsen, and Jitendra Malik. 2015. Learning to segment moving objects in videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4083--4090.Google ScholarCross Ref
- Elias Frentzos, Kostas Gratsias, Nikos Pelekis, and Yannis Theodoridis. 2007. Algorithms for nearest neighbor search on moving object trajectories. Geoinformatica 11, 2 (2007), 159--193. Google ScholarDigital Library
- Adrien Gaidon, Zaid Harchaoui, and Cordelia Schmid. 2014. Activity representation with motion hierarchies. Int. J. Comput. Vision 107, 3 (2014), 219--238. Google ScholarDigital Library
- Laurent Galluccio, Olivier Michel, Pierre Comon, and Alfred O. Hero. 2012. Graph-based k-means clustering. Signal Process. 92, 9 (2012), 1970--1984. Google ScholarDigital Library
- Chuang Gan, Naiyan Wang, Yi Yang, Dit-Yan Yeung, and Alex G. Hauptmann. 2015. Devnet: A deep event network for multimedia event detection and evidence recounting. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2568--2577.Google Scholar
- Yun-Jun Gao, Chun Li, Gen-Cai Chen, Ling Chen, Xian-Ta Jiang, and Chun Chen. 2007. Efficient k-nearest-neighbor search algorithms for historical moving object trajectories. J. Comput. Sci. Technol. 22, 2 (2007), 232--244. Google ScholarDigital Library
- Rohit Girdhar, Deva Ramanan, Abhinav Gupta, Josef Sivic, and Bryan Russell. 2017. Actionvlad: Learning spatio-temporal aggregation for action classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’17). IEEE, 3165--3174.Google ScholarCross Ref
- Joachim Gudmundsson and Marc van Kreveld. 2006. Computing longest duration flocks in trajectory data. In Proceedings of the 14th Annual ACM International Symposium on Advances in Geographic Information Systems. ACM, 35--42. Google ScholarDigital Library
- Joachim Gudmundsson, Marc van Kreveld, and Bettina Speckmann. 2004. Efficient detection of motion patterns in spatio-temporal data sets. In Proceedings of the 12th Annual ACM International Workshop on Geographic Information Systems. ACM, 250--257. Google ScholarDigital Library
- Diansheng Guo, Shufan Liu, and Hai Jin. 2010. A graph-based approach to vehicle trajectory analysis. J. Locat. Based Serv. 4, 3--4 (2010), 183--199. Google ScholarDigital Library
- Sashi Gurung, Dan Lin, Wei Jiang, Ali Hurson, and Rui Zhang. 2014. Traffic information publication with privacy preservation. ACM Trans. on Intell. Syst. Technol. 5, 3 (2014), 44. Google ScholarDigital Library
- Mahmudul Hasan and Amit K. Roy-Chowdhury. 2015. A continuous learning framework for activity recognition using deep hybrid feature models. IEEE Trans. Multimedia 17, 11 (2015), 1909--1922.Google ScholarDigital Library
- Dezhi Hong, Quanquan Gu, and Kamin Whitehouse. 2017. High-dimensional time series clustering via cross-predictability. In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS’17). 642--651.Google Scholar
- Han Hu, Jianjiang Feng, and Jie Zhou. 2015. Exploiting unsupervised and supervised constraints for subspace clustering. IEEE Trans. Pattern Anal. Mach. Intell. 37, 8 (2015), 1542--1557.Google ScholarDigital Library
- Weiming Hu, Xi Li, Guodong Tian, Stephen Maybank, and Zhongfei Zhang. 2013. An incremental DPMM-based method for trajectory clustering, modeling, and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35, 5 (2013), 1051--1065. Google ScholarDigital Library
- Weiming Hu, Xuejuan Xiao, Zhouyu Fu, Dan Xie, Tieniu Tan, and Steve Maybank. 2006. A system for learning statistical motion patterns. IEEE Trans. Pattern Anal. Mach. Intell. 28, 9 (2006), 1450--1464. Google ScholarDigital Library
- Weiming Hu, Dan Xie, Zhouyu Fu, Wenrong Zeng, and Steve Maybank. 2007. Semantic-based surveillance video retrieval. IEEE Trans. Image Process. 16, 4 (2007), 1168--1181. Google ScholarDigital Library
- Hoyoung Jeung, Man Lung Yiu, Xiaofang Zhou, Christian S. Jensen, and Heng Tao Shen. 2008. Discovery of convoys in trajectory databases. Proc. VLDB Endow. 1, 1 (2008), 1068--1080. Google ScholarDigital Library
- Yu-Gang Jiang, Qi Dai, Xiangyang Xue, Wei Liu, and Chong-Wah Ngo. 2012. Trajectory-based modeling of human actions with motion reference points. In Proceedings of the European Conference on Computer Vision. Springer, 425--438. Google ScholarDigital Library
- Yu-Gang Jiang, Zuxuan Wu, Jun Wang, Xiangyang Xue, and Shih-Fu Chang. 2015. Exploiting feature and class relationships in video categorization with regularized deep neural networks. arXiv preprint arXiv:1502.07209. Google ScholarDigital Library
- Imran N. Junejo and Hassan Foroosh. 2008. Euclidean path modeling for video surveillance. Image Vision Comput. 26, 4 (2008), 512--528. Google ScholarDigital Library
- Margret Keuper, Bjoern Andres, and Thomas Brox. 2015. Motion trajectory segmentation via minimum cost multicuts. In Proceedings of the IEEE International Conference on Computer Vision. 3271--3279. Google ScholarDigital Library
- Hnin Su Khaing and Thandar Thein. 2014. An efficient clustering algorithm for moving object trajectories. In Proceedings of the 3rd International Conference on Computational techniques and Artificial Intelligence (ICCTAI’14). 11--12.Google Scholar
- Aida Khosroshahi, Eshed Ohn-Bar, and Mohan Manubhai Trivedi. 2016. Surround vehicles trajectory analysis with recurrent neural networks. In Proceedings of the IEEE 19th International Conference on Intelligent Transportation Systems (ITSC’16). IEEE, 2267--2272.Google ScholarDigital Library
- ZuWhan Kim. 2008. Real time object tracking based on dynamic feature grouping with background subtraction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’08). IEEE, 1--8.Google Scholar
- Alexander Klaser, Marcin Marszałek, and Cordelia Schmid. 2008. A spatio-temporal descriptor based on 3D-gradients. In Proceedings of the 19th British Machine Vision Conference (BMVC’08). British Machine Vision Association, 275--1.Google ScholarCross Ref
- Xiangjie Kong, Menglin Li, Kai Ma, Kaiqi Tian, Mengyuan Wang, Zhaolong Ning, and Feng Xia. 2018. Big trajectory data: A survey of applications and services. IEEE Access 6 (2018), 58295--58306.Google ScholarCross Ref
- Dana Kulić, Wataru Takano, and Yoshihiko Nakamura. 2008. Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden Markov chains. Int. J. Robot. Res. 27, 7 (2008), 761--784. Google ScholarDigital Library
- Suryansh Kumar, Yuchao Dai, and Hongdong Li. 2017. Spatio-temporal union of subspaces for multi-body non-rigid structure-from-motion. Pattern Recogn. 71 (2017), 428--443.Google ScholarCross Ref
- Ivan Laptev, Marcin Marszalek, Cordelia Schmid, and Benjamin Rozenfeld. 2008. Learning realistic human actions from movies. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’08). IEEE, 1--8.Google ScholarCross Ref
- Fabien Lauer and Christoph Schnörr. 2009. Spectral clustering of linear subspaces for motion segmentation. In Proceedings of the IEEE 12th International Conference on Computer Vision. IEEE, 678--685.Google ScholarCross Ref
- Rikard Laxhammar and Göran Falkman. 2014. Online learning and sequential anomaly detection in trajectories. IEEE Trans. Pattern Anal. Mach. Intell. 36, 6 (2014), 1158--1173. Google ScholarDigital Library
- Jae-Gil Lee, Jiawei Han, Xiaolei Li, and Hector Gonzalez. 2008. TraClass: Trajectory classification using hierarchical region-based and trajectory-based clustering. Proc. VLDB Endow. 1, 1 (2008), 1081--1094. Google ScholarDigital Library
- Jae-Gil Lee, Jiawei Han, and Kyu-Young Whang. 2007. Trajectory clustering: A partition-and-group framework. In Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, 593--604. Google ScholarDigital Library
- Xiaohui Li, Vaida Ceikute, Christian S. Jensen, and Kian-Lee Tan. 2013. Effective online group discovery in trajectory databases. IEEE Trans. Knowl. Data Eng. 25, 12 (2013), 2752--2766. Google ScholarDigital Library
- Xiaolei Li, Jiawei Han, Jae-Gil Lee, and Hector Gonzalez. 2007. Traffic density-based discovery of hot routes in road networks. In Proceedings of the International Symposium on Spatial and Temporal Databases. Springer, 441--459. Google ScholarDigital Library
- Xi Li, Weiming Hu, and Wei Hu. 2006. A coarse-to-fine strategy for vehicle motion trajectory clustering. In Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Vol. 1. IEEE, 591--594. Google ScholarDigital Library
- Zhenhui Li, Jae-Gil Lee, Xiaolei Li, and Jiawei Han. 2010. Incremental clustering for trajectories. In Proceedings of the International Conference on Database Systems for Advanced Applications. Springer, 32--46. Google ScholarDigital Library
- Liang Lin, Yongyi Lu, Yan Pan, and Xiaowu Chen. 2012. Integrating graph partitioning and matching for trajectory analysis in video surveillance. IEEE Trans. Image Process. 21, 12 (2012), 4844--4857. Google ScholarDigital Library
- Wun-Guang Liou, Chung-Yang Hsieh, and Wei-Yang Lin. 2011. Trajectory-based sign language recognition using Discriminant Analysis in higher-dimensional feature space. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1--4. Google ScholarDigital Library
- Ming-Yu Liu, Oncel Tuzel, Srikumar Ramalingam, and Rama Chellappa. 2014. Entropy-rate clustering: Cluster analysis via maximizing a submodular function subject to a matroid constraint. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1 (2014), 99--112. Google ScholarDigital Library
- Xiaobai Liu, Liang Lin, Song-Chun Zhu, and Hai Jin. 2009. Trajectory parsing by cluster sampling in spatio-temporal graph. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 739--746.Google Scholar
- Pyry Matikainen, Martial Hebert, and Rahul Sukthankar. 2009. Trajectons: Action recognition through the motion analysis of tracked features. In Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops’09). IEEE, 514--521.Google ScholarCross Ref
- Pyry Matikainen, Martial Hebert, and Rahul Sukthankar. 2010. Representing pairwise spatial and temporal relations for action recognition. In Proceedings of the European Conference on Computer Vision. Springer, 508--521. Google ScholarDigital Library
- Jean Damascène Mazimpaka and Sabine Timpf. 2016. Trajectory data mining: A review of methods and applications. J. Spatial Info. Sci. 2016, 13 (2016), 61--99.Google Scholar
- José Melo, Andrew Naftel, Alexandre Bernardino, and José Santos-Victor. 2006. Detection and classification of highway lanes using vehicle motion trajectories. IEEE Trans. Intell. Transport. Syst. 7, 2 (2006), 188--200. Google ScholarDigital Library
- Yang Mo, Di Wu, and Yunyan Du. 2015. Application of trajectory clustering and regionalization to ocean eddies in the South China Sea. In Proceedings of the 2nd IEEE International Conference on Spatial Data Mining and Geographical Knowledge Services (ICSDM’15). IEEE, 45--48.Google ScholarCross Ref
- Brendan Morris and Mohan Trivedi. 2009. Learning trajectory patterns by clustering: Experimental studies and comparative evaluation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 312--319.Google ScholarCross Ref
- Brendan Tran Morris and Mohan Manubhai Trivedi. 2008. A survey of vision-based trajectory learning and analysis for surveillance. IEEE Trans. Circ. Syst. Video Technol. 18, 8 (2008), 1114--1127. Google ScholarDigital Library
- Brendan Tran Morris and Mohan Manubhai Trivedi. 2011. Trajectory learning for activity understanding: Unsupervised, multilevel, and long-term adaptive approach. IEEE Trans. Pattern Anal. Mach. Intell. 33, 11 (2011), 2287--2301. Google ScholarDigital Library
- Andrew Naftel and Shehzad Khalid. 2006. Motion trajectory learning in the DFT-coefficient feature space. In Proceedings of the 4th IEEE International Conference on Computer Vision Systems (ICVS’06). IEEE, 47--47. Google ScholarDigital Library
- Mirco Nanni and Dino Pedreschi. 2006. Time-focused clustering of trajectories of moving objects. J. Intell. Info. Syst. 27, 3 (2006), 267--289. Google ScholarDigital Library
- Bingbing Ni, Pierre Moulin, Xiaokang Yang, and Shuicheng Yan. 2015. Motion part regularization: Improving action recognition via trajectory selection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3698--3706.Google ScholarCross Ref
- Peter Ochs, Jitendra Malik, and Thomas Brox. 2014. Segmentation of moving objects by long term video analysis. IEEE Trans. Pattern Anal. Mach. Intell. 36, 6 (2014), 1187--1200. Google ScholarDigital Library
- Andrey Tietbohl Palma, Vania Bogorny, Bart Kuijpers, and Luis Otavio Alvares. 2008. A clustering-based approach for discovering interesting places in trajectories. In Proceedings of the ACM Symposium on Applied Computing. ACM, 863--868. Google ScholarDigital Library
- Guillem Palou and Philippe Salembier. 2013. Hierarchical video representation with trajectory binary partition tree. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2099--2106. Google ScholarDigital Library
- Nikos Pelekis, Ioannis Kopanakis, Evangelos E. Kotsifakos, Elias Frentzos, and Yannis Theodoridis. 2009. Clustering trajectories of moving objects in an uncertain world. In Proceedings of the IEEE International Conference on Data Mining (ICDM’09), Vol. 9. 417--427. Google ScholarDigital Library
- Nikos Pelekis, Ioannis Kopanakis, Evangelos E. Kotsifakos, Elias Frentzos, and Yannis Theodoridis. 2011. Clustering uncertain trajectories. Knowl. Info. Syst. 28, 1 (2011), 117--147. Google ScholarDigital Library
- Nikos Pelekis, Panagiotis Tampakis, Marios Vodas, Christos Doulkeridis, and Yannis Theodoridis. 2017. On temporal-constrained sub-trajectory cluster analysis. Data Min. Knowl. Discov. (2017), 1--37. Google ScholarDigital Library
- Claudio Piciarelli and Gian Luca Foresti. 2006. On-line trajectory clustering for anomalous events detection. Pattern Recogn. Lett. 27, 15 (2006), 1835--1842.Google ScholarDigital Library
- Claudio Piciarelli, Christian Micheloni, and Gian Luca Foresti. 2008. Trajectory-based anomalous event detection. IEEE Trans. Circ. Syst. Video Technol. 18, 11 (2008), 1544--1554. Google ScholarDigital Library
- Nicola Piotto, Nicola Conci, and Francesco G. B. De Natale. 2009. Syntactic matching of trajectories for ambient intelligence applications. IEEE Trans. Multimedia 11, 7 (2009), 1266--1275. Google ScholarDigital Library
- Stergios Poularakis and Ioannis Katsavounidis. 2016. Low-complexity hand gesture recognition system for continuous streams of digits and letters. IEEE Trans. Cybernet. 46, 9 (2016), 2094--2108.Google ScholarCross Ref
- Hossein Rahmani, Ajmal Mian, and Mubarak Shah. 2018. Learning a deep model for human action recognition from novel viewpoints. IEEE Trans. Pattern Anal. Mach. Intell. 40, 3 (2018), 667--681.Google ScholarCross Ref
- Michalis Raptis, Iasonas Kokkinos, and Stefano Soatto. 2012. Discovering discriminative action parts from mid-level video representations. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1242--1249. Google ScholarDigital Library
- Joachim Schenk and Gerhard Rigoll. 2006. Novel hybrid NN/HMM modelling techniques for on-line handwriting recognition. In Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition. Suvisoft.Google Scholar
- Tobias Schreck, Jürgen Bernard, Tatiana Von Landesberger, and Jörn Kohlhammer. 2009. Visual cluster analysis of trajectory data with interactive Kohonen maps. Info. Visual. 8, 1 (2009), 14--29. Google ScholarDigital Library
- Zhanpeng Shao and Youfu Li. 2016. On integral invariants for effective 3D motion trajectory matching and recognition. IEEE Trans. Cybernet. 46, 2 (2016), 511--523.Google ScholarCross Ref
- Yemin Shi, Yonghong Tian, Yaowei Wang, and Tiejun Huang. 2017. Sequential deep trajectory descriptor for action recognition with three-stream CNN. IEEE Trans. Multimedia 19, 7 (2017), 1510--1520.Google ScholarDigital Library
- Yemin Shi, Wei Zeng, Tiejun Huang, and Yaowei Wang. 2015. Learning deep trajectory descriptor for action recognition in videos using deep neural networks. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1--6.Google Scholar
- Rowland R. Sillito and Robert B. Fisher. 2008. Semi-supervised learning for anomalous trajectory detection. In Proceedings of the British Machine Vision Conference (BMVC’08), vol. 1. 035--1.Google Scholar
- Damien Simonnet, Eric Anquetil, and Manuel Bouillon. 2017. Multi-criteria handwriting quality analysis with online fuzzy models. Pattern Recogn. 69 (2017), 310--324. Google ScholarDigital Library
- Karen Simonyan and Andrew Zisserman. 2014. Two-stream convolutional networks for action recognition in videos. In Advances in Neural Information Processing Systems. MIT Press, 568--576. Google ScholarDigital Library
- Dinesh Singh and C. Krishna Mohan. 2017. Graph formulation of video activities for abnormal activity recognition. Pattern Recogn. 65 (2017), 265--272. Google ScholarDigital Library
- Francesco Solera, Simone Calderara, and Rita Cucchiara. 2016. Socially constrained structural learning for groups detection in crowd. IEEE Trans. Pattern Anal. Mach. Intell. 38, 5 (2016), 995--1008. Google ScholarDigital Library
- Ju Sun, Xiao Wu, Shuicheng Yan, Loong-Fah Cheong, Tat-Seng Chua, and Jintao Li. 2009. Hierarchical spatio-temporal context modeling for action recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 2004--2011.Google Scholar
- Naohiko Suzuki, Kosuke Hirasawa, Kenichi Tanaka, Yoshinori Kobayashi, Yoichi Sato, and Yozo Fujino. 2007. Learning motion patterns and anomaly detection by human trajectory analysis. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. IEEE, 498--503.Google Scholar
- Seyed Salim Tabatabaei, Mark Coates, and Michael Rabbat. 2011. Ganc: Greedy agglomerative normalized cut. arXiv preprint arXiv:1105.0974.Google Scholar
- Lu-An Tang, Yu Zheng, Jing Yuan, Jiawei Han, Alice Leung, Chih-Chieh Hung, and Wen-Chih Peng. 2012. On discovery of traveling companions from streaming trajectories. In Proceedings of the IEEE 28th International Conference on Data Engineering (ICDE’12). IEEE, 186--197. Google ScholarDigital Library
- Yannis Theodoridis, Jefferson RO Silva, and Mario A Nascimento. 1999. On the generation of spatiotemporal datasets. In Proceedings of the International Symposium on Spatial Databases. Springer, 147--164. Google ScholarDigital Library
- Eleftherios Tiakas, Apostolos N. Papadopoulos, Alexandros Nanopoulos, Yannis Manolopoulos, Dragan Stojanovic, and Slobodanka Djordjevic-Kajan. 2006. Trajectory similarity search in spatial networks. In Proceedings of the 10th International Database Engineering and Applications Symposium (IDEAS'06). IEEE, 185--192. Google ScholarDigital Library
- Francesco Turchini, Lorenzo Seidenari, and Alberto Del Bimbo. 2015. Understanding sport activities from correspondences of clustered trajectories. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 43--50. Google ScholarDigital Library
- Tinne Tuytelaars and Krystian Mikolajczyk. 2008. Local invariant feature detectors: A survey. Found. Trends Comput. Graph. Vision 3, 3 (2008), 177--280. Google ScholarDigital Library
- Hirofumi Uemura, Seiji Ishikawa, and Krystian Mikolajczyk. 2008. Feature tracking and motion compensation for action recognition. In Proceedings of the British Machine Vision Conference (BMVC’08). 1--10.Google ScholarCross Ref
- Ozge Uncu, William A. Gruver, Dilip B. Kotak, Dorian Sabaz, Zafeer Alibhai, and Colin Ng. 2006. Gridbscan: Grid density-based spatial clustering of applications with noise. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC’06), Vol. 4. IEEE, 2976--2981.Google ScholarCross Ref
- Marcos R. Vieira, Petko Bakalov, and Vassilis J. Tsotras. 2009. On-line discovery of flock patterns in spatio-temporal data. In Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 286--295. Google ScholarDigital Library
- Eleonora Vig, Michael Dorr, and David Cox. 2012. Space-variant descriptor sampling for action recognition based on saliency and eye movements. In Proceedings of the European Conference on Computer Vision. Springer, 84--97. Google ScholarDigital Library
- Monica Wachowicz, Rebecca Ong, Chiara Renso, and Mirco Nanni. 2011. Finding moving flock patterns among pedestrians through collective coherence. Int. J. Geogr. Info. Sci. 25, 11 (2011), 1849--1864.Google ScholarCross Ref
- Feng Wang, Yu-Gang Jiang, and Chong-Wah Ngo. 2008. Video event detection using motion relativity and visual relatedness. In Proceedings of the 16th ACM International Conference on Multimedia. ACM, 239--248. Google ScholarDigital Library
- Heng Wang, Alexander Kläser, Cordelia Schmid, and Cheng-Lin Liu. 2011. Action recognition by dense trajectories. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’11). IEEE, 3169--3176. Google ScholarDigital Library
- Heng Wang, Alexander Kläser, Cordelia Schmid, and Cheng-Lin Liu. 2013. Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vision 103, 1 (2013), 60--79.Google ScholarCross Ref
- Heng Wang, Dan Oneata, Jakob Verbeek, and Cordelia Schmid. 2016. A robust and efficient video representation for action recognition. Int. J. Comput. Vision 119, 3 (2016), 219--238. Google ScholarDigital Library
- He Wang and Carol O’Sullivan. 2016. Globally continuous and non-Markovian crowd activity analysis from videos. In Proceedings of the European Conference on Computer Vision. Springer, 527--544.Google ScholarCross Ref
- Heng Wang and Cordelia Schmid. 2013. Action recognition with improved trajectories. In Proceedings of the IEEE International Conference on Computer Vision. 3551--3558. Google ScholarDigital Library
- Heng Wang, Muhammad Muneeb Ullah, Alexander Klaser, Ivan Laptev, and Cordelia Schmid. 2009. Evaluation of local spatio-temporal features for action recognition. In Proceedings of the British Machine Vision Conference (BMVC’09). BMVA Press, 124--1.Google ScholarCross Ref
- Lijun Wang and Ming Dong. 2014. Detection of abnormal human behavior using a matrix approximation-based approach. In Proceedings of the 13th International Conference on Machine Learning and Applications (ICMLA’14). IEEE, 324--329. Google ScholarDigital Library
- Limin Wang, Yu Qiao, and Xiaoou Tang. 2015. Action recognition with trajectory-pooled deep-convolutional descriptors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4305--4314.Google ScholarCross Ref
- Limin Wang, Yuanjun Xiong, Zhe Wang, and Yu Qiao. 2015. Towards good practices for very deep two-stream convnets. arXiv preprint arXiv:1507.02159.Google Scholar
- Pichao Wang, Zhaoyang Li, Yonghong Hou, and Wanqing Li. 2016. Action recognition based on joint trajectory maps using convolutional neural networks. In Proceedings of the ACM on Multimedia Conference. ACM, 102--106. Google ScholarDigital Library
- Xiaogang Wang, Kinh Tieu, and Eric Grimson. 2006. Learning semantic scene models by trajectory analysis. In Proceedings of the European Conference on Computer Vision. Springer, 110--123. Google ScholarDigital Library
- Geert Willems, Tinne Tuytelaars, and Luc Van Gool. 2008. An efficient dense and scale-invariant spatio-temporal interest point detector. In Proceedings of the European Conference on Computer Vision. Springer, 650--663. Google ScholarDigital Library
- Zuxuan Wu, Yanwei Fu, Yu-Gang Jiang, and Leonid Sigal. 2016. Harnessing object and scene semantics for large-scale video understanding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3112--3121.Google ScholarCross Ref
- Zuxuan Wu, Yu-Gang Jiang, Jun Wang, Jian Pu, and Xiangyang Xue. 2014. Exploring inter-feature and inter-class relationships with deep neural networks for video classification. In Proceedings of the 22nd ACM International Conference on Multimedia. ACM, 167--176. Google ScholarDigital Library
- Tao Xiang and Shaogang Gong. 2008. Spectral clustering with eigenvector selection. Pattern Recogn. 41, 3 (2008), 1012--1029. Google ScholarDigital Library
- Hongteng Xu, Yang Zhou, Weiyao Lin, and Hongyuan Zha. 2015. Unsupervised trajectory clustering via adaptive multi-kernel-based shrinkage. In Proceedings of the IEEE International Conference on Computer Vision. 4328--4336. Google ScholarDigital Library
- Zhixian Yan, Christine Parent, Stefano Spaccapietra, and Dipanjan Chakraborty. 2010. A hybrid model and computing platform for spatio-semantic trajectories. In Proceedings of the Extended Semantic Web Conference. Springer, 60--75. Google ScholarDigital Library
- Tingting Yao, Zhiyong Wang, Zhao Xie, Jun Gao, and David Dagan Feng. 2017. Learning universal multiview dictionary for human action recognition. Pattern Recogn. 64 (2017), 236--244. Google ScholarDigital Library
- Hao Ye, Zuxuan Wu, Rui-Wei Zhao, Xi Wang, Yu-Gang Jiang, and Xiangyang Xue. 2015. Evaluating two-stream CNN for video classification. In Proceedings of the 5th ACM on International Conference on Multimedia Retrieval. ACM, 435--442. Google ScholarDigital Library
- Yang Yi and Maoqing Lin. 2016. Human action recognition with graph-based multiple-instance learning. Pattern Recogn. 53 (2016), 148--162. Google ScholarDigital Library
- Josh Jia-Ching Ying, Wang-Chien Lee, Tz-Chiao Weng, and Vincent S. Tseng. 2011. Semantic trajectory mining for location prediction. In Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 34--43. Google ScholarDigital Library
- Josh Jia-Ching Ying, Eric Hsueh-Chan Lu, Wang-Chien Lee, Tz-Chiao Weng, and Vincent S. Tseng. 2010. Mining user similarity from semantic trajectories. In Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Location-based Social Networks. ACM, 19--26. Google ScholarDigital Library
- Jin Soung Yoo, Shashi Shekhar, John Smith, and Julius P. Kumquat. 2004. A partial join approach for mining co-location patterns. In Proceedings of the 12th Annual ACM International Workshop on Geographic Information Systems. ACM, 241--249. Google ScholarDigital Library
- Chao Yuan and Amit Chakraborty. 2016. Deep convolutional factor analyser for multivariate time series modeling. In Proceedings of the IEEE 16th International Conference on Data Mining (ICDM’16). IEEE, 1323--1328.Google ScholarCross Ref
- Guan Yuan, Penghui Sun, Jie Zhao, Daxing Li, and Canwei Wang. 2017. A review of moving object trajectory clustering algorithms. Artific. Intell. Rev. 47, 1 (2017), 123--144. Google ScholarDigital Library
- Yuan Yuan, Yachuang Feng, and Xiaoqiang Lu. 2017. Statistical hypothesis detector for abnormal event detection in crowded scenes. IEEE Trans. Cybernet. 47, 11 (2017), 3597--3608.Google ScholarCross Ref
- Tianzhu Zhang, Hanqing Lu, and Stan Z. Li. 2009. Learning semantic scene models by object classification and trajectory clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09). IEEE, 1940--1947.Google Scholar
- Zhang Zhang, Kaiqi Huang, and Tieniu Tan. 2006. Comparison of similarity measures for trajectory clustering in outdoor surveillance scenes. In Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Vol. 3. IEEE, 1135--1138. Google ScholarDigital Library
- Zhang Zhang, Kaiqi Huang, Tieniu Tan, and Liangsheng Wang. 2007. Trajectory series analysis-based event rule induction for visual surveillance. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1--8.Google ScholarCross Ref
- Zhang Zhang, Kaiqi Huang, Tieniu Tan, Peipei Yang, and Jun Li. 2016. Red-sfa: Relation discovery-based slow feature analysis for trajectory clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 752--760.Google ScholarCross Ref
- Weiqi Zhao, Zhang Zhang, and Kaiqi Huang. 2018. Gestalt laws-based tracklets analysis for human crowd understanding. Pattern Recogn. 75 (2018), 112--127. Google ScholarDigital Library
- Bolong Zheng, Nicholas Jing Yuan, Kai Zheng, Xing Xie, Shazia Sadiq, and Xiaofang Zhou. 2015. Approximate keyword search in semantic trajectory database. In Proceedings of the IEEE 31st International Conference on Data Engineering (ICDE’15). IEEE, 975--986.Google ScholarCross Ref
- Kai Zheng, Yu Zheng, Nicholas Jing Yuan, and Shuo Shang. 2013. On discovery of gathering patterns from trajectories. In Proceedings of the IEEE 29th International Conference on Data Engineering (ICDE’13). IEEE, 242--253. Google ScholarDigital Library
- Yu Zheng. 2015. Trajectory data mining: An overview. ACM Trans. Intell. Syst. Technol. 6, 3 (2015), 29. Google ScholarDigital Library
- Yu Zheng, Xing Xie, and Wei-Ying Ma. 2010. GeoLife: A collaborative social networking service among user, location and trajectory. IEEE Data Eng. Bull. 33, 2 (2010), 32--39.Google Scholar
- Yu Zheng, Lizhu Zhang, Xing Xie, and Wei-Ying Ma. 2009. Mining interesting locations and travel sequences from GPS trajectories. In Proceedings of the 18th International Conference on World Wide Web. ACM, 791--800. Google ScholarDigital Library
- Qian-Yi Zhou and Vladlen Koltun. 2013. Dense scene reconstruction with points of interest. ACM Trans. Graph. 32, 4 (2013), 112. Google ScholarDigital Library
- Yue Zhou, Shuicheng Yan, and Thomas S. Huang. 2007. Detecting anomaly in videos from trajectory similarity analysis. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1087--1090.Google Scholar
Index Terms
- Trajectory Data Classification: A Review
Recommendations
Private Trajectory Data Publication for Trajectory Classification
Web Information Systems and ApplicationsAbstractTrajectory classification (TC), i.e., predicting the class labels of moving objects based on their trajectories and other features, has many important real-world applications. Private trajectory data publication is to anonymize trajectory data, ...
MasterMovelets: discovering heterogeneous movelets for multiple aspect trajectory classification
AbstractIn the last few years trajectory classification has been applied to many real problems, basically considering the dimensions of space and time or attributes inferred from these dimensions. However, with the explosion of social media data and the ...
A novel point-line duality feature for trajectory classification
Trajectory classification is important for understanding object movements within the surveillance area. Raw trajectories are represented by object location in form of (x, y) coordinates. The length of trajectories varies in terms of number of points; ...
Comments