ABSTRACT
As one of the most representative social media platforms, Twitter provides various real-life information on social events in real time. Despite that social event detection has been actively studied, tweet images, which appear in around 36 percent of the total tweets, have not been well utilized for this research problem. Most existing event detection methods tend to represent an image as a bag-of-visual-words and then process these visual words in the same way as textual words. This may not fully exploit the visual properties of images. State-of-the-art visual features like convolutional neural network (CNN) features have shown significant performance gains over the traditional bag-of-visual-words in unveiling the image's semantics. Unfortunately, they have not been employed in detecting events from social websites. Hence, how to make the most of tweet images to improve the performance of social event detection and visualization remains open. In this paper, we thoroughly study the impact of tweet images on social event detection for different event categories using various visual features. A novel topic model which jointly models five Twitter features (text, image, location, timestamp and hashtag) is designed to discover events from the sheer amount of tweets. Moreover, the evolutions of events are tracked by linking the events detected on adjacent days and each event is visualized by representative images selected on three predefined criteria. Extensive experiments have been conducted on a real-life tweet dataset to verify the effectiveness of our method.
- J. Bian, Y. Yang, and T.-S. Chua. Multimedia summarization for trending topics in microblogs. In CIKM, pages 1807--1812, 2013. Google ScholarDigital Library
- J. Bian, Y. Yang, and T.-S. Chua. Predicting trending messages and diffusion participants in microblogging network. In SIGIR, pages 537--546, 2014. Google ScholarDigital Library
- D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993--1022, 2003. Google ScholarCross Ref
- T. Chen, D. Lu, M.-Y. Kan, and P. Cui. Understanding and classifying image tweets. In ACM MM, pages 781--784, 2013. Google ScholarDigital Library
- A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. Ser. B, 39:1--38, 1977.Google ScholarCross Ref
- Q. Diao, J. Jiang, F. Zhu, and E.-P. Lim. Finding bursty topics from microblogs. In ACL, pages 536--544, 2012. Google ScholarDigital Library
- S. Geman and D. Geman. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell., 6(6):721--741, 1984. Google ScholarDigital Library
- W. H. Hsu, L. S. Kennedy, and S.-F. Chang. Video search reranking through random walk over document-level context graph. In ACM MM, pages 971--980, 2007. Google ScholarDigital Library
- Z. Huang, B. Hu, H. Cheng, H. T. Shen, H. Liu, and X. Zhou. Mining near-duplicate graph for cluster-based reranking of web video search results. ACM Trans. Inf. Syst., 28(4):22:1--22:27, 2010. Google ScholarDigital Library
- Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.Google Scholar
- D. Jiang, K. W. Leung, J. Vosecky, and W. Ng. Personalized query suggestion with diversity awareness. In ICDE, pages 400--411, 2014.Google ScholarCross Ref
- A. Khosla, B. An, J. J. Lim, and A. Torralba. Looking beyond the visible scene. In CVPR, pages 3710--3717, 2014. Google ScholarDigital Library
- R. Long, H. Wang, Y. Chen, O. Jin, and Y. Yu. Towards effective event detection, tracking and summarization on microblog data. In WAIM, pages 652--663, 2011. Google ScholarDigital Library
- Q. Mei, D. Zhou, and K. Church. Query suggestion using hitting time. In CIKM, pages 469--478, 2008. Google ScholarDigital Library
- T. Minka. Estimating a Dirichlet distribution. Technical report, MIT., 2000.Google Scholar
- J. Munkres. Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math., 5(1):32--38, 1957.Google ScholarCross Ref
- M. Oquab, L. Bottou, I. Laptev, and J. Sivic. Learning and transferring mid-level image representations using convolutional neural networks. In CVPR, pages 1717--1724, 2014. Google ScholarDigital Library
- D. Ramage, S. T. Dumais, and D. J. Liebling. Characterizing microblogs with topic models. In ICWSM, pages 130--137, 2010.Google Scholar
- A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson. CNN features off-the-shelf: an astounding baseline for recognition. arXiv preprint arXiv:1403.6382, 2014.Google Scholar
- S. D. Roy, T. Mei, W. Zeng, and S. Li. Socialtransfer: Cross-domain transfer learning from social streams for media applications. In ACM MM, pages 649--658, 2012. Google ScholarDigital Library
- B.-S. Seah, S. S. Bhowmick, and A. Sun. Prism: Concept-preserving social image search results summarization. In SIGIR, pages 737--746, 2014. Google ScholarDigital Library
- X. Wang and A. McCallum. Topics over time: A non-markov continuous-time model of topical trends. In KDD, pages 424--433, 2006. Google ScholarDigital Library
- Z. Wang, P. Cui, L. Xie, H. Chen, W. Zhu, and S. Yang. Analyzing social media via event facets. In ACM MM, pages 1359--1360, 2012. Google ScholarDigital Library
- C.-C. Wu, T. Mei, W. H. Hsu, and Y. Rui. Learning to personalize trending image search suggestion. In SIGIR, pages 727--736, 2014. Google ScholarDigital Library
- Y. Yang, Z. Zha, Y. Gao, X. Zhu, and T. Chua. Corrections to "exploiting web images for semantic video indexing via robust sample-specific loss". IEEE Trans. Multimedia, 17(2):256, 2015.Google ScholarCross Ref
- H. Yin, B. Cui, L. Chen, Z. Hu, and Z. Huang. A temporal context-aware model for user behavior modeling in social media systems. In SIGMOD, pages 1543--1554, 2014. Google ScholarDigital Library
- W. X. Zhao, J. Jiang, J. Weng, J. He, E.-P. Lim, H. Yan, and X. Li. Comparing twitter and traditional media using topic models. In ECIR, pages 338--349, 2011. Google ScholarDigital Library
- X. Zhou and L. Chen. Event detection over twitter social media streams. The VLDB Journal, 23(3):381--400, 2014. Google ScholarDigital Library
Index Terms
- What are Popular: Exploring Twitter Features for Event Detection, Tracking and Visualization
Recommendations
Visualization of Real-World Events with Geotagged Tweet Photos
ICMEW '12: Proceedings of the 2012 IEEE International Conference on Multimedia and Expo Workshopscommon, which enable people to post and read short messages from anywhere. Since microblogs are different from traditional blogs in terms of being instant and on the spot, they include much more information on various events happened over the world. In ...
Twitter Event Detection Under Spatio-Temporal Constraints
Algorithms and Architectures for Parallel ProcessingAbstractBillions of data spread on Twitter every day, which carries a lot of information. It is meaningful to mine the useful information and make it valuable. The purpose of Twitter event detection is to detect what happened in our real life from these ...
EventEye: Monitoring Evolving Events from Tweet Streams
MM '14: Proceedings of the 22nd ACM international conference on MultimediaWith the rapid growth in popularity of social websites, social event detection has become one of the hottest research topics. However, continuously monitoring social events has not been well studied. In this demo, we present a novel system called ...
Comments