Welcome to the InfoSci Platform
Reference Hub4
Semi-Supervised Multimodal Fusion Model for Social Event Detection on Web Image Collections

Semi-Supervised Multimodal Fusion Model for Social Event Detection on Web Image Collections

Zhenguo Yang, Qing Li, Zheng Lu, Yun Ma, Zhiguo Gong, Haiwei Pan, Yangbin Chen
Copyright: © 2015 |Volume: 6 |Issue: 4 |Pages: 22
ISSN: 1947-8534|EISSN: 1947-8542|EISBN13: 9781466677166|DOI: 10.4018/IJMDEM.2015100101
Cite Article Cite Article

MLA

Yang, Zhenguo, et al. "Semi-Supervised Multimodal Fusion Model for Social Event Detection on Web Image Collections." IJMDEM vol.6, no.4 2015: pp.1-22. http://doi.org/10.4018/IJMDEM.2015100101

APA

Yang, Z., Li, Q., Lu, Z., Ma, Y., Gong, Z., Pan, H., & Chen, Y. (2015). Semi-Supervised Multimodal Fusion Model for Social Event Detection on Web Image Collections. International Journal of Multimedia Data Engineering and Management (IJMDEM), 6(4), 1-22. http://doi.org/10.4018/IJMDEM.2015100101

Chicago

Yang, Zhenguo, et al. "Semi-Supervised Multimodal Fusion Model for Social Event Detection on Web Image Collections," International Journal of Multimedia Data Engineering and Management (IJMDEM) 6, no.4: 1-22. http://doi.org/10.4018/IJMDEM.2015100101

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

In this work, the authors aim to detect social events from Web images by devising a semi-supervised multimodal fusion model, denoted as SMF. With a multimodal feature fusion layer and a feature reinforcement layer, SMF learns feature histograms to represent the images, fusing multiple heterogeneous features seamlessly and efficiently. Particularly, a self-tuning approach is proposed to tune the parameters in the process of feature reinforcement automatically. Furthermore, to deal with missing values in raw features, prior knowledge is utilized to estimate the missing ones as a preprocessing step, and SMF will further extend an extra attribute to indicate if the values in the fused feature are missing. Based on the fused expression achieved by SMF, a series of algorithms are designed by adopting clustering and classification strategies separately. Extensive experiments conducted on the MediaEval social event detection challenge reveal that SMF-based approaches outperform the baselines.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.