Yi-Feng Pan
ABSTRACT
In the real world, there are a huge amount of advertisement (ad) boards to make customers have a visual awareness of the products or services easily. However, information appearing in the ad boards is so limited that customers always want to know more ad details in a convenient way. In this paper, we present an mobile-based prototype system to automatically extract web ad information from images and websites. After capturing ad images by smartphones and sending them to a remote server, ad image text is recognized by OCR engine, from where ad phrases and keywords are extracted and combined together as queries. Ad web page candidates are then obtained by specific search engines and clustered to remove noises. OCR results are further used to estimate valid ad topic web pages which are pushed back to end users for searching more detailed ad information. Based on the experiments on a real-world ad image dataset collected by ourselves, true ad topic web pages can be found from top-one and top-ten returned pages in about 51.85% and 83.33% query images respectively, which illustrates the effectiveness of the proposed system.
- D. Chen, S. Tsai, B. Girod, C.-H. Hsu, K.-H. Kim, and J. P. Singh. Building book inventories using smartphones. In Proc. ACM Multimedia (MM'10), pages 651--654, 2010. Google Scholar
Digital Library
- X. Chen and A. Yuille. A time-efficient cascade for real-time object detection: With application for the visually impaired. In Proc. 1st Int'l Workshop on Computer Vision Applications for the Visually Imparied (CVAVI'05), pages 1--8, 2005. Google ScholarDigital Library
- J. Fan, Q. Lin, and J. Liu. Mobile document scanning and copying. In Proc. ACM Multimedia (MM'10), pages 1531--1532, 2010. Google ScholarDigital Library
- R. Ji, L.-Y. Duan, J. Chen, H. Yao, J. Yuan, Y. Rui, and W. Gao. Location discriminative vocabulary coding for mobile landmark search. International Journal of Computer Vision}, 93(3):290--314, 2012. Google ScholarDigital Library
- K. Jung, K. Kim, and A. Jain. Text information extraction in images and video: A survey. Pattern Recognition, 37(5):977--997, 2004.Google ScholarCross Ref
- J. Liang, D. Doermann, and H.-P. Li. Camera-based analysis of text and documents: a survey. International Journal on Document Analysis and Recognition, 7(2--3):84--104, 2005.Google ScholarDigital Library
- D. Liu, M. R. Scott, R. Ji, W. Jiang, H. Yao, and X. Xie. Location sensitive indexing for image-based advertising. In Proc. ACM Multimedia (MM'09), pages 793--796, 2009. Google ScholarDigital Library
- Y.-F. Pan, X. Hou, and C.-L. Liu. A hybrid approach to detect and localize texts in natural scene images. IEEE Transactions on Image Processing, 20(3):800 --813, 2011. Google ScholarDigital Library
- G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Communications of the ACM, 18(11):613--620, 1975. Google ScholarDigital Library
- Y. Wang, T. Mei, J. Wang, H. Li, and S. Li. JIGSAW: Interactive mobile visual search with multimodal queries. In Proc. ACM Multimedia (MM'11), pages 73--82, 2011. Google ScholarDigital Library
- X.-D. Zhou, C.-L. Liu, and M. Nakagawa. Online handwritten {J}apanese character string recognition using conditional random fileds. In Proc. Tenth Int'l Conf. Document Analysis and Recognition (ICDAR'09), pages 521--525, 2009. Google ScholarDigital Library
Index Terms
- Mobile-based advertisement information retrieval from images and websites
Recommendations
An adaptive and scalable resource advertisement and discovery strategy for mobile ad hoc networks
GPC'06: Proceedings of the First international conference on Advances in Grid and Pervasive ComputingEffective resource advertisement and discovery (Ad/D) are particularly important in mobile ad hoc networks (MANETs), due to network dynamics and resource constraints of wireless nodes. In this paper, we propose an adaptive and scalable resource Ad/D ...
A routing layer-based hierarchical service advertisement and discovery for MANETs
The implementation of mobile ad hoc networks (MANETs) is steadily increasing. MANETs are especially popular in locations that lack a fixed communication infrastructure. To achieve zero-configuration MANETs, as well as quick and easy access to network ...
Comments