ABSTRACT
Despite significant progress in supervised hashing, there are three common limitations of existing methods. First, most pioneer methods discretely learn hash codes bit by bit, making the learning procedure rather time-consuming. Second, to reduce the large complexity of the n by n pairwise similarity matrix, most methods apply sampling strategies during training, which inevitably results in information loss and suboptimal performance; some recent methods try to replace the large matrix with a smaller one, but the size is still large. Third, among the methods that leverage the pairwise similarity matrix, most of them only encode the semantic label information in learning the hash codes, failing to fully capture the characteristics of data. In this paper, we present a novel supervised hashing method, called Fast Scalable Supervised Hashing (FSSH), which circumvents the use of the large similarity matrix by introducing a pre-computed intermediate term whose size is independent with the size of training data. Moreover, FSSH can learn the hash codes with not only the semantic information but also the features of data. Extensive experiments on three widely used datasets demonstrate its superiority over several state-of-the-art methods in both accuracy and scalability. Our experiment codes are available at: https://lcbwlx.wixsite.com/fssh.
- Ken Chatfield, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman . 2014. Return of the devil in the details: Delving deep into convolutional nets BMVC.Google Scholar
- Zhen-Duo Chen, Wan-Jin Yu, Chuan-Xiang Li, Liqiang Nie, and Xin-Shun Xu . 2018. Dual deep neural networks cross-modal hashing. In AAAI. 274--281.Google Scholar
- Tat-Seng Chua, Jinhui Tang, Richang Hong, Haojie Li, Zhiping Luo, and Yan-Tao Zheng . 2009. NUS-WIDE: A real-world web image database from National University of Singapore CIVR. 48:1--48:9. Google ScholarDigital Library
- Cheng Da, Shibiao Xu, Kun Ding, Gaofeng Meng, Shiming Xiang, and Chunhong Pan . 2017. AMVH: Asymmetric multi-valued hashing. In CVPR. 736--744.Google Scholar
- Guiguang Ding, Yuchen Guo, and Jile Zhou . 2014. Collective matrix factorization hashing for multimodal data CVPR. 2075--2082. Google ScholarDigital Library
- Venice Erin Liong, Jiwen Lu, Gang Wang, Pierre Moulin, and Jie Zhou . 2015. Deep hashing for compact binary codes learning. In CVPR. 2475--2483.Google Scholar
- Tiezheng Ge, Kaiming He, and Jian Sun . 2014. Graph cuts for supervised binary coding. In ECCV. 250--264.Google Scholar
- Aristides Gionis, Piotr Indyk, Rajeev Motwani, et almbox. . 1999. Similarity search in high dimensions via hashing. In VLDB. 518--529. Google ScholarDigital Library
- Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin . 2013. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. TPAMI Vol. 35, 12 (2013), 2916--2929. Google ScholarDigital Library
- Albert Gordo, Florent Perronnin, Yunchao Gong, and Svetlana Lazebnik . 2014. Asymmetric distances for binary embeddings. TPAMI Vol. 36, 1 (2014), 33--47. Google ScholarDigital Library
- Jie Gui, Tongliang Liu, Zhenan Sun, Dacheng Tao, and Tieniu Tan . 2018. Fast supervised discrete hashing. TPAMI Vol. 40, 2 (2018), 490--496. Google ScholarDigital Library
- Yanbin Hao, Tingting Mu, John Yannis Goulermas, Jianguo Jiang, Richang Hong, and Meng Wang . 2017. Unsupervised t-distributed video hashing and its deep hashing extension. TIP Vol. 24, 9 (2017), 2827--2840.Google Scholar
- Xiangnan He and Tat-Seng Chua . 2017. Neural factorization machines for sparse predictive analytics SIGIR. 355--364. Google ScholarDigital Library
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua . 2017. Neural collaborative filtering. In WWW. 173--182. Google ScholarDigital Library
- Long-Kai Huang and Sinno Jialin Pan . 2016. Class-wise supervised hashing with label embedding and active bits IJCAI. 1585--1591. Google ScholarDigital Library
- Qing-Yuan Jiang and Wu-Jun Li . 2015. Scalable graph hashing with feature transformation IJCAI. 2248--2254. Google ScholarDigital Library
- Wang-Cheng Kang, Wu-Jun Li, and Zhi-Hua Zhou . 2016. Column sampling based discrete supervised hashing. In AAAI. 1230--1236. Google ScholarDigital Library
- Alex Krizhevsky and Geoffrey Hinton . 2009. Learning multiple layers of features from tiny images. Technical Report, University of Toronto (2009).Google Scholar
- Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner . 1998. Gradient-based learning applied to document recognition. Proc. IEEE Vol. 86, 11 (1998), 2278--2324.Google ScholarCross Ref
- Jing Li, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Tao Lian, and Jun Ma . 2017 a. Neural attentive session-based recommendation. In CIKM. 1419--1428. Google ScholarDigital Library
- Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam . 2017 c. Neural rating regression with abstractive tips generation for recommendation SIGIR. 345--354. Google ScholarDigital Library
- Qi Li, Zhenan Sun, Ran He, and Tieniu Tan . 2017 b. Deep supervised discrete hashing. In NIPS. 2479--2488.Google Scholar
- Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang . 2016. Feature learning based deep supervised hashing with pairwise labels IJCAI. 1711--1717. Google ScholarDigital Library
- Guosheng Lin, Chunhua Shen, Qinfeng Shi, Anton Van den Hengel, and David Suter . 2014. Fast supervised hashing with decision trees for high-dimensional data CVPR. 1963--1970. Google ScholarDigital Library
- Guosheng Lin, Chunhua Shen, David Suter, and Anton van den Hengel . 2013. A general two-step approach to learning-based hashing ICCV. 2552--2559. Google ScholarDigital Library
- Zijia Lin, Guiguang Ding, Mingqing Hu, and Jianmin Wang . 2015. Semantics-preserving hashing for cross-view retrieval CVPR. 3864--3872.Google Scholar
- Haomiao Liu, Ruiping Wang, Shiguang Shan, and Xilin Chen . 2016. Deep supervised hashing for fast image retrieval. In CVPR. 2064--2072.Google Scholar
- Wei Liu, Jun Wang, Rongrong Ji, Yu-Gang Jiang, and Shih-Fu Chang . 2012. Supervised hashing with kernels. In CVPR. 2074--2081. Google ScholarDigital Library
- Xin Luo, Ye Wu, and Xin-Shun Xu . 2018. Scalable supervised discrete hashing for large-scale search WWW. 1603--1612. Google ScholarDigital Library
- Liqiang Nie, Meng Wang, Zheng-Jun Zha, and Tat-Seng Chua . 2012. Oracle in image search: A content-based approach to performance prediction. TOIS Vol. 30, 2 (2012), 13. Google ScholarDigital Library
- Liqiang Nie, Yi-Liang Zhao, Mohammad Akbari, Jialie Shen, and Tat-Seng Chua . 2015. Bridging the vocabulary gap between health seekers and healthcare knowledge. TKDE Vol. 27, 2 (2015), 396--409.Google ScholarCross Ref
- Mohammad Norouzi and David M Blei . 2011. Minimal loss hashing for compact binary codes. In ICML. 353--360. Google ScholarDigital Library
- Aude Oliva and Antonio Torralba . 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. IJCV Vol. 42, 3 (2001), 145--175. Google ScholarDigital Library
- Mingdong Ou, Peng Cui, Fei Wang, Jun Wang, and Wenwu Zhu . 2015. Non-transitive hashing with latent similarity components SIGKDD. 895--904. Google ScholarDigital Library
- Fumin Shen, Chunhua Shen, Wei Liu, and Heng Tao Shen . 2015. Supervised discrete hashing. In CVPR. 37--45.Google Scholar
- Fumin Shen, Chunhua Shen, Qinfeng Shi, Anton Hengel, and Zhenmin Tang . 2013. Inductive hashing on manifolds. In CVPR. 1562--1569. Google ScholarDigital Library
- Jinhui Tang, Zechao Li, Meng Wang, and Ruizhen Zhao . 2015. Neighborhood discriminant hashing for large-scale image retrieval. TIP Vol. 24, 9 (2015), 2827--2840.Google ScholarDigital Library
- Jun Wang, Sanjiv Kumar, and Shih-Fu Chang . 2010. Semi-supervised hashing for scalable image retrieval CVPR. 3424--3431.Google Scholar
- Xiaofang Wang, Yi Shi, and Kris M Kitani . 2016. Deep supervised hashing with triplet labels. In ACCV. 70--84.Google Scholar
- Yair Weiss, Antonio Torralba, and Rob Fergus . 2009. Spectral hashing. In NIPS. 1753--1760. Google ScholarDigital Library
- Rongkai Xia, Yan Pan, Hanjiang Lai, Cong Liu, and Shuicheng Yan . 2014. Supervised hashing for image retrieval via image representation learning AAAI. 2156--2162. Google ScholarDigital Library
- Ting-Kun Yan, Xin-Shun Xu, Shanqing Guo, Zi Huang, and Xiao-Lin Wang . 2016. Supervised robust discrete multimodal hashing for cross-media retrieval CIKM. 1271--1280. Google ScholarDigital Library
- Yang Yang, Fumin Shen, Heng-Tao Shen, Hanxi Li, and Xuelong Li . 2015. Robust discrete spectral hashing for large-scale image semantic indexing. Trans. Big Data Vol. 1, 4 (2015), 162--171.Google ScholarCross Ref
- Dongqing Zhang and Wu-Jun Li . 2014. Large-scale supervised multimodal hashing with semantic correlation maximization AAAI. 2177--2183. Google ScholarDigital Library
- Dan Zhang, Fei Wang, and Luo Si . 2011. Composite hashing with multiple information sources SIGIR. 225--234. Google ScholarDigital Library
- Dell Zhang, Jun Wang, Deng Cai, and Jinsong Lu . 2010. Self-taught hashing for fast similarity search. In SIGIR. 18--25. Google ScholarDigital Library
- Hanwang Zhang, Fumin Shen, Wei Liu, Xiangnan He, Huanbo Luan, and Tat-Seng Chua . 2016 b. Discrete collaborative filtering. In SIGIR. 325--334. Google ScholarDigital Library
- Peichao Zhang, Wei Zhang, Wu-Jun Li, and Minyi Guo . 2014. Supervised hashing with latent factor models. In SIGIR. 173--182. Google ScholarDigital Library
- Peng-Fei Zhang, Chuan-Xiang Li, Meng-Yuan Liu, Liqiang Nie, and Xin-Shun Xu . 2017 b. Semi-relaxation supervised hashing for cross-modal retrieval MM. 1762--1770. Google ScholarDigital Library
- Ruimao Zhang, Liang Lin, Rui Zhang, Wangmeng Zuo, and Lei Zhang . 2015. Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. TIP Vol. 24, 12 (2015), 4766--4779.Google ScholarDigital Library
- Shifeng Zhang, Jianmin Li, Mengqing Jiang, and Bo Zhang . 2017 a. Scalable discrete supervised multimedia hash learning with clustering. TCSVT Vol. PP, 99 (2017), 1--1.Google Scholar
- Ziming Zhang, Yuting Chen, and Venkatesh Saligrama . 2016 a. Efficient training of very deep neural networks for supervised hashing CVPR. 1487--1495.Google Scholar
- Fang Zhao, Yongzhen Huang, Liang Wang, and Tieniu Tan . 2015. Deep semantic ranking based hashing for multi-label image retrieval CVPR. 1556--1564.Google Scholar
- Lei Zhu, Zi Huang, Xiaobai Liu, Xiangnan He, Jiande Sun, and Xiaofang Zhou . 2017. Discrete multimodal hashing with canonical views for robust mobile landmark search. TMM Vol. 19, 9 (2017), 2066--2079.Google ScholarDigital Library
Index Terms
- Fast Scalable Supervised Hashing
Recommendations
Supervised Discrete Hashing With Mutual Linear Regression
MM '19: Proceedings of the 27th ACM International Conference on MultimediaSupervised linear hashing can compress high-dimensional data into compact binary codes owing to its efficiency. Generally, the relation between label and hash codes is widely used in the existing hashing methods because of its effectiveness of improving ...
Scalable Supervised Discrete Hashing for Large-Scale Search
WWW '18: Proceedings of the 2018 World Wide Web ConferenceSupervised hashing methods have attracted much attention in these years. However, most existing supervised hashing algorithms have some of the following problems. First, most of them leverage the pairwise similarity matrix, whose size is quadratic to ...
Supervised Hierarchical Deep Hashing for Cross-Modal Retrieval
MM '20: Proceedings of the 28th ACM International Conference on MultimediaCross-modal hashing has attracted much attention in the large-scale multimedia search area. In many real applications, labels of samples have hierarchical structure which also contains much useful information for learning. However, most existing methods ...
Comments