Skip to main content
Top
Published in: Cluster Computing 1/2019

03-02-2018

Parallel image search application based on online hashing hierarchical ranking

Authors: Xiaofei Li, Di He, Jun-yi Li

Published in: Cluster Computing | Special Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As we know that the nearest neighbor search is a good and effective method for large-scaled image search. This paper mainly focuses on the design and implementation of parallel image retrieval system based on Hadoop architecture and hashing binary code. Firstly, the whole architecture design of the system and the whole flow of image Hash retrieval are introduced. Then, the image feature extraction based on MAPREDUCE parallel data processing framework, as well as the next feature quantization and the construction method of the Hash index table are introduced in details. Finally, through the comparison of retrieval performances on the INRIA data set, it has been proved that the proposed system has better performance than the single node system on both the retrieval speed and the capability of dealing with massive data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: state of the art and challenges. ACM Trans. Multimed. Comput. Commun. Appl. 2(1), 1–19 (2006)CrossRef Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: state of the art and challenges. ACM Trans. Multimed. Comput. Commun. Appl. 2(1), 1–19 (2006)CrossRef
2.
go back to reference Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, inuences, and trends of the new age. ACM Comput. Surv. 40(2), 1–60 (2008)CrossRef Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, inuences, and trends of the new age. ACM Comput. Surv. 40(2), 1–60 (2008)CrossRef
3.
go back to reference Liu, Y., Zhang, D., Lu, G., Ma, W.: A survey of content-based image retrieval with high-level semantics. Pattern Recognit. 40(1), 262–282 (2007)CrossRefMATH Liu, Y., Zhang, D., Lu, G., Ma, W.: A survey of content-based image retrieval with high-level semantics. Pattern Recognit. 40(1), 262–282 (2007)CrossRefMATH
4.
go back to reference Srihari, R., Zhang, Z., Rao, A.: Image background search: combining object detection techniques with content-based image retrieval (CBIR) systems. In: Content-based Access of Image & Video Libraries, pp. 97–101 (1999) Srihari, R., Zhang, Z., Rao, A.: Image background search: combining object detection techniques with content-based image retrieval (CBIR) systems. In: Content-based Access of Image & Video Libraries, pp. 97–101 (1999)
5.
go back to reference Kulis, B., Jain, P., Grauman, K.: Fast similarity search for learned metrics. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2143–2157 (2009)CrossRef Kulis, B., Jain, P., Grauman, K.: Fast similarity search for learned metrics. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2143–2157 (2009)CrossRef
6.
go back to reference Dean, J., Ghemawat, S.: MapReduce: a flexible data processing tool. Commun. ACM 53(1), 72–77 (2010)CrossRef Dean, J., Ghemawat, S.: MapReduce: a flexible data processing tool. Commun. ACM 53(1), 72–77 (2010)CrossRef
7.
go back to reference Dean, J.: MapReduce: simplified data processing on large clusters. Commun. 51(1), 107–113 (2004) Dean, J.: MapReduce: simplified data processing on large clusters. Commun. 51(1), 107–113 (2004)
8.
go back to reference Gathering clouds and a sequencing storm. Nat. Biotechnol. 28(1), pp. 1–1 (2010) Gathering clouds and a sequencing storm. Nat. Biotechnol. 28(1), pp. 1–1 (2010)
9.
go back to reference Schat, M.C.: Highly sensitive read mapping with MapReduce. Bioinformatics 25(11), 1363–1369 (2009)CrossRef Schat, M.C.: Highly sensitive read mapping with MapReduce. Bioinformatics 25(11), 1363–1369 (2009)CrossRef
10.
go back to reference Lux, M., Chatzichristofis, S.A.: LIRe: lucene image retrieval–an extensible java CBIR library. In: ACM International Conference on Multimedia, pp. 1085–1088 (2008) Lux, M., Chatzichristofis, S.A.: LIRe: lucene image retrieval–an extensible java CBIR library. In: ACM International Conference on Multimedia, pp. 1085–1088 (2008)
11.
go back to reference Lux, M.: Revisiting the vector retrieval model in context of the MPEG-7 semantic description scheme. In: International Workshop on Image Analysis for Multimedia Interactive Services, pp. 134–138 (2008) Lux, M.: Revisiting the vector retrieval model in context of the MPEG-7 semantic description scheme. In: International Workshop on Image Analysis for Multimedia Interactive Services, pp. 134–138 (2008)
12.
go back to reference Chang, S.F., Sikora, T., Puri, A.: Overview of the mpeg-7 standard. IEEE Trans. Circuits Syst. Video Technol. 11(6), 688–695 (2001)CrossRef Chang, S.F., Sikora, T., Puri, A.: Overview of the mpeg-7 standard. IEEE Trans. Circuits Syst. Video Technol. 11(6), 688–695 (2001)CrossRef
13.
go back to reference Huang, J., Mitra, M., Zhu, W.J.: Image indexing using color correlograms. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 762–768 (1997) Huang, J., Mitra, M., Zhu, W.J.: Image indexing using color correlograms. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 762–768 (1997)
14.
go back to reference Chatzichristofis, S.A., Boutalis, Y.S.: Cedd: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval. In; International Conference on Computer Vision Systems, pp. 312–322 (2008) Chatzichristofis, S.A., Boutalis, Y.S.: Cedd: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval. In; International Conference on Computer Vision Systems, pp. 312–322 (2008)
15.
go back to reference Chatzichristofis, S.A., Boutalis, Y.S.: Fcth: Fuzzy color and texturehistogram a low level feature for accurate image retrieval. In: Proceedings of International Workshop on Image Analysis for Multimedia Interactive Services, pp. 191–196 (2008) Chatzichristofis, S.A., Boutalis, Y.S.: Fcth: Fuzzy color and texturehistogram a low level feature for accurate image retrieval. In: Proceedings of International Workshop on Image Analysis for Multimedia Interactive Services, pp. 191–196 (2008)
16.
go back to reference Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval: an experimental comparison. Inform. Retr. 11(11), 77–107 (2008)CrossRef Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval: an experimental comparison. Inform. Retr. 11(11), 77–107 (2008)CrossRef
17.
go back to reference Torralba, A., Fergus, R., Weiss, Y.: Small codes and large image databases for recognition. In: Proceedings of IEEE Conference on Computer Vision & Pattern Recognition, pp. 1–8 (2008) Torralba, A., Fergus, R., Weiss, Y.: Small codes and large image databases for recognition. In: Proceedings of IEEE Conference on Computer Vision & Pattern Recognition, pp. 1–8 (2008)
19.
go back to reference Chu, C.T., Sang, K.K., Lin, Y.A., Yu, Y.Y., Bradski, G.R., Ng, A.Y.: Map-reduce for machine learning on multicore. In: Advances in Neural Information Processing System, pp. 281–288 (2006) Chu, C.T., Sang, K.K., Lin, Y.A., Yu, Y.Y., Bradski, G.R., Ng, A.Y.: Map-reduce for machine learning on multicore. In: Advances in Neural Information Processing System, pp. 281–288 (2006)
20.
go back to reference Abouzeid, A., Bajda-Pawlikowski, K., Abadi, D., Silberschatz, A., Rasin, A.: HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads. Proc. Vldb Endow. 2(1), 922–933 (2009)CrossRef Abouzeid, A., Bajda-Pawlikowski, K., Abadi, D., Silberschatz, A., Rasin, A.: HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads. Proc. Vldb Endow. 2(1), 922–933 (2009)CrossRef
21.
go back to reference Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. ACM Sigops Oper. Syst. Rev. 37(5), 29–43 (2003)CrossRef Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. ACM Sigops Oper. Syst. Rev. 37(5), 29–43 (2003)CrossRef
22.
go back to reference Maji, S., Berg, A.C.: Max-margin additive classifiers for detection. In: Proceedings of IEEE International Conference on Computer Vision, pp. 40–47. Theory of Computing (2009) Maji, S., Berg, A.C.: Max-margin additive classifiers for detection. In: Proceedings of IEEE International Conference on Computer Vision, pp. 40–47. Theory of Computing (2009)
23.
go back to reference Shakhnarovich, G., Viola, P., Darrell, T.: Fast pose estimation with parameter-sensitive hashing. In: Proceedings of IEEE International Conference on Computer Vision, pp. 750–758 (2003) Shakhnarovich, G., Viola, P., Darrell, T.: Fast pose estimation with parameter-sensitive hashing. In: Proceedings of IEEE International Conference on Computer Vision, pp. 750–758 (2003)
Metadata
Title
Parallel image search application based on online hashing hierarchical ranking
Authors
Xiaofei Li
Di He
Jun-yi Li
Publication date
03-02-2018
Publisher
Springer US
Published in
Cluster Computing / Issue Special Issue 1/2019
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-1922-8

Other articles of this Special Issue 1/2019

Cluster Computing 1/2019 Go to the issue

Premium Partner