Skip to main content
Top

2019 | OriginalPaper | Chapter

A New Parallel and Distributed Approach for Large Scale Images Retrieval

Authors : Mohammed Amin Belarbi, Sidi Ahmed Mahmoudi, Saïd Mahmoudi, Ghalem Belalem

Published in: Cloud Computing and Big Data: Technologies, Applications and Security

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The process of image retrieval presents a great interest in the domains of computer vision, video-surveillance, etc. Visual characteristics of image such as color, texture, shape are used to identify the content of images. However, the retrieving process becomes very challenging due to the hard management of large databases in terms of storage, computation complexity, performance and similarity representation.
In this paper, we propose a new approach for indexing images by the content. The proposed method provides a parallel and distributed computation using the HIPI framework (Hadoop Image Processing Interface) and HDFS (Hadoop Distributed File System) as a storage system, and exploiting the high power of GPUs (Graphic Processing Units). As result, our approach allows to manage and process, fastly, large images databases, thanks to the distributed storage (HDFS) and the GPU parallel computations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Belarbi, M.A., Mahmoudi, S., Belalem, G., Mahmoudi, S.A.: Web-based multimedia research and indexation for big data databases. In: 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech), pp. 1–7, October 2017 Belarbi, M.A., Mahmoudi, S., Belalem, G., Mahmoudi, S.A.: Web-based multimedia research and indexation for big data databases. In: 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech), pp. 1–7, October 2017
2.
go back to reference Belarbi, M.A., Mahmoudi, S., Belalem, G.: Indexing video by the content. In: Information Systems Design and Intelligent Applications, Proceedings of Third International Conference INDIA 2016, vol. 2, p. 21. Springer (2016) Belarbi, M.A., Mahmoudi, S., Belalem, G.: Indexing video by the content. In: Information Systems Design and Intelligent Applications, Proceedings of Third International Conference INDIA 2016, vol. 2, p. 21. Springer (2016)
3.
go back to reference Belarbi, M.A., Mahmoudi, S., Belalem, G.: PCA as dimensionality reduction for large-scale image retrieval systems. Int. J. Amb. Comput. Intell. (IJACI) 8(4), 45–58 (2017)CrossRef Belarbi, M.A., Mahmoudi, S., Belalem, G.: PCA as dimensionality reduction for large-scale image retrieval systems. Int. J. Amb. Comput. Intell. (IJACI) 8(4), 45–58 (2017)CrossRef
4.
go back to reference Sweeney, C., Liu, L., Arietta, S., Lawrence, J.: HIPI: a hadoop image processing interface for image-based mapreduce tasks. Chris. Univ. Va. 2, 1–5 (2011) Sweeney, C., Liu, L., Arietta, S., Lawrence, J.: HIPI: a hadoop image processing interface for image-based mapreduce tasks. Chris. Univ. Va. 2, 1–5 (2011)
5.
go back to reference Cai, H., Wang, X., Wang, Y.: Compact and robust fisher descriptors for large-scale image retrieval. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2011), pp. 1–6. IEEE (2011) Cai, H., Wang, X., Wang, Y.: Compact and robust fisher descriptors for large-scale image retrieval. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2011), pp. 1–6. IEEE (2011)
6.
go back to reference Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 245–250. ACM (2001) Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 245–250. ACM (2001)
7.
go back to reference Schwartz, W.R., Kembhavi, A., Harwood, D., Davis, L.S.: Human detection using partial least squares analysis. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 24–31. IEEE (2009) Schwartz, W.R., Kembhavi, A., Harwood, D., Davis, L.S.: Human detection using partial least squares analysis. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 24–31. IEEE (2009)
8.
go back to reference Shi, Q., Petterson, J., Dror, G., Langford, J., Strehl, A.L., Smola, A.J., Vishwanathan, S.V.N.:: Hash kernels. In: International Conference on Artificial Intelligence and Statistics, pp. 496–503 (2009) Shi, Q., Petterson, J., Dror, G., Langford, J., Strehl, A.L., Smola, A.J., Vishwanathan, S.V.N.:: Hash kernels. In: International Conference on Artificial Intelligence and Statistics, pp. 496–503 (2009)
9.
go back to reference Weinberger, K., Dasgupta, A., Langford, J., Smola, A., Attenberg, J.: Feature hashing for large scale multitask learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 1113–1120. ACM (2009) Weinberger, K., Dasgupta, A., Langford, J., Smola, A., Attenberg, J.: Feature hashing for large scale multitask learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 1113–1120. ACM (2009)
10.
go back to reference Shi, Q., Li, H., Shen, C.: Rapid face recognition using hashing. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2753–2760. IEEE (2010) Shi, Q., Li, H., Shen, C.: Rapid face recognition using hashing. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2753–2760. IEEE (2010)
11.
go back to reference Dubey, R.S., Choubey, R., Bhattacharjee, J.: Multi feature content based image retrieval. Int. J. Comput. Sci. Eng. 2(6), 2145–2149 (2010) Dubey, R.S., Choubey, R., Bhattacharjee, J.: Multi feature content based image retrieval. Int. J. Comput. Sci. Eng. 2(6), 2145–2149 (2010)
12.
go back to reference Hirata, K., Kato, T.: Query by visual example. In: International Conference on Extending Database Technology. Springer, pp. 56–71 (1992) Hirata, K., Kato, T.: Query by visual example. In: International Conference on Extending Database Technology. Springer, pp. 56–71 (1992)
13.
go back to reference Lee, D.-H., Kim, H.-J.: A fast content-based indexing and retrieval technique by the shape information in large image database. J. Syst. Softw. 56(2), 165–182 (2001)MathSciNetCrossRef Lee, D.-H., Kim, H.-J.: A fast content-based indexing and retrieval technique by the shape information in large image database. J. Syst. Softw. 56(2), 165–182 (2001)MathSciNetCrossRef
14.
go back to reference Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., Equitz, W.: Efficient and effective querying by image content. J. Intell. Inf. Syst. 3(3–4), 231–262 (1994)CrossRef Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., Equitz, W.: Efficient and effective querying by image content. J. Intell. Inf. Syst. 3(3–4), 231–262 (1994)CrossRef
15.
go back to reference Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafher, J., Lee, D., Petkovie, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. Computer 28(9), 23–32 (1995)CrossRef Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafher, J., Lee, D., Petkovie, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. Computer 28(9), 23–32 (1995)CrossRef
16.
go back to reference Smith, J.R., Chang, S.-F.: Visualseek: a fully automated content-based image query system. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 87–98. ACM (1997) Smith, J.R., Chang, S.-F.: Visualseek: a fully automated content-based image query system. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 87–98. ACM (1997)
18.
go back to reference Bentley, J.L.: Multidimensional binary search trees in database applications. IEEE Trans. Softw. Eng. 4, 333–340 (1979)CrossRef Bentley, J.L.: Multidimensional binary search trees in database applications. IEEE Trans. Softw. Eng. 4, 333–340 (1979)CrossRef
19.
go back to reference Hadjieleftheriou, M., Manolopoulos, Y., Theodoridis, Y., Tsotras, V.J.: R-trees- a dynamic index structure for spatial searching. In: Encyclopedia of GIS, pp. 993–1002. Springer (2008)CrossRef Hadjieleftheriou, M., Manolopoulos, Y., Theodoridis, Y., Tsotras, V.J.: R-trees- a dynamic index structure for spatial searching. In: Encyclopedia of GIS, pp. 993–1002. Springer (2008)CrossRef
20.
go back to reference Valgren, C., Lilienthal, A.J.: SIFT, SURF and seasons: long-term outdoor localization using local features. In: EMCR (2007) Valgren, C., Lilienthal, A.J.: SIFT, SURF and seasons: long-term outdoor localization using local features. In: EMCR (2007)
21.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
22.
go back to reference Bouchech, H.J., Foufou, S., Abidi, M.: Strengthening surf descriptor with discriminant image filter learning: application to face recognition. In: Proceeding of the 26th International Conference on Microelectronics (ICM), pp. 136–139. IEEE (2014) Bouchech, H.J., Foufou, S., Abidi, M.: Strengthening surf descriptor with discriminant image filter learning: application to face recognition. In: Proceeding of the 26th International Conference on Microelectronics (ICM), pp. 136–139. IEEE (2014)
23.
go back to reference Muja, M., Lowe, D.G.: Fast matching of binary features. In: 2012 Ninth Conference on Computer and Robot Vision (CRV), pp. 404–410. IEEE (2012) Muja, M., Lowe, D.G.: Fast matching of binary features. In: 2012 Ninth Conference on Computer and Robot Vision (CRV), pp. 404–410. IEEE (2012)
24.
go back to reference Takagi, N., Yasuura, H., Yajima, S.: High-speed VLSI multiplication algorithm with a redundant binary addition tree. IEEE Trans. Comput. 34(9), 789–796 (1985)CrossRef Takagi, N., Yasuura, H., Yajima, S.: High-speed VLSI multiplication algorithm with a redundant binary addition tree. IEEE Trans. Comput. 34(9), 789–796 (1985)CrossRef
25.
go back to reference Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef
26.
go back to reference Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE Computer Society Conference on 2004 Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. II–II. IEEE (2004) Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE Computer Society Conference on 2004 Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. II–II. IEEE (2004)
27.
go back to reference Silpa-Anan, C., Hartley, R.: Optimised KD-trees for fast image descriptor matching. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008) Silpa-Anan, C., Hartley, R.: Optimised KD-trees for fast image descriptor matching. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
Metadata
Title
A New Parallel and Distributed Approach for Large Scale Images Retrieval
Authors
Mohammed Amin Belarbi
Sidi Ahmed Mahmoudi
Saïd Mahmoudi
Ghalem Belalem
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-319-97719-5_13