Skip to main content

2019 | OriginalPaper | Buchkapitel

A New Parallel and Distributed Approach for Large Scale Images Retrieval

verfasst von : Mohammed Amin Belarbi, Sidi Ahmed Mahmoudi, Saïd Mahmoudi, Ghalem Belalem

Erschienen in: Cloud Computing and Big Data: Technologies, Applications and Security

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The process of image retrieval presents a great interest in the domains of computer vision, video-surveillance, etc. Visual characteristics of image such as color, texture, shape are used to identify the content of images. However, the retrieving process becomes very challenging due to the hard management of large databases in terms of storage, computation complexity, performance and similarity representation.
In this paper, we propose a new approach for indexing images by the content. The proposed method provides a parallel and distributed computation using the HIPI framework (Hadoop Image Processing Interface) and HDFS (Hadoop Distributed File System) as a storage system, and exploiting the high power of GPUs (Graphic Processing Units). As result, our approach allows to manage and process, fastly, large images databases, thanks to the distributed storage (HDFS) and the GPU parallel computations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Belarbi, M.A., Mahmoudi, S., Belalem, G., Mahmoudi, S.A.: Web-based multimedia research and indexation for big data databases. In: 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech), pp. 1–7, October 2017 Belarbi, M.A., Mahmoudi, S., Belalem, G., Mahmoudi, S.A.: Web-based multimedia research and indexation for big data databases. In: 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech), pp. 1–7, October 2017
2.
Zurück zum Zitat Belarbi, M.A., Mahmoudi, S., Belalem, G.: Indexing video by the content. In: Information Systems Design and Intelligent Applications, Proceedings of Third International Conference INDIA 2016, vol. 2, p. 21. Springer (2016) Belarbi, M.A., Mahmoudi, S., Belalem, G.: Indexing video by the content. In: Information Systems Design and Intelligent Applications, Proceedings of Third International Conference INDIA 2016, vol. 2, p. 21. Springer (2016)
3.
Zurück zum Zitat Belarbi, M.A., Mahmoudi, S., Belalem, G.: PCA as dimensionality reduction for large-scale image retrieval systems. Int. J. Amb. Comput. Intell. (IJACI) 8(4), 45–58 (2017)CrossRef Belarbi, M.A., Mahmoudi, S., Belalem, G.: PCA as dimensionality reduction for large-scale image retrieval systems. Int. J. Amb. Comput. Intell. (IJACI) 8(4), 45–58 (2017)CrossRef
4.
Zurück zum Zitat Sweeney, C., Liu, L., Arietta, S., Lawrence, J.: HIPI: a hadoop image processing interface for image-based mapreduce tasks. Chris. Univ. Va. 2, 1–5 (2011) Sweeney, C., Liu, L., Arietta, S., Lawrence, J.: HIPI: a hadoop image processing interface for image-based mapreduce tasks. Chris. Univ. Va. 2, 1–5 (2011)
5.
Zurück zum Zitat Cai, H., Wang, X., Wang, Y.: Compact and robust fisher descriptors for large-scale image retrieval. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2011), pp. 1–6. IEEE (2011) Cai, H., Wang, X., Wang, Y.: Compact and robust fisher descriptors for large-scale image retrieval. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2011), pp. 1–6. IEEE (2011)
6.
Zurück zum Zitat Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 245–250. ACM (2001) Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 245–250. ACM (2001)
7.
Zurück zum Zitat Schwartz, W.R., Kembhavi, A., Harwood, D., Davis, L.S.: Human detection using partial least squares analysis. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 24–31. IEEE (2009) Schwartz, W.R., Kembhavi, A., Harwood, D., Davis, L.S.: Human detection using partial least squares analysis. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 24–31. IEEE (2009)
8.
Zurück zum Zitat Shi, Q., Petterson, J., Dror, G., Langford, J., Strehl, A.L., Smola, A.J., Vishwanathan, S.V.N.:: Hash kernels. In: International Conference on Artificial Intelligence and Statistics, pp. 496–503 (2009) Shi, Q., Petterson, J., Dror, G., Langford, J., Strehl, A.L., Smola, A.J., Vishwanathan, S.V.N.:: Hash kernels. In: International Conference on Artificial Intelligence and Statistics, pp. 496–503 (2009)
9.
Zurück zum Zitat Weinberger, K., Dasgupta, A., Langford, J., Smola, A., Attenberg, J.: Feature hashing for large scale multitask learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 1113–1120. ACM (2009) Weinberger, K., Dasgupta, A., Langford, J., Smola, A., Attenberg, J.: Feature hashing for large scale multitask learning. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 1113–1120. ACM (2009)
10.
Zurück zum Zitat Shi, Q., Li, H., Shen, C.: Rapid face recognition using hashing. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2753–2760. IEEE (2010) Shi, Q., Li, H., Shen, C.: Rapid face recognition using hashing. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2753–2760. IEEE (2010)
11.
Zurück zum Zitat Dubey, R.S., Choubey, R., Bhattacharjee, J.: Multi feature content based image retrieval. Int. J. Comput. Sci. Eng. 2(6), 2145–2149 (2010) Dubey, R.S., Choubey, R., Bhattacharjee, J.: Multi feature content based image retrieval. Int. J. Comput. Sci. Eng. 2(6), 2145–2149 (2010)
12.
Zurück zum Zitat Hirata, K., Kato, T.: Query by visual example. In: International Conference on Extending Database Technology. Springer, pp. 56–71 (1992) Hirata, K., Kato, T.: Query by visual example. In: International Conference on Extending Database Technology. Springer, pp. 56–71 (1992)
13.
Zurück zum Zitat Lee, D.-H., Kim, H.-J.: A fast content-based indexing and retrieval technique by the shape information in large image database. J. Syst. Softw. 56(2), 165–182 (2001)MathSciNetCrossRef Lee, D.-H., Kim, H.-J.: A fast content-based indexing and retrieval technique by the shape information in large image database. J. Syst. Softw. 56(2), 165–182 (2001)MathSciNetCrossRef
14.
Zurück zum Zitat Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., Equitz, W.: Efficient and effective querying by image content. J. Intell. Inf. Syst. 3(3–4), 231–262 (1994)CrossRef Faloutsos, C., Barber, R., Flickner, M., Hafner, J., Niblack, W., Petkovic, D., Equitz, W.: Efficient and effective querying by image content. J. Intell. Inf. Syst. 3(3–4), 231–262 (1994)CrossRef
15.
Zurück zum Zitat Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafher, J., Lee, D., Petkovie, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. Computer 28(9), 23–32 (1995)CrossRef Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafher, J., Lee, D., Petkovie, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. Computer 28(9), 23–32 (1995)CrossRef
16.
Zurück zum Zitat Smith, J.R., Chang, S.-F.: Visualseek: a fully automated content-based image query system. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 87–98. ACM (1997) Smith, J.R., Chang, S.-F.: Visualseek: a fully automated content-based image query system. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 87–98. ACM (1997)
18.
Zurück zum Zitat Bentley, J.L.: Multidimensional binary search trees in database applications. IEEE Trans. Softw. Eng. 4, 333–340 (1979)CrossRef Bentley, J.L.: Multidimensional binary search trees in database applications. IEEE Trans. Softw. Eng. 4, 333–340 (1979)CrossRef
19.
Zurück zum Zitat Hadjieleftheriou, M., Manolopoulos, Y., Theodoridis, Y., Tsotras, V.J.: R-trees- a dynamic index structure for spatial searching. In: Encyclopedia of GIS, pp. 993–1002. Springer (2008)CrossRef Hadjieleftheriou, M., Manolopoulos, Y., Theodoridis, Y., Tsotras, V.J.: R-trees- a dynamic index structure for spatial searching. In: Encyclopedia of GIS, pp. 993–1002. Springer (2008)CrossRef
20.
Zurück zum Zitat Valgren, C., Lilienthal, A.J.: SIFT, SURF and seasons: long-term outdoor localization using local features. In: EMCR (2007) Valgren, C., Lilienthal, A.J.: SIFT, SURF and seasons: long-term outdoor localization using local features. In: EMCR (2007)
21.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
22.
Zurück zum Zitat Bouchech, H.J., Foufou, S., Abidi, M.: Strengthening surf descriptor with discriminant image filter learning: application to face recognition. In: Proceeding of the 26th International Conference on Microelectronics (ICM), pp. 136–139. IEEE (2014) Bouchech, H.J., Foufou, S., Abidi, M.: Strengthening surf descriptor with discriminant image filter learning: application to face recognition. In: Proceeding of the 26th International Conference on Microelectronics (ICM), pp. 136–139. IEEE (2014)
23.
Zurück zum Zitat Muja, M., Lowe, D.G.: Fast matching of binary features. In: 2012 Ninth Conference on Computer and Robot Vision (CRV), pp. 404–410. IEEE (2012) Muja, M., Lowe, D.G.: Fast matching of binary features. In: 2012 Ninth Conference on Computer and Robot Vision (CRV), pp. 404–410. IEEE (2012)
24.
Zurück zum Zitat Takagi, N., Yasuura, H., Yajima, S.: High-speed VLSI multiplication algorithm with a redundant binary addition tree. IEEE Trans. Comput. 34(9), 789–796 (1985)CrossRef Takagi, N., Yasuura, H., Yajima, S.: High-speed VLSI multiplication algorithm with a redundant binary addition tree. IEEE Trans. Comput. 34(9), 789–796 (1985)CrossRef
25.
Zurück zum Zitat Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)CrossRef
26.
Zurück zum Zitat Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE Computer Society Conference on 2004 Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. II–II. IEEE (2004) Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of the 2004 IEEE Computer Society Conference on 2004 Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. II–II. IEEE (2004)
27.
Zurück zum Zitat Silpa-Anan, C., Hartley, R.: Optimised KD-trees for fast image descriptor matching. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008) Silpa-Anan, C., Hartley, R.: Optimised KD-trees for fast image descriptor matching. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
Metadaten
Titel
A New Parallel and Distributed Approach for Large Scale Images Retrieval
verfasst von
Mohammed Amin Belarbi
Sidi Ahmed Mahmoudi
Saïd Mahmoudi
Ghalem Belalem
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-97719-5_13

Neuer Inhalt