Skip to main content

2015 | OriginalPaper | Buchkapitel

12. Selection of Visual Descriptors for the Purpose of Multi-camera Object Re-identification

verfasst von : Piotr Dalka, Damian Ellwart, Grzegorz Szwoch, Karol Lisowski, Piotr Szczuko, Andrzej Czyżewski

Erschienen in: Feature Selection for Data and Pattern Recognition

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A comparative analysis of various visual descriptors is presented in this chapter. The descriptors utilize many aspects of image data: colour, texture, gradient, and statistical moments. The descriptor list is supplemented with local features calculated in close vicinity of key points found automatically in the image. The goal of the analysis is to find descriptors that are best suited for particular task, i.e. re-identification of objects in a multi-camera environment. The analysis is performed using two datasets containing images of humans and vehicles recorded with different cameras. For the purpose of descriptor evaluation, scatter and clustering measures are supplemented with a new measure that is derived from calculating direct dissimilarities between pairs of images. In order to draw conclusions from multi-dataset analysis, four aggregation measures are introduced. They are meant to find descriptors that provide the best identification effectiveness, based on the relative ranking, and simultaneously are characterized with large stability (invariance to the selection of objects in the dataset). Proposed descriptors are evaluated practically with object re-identification experiments involving four classifiers to detect the same object after its transition between cameras’ fields of view. The achieved results are discussed in detail and illustrated with figures.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Allen, R., Mcgeorge, P., Pearson, D., Milne, A.B.: Attention and expertise in multiple target tracking. Appl. Cogn. Psychol. 18(3), 337–347 (2004)CrossRef Allen, R., Mcgeorge, P., Pearson, D., Milne, A.B.: Attention and expertise in multiple target tracking. Appl. Cogn. Psychol. 18(3), 337–347 (2004)CrossRef
2.
Zurück zum Zitat Antani, S., Kasturi, R., Jain, R.: A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video. Pattern Recognit. 35(4), 945–965 (2002)CrossRefMATH Antani, S., Kasturi, R., Jain, R.: A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video. Pattern Recognit. 35(4), 945–965 (2002)CrossRefMATH
3.
Zurück zum Zitat Bannour, H., Hlaoua, L., El Ayeb, B.: Survey of the adequate descriptor for content-based image retrieval on the web: global versus local features. In: Conference en Recherche d’Information et Applications CORIA, pp. 445–456. LSIS-USTV (2009) Bannour, H., Hlaoua, L., El Ayeb, B.: Survey of the adequate descriptor for content-based image retrieval on the web: global versus local features. In: Conference en Recherche d’Information et Applications CORIA, pp. 445–456. LSIS-USTV (2009)
4.
Zurück zum Zitat Baxes, G.A.: Digital Image Processing: Principles and Applications. Wiley, New York (1994) Baxes, G.A.: Digital Image Processing: Principles and Applications. Wiley, New York (1994)
5.
Zurück zum Zitat Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRef
7.
Zurück zum Zitat Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Chapman and Hall, New York (1994) Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Chapman and Hall, New York (1994)
8.
Zurück zum Zitat Burger, W., Burge, M.J.: Principles of Digital Image Processing: Core Algorithms. Springer, Berlin (2009) Burger, W., Burge, M.J.: Principles of Digital Image Processing: Core Algorithms. Springer, Berlin (2009)
9.
Zurück zum Zitat Burger, W., Burge, M.J.: Principles of Digital Image Processing: Fundamental Techniques. Springer, New York (2009) Burger, W., Burge, M.J.: Principles of Digital Image Processing: Fundamental Techniques. Springer, New York (2009)
10.
Zurück zum Zitat Cavanagh, P., Alvarez, G.A.: Tracking multiple targets with multifocal attention. Trends Cogn. Sci. 9(7), 349–354 (2005)CrossRef Cavanagh, P., Alvarez, G.A.: Tracking multiple targets with multifocal attention. Trends Cogn. Sci. 9(7), 349–354 (2005)CrossRef
11.
Zurück zum Zitat Chang-yeon, J.: Face detection using LBP features. Final project report—CS 229 machine learning (2008) Chang-yeon, J.: Face detection using LBP features. Final project report—CS 229 machine learning (2008)
12.
Zurück zum Zitat Cipolla, R., Battiato, S., Farinella, G.: Computer Vision: Detection, Recognition and Reconstruction. Studies in Computational Intelligence. Springer, New York (2010)CrossRef Cipolla, R., Battiato, S., Farinella, G.: Computer Vision: Detection, Recognition and Reconstruction. Studies in Computational Intelligence. Springer, New York (2010)CrossRef
13.
Zurück zum Zitat Clausi, D.A.: An analysis of co-occurrence texture statistics as a function of grey level quantization. Can. J. Remote Sens. 28(1), 45–62 (2002)CrossRef Clausi, D.A.: An analysis of co-occurrence texture statistics as a function of grey level quantization. Can. J. Remote Sens. 28(1), 45–62 (2002)CrossRef
14.
Zurück zum Zitat Czyżewski, A., Lisowski, K.: Employing flowgraphs for forward route reconstruction in video surveillance system. J. Intell. Inf. Syst. 40, 1–15 (2013)CrossRef Czyżewski, A., Lisowski, K.: Employing flowgraphs for forward route reconstruction in video surveillance system. J. Intell. Inf. Syst. 40, 1–15 (2013)CrossRef
15.
Zurück zum Zitat Dalka, P., Szwoch, G., Ciarkowski, A.: Distributed framework for visual event detection in parking lot area. In: Dziech, A., Czyżewski, A. (eds.) Multimedia Communications, Services and Security. Communications in Computer and Information Science, vol. 149, pp. 37–45. Springer, Berlin (2011) Dalka, P., Szwoch, G., Ciarkowski, A.: Distributed framework for visual event detection in parking lot area. In: Dziech, A., Czyżewski, A. (eds.) Multimedia Communications, Services and Security. Communications in Computer and Information Science, vol. 149, pp. 37–45. Springer, Berlin (2011)
16.
Zurück zum Zitat Dalka, P., Szwoch, G., Szczuko, P., Czyżewski, A.: Video content analysis in the Urban area telemonitoring system. In: Tsihrintzis, G.A., Jain, L.C. (eds.) Multimedia Services in Intelligent Environments, Smart Innovation, Systems and Technologies, vol. 3, pp. 241–261. Springer, Berlin (2010)CrossRef Dalka, P., Szwoch, G., Szczuko, P., Czyżewski, A.: Video content analysis in the Urban area telemonitoring system. In: Tsihrintzis, G.A., Jain, L.C. (eds.) Multimedia Services in Intelligent Environments, Smart Innovation, Systems and Technologies, vol. 3, pp. 241–261. Springer, Berlin (2010)CrossRef
17.
Zurück zum Zitat Doyle, A., Lippert, R., Lyon, D.: Eyes Everywhere : The Global Growth of Camera Surveillance. Routledge, London (2012) Doyle, A., Lippert, R., Lyon, D.: Eyes Everywhere : The Global Growth of Camera Surveillance. Routledge, London (2012)
18.
Zurück zum Zitat Ellis, T.J., Makris, D., Black, J.K.: Learning a multi-camera topology. In: Proceedings of Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 165–171 (2003) Ellis, T.J., Makris, D., Black, J.K.: Learning a multi-camera topology. In: Proceedings of Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, pp. 165–171 (2003)
19.
Zurück zum Zitat Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2000)CrossRef Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2000)CrossRef
20.
Zurück zum Zitat Geng, X., Wang, L., Li, M., Wu, Q., Smith-Miles, K.: Adaptive fusion of gait and face for human identification in video. In: Proceedings of IEEE Workshop on Applications of Computer Vision WACV, pp. 1–6 (2008) Geng, X., Wang, L., Li, M., Wu, Q., Smith-Miles, K.: Adaptive fusion of gait and face for human identification in video. In: Proceedings of IEEE Workshop on Applications of Computer Vision WACV, pp. 1–6 (2008)
21.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River (2006) Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River (2006)
22.
Zurück zum Zitat Halkidi, M., Vazirgiannis, M., Batistakis, Y.: Quality scheme assessment in the clustering process. In: Zighed, D.A., Komorowski, J., Zytkow, J. (eds.) Principles of Data Mining and Knowledge Discovery. Lecture Notes in Computer Science, vol. 1910, pp. 265–276. Springer, Berlin (2000)CrossRef Halkidi, M., Vazirgiannis, M., Batistakis, Y.: Quality scheme assessment in the clustering process. In: Zighed, D.A., Komorowski, J., Zytkow, J. (eds.) Principles of Data Mining and Knowledge Discovery. Lecture Notes in Computer Science, vol. 1910, pp. 265–276. Springer, Berlin (2000)CrossRef
23.
Zurück zum Zitat Hamdoun, O., Moutarde, F., Stanciulescu, B., Steux, B.: Person re-identification in multi-camera system by signature based on interest point descriptors collected on short video sequences. In: Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras ICDSC, pp. 1–6 (2008) Hamdoun, O., Moutarde, F., Stanciulescu, B., Steux, B.: Person re-identification in multi-camera system by signature based on interest point descriptors collected on short video sequences. In: Proceedings of the 2nd ACM/IEEE International Conference on Distributed Smart Cameras ICDSC, pp. 1–6 (2008)
24.
Zurück zum Zitat Hanbury, A., Kandaswamy, U., Adjeroh, D.A.: Illumination-invariant morphological texture classification. In: Ronse, C., Najman, L., Decencière, E. (eds.) 40 Years On Mathematical Morphology. Computational Imaging and Vision, vol. 30, pp. 377–386. Springer, Netherlands (2005)CrossRef Hanbury, A., Kandaswamy, U., Adjeroh, D.A.: Illumination-invariant morphological texture classification. In: Ronse, C., Najman, L., Decencière, E. (eds.) 40 Years On Mathematical Morphology. Computational Imaging and Vision, vol. 30, pp. 377–386. Springer, Netherlands (2005)CrossRef
25.
Zurück zum Zitat Haralick, R., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. SMC–3(6), 610–621 (1973)CrossRef Haralick, R., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. SMC–3(6), 610–621 (1973)CrossRef
26.
Zurück zum Zitat Ilyas, A., Scuturici, M., Miguet, S.: Inter-camera color calibration for object re-identification and tracking. In: Proceedings of International Conference of Soft Computing and Pattern Recognition (SoCPaR), pp. 188–193 (2010) Ilyas, A., Scuturici, M., Miguet, S.: Inter-camera color calibration for object re-identification and tracking. In: Proceedings of International Conference of Soft Computing and Pattern Recognition (SoCPaR), pp. 188–193 (2010)
27.
Zurück zum Zitat Jeong, K., Jaynes, C.: Object matching in disjoint cameras using a color transfer approach. Mach. Vis. Appl. 19(5–6), 443–455 (2008)CrossRefMATH Jeong, K., Jaynes, C.: Object matching in disjoint cameras using a color transfer approach. Mach. Vis. Appl. 19(5–6), 443–455 (2008)CrossRefMATH
28.
Zurück zum Zitat Kale, K.: Advances in Computer Vision and Information Technology. I.K. International Publishing House Pvt. Limited, New Delhi (2008) Kale, K.: Advances in Computer Vision and Information Technology. I.K. International Publishing House Pvt. Limited, New Delhi (2008)
29.
Zurück zum Zitat Kettnaker, V., Zabih, R.: Bayesian multi-camera surveillance. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. 259 (1999) Kettnaker, V., Zabih, R.: Bayesian multi-camera surveillance. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. 259 (1999)
30.
Zurück zum Zitat Kim, H., Romberg, J., Wolf, W.: Multi-camera tracking on a graph using Markov chain Monte Carlo. In: Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC, pp. 1–8 (2009) Kim, H., Romberg, J., Wolf, W.: Multi-camera tracking on a graph using Markov chain Monte Carlo. In: Proceedings of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC, pp. 1–8 (2009)
31.
Zurück zum Zitat Kramer, A.F., Hahn, S.: Splitting the beam: distribution of attention over noncontiguous regions of the visual field. Psychol. Sci. 6(6), 381–386 (1995)CrossRef Kramer, A.F., Hahn, S.: Splitting the beam: distribution of attention over noncontiguous regions of the visual field. Psychol. Sci. 6(6), 381–386 (1995)CrossRef
32.
Zurück zum Zitat Li, J.H., Liu, M.S., Song, P.: An novel modified extraction method of MPEG-7 visual descriptor for image retrieval. In: Proceedings of International Conference on Machine Learning and Cybernetics (ICMLC), vol. 4, pp. 2037–2041 (2010) Li, J.H., Liu, M.S., Song, P.: An novel modified extraction method of MPEG-7 visual descriptor for image retrieval. In: Proceedings of International Conference on Machine Learning and Cybernetics (ICMLC), vol. 4, pp. 2037–2041 (2010)
33.
Zurück zum Zitat Liu, Y., Li, Z., Xiong, H., Gao, X., Wu, J.: Understanding of internal clustering validation measures. In: Proceedings of IEEE 10th International Conference on Data Mining (ICDM), pp. 911–916 (2010) Liu, Y., Li, Z., Xiong, H., Gao, X., Wu, J.: Understanding of internal clustering validation measures. In: Proceedings of IEEE 10th International Conference on Data Mining (ICDM), pp. 911–916 (2010)
34.
Zurück zum Zitat Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
35.
Zurück zum Zitat Manjunath, B., Ohm, J.R., Vasudevan, V., Yamada, A.: Color and texture descriptors. IEEE Trans. Circuits Syst. Video Technol. 11(6), 703–715 (2001)CrossRef Manjunath, B., Ohm, J.R., Vasudevan, V., Yamada, A.: Color and texture descriptors. IEEE Trans. Circuits Syst. Video Technol. 11(6), 703–715 (2001)CrossRef
37.
Zurück zum Zitat Mindru, F., Tuytelaars, T., Gool, L.V.: Moment invariants for recognition under changing viewpoint and illumination. Comput. Vis. Image Underst. 94(1–3), 3–27 (2004). Special Issue: Colour for Image Indexing and Retrieval Mindru, F., Tuytelaars, T., Gool, L.V.: Moment invariants for recognition under changing viewpoint and illumination. Comput. Vis. Image Underst. 94(1–3), 3–27 (2004). Special Issue: Colour for Image Indexing and Retrieval
38.
Zurück zum Zitat Mittal, A., Davis, L.: Unified multi-camera detection and tracking using region-matching. In: Proceedings of IEEE Workshop on Multi-Object Tracking, pp. 3–10 (2001) Mittal, A., Davis, L.: Unified multi-camera detection and tracking using region-matching. In: Proceedings of IEEE Workshop on Multi-Object Tracking, pp. 3–10 (2001)
39.
Zurück zum Zitat Orr, G., Muller, K.: Neural Networks: Tricks of the Trade. Springer, New York (1998)CrossRef Orr, G., Muller, K.: Neural Networks: Tricks of the Trade. Springer, New York (1998)CrossRef
40.
Zurück zum Zitat Piciarelli, C., Foresti, G.: Surveillance-oriented event detection in video streams. IEEE Intell. Syst. 26(3), 32–41 (2011)CrossRef Piciarelli, C., Foresti, G.: Surveillance-oriented event detection in video streams. IEEE Intell. Syst. 26(3), 32–41 (2011)CrossRef
41.
Zurück zum Zitat Pinheiro, A.: Image descriptors based on the edge orientation. In: Proceedings of the 4th International Workshop on Semantic Media Adaptation and Personalization SMAP, pp. 73–78 (2009) Pinheiro, A.: Image descriptors based on the edge orientation. In: Proceedings of the 4th International Workshop on Semantic Media Adaptation and Personalization SMAP, pp. 73–78 (2009)
42.
Zurück zum Zitat Pitas, I.: Digital Image Processing Algorithms and Applications. Wiley-Interscience Publication, New York (2000) Pitas, I.: Digital Image Processing Algorithms and Applications. Wiley-Interscience Publication, New York (2000)
43.
Zurück zum Zitat Sharma, S.: Applied multivariate techniques. Wiley, New York (1996) Sharma, S.: Applied multivariate techniques. Wiley, New York (1996)
44.
Zurück zum Zitat Spyrou, E., Borgne, H.L., Mailis, T., Cooke, E.: Fusing MPEG-7 visual descriptors for image classification. In: Proceedings of International Conference on Artificial Neural Networks (ICANN), pp. 847–852. Springer (2005) Spyrou, E., Borgne, H.L., Mailis, T., Cooke, E.: Fusing MPEG-7 visual descriptors for image classification. In: Proceedings of International Conference on Artificial Neural Networks (ICANN), pp. 847–852. Springer (2005)
45.
Zurück zum Zitat Szeliski, R.: Computer Vision: Algorithms and Applications. Texts in Computer Science. Springer, Heidelberg (2010) Szeliski, R.: Computer Vision: Algorithms and Applications. Texts in Computer Science. Springer, Heidelberg (2010)
46.
Zurück zum Zitat Szwoch, G., Dalka, P., Czyżewski, A.: A framework for automatic detection of abandoned luggage in airport terminal. In: Tsihrintzis, G., Damiani, E., Virvou, M., Howlett, R., Jain, L.C. (eds.) Intelligent Interactive Multimedia Systems and Services, Smart Innovation, Systems and Technologies, vol. 6, pp. 13–22. Springer, Berlin (2010)CrossRef Szwoch, G., Dalka, P., Czyżewski, A.: A framework for automatic detection of abandoned luggage in airport terminal. In: Tsihrintzis, G., Damiani, E., Virvou, M., Howlett, R., Jain, L.C. (eds.) Intelligent Interactive Multimedia Systems and Services, Smart Innovation, Systems and Technologies, vol. 6, pp. 13–22. Springer, Berlin (2010)CrossRef
47.
Zurück zum Zitat Teixeira, L.F., Corte-Real, L.: Video object matching across multiple independent views using local descriptors and adaptive learning. Pattern Recognit. Lett. 30(2), 157–167 (2009)CrossRef Teixeira, L.F., Corte-Real, L.: Video object matching across multiple independent views using local descriptors and adaptive learning. Pattern Recognit. Lett. 30(2), 157–167 (2009)CrossRef
48.
Zurück zum Zitat Tian, Y.L., Hampapur, A., Brown, L., Feris, R., Lu, M., Senior, A., Shu, C.F., Zhai, Y.: Event detection, query, and retrieval for video surveillance, Chap. Artificial Intelligence for Max-imizing Content Based Image Retrieval, Information Science Reference (2008) Tian, Y.L., Hampapur, A., Brown, L., Feris, R., Lu, M., Senior, A., Shu, C.F., Zhai, Y.: Event detection, query, and retrieval for video surveillance, Chap. Artificial Intelligence for Max-imizing Content Based Image Retrieval, Information Science Reference (2008)
49.
Zurück zum Zitat Van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1582–1596 (2010)CrossRef Van de Sande, K.E.A., Gevers, T., Snoek, C.G.M.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1582–1596 (2010)CrossRef
50.
Zurück zum Zitat Wallraven, C., Caputo, B., Graf, A.: Recognition with local features: the kernel recipe. In: Proceedings of the 9th IEEE International Conference on Computer Vision, vol. 1, pp. 257–264 (2003) Wallraven, C., Caputo, B., Graf, A.: Recognition with local features: the kernel recipe. In: Proceedings of the 9th IEEE International Conference on Computer Vision, vol. 1, pp. 257–264 (2003)
Metadaten
Titel
Selection of Visual Descriptors for the Purpose of Multi-camera Object Re-identification
verfasst von
Piotr Dalka
Damian Ellwart
Grzegorz Szwoch
Karol Lisowski
Piotr Szczuko
Andrzej Czyżewski
Copyright-Jahr
2015
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-45620-0_12