Skip to main content

2014 | OriginalPaper | Buchkapitel

Shopper Analytics: A Customer Activity Recognition System Using a Distributed RGB-D Camera Network

verfasst von : Daniele Liciotti, Marco Contigiani, Emanuele Frontoni, Adriano Mancini, Primo Zingaretti, Valerio Placidi

Erschienen in: Video Analytics for Audience Measurement

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The aim of this paper is to present an integrated system consisted of a RGB-D camera and a software able to monitor shoppers in intelligent retail environments. We propose an innovative low cost smart system that can understand the shoppers’ behavior and, in particular, their interactions with the products in the shelves, with the aim to develop an automatic RGB-D technique for video analysis. The system of cameras detects the presence of people and univocally identifies them. Through the depth frames, the system detects the interactions of the shoppers with the products on the shelf and determines if a product is picked up or if the product is taken and then put back and finally, if there is not contact with the products. The system is low cost and easy to install, and experimental results demonstrated that its performances are satisfactory also in real environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ko, T., Raytheon, C., Arlington, V.A.: A survey on behavior analysis in video surveillance for homeland security applications. In: 37th IEEE Applied Imagery Pattern Recognition Workshop, AIPR ’08, pp. 1–8, 15–17 Oct 2008 Ko, T., Raytheon, C., Arlington, V.A.: A survey on behavior analysis in video surveillance for homeland security applications. In: 37th IEEE Applied Imagery Pattern Recognition Workshop, AIPR ’08, pp. 1–8, 15–17 Oct 2008
2.
Zurück zum Zitat Cristani, M., Raghavendra, R., Del Bue, A., Murino, V.: Human behavior analysis in video surveillance: A Social Signal Processing perspective. Neurocomputing 100, 86–97 (2013). (Special issue: Behaviours in video)CrossRef Cristani, M., Raghavendra, R., Del Bue, A., Murino, V.: Human behavior analysis in video surveillance: A Social Signal Processing perspective. Neurocomputing 100, 86–97 (2013). (Special issue: Behaviours in video)CrossRef
3.
Zurück zum Zitat Frontoni, E., Mancini, A., Zingaretti, P.: RGBD Sensors for human activity detection in AAL environments. In: Longhi, S., Siciliano, P., Germani, M., Monteriú, A. (eds.) Living Italian Forum 2013, 300 p. 50 illus, Due: 31 July 2014. Available Formats: eBook ISBN 978-3-319-01118-9 Frontoni, E., Mancini, A., Zingaretti, P.: RGBD Sensors for human activity detection in AAL environments. In: Longhi, S., Siciliano, P., Germani, M., Monteriú, A. (eds.) Living Italian Forum 2013, 300 p. 50 illus, Due: 31 July 2014. Available Formats: eBook ISBN 978-3-319-01118-9
4.
Zurück zum Zitat Frontoni, E., Raspa, P., Mancini, A., Zingaretti, P., Placidi, V.: Customers’ activity recognition in intelligent retail environments. In: Petrosino, A., Maddalena, L., Pala, P. (eds.) ICIAP 2013. LNCS, vol. 8158, pp. 509–516. Springer, Heidelberg (2013)CrossRef Frontoni, E., Raspa, P., Mancini, A., Zingaretti, P., Placidi, V.: Customers’ activity recognition in intelligent retail environments. In: Petrosino, A., Maddalena, L., Pala, P. (eds.) ICIAP 2013. LNCS, vol. 8158, pp. 509–516. Springer, Heidelberg (2013)CrossRef
5.
Zurück zum Zitat Ascani, A., Frontoni, E., Mancini, A., Zingaretti, P.: Feature group matching for appearance-based localization. In: IEEE/RSJ 2008 International Conference on Intelligent RObots and Systems, IROS 2008, Nice (2008) Ascani, A., Frontoni, E., Mancini, A., Zingaretti, P.: Feature group matching for appearance-based localization. In: IEEE/RSJ 2008 International Conference on Intelligent RObots and Systems, IROS 2008, Nice (2008)
6.
Zurück zum Zitat Ferrari, V., Marin-Jimene, M., Zisserman, A.: Pose search: retrieving people using their pose. In: International Conference on Computer Vision and Pattern Recognition IEEE/CVPR, pp. 1–8 (2009) Ferrari, V., Marin-Jimene, M., Zisserman, A.: Pose search: retrieving people using their pose. In: International Conference on Computer Vision and Pattern Recognition IEEE/CVPR, pp. 1–8 (2009)
7.
Zurück zum Zitat Desai, C., Ramanan, D., Fowlkes, C.: Discriminative models for static human-object interactions. In: Computer Vision and Pattern Recognition Workshops (IEEE/CVPRW), pp. 9–16 (2010) Desai, C., Ramanan, D., Fowlkes, C.: Discriminative models for static human-object interactions. In: Computer Vision and Pattern Recognition Workshops (IEEE/CVPRW), pp. 9–16 (2010)
8.
Zurück zum Zitat Brox, T., Bourdev, L., Maji, S., Malik, J.: Object segmentation by alignment of poselet activations to image contours. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 2225–2232 (2011) Brox, T., Bourdev, L., Maji, S., Malik, J.: Object segmentation by alignment of poselet activations to image contours. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 2225–2232 (2011)
9.
Zurück zum Zitat Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: International Computer on Vision and Pattern Recognition, IEEE/CVPR, pp. 1778–1785 (2009) Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: International Computer on Vision and Pattern Recognition, IEEE/CVPR, pp. 1778–1785 (2009)
10.
Zurück zum Zitat Bourdev, L., Malik, J.: Poselets: Body part detectors trained using 3D human pose annotations. In: International Conference on Computer Vision IEEE/ICCV, pp. 1365–1372 (2009) Bourdev, L., Malik, J.: Poselets: Body part detectors trained using 3D human pose annotations. In: International Conference on Computer Vision IEEE/ICCV, pp. 1365–1372 (2009)
11.
Zurück zum Zitat Csurka, G., Bray, C., Dance, C., Fan, L.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004) Csurka, G., Bray, C., Dance, C., Fan, L.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004)
12.
Zurück zum Zitat Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)CrossRef Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)CrossRef
13.
Zurück zum Zitat Gupta, A., Kembhavi, A., Davis, L.: Observing human-object interactions: Using spatial and functional compatibility for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1775–1789 (2009)CrossRef Gupta, A., Kembhavi, A., Davis, L.: Observing human-object interactions: Using spatial and functional compatibility for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1775–1789 (2009)CrossRef
15.
Zurück zum Zitat Mankodiya, K., Gandhi, R., Narasimhan, P.: Challenges and opportunities for embedded computing in retail environments. In: Martins, F., Lopes, L., Paulino, H. (eds.) S-CUBE 2012. LNICST, vol. 102, pp. 121–136. Springer, Heidelberg (2012)CrossRef Mankodiya, K., Gandhi, R., Narasimhan, P.: Challenges and opportunities for embedded computing in retail environments. In: Martins, F., Lopes, L., Paulino, H. (eds.) S-CUBE 2012. LNICST, vol. 102, pp. 121–136. Springer, Heidelberg (2012)CrossRef
16.
Zurück zum Zitat Migniot, C., Ababsa, F.: 3D human tracking from depth cue in a buying behavior analysis context. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013, Part I. LNCS, vol. 8047, pp. 482–489. Springer, Heidelberg (2013)CrossRef Migniot, C., Ababsa, F.: 3D human tracking from depth cue in a buying behavior analysis context. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013, Part I. LNCS, vol. 8047, pp. 482–489. Springer, Heidelberg (2013)CrossRef
Metadaten
Titel
Shopper Analytics: A Customer Activity Recognition System Using a Distributed RGB-D Camera Network
verfasst von
Daniele Liciotti
Marco Contigiani
Emanuele Frontoni
Adriano Mancini
Primo Zingaretti
Valerio Placidi
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-12811-5_11

Premium Partner