Skip to main content
Erschienen in: The Journal of Supercomputing 3/2017

04.06.2016

Real-time wireless multisensory smart surveillance with 3D-HEVC streams for internet-of-things (IoT)

verfasst von: George Kokkonis, Kostas E. Psannis, Manos Roumeliotis, Dan Schonfeld

Erschienen in: The Journal of Supercomputing | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents the design of a novel, real-time, wireless, multisensory, smart surveillance system with 3D-HEVC features. The proposed high-level system architecture of the surveillance system is analyzed. The advantages of HEVC encoding are presented. Methods for synchronization between multiple streams are presented. Available wireless standards are presented and compared. A network-adaptive transmission protocol for a reliable, real-time, multisensory surveillance system is proposed. Adaptive packet frame grouping (APFG) and adaptive quantization are deployed to maximize the quality-of-experience (QoE). Measurements of the proposed protocol have been shown to provide superior results compared to existing transport protocols.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat I. D. N. Enterprise, R. I. G. Micro, Nanosystems, W. G. R. of the ETP EPOSS (2008) Internet of things in 2020: roadmap for the future. Version 1.1. Tech. Rep. 27, May 2008 I. D. N. Enterprise, R. I. G. Micro, Nanosystems, W. G. R. of the ETP EPOSS (2008) Internet of things in 2020: roadmap for the future. Version 1.1. Tech. Rep. 27, May 2008
2.
Zurück zum Zitat Garcia R, Kalva H (2014) Subjective evaluation of HEVC and AVC/H.264 in mobile environments. IEEE Trans Consum Electron 60(1):116–123CrossRef Garcia R, Kalva H (2014) Subjective evaluation of HEVC and AVC/H.264 in mobile environments. IEEE Trans Consum Electron 60(1):116–123CrossRef
3.
Zurück zum Zitat Valera M, Velastin SA (2005) Intelligent distributed surveillance systems: a review. In: IEE proceedings—vision, image and signal processing, vol 152. No. 2. IET, 2005 Valera M, Velastin SA (2005) Intelligent distributed surveillance systems: a review. In: IEE proceedings—vision, image and signal processing, vol 152. No. 2. IET, 2005
4.
Zurück zum Zitat Kim HI, Lee SH, Ro YM (2016) Low-power face detection for smart camera. In: Theory and applications of smart cameras, pp 139–155 Kim HI, Lee SH, Ro YM (2016) Low-power face detection for smart camera. In: Theory and applications of smart cameras, pp 139–155
5.
Zurück zum Zitat Collins RT, Lipton AJ, Kanade T, Fujiyoshi H, Duggins D, Tsin Y, Tolliver D, Enomoto N, Hasegawa O, Burt P, Wixson L (2000) A system for video surveillance and monitoring. Carnegie Mellon University Technical Report, CMU-RI-TR-00-12, 2000 Collins RT, Lipton AJ, Kanade T, Fujiyoshi H, Duggins D, Tsin Y, Tolliver D, Enomoto N, Hasegawa O, Burt P, Wixson L (2000) A system for video surveillance and monitoring. Carnegie Mellon University Technical Report, CMU-RI-TR-00-12, 2000
6.
Zurück zum Zitat Siebel NT, Maybank S (2004) The advisor visual surveillance system. In: Proc. of the ECCV workshop on applications of computer vision, pp 103–111 Siebel NT, Maybank S (2004) The advisor visual surveillance system. In: Proc. of the ECCV workshop on applications of computer vision, pp 103–111
7.
Zurück zum Zitat Shu CF, Hampapur A, Lu M, Brown L, Connell J, Senior A, Tian Y (2005) IBM smart surveillance system (S3): an open and extensible framework for event based surveillance. In: Proc. of IEEE Conf. advanced video and signal based surveillance, pp 318–323 Shu CF, Hampapur A, Lu M, Brown L, Connell J, Senior A, Tian Y (2005) IBM smart surveillance system (S3): an open and extensible framework for event based surveillance. In: Proc. of IEEE Conf. advanced video and signal based surveillance, pp 318–323
8.
Zurück zum Zitat Regazzoni C, Ramesh V, Foresti GL (2001) Special issue on video communications, processing, and understanding for third generation surveillance systems. Proc IEEE 89(10):1355–1367CrossRef Regazzoni C, Ramesh V, Foresti GL (2001) Special issue on video communications, processing, and understanding for third generation surveillance systems. Proc IEEE 89(10):1355–1367CrossRef
9.
Zurück zum Zitat Dong X, Wen J (2016) Low lighting image enhancement using local maximum color value prior. Front Comput Sci 10(1):147–156CrossRef Dong X, Wen J (2016) Low lighting image enhancement using local maximum color value prior. Front Comput Sci 10(1):147–156CrossRef
10.
Zurück zum Zitat Sanjay S, Shekhar C, Vohra A (2016) FPGA-based real-time motion detection for automated video surveillance systems. Electronics 5(1):10CrossRef Sanjay S, Shekhar C, Vohra A (2016) FPGA-based real-time motion detection for automated video surveillance systems. Electronics 5(1):10CrossRef
11.
Zurück zum Zitat Guo DJ, Zhe-Ming L, Hao L (2016) Multi-channel adaptive mixture background model for real-time tracking. J Inform Hiding Multimed Signal Process 7(1):216–221 Guo DJ, Zhe-Ming L, Hao L (2016) Multi-channel adaptive mixture background model for real-time tracking. J Inform Hiding Multimed Signal Process 7(1):216–221
12.
Zurück zum Zitat Maadi AE, Djouadi MS (2016) Large-scale surveillance system: detection and tracking of suspicious motion patterns in crowded traffic scenes. Automatika J Control Meas Electron Comput Commun 60(1):1–15 Maadi AE, Djouadi MS (2016) Large-scale surveillance system: detection and tracking of suspicious motion patterns in crowded traffic scenes. Automatika J Control Meas Electron Comput Commun 60(1):1–15
13.
Zurück zum Zitat Zhengguo S, Shusen Y, Yu Y, Vasilakos A, McCann J, Kin L (2013) A survey on the IETF protocol suite for the internet of things: standards, challenges, and opportunities. IEEE Wirel Commun 20(6):91–98CrossRef Zhengguo S, Shusen Y, Yu Y, Vasilakos A, McCann J, Kin L (2013) A survey on the IETF protocol suite for the internet of things: standards, challenges, and opportunities. IEEE Wirel Commun 20(6):91–98CrossRef
14.
Zurück zum Zitat Mongay Batalla J (2015) Advanced multimedia service provisioning based on efficient interoperability of adaptive streaming protocol and high efficient video coding. J Real Time Image Process. doi:10.1007/s11554-015-0496-4 Mongay Batalla J (2015) Advanced multimedia service provisioning based on efficient interoperability of adaptive streaming protocol and high efficient video coding. J Real Time Image Process. doi:10.​1007/​s11554-015-0496-4
15.
Zurück zum Zitat Kurniawati E, Lau C, Premkumar B, Absar J, George S (2004) New implementation techniques of an efficient MPEG advanced audio coder. IEEE Trans Consumer Electron 50(2):655–665CrossRef Kurniawati E, Lau C, Premkumar B, Absar J, George S (2004) New implementation techniques of an efficient MPEG advanced audio coder. IEEE Trans Consumer Electron 50(2):655–665CrossRef
16.
Zurück zum Zitat Ohm J, Sullivan G, Schwarz H, Tan TK, Wiegand T (2012) Comparison of the coding efficiency of video coding standards—including high efficiency video coding (HEVC). IEEE Trans Circuits Syst Video Technol 22(12):1669–1684CrossRef Ohm J, Sullivan G, Schwarz H, Tan TK, Wiegand T (2012) Comparison of the coding efficiency of video coding standards—including high efficiency video coding (HEVC). IEEE Trans Circuits Syst Video Technol 22(12):1669–1684CrossRef
18.
Zurück zum Zitat Kokkonis G, Psannis KE, Roumeliotis M, Ishibashi Y (2015) Efficient algorithm for transferring a real-time HEVC stream with haptic data through the internet. J Real Time Image Process. doi:10.1007/s11554-015-0505-7 Kokkonis G, Psannis KE, Roumeliotis M, Ishibashi Y (2015) Efficient algorithm for transferring a real-time HEVC stream with haptic data through the internet. J Real Time Image Process. doi:10.​1007/​s11554-015-0505-7
19.
Zurück zum Zitat Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE Multimed 19(2):4–10CrossRef Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE Multimed 19(2):4–10CrossRef
20.
Zurück zum Zitat Silberman N, Hoiem D, Kohli P, Fergus R (2012) Indoor segmentation and support inference from RGBD images. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Proceedings of 12th European Conference on Computer Vision, October 2012. Springer, Berlin, pp 746–760 Silberman N, Hoiem D, Kohli P, Fergus R (2012) Indoor segmentation and support inference from RGBD images. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Proceedings of 12th European Conference on Computer Vision, October 2012. Springer, Berlin, pp 746–760
21.
Zurück zum Zitat Ishibashi Y, Kanbara T, Tasaka S (2004) Inter-stream synchronization between haptic media and voice in collaborative virtual environments. In: Proc. of the 12th annual ACM Int. Conf. on multimedia, pp 604–611 Ishibashi Y, Kanbara T, Tasaka S (2004) Inter-stream synchronization between haptic media and voice in collaborative virtual environments. In: Proc. of the 12th annual ACM Int. Conf. on multimedia, pp 604–611
22.
Zurück zum Zitat Lee J-S, Su Y-W, Shen C-C (2007) A comparative study of wireless protocols: bluetooth, UWB, ZigBee, and Wi-Fi. In: Industrial Electronics Society, 2007. IECON 2007. 33rd annual conference of the IEEE, Nov 2007, pp 46–51 Lee J-S, Su Y-W, Shen C-C (2007) A comparative study of wireless protocols: bluetooth, UWB, ZigBee, and Wi-Fi. In: Industrial Electronics Society, 2007. IECON 2007. 33rd annual conference of the IEEE, Nov 2007, pp 46–51
23.
Zurück zum Zitat Ong EH, Kneckt J, Alanen O, Chang Z, Huovinen T, Nihtila T (2011) IEEE 802.11ac: enhancements for very high throughput WLANs. In: IEEE 22nd Int. Symp. on personal indoor and mobile radio communications (PIMRC), Sept 2011, pp 849–853 Ong EH, Kneckt J, Alanen O, Chang Z, Huovinen T, Nihtila T (2011) IEEE 802.11ac: enhancements for very high throughput WLANs. In: IEEE 22nd Int. Symp. on personal indoor and mobile radio communications (PIMRC), Sept 2011, pp 849–853
24.
Zurück zum Zitat Huang J, Qian F, Gerber A, Mao ZM, Sen S, Spatscheck O (2012) A close examination of performance and power characteristics of 4G LTE networks. In: Proc. 10th international conference on mobile systems, applications, and services, 2012, pp 225–238 Huang J, Qian F, Gerber A, Mao ZM, Sen S, Spatscheck O (2012) A close examination of performance and power characteristics of 4G LTE networks. In: Proc. 10th international conference on mobile systems, applications, and services, 2012, pp 225–238
25.
Zurück zum Zitat Andrews J, Buzzi S, Choi W, Hanly S, Lozano A, Soong A, Zhang J (2014) What will 5G be? IEEE J Sel Areas Commun 32(6):1065–1082CrossRef Andrews J, Buzzi S, Choi W, Hanly S, Lozano A, Soong A, Zhang J (2014) What will 5G be? IEEE J Sel Areas Commun 32(6):1065–1082CrossRef
26.
Zurück zum Zitat Tourrilhes J (1998) Packet frame grouping: improving IP multimedia performance over CSMA/CA. In: IEEE Int. Conf. on universal personal communications, Oct 1998, vol 2, pp 1345–1349 Tourrilhes J (1998) Packet frame grouping: improving IP multimedia performance over CSMA/CA. In: IEEE Int. Conf. on universal personal communications, Oct 1998, vol 2, pp 1345–1349
27.
Zurück zum Zitat Iwata K, Ishibashi Y, Fukushima N, Sugawara S (2010) Qoe assessment in haptic media, sound, and video transmission: effect of playout buffering control. Comput Entertain (CIE) 8(2):12 Iwata K, Ishibashi Y, Fukushima N, Sugawara S (2010) Qoe assessment in haptic media, sound, and video transmission: effect of playout buffering control. Comput Entertain (CIE) 8(2):12
28.
Zurück zum Zitat Guiyun L, Yao J, Liu Y, Chen H, Tang D (2015) Channel-aware adaptive quantization method for source localization in wireless sensor networks. Int J Distrib Sensor Netw 214081:13 Guiyun L, Yao J, Liu Y, Chen H, Tang D (2015) Channel-aware adaptive quantization method for source localization in wireless sensor networks. Int J Distrib Sensor Netw 214081:13
30.
Zurück zum Zitat Mulabegovic E, Schonfeld D, Ansari R (2002) Lightweight streaming protocol (LSP). In: Proc. 10th ACM Int. Conf. on multimedia, MULTIMEDIA ’02, pp 227–230 Mulabegovic E, Schonfeld D, Ansari R (2002) Lightweight streaming protocol (LSP). In: Proc. 10th ACM Int. Conf. on multimedia, MULTIMEDIA ’02, pp 227–230
Metadaten
Titel
Real-time wireless multisensory smart surveillance with 3D-HEVC streams for internet-of-things (IoT)
verfasst von
George Kokkonis
Kostas E. Psannis
Manos Roumeliotis
Dan Schonfeld
Publikationsdatum
04.06.2016
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 3/2017
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-016-1769-9

Weitere Artikel der Ausgabe 3/2017

The Journal of Supercomputing 3/2017 Zur Ausgabe