Abstract
Recent developments in low-cost CMOS cameras have created the opportunity of bringing imaging capabilities to sensor networks. Various visual sensor platforms have been developed with the aim of integrating visual data to wireless sensor applications. The objective of this article is to survey current visual sensor platforms according to in-network processing and compression/coding techniques together with their targeted applications. Characteristics of these platforms such as level of integration, data processing hardware, energy dissipation, radios and operating systems are also explored and discussed.
Similar content being viewed by others
Notes
The energy cost of transmitting 1 Kb of data to a distance of 100 m, assuming Raleigh fading channel, BPSK modulation, 10−6 BER and fourth power distance loss is 3 Joules, which is approximately the same energy cost as of executing 3 million instructions by a 100 million instructions per second (MIPS)/W processor.
Because of their simplicity, PSNR (Peak Signal-to-Noise-Ratio) and MSE (Mean Square Error) are most widely used models for assessing image/video quality. We note that there are better models available in the literature [50].
There are many other smart camera platforms, which are not specifically designed as standalone VSN platforms (a comprehensive survey of smart camera platforms is presented in [41]).
There are some real-time embedded operating systems that provide a full-compliance POSIX interface (e.g., LynxOS, QNX), the same functionalities as Linux, but with less overhead. However, they were not used in VSN platforms presented in this paper.
References
Atmel AT 91 Sam9261 Datasheet, http://www.keil.com/dd/docs/datashts/atmel/at91sam9261_dc.pdf
Bajwa W, Haupt J, Sayeed A, Nowak R (2006) Compressive wireless sensing. In Proc. International Conference on Information processing in Sensor Networks
Boice J, Lu X, Margi C, Stanek G, Zhang G, Manduchi R, Obraczka K (2006) Meerkats: a power-aware, self-managing wireless camera network for wide area monitoring. In: Proc. Workshop on Distributed Smart Cameras
Candes EJ (2006) Compressive sampling. In: Proc. International Congress of Mathematicians
Charfi Y, Wakamiya N, Murata M (2009) Challenging issues in visual sensor networks. IEEE Wirel Commun 16:44–49
Chen P, Ahammed P, Boyer C, Huang S, Lin L, Lobaton E, Meingast M, Oh S, Wang S, Yan P, Yang AY, Yeo C, Chang LC, Tygar D, Sastry SS (2008) CITRIC: a low-bandwidth wireless camera network platform. In: Proc. International Conference on Distributed Smart Cameras, pp 1–10
Chong CY, Kumar SP (2003) Sensor networks: evolution, opportunities, and challenges. Proc IEEE 91:1247–1256
Chou PA, Wu Y (2007) Network coding for the internet and wireless networks. IEEE Signal Proc Mag 5:77–85
Chu D, Lin K, Linares A, Nguyen G, Hellerstein JM (2006) Sdlib: a sensor network data and communications library for rapid and robust application development. In: Proc. International Conference on Information processing in Sensor Networks, pp 432–440
Crossbow Technology, http://www.xbow.com.
Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52:1289–1306
Duarte MF, Wakin MB, Baron D, Baraniuk RG (2006) Universal distributed sensing via random projections. In: Proc. International Conference on Information processing in Sensor Networks
Dunkels A, Gronvall B, Voigt T (2004) Contiki—a lightweight and flexible operating system for tiny networked sensors. In: Proc. IEEE International Conference on Local Computer Networks, pp 455–462
Feng WC, Kaiser E, Shea M, Feng WC, Baillif L (2005) Panoptes: scalable low-power video sensor networking technologies. Trans Multimed Comput Comm Appl 1:151–167
Girod B, Aaron A, Rane S, Rebollo Monedero D (2005) Distributed video coding. Proc IEEE 93:71–83
Guerrero-Zapata M, Zilan R, Barcelo Ordinas JM, Bicakci K, Tavli B (2010) The future of security in wireless multimedia sensor networks: a position paper. Telecommun Syst 45:77–91
He Z, Wu D (2006) Resource allocation and performance analysis of wireless video sensors. IEEE Trans Circ Syst Video Tech 16:590–599
Hengstler S, Aghajan H (2006) WiSNAP: a wireless image sensor network application platform. In: Proc. International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities
Hengstler S, Prashanth D, Fong S, Aghajan H (2007) MeshEye: a hybrid-resolution smart camera mote for applications in distributed intelligent surveillance. In: Proc. International Conference on Information processing in Sensor Networks
Hill J, Horton M, Kling R, Krishnamurthy L (2004) The platforms enabling wireless sensor networks. Commun ACM 47:41–46
Hu W, Tan T, Wang L, Maybank S (2004) A survey on visual surveillance of object motion and behaviors. IEEE Trans Syst Man Cybern C Appl Rev 34:334–352
Kang LW, Lu CS (2007) Multi-view distributed video coding with low-complexity inter-sensor communication over wireless video sensor networks. In: Proc. IEEE International Conference on Image Processing, vol. 3, pp 13–16
Kerhet A, Magno M, Leonardi F, Boni A, Benini L (2007) A low-power wireless video sensor node for distributed object detection. J Real-Time Image Process 2:331–342
Kleihorst R, Abbo A, Schueler B, Danilin A (2007) Camera mote with a high-performance parallel processor for realtime frame-based video processing. In: Proc. International Conference on Distributed Smart Cameras, pp 109–116
Kulkarni P, Ganesan D, Shenoy P, Lu Q (2005) SensEye: a multi tier camera sensor network. In: Proc. ACM International Conference on Multimedia, pp 229–238
Lu Q, Luo W, Wang J, Chen B (2008) Low-complexity and energy efficient image compression scheme for wireless sensor networks. Comput Netw 52:2594–2603
Margi CB, Petkov V, Obraczka K, Manduchi R (2006) Characterizing the energy consumption in a visual sensor network testbed. In: Proc. International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities
Mica High Speed Radio Stack, http://www.tinyos.net/tinyos-1.x/doc/stack.pdf.
Misra S, Reisslein M, Xue G (2008) A survey of multimedia streaming in wireless sensor networks. IEEE Commun Surv Tutorials 10:18–39
Moteiv Corporation Tmote Sky Datasheet, http://www.snm.ethz.ch/Projects/TmoteSky.
Mottola L, Picco GP (2011) Programming wireless sensor networks: fundamental concepts and state of the art, (to appear in) ACM Computing Surveys
Murat UM, Sclaroff S (2004) Optimal placement of cameras in floorplans to satisfy task requirements and cost constraints. In: Proc. Workshop on Omnidirectional Vision, Camera Networks, and Non-classical Cameras
Nano-RK: A Wireless Sensor Networking Real-Time OS—http://www.nano-rk.org/
Nguyen H, Bhanu B, Patel A, Diaz R (2009) VideoWeb: design of a wireless camera network for real-time monitoring of activities. In: Proc. ACM/IEEE International Conference on Distributed Smart Cameras, pp 1–8
OpenCV, http://www.opencv.org
Park C, Chou PH (2006) eCAM: ultra compact, high data-rate wireless sensor node with a miniature camera. In: Proc. ACM Conference on Embedded Networked Sensor Systems, pp 359–360
Pereira F, Torres L, Guillemot C, Ebrahimi T, Leonardi R, Klomp S (2008) Distributed video coding: selecting the most promising application scenarios. Signal Process: Image Commun 23:339–352
Pottie GJ, Kaiser WJ (2000) Wireless integrated network sensors. Commun ACM 43:551–558
Puri R, Majumdar A, Ishwar P, Ramchandran K (2006) Distributed video coding in wireless sensor networks. IEEE Signal Process Mag 23:94–106
Rahimi M, Baer R, Iroezi OI, Garcia JC, Warrior J, Estrin D, Srivastava M (2005) Cyclops: in situ image sensing and interpretation in wireless sensor networks. In: Proc. ACM Conference on Embedded Networked Sensor Systems, pp 192–204
Rinner B, Winkler T, Schriebl W, Quaritsch M, Wolf W (2008) The evolution from single to pervasive smart cameras. In: Proc. International Conference on Distributed Smart Cameras, pp 1–10
Rowe A, Goal D, Rajkumar R (2007) FireFly Mosaic: a vision-enabled wireless sensor networking system. In Proc. IEEE International Real-Time Systems Symposium, pp 459–468
Rowe A, Goode A, Goel D, Nourbakhsh I (2007) CMUcam3: an open programmable embedded vision sensor. Carnegie Mellon Robotics Institute Technical Report, RI-TR-07-13
Soro S, Heinzelman W (2009) A survey of visual sensor networks. Adv Multimed 2009, Article ID 640386
SOS: An OS for mote-class wireless sensor networks—https://projects.nesl.ucla.edu/public/sos-2x/doc/
Tavli B, Bagci IE, Ceylan O (2010) Optimal data compression and forwarding in wireless sensor networks. IEEE Commun Lett 14:408–410
Tavli B, Kayaalp M, Ceylan O, Bagci IE (2010) Data processing and communication strategies for lifetime optimization in wireless sensor networks. AEU Int J Electron Commun 64:992–998
Teixeira T, Culurciello E, Park JH, Lymberopoulos D, Sweeney AB, Savvides A (2006) Address event imagers for sensor networks: evaluation and modeling. In Proc. International Conference on Information processing in Sensor Networks, pp 458–466
TinyOS: An OS for networked sensors—http://tinyos.millennium.berkeley.edu
Wang Z, Sheikh HR, Bovik AC (2003) Objective video quality assessment. In: Furht B, Marques O (eds) The handbook of video databases: design and applications. CRC Press, Boca Raton
Wang H, Wang W, Wu S, Hua K (2010) A survey on the cross-layer design for wireless multimedia sensor networks. Social Informatics and Telecommun Eng, LNCS 48:474–486
WSN Platforms, http://wsn.oversigma.com/wiki/index.php?title=WSN_Platforms.
Wu M, Chen CW (2007) Collaborative image coding and transmission over wireless sensor networks. EURASIP Journal on Advances in Signal Processing, Article ID: 70481
Wu Y, Stankovic V, Xiong Z, Kung SY (2005) On practical design for joint distributed source and network coding. In: Proc. Workshop on Network Coding, Theory and Applications
Yick J, Mukherjee B, Ghosal D (2008) Wireless sensor network survey. Comput Netw 52:2292–2330
Yu Y, Krishnamachari B, Prasanna VK (2008) Data gathering with tunable compression in sensor networks. IEEE Trans Parallel Distr Syst 19:276–287
Zhang M, Cai W (2010) Vision mesh: a novel video sensor networks platform for water conservancy engineering. In: Proc. IEEE International Conference on Computer Science and Information Technology, pp 106–109
Acknowledgements
This work was partially supported by Spanish projects TIN2010-21378-C02-01 and 2009-SGR-1167. We would like to thank Ugur Cil for his help on figure drawings. We would like to thank the anonymous reviewers for their helpful comments, feedbacks, and suggestions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tavli, B., Bicakci, K., Zilan, R. et al. A survey of visual sensor network platforms. Multimed Tools Appl 60, 689–726 (2012). https://doi.org/10.1007/s11042-011-0840-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0840-z