Skip to main content
Erschienen in: Neural Processing Letters 3/2014

01.12.2014

Distributed Fault Detection in Sensor Networks using a Recurrent Neural Network

verfasst von: Oliver Obst

Erschienen in: Neural Processing Letters | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In long-term deployments of sensor networks, monitoring the quality of gathered data is a critical issue. Over the time of deployment, sensors are exposed to harsh conditions, causing some of them to fail or to deliver less accurate data. If such a degradation remains undetected, the usefulness of a sensor network can be greatly reduced. We present an approach that learns spatio-temporal correlations between different sensors, and makes use of the learned model to detect anomalous sensors by using distributed computation and only local communication between nodes. We introduce SODESN, a distributed recurrent neural network architecture, and a learning method to train SODESN for fault detection in a distributed scenario. Our approach is evaluated using data from a real-world sensor-network deployment, and shows good results even with imperfect link qualities and a number of simultaneous faults.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Benaoudaa D, Murtaghb F, Starckc JL, Renaud O (2006) Wavelet-based nonlinear multiscale decomposition model for electricity load forecasting. Neurocomputing 70(1–3):139–154CrossRef Benaoudaa D, Murtaghb F, Starckc JL, Renaud O (2006) Wavelet-based nonlinear multiscale decomposition model for electricity load forecasting. Neurocomputing 70(1–3):139–154CrossRef
2.
Zurück zum Zitat Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef
3.
Zurück zum Zitat Boedecker J, Obst O, Mayer NM, Asada M (2009) Initialization and self-organized optimization of recurrent neural network connectivity. HFSP J 3(5):340–349CrossRef Boedecker J, Obst O, Mayer NM, Asada M (2009) Initialization and self-organized optimization of recurrent neural network connectivity. HFSP J 3(5):340–349CrossRef
4.
Zurück zum Zitat Chang M, Terzis A, Bonnet P (2009) Mote-based online anomaly detection using echo state networks. In: DCOSS ’09 proceedings of the 5th IEEE international conference on distributed computing in sensor systems. Springer, Berlin, pp 72–86 Chang M, Terzis A, Bonnet P (2009) Mote-based online anomaly detection using echo state networks. In: DCOSS ’09 proceedings of the 5th IEEE international conference on distributed computing in sensor systems. Springer, Berlin, pp 72–86
5.
Zurück zum Zitat Corke P, Valencia P, Sikka P, Wark T, Overs L (2007) Long-duration solar-powered wireless sensor networks. In: EmNets ’07 proceedings of the 4th workshop on embedded networked sensors. ACM, New York, pp 33–37 Corke P, Valencia P, Sikka P, Wark T, Overs L (2007) Long-duration solar-powered wireless sensor networks. In: EmNets ’07 proceedings of the 4th workshop on embedded networked sensors. ACM, New York, pp 33–37
6.
Zurück zum Zitat Greenwald MB, Khanna S (2004) Power-conserving computation of order-statistics over sensor networks. In: Proceedings of the 23rd ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, pp 275–285 Greenwald MB, Khanna S (2004) Power-conserving computation of order-statistics over sensor networks. In: Proceedings of the 23rd ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, pp 275–285
7.
Zurück zum Zitat Hammer B, Micheli A, Neubauer N, Sperduti A, Strickert M (2005) Self organizing maps for time series. In: Proceedings of WSOM 2005, pp 115–122 Hammer B, Micheli A, Neubauer N, Sperduti A, Strickert M (2005) Self organizing maps for time series. In: Proceedings of WSOM 2005, pp 115–122
8.
Zurück zum Zitat Hammer B, Schrauwen B, Steil JJ (2009) Recent advances in efficient learning of recurrent networks. In: ESANN’2009 proceedings, European symposium on artificial neural networks—advances in computational intelligence and, learning, pp 213–226 Hammer B, Schrauwen B, Steil JJ (2009) Recent advances in efficient learning of recurrent networks. In: ESANN’2009 proceedings, European symposium on artificial neural networks—advances in computational intelligence and, learning, pp 213–226
9.
Zurück zum Zitat Heinzelman WR, Chandrakasan A, Balakrishnan H (2000) Energy-efficient communication protocol for wireless microsensor networks. In: Proceedings of the 33rd annual Hawaii international conference on system sciences (HICSS ’00), vol 8, pp 3005–3014 Heinzelman WR, Chandrakasan A, Balakrishnan H (2000) Energy-efficient communication protocol for wireless microsensor networks. In: Proceedings of the 33rd annual Hawaii international conference on system sciences (HICSS ’00), vol 8, pp 3005–3014
10.
Zurück zum Zitat Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. Department of Computer Science, University of Toronto (arXiv preprint 1207.0580) Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR (2012) Improving neural networks by preventing co-adaptation of feature detectors. Department of Computer Science, University of Toronto (arXiv preprint 1207.0580)
11.
Zurück zum Zitat Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl Based Syst 6(2):107–116CrossRefMATHMathSciNet Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl Based Syst 6(2):107–116CrossRefMATHMathSciNet
12.
Zurück zum Zitat Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
13.
Zurück zum Zitat Jaeger, H (2001) The “echo state” approach to analysing and training recurrent neural networks. GMD Report 148, GMD, German National Research Institute for Computer Science Jaeger, H (2001) The “echo state” approach to analysing and training recurrent neural networks. GMD Report 148, GMD, German National Research Institute for Computer Science
14.
Zurück zum Zitat Jaeger H (2002) Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the echo state network approach. GMD Report 159, Fraunhofer Institute AIS Jaeger H (2002) Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the echo state network approach. GMD Report 159, Fraunhofer Institute AIS
15.
Zurück zum Zitat Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667):78–80CrossRef Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667):78–80CrossRef
16.
Zurück zum Zitat Lukosevicius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3(3):127–149CrossRefMATH Lukosevicius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3(3):127–149CrossRefMATH
17.
Zurück zum Zitat Mayer NM, Browne M, Wu HJ (2010) ESNs with one dimensional topography. In: Proceedings of the 17th international conference on neural information processing: models and applications (ICONIP’10), vol II, pp 209–216 Mayer NM, Browne M, Wu HJ (2010) ESNs with one dimensional topography. In: Proceedings of the 17th international conference on neural information processing: models and applications (ICONIP’10), vol II, pp 209–216
18.
Zurück zum Zitat Obst O (2009) Distributed fault detection using a recurrent neural network. In: Proceedings of the international conference on information processing in sensor networks (IPSN 2009). IEEE Computer Society, Washington, pp 373–374 (2009) Obst O (2009) Distributed fault detection using a recurrent neural network. In: Proceedings of the international conference on information processing in sensor networks (IPSN 2009). IEEE Computer Society, Washington, pp 373–374 (2009)
19.
Zurück zum Zitat Obst O, Wang XR, Prokopenko M (2008) Using echo state networks for anomaly detection in underground coal mines. In: Proceedings of the international conference on information processing in sensor networks (IPSN 2008). IEEE Computer Society, Los Alamitos, pp 219–229 Obst O, Wang XR, Prokopenko M (2008) Using echo state networks for anomaly detection in underground coal mines. In: Proceedings of the international conference on information processing in sensor networks (IPSN 2008). IEEE Computer Society, Los Alamitos, pp 219–229
20.
Zurück zum Zitat Palangpour P, Venayagamoorthy GK, Duffy K (2006) Recurrent neural network based predictions of elephant migration in a South African game reserve. In: Proceedings of the international joint conference on neural networks (IJCNN 2006), Vancouver, BC, pp 4084–4088 Palangpour P, Venayagamoorthy GK, Duffy K (2006) Recurrent neural network based predictions of elephant migration in a South African game reserve. In: Proceedings of the international joint conference on neural networks (IJCNN 2006), Vancouver, BC, pp 4084–4088
21.
Zurück zum Zitat Quek C, Pasquier M, Kumar N (2008) A novel recurrent neural network-based prediction system for option trading and hedging. Appl Intell 29(2):138–151CrossRef Quek C, Pasquier M, Kumar N (2008) A novel recurrent neural network-based prediction system for option trading and hedging. Appl Intell 29(2):138–151CrossRef
22.
Zurück zum Zitat Schmidhuber J, Wierstra D, Gagliolo M, Gomez F (2007) Training recurrent networks by evolino. Neural Comput 19(3):757–779CrossRefMATH Schmidhuber J, Wierstra D, Gagliolo M, Gomez F (2007) Training recurrent networks by evolino. Neural Comput 19(3):757–779CrossRefMATH
23.
Zurück zum Zitat Schmidhuber J, Wierstra D, Gomez FJ (2005) Evolino: hybrid neuroevolution/optimal linear search for sequence learning. In: Kaelbling LP, Saffiotti A (eds) Proceedings of the nineteenth international joint conference on artificial intelligence (IJCAI-05), pp 853–858 Schmidhuber J, Wierstra D, Gomez FJ (2005) Evolino: hybrid neuroevolution/optimal linear search for sequence learning. In: Kaelbling LP, Saffiotti A (eds) Proceedings of the nineteenth international joint conference on artificial intelligence (IJCAI-05), pp 853–858
24.
Zurück zum Zitat Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. In: Proceedings of the twenty-fifth international conference (ICML 2008), pp 1096–1103 Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. In: Proceedings of the twenty-fifth international conference (ICML 2008), pp 1096–1103
25.
Zurück zum Zitat Wang Q, Hempstead M, Yang W (2006) A realistic power consumption model for wireless sensor network devices. In: 3rd annual IEEE communications society on sensor and ad hoc communications and networks (SECON ’06), vol 1, pp 286–295 Wang Q, Hempstead M, Yang W (2006) A realistic power consumption model for wireless sensor network devices. In: 3rd annual IEEE communications society on sensor and ad hoc communications and networks (SECON ’06), vol 1, pp 286–295
26.
Zurück zum Zitat Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560CrossRef Werbos PJ (1990) Backpropagation through time: what it does and how to do it. Proc IEEE 78(10):1550–1560CrossRef
Metadaten
Titel
Distributed Fault Detection in Sensor Networks using a Recurrent Neural Network
verfasst von
Oliver Obst
Publikationsdatum
01.12.2014
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2014
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-013-9327-4

Weitere Artikel der Ausgabe 3/2014

Neural Processing Letters 3/2014 Zur Ausgabe

Neuer Inhalt