Skip to main content
Erschienen in: Neural Processing Letters 2/2020

07.12.2019

Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video

verfasst von: Tong Chen, Ying Jiang, Wang Jian, Lanxin Qiu, Huan Liu, Zhaolin Xiao

Erschienen in: Neural Processing Letters | Ausgabe 2/2020

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, deep learning theory and applications have been grown rapidly. Its application aspects has been widely extended to medical care, unmanned driving, intelligent monitoring and other fields. In this paper, we focus on detecting and analyzing the movements of maintenance personnel based on power grid surveillance videos by using MASK-RCNN. Firstly, we detect the maintenance personnel in the video data using optimized MASK-RCNN network. Then, we plot the corresponding personnel path image using segmentation and centroid detection, which can accurately count the personnel trajectory with in-and-out information. Secondly, this paper introduce a tracking-learning-detection algorithm to further track and analyze interested feature events of power grid video. The experimental results show that our algorithm can accurately detect multiple personnel and obtain the key features of the video contents.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9 Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
2.
Zurück zum Zitat Russakovsky O et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252MathSciNetCrossRef Russakovsky O et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252MathSciNetCrossRef
3.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
4.
Zurück zum Zitat Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12 Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12
5.
Zurück zum Zitat Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732 Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732
6.
Zurück zum Zitat Yue-Hei Ng J, Hausknecht M, Vijayanarasimhan S, Vinyals O, Monga R, Toderici G (2015) Beyond short snippets: Deep networks for video classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4694–4702 Yue-Hei Ng J, Hausknecht M, Vijayanarasimhan S, Vinyals O, Monga R, Toderici G (2015) Beyond short snippets: Deep networks for video classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4694–4702
7.
Zurück zum Zitat Wu Z, Wang X, Jiang Y-G, Ye H, Xue X (2015) Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. In Proceedings of the 23rd ACM international conference on multimedia. ACM, pp 461–470 Wu Z, Wang X, Jiang Y-G, Ye H, Xue X (2015) Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. In Proceedings of the 23rd ACM international conference on multimedia. ACM, pp 461–470
8.
Zurück zum Zitat Nie L et al (2017) Enhancing Micro-video understanding by harnessing external sounds. In: Presented at the Proceedings of the 25th ACM international conference on multimedia, Mountain View, California, USA Nie L et al (2017) Enhancing Micro-video understanding by harnessing external sounds. In: Presented at the Proceedings of the 25th ACM international conference on multimedia, Mountain View, California, USA
9.
Zurück zum Zitat Hao C, Yapin H, Jiongcong C (2014) Study on application of intelligent network video monitoring system. Electro Test 1:10–16 Hao C, Yapin H, Jiongcong C (2014) Study on application of intelligent network video monitoring system. Electro Test 1:10–16
10.
Zurück zum Zitat Yang Y, Liu C, Huang L (2010) Application of image and video analysis in monitor system of power equipment. J Comput Appl 30:281–284 Yang Y, Liu C, Huang L (2010) Application of image and video analysis in monitor system of power equipment. J Comput Appl 30:281–284
11.
Zurück zum Zitat Tianbing K, Yongqian L (2014) Research of object detection and tracking algorithm on the video surveillance in electric power system. Electr Power Sci Eng 30:42–46 Tianbing K, Yongqian L (2014) Research of object detection and tracking algorithm on the video surveillance in electric power system. Electr Power Sci Eng 30:42–46
12.
Zurück zum Zitat Qing W, Yaoquan Y (2018) Research on moving target detection algorithm in power monitoring system. Electr Power Sci Eng 5:71–77 Qing W, Yaoquan Y (2018) Research on moving target detection algorithm in power monitoring system. Electr Power Sci Eng 5:71–77
13.
Zurück zum Zitat De P, Qin Z, Wan D et al (2002) Application of video monitoring and intelligent warning system at unattended substations. Heilongjiang Electr Power 5:43–50 De P, Qin Z, Wan D et al (2002) Application of video monitoring and intelligent warning system at unattended substations. Heilongjiang Electr Power 5:43–50
14.
Zurück zum Zitat Limin W, Yanwei G, Xinyu L (2010) Automatic tracking system for non-attended substation based on image procession. J North China Univ Water Resour Electr Power (Nat Sci Ed) 1:20–27 Limin W, Yanwei G, Xinyu L (2010) Automatic tracking system for non-attended substation based on image procession. J North China Univ Water Resour Electr Power (Nat Sci Ed) 1:20–27
15.
Zurück zum Zitat He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 2980–2988 He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 2980–2988
16.
Zurück zum Zitat Girshick R (2015) Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pp 1440–1448
17.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
Metadaten
Titel
Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video
verfasst von
Tong Chen
Ying Jiang
Wang Jian
Lanxin Qiu
Huan Liu
Zhaolin Xiao
Publikationsdatum
07.12.2019
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-019-10159-w

Weitere Artikel der Ausgabe 2/2020

Neural Processing Letters 2/2020 Zur Ausgabe

Neuer Inhalt