Skip to main content
Top
Published in: Neural Processing Letters 2/2020

07-12-2019

Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video

Authors: Tong Chen, Ying Jiang, Wang Jian, Lanxin Qiu, Huan Liu, Zhaolin Xiao

Published in: Neural Processing Letters | Issue 2/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, deep learning theory and applications have been grown rapidly. Its application aspects has been widely extended to medical care, unmanned driving, intelligent monitoring and other fields. In this paper, we focus on detecting and analyzing the movements of maintenance personnel based on power grid surveillance videos by using MASK-RCNN. Firstly, we detect the maintenance personnel in the video data using optimized MASK-RCNN network. Then, we plot the corresponding personnel path image using segmentation and centroid detection, which can accurately count the personnel trajectory with in-and-out information. Secondly, this paper introduce a tracking-learning-detection algorithm to further track and analyze interested feature events of power grid video. The experimental results show that our algorithm can accurately detect multiple personnel and obtain the key features of the video contents.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9 Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
2.
3.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
4.
go back to reference Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12 Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12
5.
go back to reference Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732 Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732
6.
go back to reference Yue-Hei Ng J, Hausknecht M, Vijayanarasimhan S, Vinyals O, Monga R, Toderici G (2015) Beyond short snippets: Deep networks for video classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4694–4702 Yue-Hei Ng J, Hausknecht M, Vijayanarasimhan S, Vinyals O, Monga R, Toderici G (2015) Beyond short snippets: Deep networks for video classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4694–4702
7.
go back to reference Wu Z, Wang X, Jiang Y-G, Ye H, Xue X (2015) Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. In Proceedings of the 23rd ACM international conference on multimedia. ACM, pp 461–470 Wu Z, Wang X, Jiang Y-G, Ye H, Xue X (2015) Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. In Proceedings of the 23rd ACM international conference on multimedia. ACM, pp 461–470
8.
go back to reference Nie L et al (2017) Enhancing Micro-video understanding by harnessing external sounds. In: Presented at the Proceedings of the 25th ACM international conference on multimedia, Mountain View, California, USA Nie L et al (2017) Enhancing Micro-video understanding by harnessing external sounds. In: Presented at the Proceedings of the 25th ACM international conference on multimedia, Mountain View, California, USA
9.
go back to reference Hao C, Yapin H, Jiongcong C (2014) Study on application of intelligent network video monitoring system. Electro Test 1:10–16 Hao C, Yapin H, Jiongcong C (2014) Study on application of intelligent network video monitoring system. Electro Test 1:10–16
10.
go back to reference Yang Y, Liu C, Huang L (2010) Application of image and video analysis in monitor system of power equipment. J Comput Appl 30:281–284 Yang Y, Liu C, Huang L (2010) Application of image and video analysis in monitor system of power equipment. J Comput Appl 30:281–284
11.
go back to reference Tianbing K, Yongqian L (2014) Research of object detection and tracking algorithm on the video surveillance in electric power system. Electr Power Sci Eng 30:42–46 Tianbing K, Yongqian L (2014) Research of object detection and tracking algorithm on the video surveillance in electric power system. Electr Power Sci Eng 30:42–46
12.
go back to reference Qing W, Yaoquan Y (2018) Research on moving target detection algorithm in power monitoring system. Electr Power Sci Eng 5:71–77 Qing W, Yaoquan Y (2018) Research on moving target detection algorithm in power monitoring system. Electr Power Sci Eng 5:71–77
13.
go back to reference De P, Qin Z, Wan D et al (2002) Application of video monitoring and intelligent warning system at unattended substations. Heilongjiang Electr Power 5:43–50 De P, Qin Z, Wan D et al (2002) Application of video monitoring and intelligent warning system at unattended substations. Heilongjiang Electr Power 5:43–50
14.
go back to reference Limin W, Yanwei G, Xinyu L (2010) Automatic tracking system for non-attended substation based on image procession. J North China Univ Water Resour Electr Power (Nat Sci Ed) 1:20–27 Limin W, Yanwei G, Xinyu L (2010) Automatic tracking system for non-attended substation based on image procession. J North China Univ Water Resour Electr Power (Nat Sci Ed) 1:20–27
15.
go back to reference He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 2980–2988 He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 2980–2988
16.
go back to reference Girshick R (2015) Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pp 1440–1448
17.
go back to reference Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
Metadata
Title
Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video
Authors
Tong Chen
Ying Jiang
Wang Jian
Lanxin Qiu
Huan Liu
Zhaolin Xiao
Publication date
07-12-2019
Publisher
Springer US
Published in
Neural Processing Letters / Issue 2/2020
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-019-10159-w

Other articles of this Issue 2/2020

Neural Processing Letters 2/2020 Go to the issue