Skip to main content
Erschienen in: Neural Computing and Applications 15/2021

29.01.2021 | Original Article

ID-Net: an improved mask R-CNN model for intrusion detection under power grid surveillance

verfasst von: Feng Gao, Shengchang Ji, Jie Guo, Qun Li, Yuzhu Ji, Yang Liu, Simeng Feng, Haokun Wei, Nan Wang, Biao Yang

Erschienen in: Neural Computing and Applications | Ausgabe 15/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Intrusion detection is a crucial task in power grid surveillance system by providing early warning for power grid security. Construction machinery and engineering vehicles, as the most common intrusion objects, have become the major concern for preventing external damages in power grid maintenance. In this paper, by considering the diversity of scales of intrusion objects and complexity of application scenarios under power grid surveillance, we compiled a dataset which contains 8177 images captured by 653 different power grid surveillance cameras. Based on this dataset, we proposed an improved context-aware mask region-based convolutional neural network (Mask R-CNN) model, namely ID-Net, for intrusion object detection. A modulated deformable convolutional operation is integrated into the backbone network for learning robust feature representations from geometric variations in engineering vehicles. By considering the correlation between objects and their context, a self-attention-based module is leveraged for long-range context relation modeling. For small objects detection, a feature integration module is applied for multi-scale feature fusion under a pyramid hierarchy. Then, a cascaded coarse-to-fine region proposal network is incorporated for progressively refining the bounding box location regression. Experimental results have demonstrated that our model can achieve competitive performance in comparison with state-of-the-art object detection methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Xiang X, Lv N, Guo X, Wang S, El Saddik AJS (2018) Engineering vehicles detection based on modified faster R-Cnn for power grid surveillance. Sensors 18(7):2258CrossRef Xiang X, Lv N, Guo X, Wang S, El Saddik AJS (2018) Engineering vehicles detection based on modified faster R-Cnn for power grid surveillance. Sensors 18(7):2258CrossRef
2.
Zurück zum Zitat Chen S, Wen H, Wu J et al (2019) Internet of things based smart grids supported by intelligent edge computing. IEEE Access 7:74089–74102CrossRef Chen S, Wen H, Wu J et al (2019) Internet of things based smart grids supported by intelligent edge computing. IEEE Access 7:74089–74102CrossRef
3.
Zurück zum Zitat He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-Cnn. In: IEEE international conference on computer vision, pp 2961–2969 He K, Gkioxari G, Dollár P, Girshick R (2017) Mask R-Cnn. In: IEEE international conference on computer vision, pp 2961–2969
4.
Zurück zum Zitat Zhu X, Hu H, Lin S, Dai J (2019) Deformable convnets V2: more deformable, better results. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9308–9316 Zhu X, Hu H, Lin S, Dai J (2019) Deformable convnets V2: more deformable, better results. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9308–9316
5.
Zurück zum Zitat Wang X, Girshick R, Gupta A, He K (2018) Non-local neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7794–7803 Wang X, Girshick R, Gupta A, He K (2018) Non-local neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7794–7803
6.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton GJN (2015) Deep learning. Nature 521(7553):436–444CrossRef LeCun Y, Bengio Y, Hinton GJN (2015) Deep learning. Nature 521(7553):436–444CrossRef
7.
Zurück zum Zitat Girshick R (2015) Fast R-CNN. In: IEEE international conference on computer vision, pp 1440–1448 Girshick R (2015) Fast R-CNN. In: IEEE international conference on computer vision, pp 1440–1448
8.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Neural information processing systems, pp 91–99 Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Neural information processing systems, pp 91–99
9.
Zurück zum Zitat Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: IEEE conference on computer vision and pattern recognition, pp 2117–2125 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. In: IEEE conference on computer vision and pattern recognition, pp 2117–2125
10.
Zurück zum Zitat Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE conference on computer vision and pattern recognition, pp 580–587 Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE conference on computer vision and pattern recognition, pp 580–587
11.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef
12.
Zurück zum Zitat Dai J, Li Y, He K, Sun J (2016) R-FCN: object detection via region-based fully convolutional networks. In: Neural information processing systems, pp 379–387 Dai J, Li Y, He K, Sun J (2016) R-FCN: object detection via region-based fully convolutional networks. In: Neural information processing systems, pp 379–387
13.
Zurück zum Zitat Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: IEEE conference on computer vision and pattern recognition, pp 779–788
14.
Zurück zum Zitat Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271 Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263–7271
15.
Zurück zum Zitat Liu W, Anguelov D, Erhan D et al (2016) SSD: single shot multibox detector. In: European conference on computer vision. Springer, pp 21–37 Liu W, Anguelov D, Erhan D et al (2016) SSD: single shot multibox detector. In: European conference on computer vision. Springer, pp 21–37
16.
Zurück zum Zitat Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv preprint arXiv: 1804.02767 Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv preprint arXiv: 1804.02767
17.
Zurück zum Zitat Fu C-Y, Liu W, Ranga A, Tyagi A, Berg AC (2017) DSSD: deconvolutional single shot detector Fu C-Y, Liu W, Ranga A, Tyagi A, Berg AC (2017) DSSD: deconvolutional single shot detector
18.
Zurück zum Zitat Shrivastava A, Sukthankar R, Malik J, Gupta AJ (2016) Beyond skip connections: top-down modulation for object detection Shrivastava A, Sukthankar R, Malik J, Gupta AJ (2016) Beyond skip connections: top-down modulation for object detection
19.
Zurück zum Zitat Lin T-Y, Goyal P, Girshick RB, He K, Dollár P (2017) Focal loss for dense object detection. Presented at the international conference on computer vision Lin T-Y, Goyal P, Girshick RB, He K, Dollár P (2017) Focal loss for dense object detection. Presented at the international conference on computer vision
20.
Zurück zum Zitat Liu L, Ouyang W, Wang X et al (2020) Deep learning for generic object detection: a survey. Int J Comput Vis 128(2):261–318CrossRef Liu L, Ouyang W, Wang X et al (2020) Deep learning for generic object detection: a survey. Int J Comput Vis 128(2):261–318CrossRef
21.
Zurück zum Zitat Law H, Deng J (2018) Cornernet: detecting objects as paired keypoints. In: Proceedings of the European conference on computer vision (ECCV), pp 734–750 Law H, Deng J (2018) Cornernet: detecting objects as paired keypoints. In: Proceedings of the European conference on computer vision (ECCV), pp 734–750
22.
Zurück zum Zitat Duan K, Bai S, Xie L, Qi H, Huang Q, Tian Q (2019) Centernet: keypoint triplets for object detection. In: Proceedings of the IEEE international conference on computer vision, pp 6569–6578 Duan K, Bai S, Xie L, Qi H, Huang Q, Tian Q (2019) Centernet: keypoint triplets for object detection. In: Proceedings of the IEEE international conference on computer vision, pp 6569–6578
23.
Zurück zum Zitat Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: European conference on computer vision. Springer, pp 483–499 Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. In: European conference on computer vision. Springer, pp 483–499
24.
Zurück zum Zitat Chouchene A, Carvalho A, Lima TM, Charrua-Santos F, Osório GJ, Barhoumi W (2020) Artificial intelligence for product quality inspection toward smart industries: quality control of vehicle non-conformities. In: 2020 9th international conference on industrial technology and management (ICITM), pp 127–131. IEEE Chouchene A, Carvalho A, Lima TM, Charrua-Santos F, Osório GJ, Barhoumi W (2020) Artificial intelligence for product quality inspection toward smart industries: quality control of vehicle non-conformities. In: 2020 9th international conference on industrial technology and management (ICITM), pp 127–131. IEEE
25.
Zurück zum Zitat Zhang H, Li D, Ji Y, Zhou H, Wu W, Liu KJIToII (2019) Towards new retail: a benchmark dataset for smart unmanned vending machines Zhang H, Li D, Ji Y, Zhou H, Wu W, Liu KJIToII (2019) Towards new retail: a benchmark dataset for smart unmanned vending machines
26.
Zurück zum Zitat Chang M-C, Chiang C-K, Tsai C-M et al (2020) Ai city challenge 2020-computer vision for smart transportation applications. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 620–621 Chang M-C, Chiang C-K, Tsai C-M et al (2020) Ai city challenge 2020-computer vision for smart transportation applications. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 620–621
27.
Zurück zum Zitat Nguyen VN, Jenssen R, Roverso D (2018) Automatic autonomous vision-based power line inspection: a review of current status and the potential role of deep learning. Int J Electr Power Energy Syst 99:107–120CrossRef Nguyen VN, Jenssen R, Roverso D (2018) Automatic autonomous vision-based power line inspection: a review of current status and the potential role of deep learning. Int J Electr Power Energy Syst 99:107–120CrossRef
28.
Zurück zum Zitat Sang J, Wu Z, Guo P et al (2018) An improved Yolov2 for vehicle detection. Sensors 18(12):4272CrossRef Sang J, Wu Z, Guo P et al (2018) An improved Yolov2 for vehicle detection. Sensors 18(12):4272CrossRef
29.
Zurück zum Zitat Kim K-J, Kim P-K, Chung Y-S, Choi D-H (2018) Performance enhancement of Yolov3 by adding prediction layers with spatial pyramid pooling for vehicle detection. In: 2018 15th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp. 1–6 Kim K-J, Kim P-K, Chung Y-S, Choi D-H (2018) Performance enhancement of Yolov3 by adding prediction layers with spatial pyramid pooling for vehicle detection. In: 2018 15th IEEE international conference on advanced video and signal based surveillance (AVSS). IEEE, pp. 1–6
30.
Zurück zum Zitat Dai J, Qi H, Xiong Y et al (2017) Deformable convolutional networks. In: IEEE international conference on computer vision, pp 764–773 Dai J, Qi H, Xiong Y et al (2017) Deformable convolutional networks. In: IEEE international conference on computer vision, pp 764–773
31.
Zurück zum Zitat Pang J, Chen K, Shi J, Feng H, Ouyang W, Lin D (2019) Libra R-CNN: towards balanced learning for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 821–830 Pang J, Chen K, Shi J, Feng H, Ouyang W, Lin D (2019) Libra R-CNN: towards balanced learning for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 821–830
32.
Zurück zum Zitat Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef
33.
Zurück zum Zitat Cai Z, Vasconcelos N (2018) Cascade R-CNN: delving into high quality object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6154–6162 Cai Z, Vasconcelos N (2018) Cascade R-CNN: delving into high quality object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6154–6162
34.
Zurück zum Zitat Dutta A, Zisserman A (2019) The via annotation software for images, audio and video. In: Proceedings of the 27th ACM international conference on multimedia, pp 2276–2279 Dutta A, Zisserman A (2019) The via annotation software for images, audio and video. In: Proceedings of the 27th ACM international conference on multimedia, pp 2276–2279
35.
Zurück zum Zitat Lin T-Y, Maire M, Belongie S, et al (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, pp 740–755 Lin T-Y, Maire M, Belongie S, et al (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, pp 740–755
36.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
37.
Zurück zum Zitat Chen K, Wang J, Pang J et al (2019) Mmdetection: open mmlab detection toolbox and benchmark. CoRR, vol. abs/1906.07155 Chen K, Wang J, Pang J et al (2019) Mmdetection: open mmlab detection toolbox and benchmark. CoRR, vol. abs/1906.07155
38.
Zurück zum Zitat Zhang Y, Li X, Lin M, Chiu B, Zhao M (2020) Deep-recursive residual network for image semantic segmentation. In: Neural computing and applications, pp 12935–12947 Zhang Y, Li X, Lin M, Chiu B, Zhao M (2020) Deep-recursive residual network for image semantic segmentation. In: Neural computing and applications, pp 12935–12947
Metadaten
Titel
ID-Net: an improved mask R-CNN model for intrusion detection under power grid surveillance
verfasst von
Feng Gao
Shengchang Ji
Jie Guo
Qun Li
Yuzhu Ji
Yang Liu
Simeng Feng
Haokun Wei
Nan Wang
Biao Yang
Publikationsdatum
29.01.2021
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 15/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-021-05688-2

Weitere Artikel der Ausgabe 15/2021

Neural Computing and Applications 15/2021 Zur Ausgabe