Skip to main content
Top
Published in: Fire Technology 6/2023

21-07-2023

Lite Transformer Network with Long–Short Range Attention for Real-Time Fire Detection

Authors: Zhao Wenxuan, Zhao Yaqin, Zheng Zhaoxiang, Li Ao

Published in: Fire Technology | Issue 6/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the popularity of video surveillance network, image-based fire detection method is of great significance to reduce the loss of public life and public property caused by fire disasters. Convolutional neural networks based on deep learning have been used in the field of fire detection. However, these methods directly use the existing object detection network, so there are some problems such as low detection accuracy, slow speed and high calculation cost. In this paper, we propose a cost-efficient neural network based on long-short range attention for real-time fire detection. First, we design a light-weight backbone network to extract multi-scale fire features with lower computational cost. Secondly, we introduce the transformer module into the convolution layer and construct an long-short range attention block, which can extract the global attention independent of distance to assist the network in identifying fire and background. Finally, the feature fusion module is constructed to process the multi-scale features extracted by backbone, and improve the detection effect of different size fires, especially early small-size fires. The experimental results show that our network can accurately detect fire with very fast speed and very low calculation cost, and the false alarm rate is lower. At the same time, it also has significant advantages for the detection performance of early small-size fire.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhang J, Li W, Han N, Kan J (2008) Forest fire detection system based on a zigbee wireless sensor network. Front Forest China 3(3):369–374CrossRef Zhang J, Li W, Han N, Kan J (2008) Forest fire detection system based on a zigbee wireless sensor network. Front Forest China 3(3):369–374CrossRef
2.
go back to reference Aslan YE, Korpeoglu I, Ulusoy Ö (2012) A framework for use of wireless sensor networks in forest fire detection and monitoring. Comput Environ Urban Sys 36(6):614–625 (2012)CrossRef Aslan YE, Korpeoglu I, Ulusoy Ö (2012) A framework for use of wireless sensor networks in forest fire detection and monitoring. Comput Environ Urban Sys 36(6):614–625 (2012)CrossRef
3.
go back to reference Dener M, Özkök Y, Bostancıoğlu C (2015) Fire detection systems in wireless sensor networks. Procedia Soc Behav Sci 195:1846–1850CrossRef Dener M, Özkök Y, Bostancıoğlu C (2015) Fire detection systems in wireless sensor networks. Procedia Soc Behav Sci 195:1846–1850CrossRef
4.
go back to reference Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef
5.
go back to reference Wang T, Shi L, Yuan P, Bu L, Hou X (2017) A new fire detection method based on flame color dispersion and similarity in consecutive frames. In: 2017 Chinese automation congress (CAC). IEEE, pp. 151–156 Wang T, Shi L, Yuan P, Bu L, Hou X (2017) A new fire detection method based on flame color dispersion and similarity in consecutive frames. In: 2017 Chinese automation congress (CAC). IEEE, pp. 151–156
6.
go back to reference Emmy Prema C, Vinsley S, Suresh S (2018) Efficient flame detection based on static and dynamic texture analysis in forest fire detection. Fire technology 54(1):255–288CrossRef Emmy Prema C, Vinsley S, Suresh S (2018) Efficient flame detection based on static and dynamic texture analysis in forest fire detection. Fire technology 54(1):255–288CrossRef
7.
go back to reference Abdusalomov A, Baratov N, Kutlimuratov A, Whangbo TK (2021) An improvement of the fire detection and classification method using yolov3 for surveillance systems. Sensors 21(19): 6519CrossRef Abdusalomov A, Baratov N, Kutlimuratov A, Whangbo TK (2021) An improvement of the fire detection and classification method using yolov3 for surveillance systems. Sensors 21(19): 6519CrossRef
8.
go back to reference Majid S, Alenezi F, Masood S, Ahmad M, Gündüz E, Polat K (2022) Attention based CNN model for fire detection and localization in real-world images. Expert Syst App 189:116114CrossRef Majid S, Alenezi F, Masood S, Ahmad M, Gündüz E, Polat K (2022) Attention based CNN model for fire detection and localization in real-world images. Expert Syst App 189:116114CrossRef
9.
go back to reference Xu R, Lin H, Lu K, Cao L, Liu Y (2021) A forest fire detection system based on ensemble learning. Forests 12(2):217CrossRef Xu R, Lin H, Lu K, Cao L, Liu Y (2021) A forest fire detection system based on ensemble learning. Forests 12(2):217CrossRef
10.
go back to reference Kim B, Lee J (2019) A video-based fire detection using deep learning models. Appl Sci 9(14):2862CrossRef Kim B, Lee J (2019) A video-based fire detection using deep learning models. Appl Sci 9(14):2862CrossRef
11.
go back to reference Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: a specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:1905.11922 Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: a specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:​1905.​11922
12.
go back to reference Luo Y, Zhao L, Liu P, Huang D (2018) Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools App 77(12):15075–15092CrossRef Luo Y, Zhao L, Liu P, Huang D (2018) Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools App 77(12):15075–15092CrossRef
13.
go back to reference Govil EA (2020) Kinshuk: Preliminary results from a wildfire detection system using deep learning on remote camera images. Remote Sens Govil EA (2020) Kinshuk: Preliminary results from a wildfire detection system using deep learning on remote camera images. Remote Sens
14.
15.
go back to reference Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 28 Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 28
16.
go back to reference Guede EA (2021) Federico: a deep learning based object identification system for forest fire detection. Fire Guede EA (2021) Federico: a deep learning based object identification system for forest fire detection. Fire
17.
go back to reference Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, pp. 6105–6114 Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, pp. 6105–6114
18.
19.
go back to reference Tan M, Pang R, Le QV (2020) Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10781–10790 Tan M, Pang R, Le QV (2020) Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10781–10790
20.
go back to reference Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng 19:100625CrossRef Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Stud Therm Eng 19:100625CrossRef
22.
go back to reference Dimitropoulos K, Barmpoutis P, Grammalidis N (2014) Spatio-temporal flame modeling and dynamic texture analysis for automatic video-based fire detection. IEEE Trans Circ Syst Video Technol 25(2):339–351CrossRef Dimitropoulos K, Barmpoutis P, Grammalidis N (2014) Spatio-temporal flame modeling and dynamic texture analysis for automatic video-based fire detection. IEEE Trans Circ Syst Video Technol 25(2):339–351CrossRef
23.
24.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778
25.
go back to reference Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788
26.
go back to reference Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263–7271 Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263–7271
28.
go back to reference Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4510–4520 Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) Mobilenetv2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4510–4520
29.
go back to reference Li Z, Zou H, Sun X, Zhu T, Ni C (2021) 3d expression-invariant face verification based on transfer learning and Siamese network for small sample size. Electronics 10(17), 2128CrossRef Li Z, Zou H, Sun X, Zhu T, Ni C (2021) 3d expression-invariant face verification based on transfer learning and Siamese network for small sample size. Electronics 10(17), 2128CrossRef
30.
go back to reference Fukui H, Hirakawa T, Yamashita T, Fujiyoshi H (2019) Attention branch network: learning of attention mechanism for visual explanation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10705–10714 Fukui H, Hirakawa T, Yamashita T, Fujiyoshi H (2019) Attention branch network: learning of attention mechanism for visual explanation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10705–10714
31.
go back to reference Woo S, Park J, Lee J-Y, Kweon IS (2018) Cbam: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp. 3–19 Woo S, Park J, Lee J-Y, Kweon IS (2018) Cbam: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp. 3–19
32.
go back to reference Zhang H-J, Zhang N, Xiao N-F (2015) Fire detection and identification method based on visual attention mechanism. Optik 126(24):5011–5018CrossRef Zhang H-J, Zhang N, Xiao N-F (2015) Fire detection and identification method based on visual attention mechanism. Optik 126(24):5011–5018CrossRef
34.
go back to reference Mehta S, Rastegari M (2021) Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:2110.02178 Mehta S, Rastegari M (2021) Mobilevit: light-weight, general-purpose, and mobile-friendly vision transformer. arXiv preprint arXiv:​2110.​02178
35.
go back to reference Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie, S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 2117–2125 Lin T-Y, Dollár P, Girshick R, He K, Hariharan B, Belongie, S (2017) Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 2117–2125
36.
go back to reference Wang K, Liew JH, Zou Y, Zhou D, Feng J (2019) Panet: few-shot image semantic segmentation with prototype alignment. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9197–9206 Wang K, Liew JH, Zou Y, Zhou D, Feng J (2019) Panet: few-shot image semantic segmentation with prototype alignment. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9197–9206
38.
go back to reference Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9627–9636 Tian Z, Shen C, Chen H, He T (2019) Fcos: fully convolutional one-stage object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, pp. 9627–9636
39.
go back to reference Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In: European conference on computer vision. Springer, pp. 21–37 Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) SSD: single shot multibox detector. In: European conference on computer vision. Springer, pp. 21–37
40.
go back to reference Pan H, Badawi D, Cetin AE (2021) Computationally efficient wildfire detection method using a deep convolutional network pruned via Fourier analysis. Sensors Pan H, Badawi D, Cetin AE (2021) Computationally efficient wildfire detection method using a deep convolutional network pruned via Fourier analysis. Sensors
Metadata
Title
Lite Transformer Network with Long–Short Range Attention for Real-Time Fire Detection
Authors
Zhao Wenxuan
Zhao Yaqin
Zheng Zhaoxiang
Li Ao
Publication date
21-07-2023
Publisher
Springer US
Published in
Fire Technology / Issue 6/2023
Print ISSN: 0015-2684
Electronic ISSN: 1572-8099
DOI
https://doi.org/10.1007/s10694-023-01465-w

Other articles of this Issue 6/2023

Fire Technology 6/2023 Go to the issue