Skip to main content
Top
Published in: Fire Technology 5/2021

08-05-2021

Multi-Scale Prediction For Fire Detection Using Convolutional Neural Network

Authors: Myeongho Jeon, Han-Soo Choi, Junho Lee, Myungjoo Kang

Published in: Fire Technology | Issue 5/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The automation of fire detection systems can reduce the loss of life and property by allowing a fast and accurate response to fire accidents. Although visual techniques have some advantages over sensor-based methods, conventional image processing-based methods frequently cause false alarms. Recent studies on convolutional neural networks have overcome these limitations and exhibited an outstanding performance in fire detection tasks. Nevertheless, previous studies have only used single-scale feature maps for fire image classification, which are insufficiently robust to fires of various sizes in the images. To address this issue, we propose a multi-scale prediction framework that exploits the feature maps of all the scales obtained by the deeply stacked convolutional layers. To utilize the feature maps of various scales in the final prediction, this paper proposes a feature-squeeze block. The feature-squeeze block squeezes the feature maps spatially and channel-wise to effectively use the information from the multi-scale prediction. Extensive evaluations demonstrate that the proposed method outperforms the state-of-the-art convolutional neural networks-based methods. As a result of the experiment, the proposed method shows 97.89% for F1-score and 0.0227 for false positive rate in the average of evaluations for multiple.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. In: 2004 International conference on image processing, 2004 (ICIP’04), vol. 3, pp. 1707–1710. IEEE Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. In: 2004 International conference on image processing, 2004 (ICIP’04), vol. 3, pp. 1707–1710. IEEE
2.
go back to reference Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Safety J 41(4):285–289CrossRef Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Safety J 41(4):285–289CrossRef
3.
go back to reference Celik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Safety J 44(2):147–158CrossRef Celik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Safety J 44(2):147–158CrossRef
4.
go back to reference Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef
5.
go back to reference Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185CrossRef Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185CrossRef
6.
go back to reference Rinsurongkawong S, Ekpanyapong M, Dailey MN (2012) Fire detection for early fire alarm based on optical flow video processing. In: 2012 9th International conference on electrical engineering/electronics, computer, telecommunications and information technology, pp. 1-4, IEEE. Rinsurongkawong S, Ekpanyapong M, Dailey MN (2012) Fire detection for early fire alarm based on optical flow video processing. In: 2012 9th International conference on electrical engineering/electronics, computer, telecommunications and information technology, pp. 1-4, IEEE.
7.
go back to reference Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Safety J 44(3):322–329CrossRef Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Safety J 44(3):322–329CrossRef
8.
go back to reference Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In 2015 Chinese Automation Congress (CAC), pp. 633-637. IEEE Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In 2015 Chinese Automation Congress (CAC), pp. 633-637. IEEE
9.
go back to reference Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Safety J 79:37–43CrossRef Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Safety J 79:37–43CrossRef
10.
go back to reference Mao W, Wang W, Dou Z, Li Y (2018) Fire recognition based on multi-channel convolutional neural network. Fire Technol 54(2):531–554CrossRef Mao W, Wang W, Dou Z, Li Y (2018) Fire recognition based on multi-channel convolutional neural network. Fire Technol 54(2):531–554CrossRef
11.
go back to reference Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: A specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:1905.11922. Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: A specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:​1905.​11922.
12.
go back to reference Saeed F, Paul A, gaikumar P, Nayyar A (2019) Convolutional neural network based early fire detection. Multimed Tools Appl 79:9083–9099CrossRef Saeed F, Paul A, gaikumar P, Nayyar A (2019) Convolutional neural network based early fire detection. Multimed Tools Appl 79:9083–9099CrossRef
13.
go back to reference Frizzi S, Kaabi R, Bouchouicha M, Ginoux JM, Moreau E, Fnaiech F (2016) Convolutional neural network for video fire and smoke detection. In: IECON 2016-42nd annual conference of the IEEE industrial electronics society, pp. 877-882, IEEE Frizzi S, Kaabi R, Bouchouicha M, Ginoux JM, Moreau E, Fnaiech F (2016) Convolutional neural network for video fire and smoke detection. In: IECON 2016-42nd annual conference of the IEEE industrial electronics society, pp. 877-882, IEEE
14.
go back to reference Dunnings AJ, Breckon TP (2018) Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. In: 2018 25th IEEE International conference on image processing (ICIP), pp. 1558-1562, IEEE Dunnings AJ, Breckon TP (2018) Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. In: 2018 25th IEEE International conference on image processing (ICIP), pp. 1558-1562, IEEE
15.
go back to reference Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: 2016 International forum on management, education and information technology application. Atlantis Press Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: 2016 International forum on management, education and information technology application. Atlantis Press
16.
go back to reference Sharma J, Granmo OC, Goodwin M, Fidje JT (2017) Deep convolutional neural networks for fire detection in images. Int Conf Eng Appl Neural Netw. Springer, Cham, pp 183–193CrossRef Sharma J, Granmo OC, Goodwin M, Fidje JT (2017) Deep convolutional neural networks for fire detection in images. Int Conf Eng Appl Neural Netw. Springer, Cham, pp 183–193CrossRef
17.
go back to reference Maksymiv O, Rak T, Peleshko D (2017) Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence. In: 2017 14th international conference the experience of designing and application of CAD Systems in microelectronics (CADSM), pp. 351–353, IEEE Maksymiv O, Rak T, Peleshko D (2017) Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence. In: 2017 14th international conference the experience of designing and application of CAD Systems in microelectronics (CADSM), pp. 351–353, IEEE
18.
go back to reference Yang H, Jang H, Kim T, Lee B (2019) Non-temporal lightweight fire detection network for intelligent surveillance systems. IEEE Access 7:169257–169266CrossRef Yang H, Jang H, Kim T, Lee B (2019) Non-temporal lightweight fire detection network for intelligent surveillance systems. IEEE Access 7:169257–169266CrossRef
19.
go back to reference Li S, Yan Q, Liu P (2020) An efficient fire detection method based on multiscale feature extraction, implicit deep supervision and channel attention mechanism. IEEE Trans Image Process 29:8467–8475CrossRef Li S, Yan Q, Liu P (2020) An efficient fire detection method based on multiscale feature extraction, implicit deep supervision and channel attention mechanism. IEEE Trans Image Process 29:8467–8475CrossRef
20.
go back to reference Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 1–9
21.
go back to reference Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556.
22.
go back to reference Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183CrossRef Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183CrossRef
23.
go back to reference Muhammad K, Ahmad J, Baik SW (2018) Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288:30–42CrossRef Muhammad K, Ahmad J, Baik SW (2018) Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288:30–42CrossRef
24.
go back to reference Muhammad K, Khan S, Elhoseny M, Ahmed SH, Baik SW (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Informat 15(5):3113–3122CrossRef Muhammad K, Khan S, Elhoseny M, Ahmed SH, Baik SW (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Informat 15(5):3113–3122CrossRef
25.
go back to reference Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Studies Thermal Eng 19:100625CrossRef Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Studies Thermal Eng 19:100625CrossRef
26.
go back to reference Wu S, Zhang L (2018) Using popular object detection methods for real time forest fire detection. In 2018 11th International symposium on computational intelligence and design (ISCID), vol. 1, pp. 280–284, IEEE Wu S, Zhang L (2018) Using popular object detection methods for real time forest fire detection. In 2018 11th International symposium on computational intelligence and design (ISCID), vol. 1, pp. 280–284, IEEE
27.
go back to reference Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:​1506.​01497.
28.
go back to reference Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861.
29.
go back to reference Töreyin BU, Dedeoğlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58CrossRef Töreyin BU, Dedeoğlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58CrossRef
30.
go back to reference Zhang Z, Zhao J, Zhang D, Qu C, Ke Y, Cai B (2008) Contour based forest fire detection using FFT and wavelet. In 2008 International conference on computer science and software engineering, vol. 1, pp. 760-763, IEEE Zhang Z, Zhao J, Zhang D, Qu C, Ke Y, Cai B (2008) Contour based forest fire detection using FFT and wavelet. In 2008 International conference on computer science and software engineering, vol. 1, pp. 760-763, IEEE
31.
go back to reference Günay O, Taşdemir K, Töreyin BU, Çetin AE (2010) Fire detection in video using LMS based active learning. Fire Technol 46(3):551–577CrossRef Günay O, Taşdemir K, Töreyin BU, Çetin AE (2010) Fire detection in video using LMS based active learning. Fire Technol 46(3):551–577CrossRef
32.
go back to reference Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circuits Syst Video Technol 20(5):721–731CrossRef Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circuits Syst Video Technol 20(5):721–731CrossRef
33.
go back to reference Qiu T, Yan Y, Lu G (2011) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Measure 61(5):1486–1493CrossRef Qiu T, Yan Y, Lu G (2011) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Measure 61(5):1486–1493CrossRef
34.
go back to reference Wang DC, Cui X, Park E, Jin C, Kim H (2013) Adaptive flame detection using randomness testing and robust features. Fire Safety J 55:116–125CrossRef Wang DC, Cui X, Park E, Jin C, Kim H (2013) Adaptive flame detection using randomness testing and robust features. Fire Safety J 55:116–125CrossRef
35.
go back to reference Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circuits Syst Video Technol 25(9):1545–1556CrossRef Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circuits Syst Video Technol 25(9):1545–1556CrossRef
36.
go back to reference He K, Zhang X, Ren S, & Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778 He K, Zhang X, Ren S, & Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778
37.
go back to reference Krizhevsky A, Sutskever I, & Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097-1105 Krizhevsky A, Sutskever I, & Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097-1105
38.
go back to reference Zhang G, Wang M, Liu K (2019) Forest fire susceptibility modeling using a convolutional neural network for Yunnan province of China. Int J Disaster Risk Sci 10(3):386–403CrossRef Zhang G, Wang M, Liu K (2019) Forest fire susceptibility modeling using a convolutional neural network for Yunnan province of China. Int J Disaster Risk Sci 10(3):386–403CrossRef
39.
go back to reference Park B, Yu S, Jeong J (2019) Densely connected hierarchical network for image denoising. In Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp. 0–0 Park B, Yu S, Jeong J (2019) Densely connected hierarchical network for image denoising. In Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp. 0–0
40.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In European conference on computer vision. Springer, Cham, pp. 630–645 He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In European conference on computer vision. Springer, Cham, pp. 630–645
41.
go back to reference Project FP7-ICT-2013-EU-Brazil (2013) RESCURE-Reliable and Smart Crowdsourcing Solution for Emergency and Crisis Management Project FP7-ICT-2013-EU-Brazil (2013) RESCURE-Reliable and Smart Crowdsourcing Solution for Emergency and Crisis Management
42.
go back to reference Daniel YT Chino et al. (2015) Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: 2015 28th SIBGRAPI conference on graphics, patterns and images, pp. 95–102, IEEE Daniel YT Chino et al. (2015) Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: 2015 28th SIBGRAPI conference on graphics, patterns and images, pp. 95–102, IEEE
43.
go back to reference Mlích, J, Koplík, K, Hradiš M, Zemčík P (2020) Fire segmentation in still images. In: International conference on advanced concepts for intelligent vision systems. Springer, Cham, pp. 27–37 Mlích, J, Koplík, K, Hradiš M, Zemčík P (2020) Fire segmentation in still images. In: International conference on advanced concepts for intelligent vision systems. Springer, Cham, pp. 27–37
Metadata
Title
Multi-Scale Prediction For Fire Detection Using Convolutional Neural Network
Authors
Myeongho Jeon
Han-Soo Choi
Junho Lee
Myungjoo Kang
Publication date
08-05-2021
Publisher
Springer US
Published in
Fire Technology / Issue 5/2021
Print ISSN: 0015-2684
Electronic ISSN: 1572-8099
DOI
https://doi.org/10.1007/s10694-021-01132-y

Other articles of this Issue 5/2021

Fire Technology 5/2021 Go to the issue