Skip to main content
Erschienen in: Fire Technology 2/2018

03.01.2018

Fire Recognition Based On Multi-Channel Convolutional Neural Network

verfasst von: Wentao Mao, Wenpeng Wang, Zhi Dou, Yuan Li

Erschienen in: Fire Technology | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, fire recognition methods have received more and more attention in the fields of academy and industry. Current sensor-based recognition methods rely heavily on the external physical signals, which will probably reduce the recognition precision if the external environment changes dramatically. With the rapid development of high-definition camera, the methods based on image feature extraction provide another solution which tries to conduct pattern recognition for the monitoring video. However, these methods couldn’t be widely and successfully applied to fire detection due to two deficiencies: (1) there are too many interference items like lamplight and car highlight in the room or tunnel, which will disturb the recognition performance largely; (2) The features depend on much prior knowledge about flame and smoke, and there lacks a universal and automatic extraction method for various fire scenes. As a breakthrough in pattern recognition, deep learning is capable of exploring the useful information from raw data, and can automatically provide accurate recognition results. Therefore, based on deep learning idea, a novel fire recognition method based on multi-channel convolutional neural network is proposed in this paper to overcome the deficiencies mentioned above. First, three channel colorful images are constructed as the input of convolutional neural network; Second, the hidden layers with multiple-layer convolution and pooling are constructed, and simultaneously, the model parameters are find tuned by using back propagation; Finally, softmax method is used to conduct the classification about fire recognition. To save the training time, we utilize GPU to construct training and test models. From public fire dataset and Internet, we collect 7000 images for training and 4494 images for test, and then run experiments with the comparison of four baseline methods including deep neural network, support vector machine based on scale-invariant feature transform feature, stack auto-encoder and deep belief network. The experimental results show that the proposed method is more capable of restoring the features of input image by means of hidden output figure, and for various flame scenes and types, the proposed method can reach 98% or more classification accuracy, getting improvement of around 2% than the traditional feature-based method. Also, the proposed method always outperforms other Deep Learning methods in terms of ROC curve, recall rate, precision rate and F1-score.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu B, Zhang Y, Wang D (2007) Design intelligent multi-sensor fire monitoring based on DSP. In: International conference on electronic measurement and instruments, 4-799-4-804 Liu B, Zhang Y, Wang D (2007) Design intelligent multi-sensor fire monitoring based on DSP. In: International conference on electronic measurement and instruments, 4-799-4-804
2.
Zurück zum Zitat Carter CF (2004) Fire detection sensors. US, US6818893 Carter CF (2004) Fire detection sensors. US, US6818893
3.
Zurück zum Zitat Zhang J, Zhang H, Li M (2013) TDLAS-based early-stage forest fire detection system. For Eng 29(2):139–142 Zhang J, Zhang H, Li M (2013) TDLAS-based early-stage forest fire detection system. For Eng 29(2):139–142
4.
Zurück zum Zitat Chen S, Bao H, Zeng X, Yang Y (2003) A fire detecting method based on multi-sensor data fusion. In: Proceedings of IEEE international conference on systems, man and cybernetics, Washington, USA Chen S, Bao H, Zeng X, Yang Y (2003) A fire detecting method based on multi-sensor data fusion. In: Proceedings of IEEE international conference on systems, man and cybernetics, Washington, USA
5.
Zurück zum Zitat Li M, Xu W, Xu K, Fan J, Hou D (2013) Review of fire detection technologies based on video image. J Theor Appl Inf Technol 49(2):700–707 Li M, Xu W, Xu K, Fan J, Hou D (2013) Review of fire detection technologies based on video image. J Theor Appl Inf Technol 49(2):700–707
6.
Zurück zum Zitat Enis Cetin A, Dimitropoulos K, Gouverneur B, Grammalidis N, Günay O et al (2013) Video fire detection—review. Digit Signal Proc 23(6):1827–1843CrossRef Enis Cetin A, Dimitropoulos K, Gouverneur B, Grammalidis N, Günay O et al (2013) Video fire detection—review. Digit Signal Proc 23(6):1827–1843CrossRef
7.
Zurück zum Zitat Ko B, Cheong K, Nam J (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–329CrossRef Ko B, Cheong K, Nam J (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–329CrossRef
8.
Zurück zum Zitat Yang B, Dong Z, Zhang Y, Zheng X (2010) Recognition of fire detection based on neural network. Lecture notes in computer science—life system modeling and intelligent computing 6329:250–258CrossRef Yang B, Dong Z, Zhang Y, Zheng X (2010) Recognition of fire detection based on neural network. Lecture notes in computer science—life system modeling and intelligent computing 6329:250–258CrossRef
9.
Zurück zum Zitat Zaidi N, Lokman N, Daud M, Chia K (2015) Fire recognition using RGB and YCbCr color space. ARPN J Eng Appl Sci 10(21):9786–9790 Zaidi N, Lokman N, Daud M, Chia K (2015) Fire recognition using RGB and YCbCr color space. ARPN J Eng Appl Sci 10(21):9786–9790
10.
Zurück zum Zitat Qiang Y, Pei B, Zhao J (2014) Forest fire image intelligent recognition based on the neural network. J Multimed 9(3):449–455CrossRef Qiang Y, Pei B, Zhao J (2014) Forest fire image intelligent recognition based on the neural network. J Multimed 9(3):449–455CrossRef
11.
Zurück zum Zitat Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf J 79:37–43CrossRef Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf J 79:37–43CrossRef
12.
Zurück zum Zitat Zhang Z, Shen T, Zou J (2014) An improved probabilistic approach for fire detection in videos. Fire Technol 50(3):745–752CrossRef Zhang Z, Shen T, Zou J (2014) An improved probabilistic approach for fire detection in videos. Fire Technol 50(3):745–752CrossRef
13.
Zurück zum Zitat Chu YY, Kodur VKR, Liang D (2017) A probabilistic inferential algorithm to determine fire source location based on inversion of multidimensional fire parameters. Fire Technol 53(3):1077–1100CrossRef Chu YY, Kodur VKR, Liang D (2017) A probabilistic inferential algorithm to determine fire source location based on inversion of multidimensional fire parameters. Fire Technol 53(3):1077–1100CrossRef
14.
Zurück zum Zitat Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef
15.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):1097–1105
16.
Zurück zum Zitat Graves A, Mohamed A, Hinton GE (2013) Speech recognition with deep recurrent neural networks. In: Proceedings of 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP), Vancouver, BC, Canada, pp 6645-6649 Graves A, Mohamed A, Hinton GE (2013) Speech recognition with deep recurrent neural networks. In: Proceedings of 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP), Vancouver, BC, Canada, pp 6645-6649
17.
Zurück zum Zitat Mamoshina P, Vieira A, Putin E, Zhavoronkov A (2016) Applications of deep learning in biomedicine. Mol Pharm 13(5):1445–1454CrossRef Mamoshina P, Vieira A, Putin E, Zhavoronkov A (2016) Applications of deep learning in biomedicine. Mol Pharm 13(5):1445–1454CrossRef
18.
Zurück zum Zitat Yu C, Fang J, Wang J, Zhang Y (2010) Video fire smoke detection using motion and color features.Fire Technol 46(3):651–663CrossRef Yu C, Fang J, Wang J, Zhang Y (2010) Video fire smoke detection using motion and color features.Fire Technol 46(3):651–663CrossRef
19.
Zurück zum Zitat Fang J, Wang J, Yu C, Zhang Y (2009) Texture analysis of smoke for real-time fire detection. In: Proceeding of international workshop on computer science and engineering (IWCSE), Qingdao, China, pp 511–515 Fang J, Wang J, Yu C, Zhang Y (2009) Texture analysis of smoke for real-time fire detection. In: Proceeding of international workshop on computer science and engineering (IWCSE), Qingdao, China, pp 511–515
20.
Zurück zum Zitat Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In: Proceeding of 2015 Chinese Automation Congress Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In: Proceeding of 2015 Chinese Automation Congress
21.
Zurück zum Zitat Uqur Töreyin B, Gokberk Cinbis R, Dedeoglu Y, Enis Cetin A (2007) Fire detection in infrared video using wavelet analysis.Opt Eng 46(6):067204CrossRef Uqur Töreyin B, Gokberk Cinbis R, Dedeoglu Y, Enis Cetin A (2007) Fire detection in infrared video using wavelet analysis.Opt Eng 46(6):067204CrossRef
22.
Zurück zum Zitat LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
23.
Zurück zum Zitat Rumelhart D, Hinton G, Williams R (1986) Learning representations by back-propagating errors. Nature 323:533–536CrossRefMATH Rumelhart D, Hinton G, Williams R (1986) Learning representations by back-propagating errors. Nature 323:533–536CrossRefMATH
24.
Zurück zum Zitat Lee V, Kim C, Chhugani J, Deisher M, Kim D et al. (2010) Debunking the 100x GPU vs. CPU myth: an evaluation of throughput computing on CPU and GPU. ACM Sigarch Comput Archit News 38(3):451–460CrossRef Lee V, Kim C, Chhugani J, Deisher M, Kim D et al. (2010) Debunking the 100x GPU vs. CPU myth: an evaluation of throughput computing on CPU and GPU. ACM Sigarch Comput Archit News 38(3):451–460CrossRef
28.
Zurück zum Zitat Hinton GE, Li D, Dong Y et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97CrossRef Hinton GE, Li D, Dong Y et al (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97CrossRef
29.
Zurück zum Zitat Mao W, Wang W, Jiang M, Ouyang J (2016) Fast flame recognition approach based on local feature filtering. J Comput Appl 36(10):2907–2911. (in Chinese) Mao W, Wang W, Jiang M, Ouyang J (2016) Fast flame recognition approach based on local feature filtering. J Comput Appl 36(10):2907–2911. (in Chinese)
30.
Zurück zum Zitat Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(12):3371–3408MathSciNetMATH Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(12):3371–3408MathSciNetMATH
31.
Zurück zum Zitat Suk H, Lee S, Shen D (2015) Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct Funct 220(2):841–859CrossRef Suk H, Lee S, Shen D (2015) Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct Funct 220(2):841–859CrossRef
32.
Zurück zum Zitat Mao W, He J, Li Y, Yan Y (2017) Bearing fault diagnosis with auto-encoder extreme learning machine: a comparative study. Proc Inst Mech Eng Part C J Mech Eng Sci 231(8):1560–1578CrossRef Mao W, He J, Li Y, Yan Y (2017) Bearing fault diagnosis with auto-encoder extreme learning machine: a comparative study. Proc Inst Mech Eng Part C J Mech Eng Sci 231(8):1560–1578CrossRef
33.
34.
Zurück zum Zitat Kuremoto T, Kimura S, Kobayashi K, Obayashi M (2014) Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137:47–56CrossRef Kuremoto T, Kimura S, Kobayashi K, Obayashi M (2014) Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137:47–56CrossRef
35.
Zurück zum Zitat Ranzato M, Boureau Y, LeCun Y (2008) Sparse feature learning for deep belief networks. Adv Neural Inf Process Syst ;20: 1185-1192 Ranzato M, Boureau Y, LeCun Y (2008) Sparse feature learning for deep belief networks. Adv Neural Inf Process Syst ;20: 1185-1192
Metadaten
Titel
Fire Recognition Based On Multi-Channel Convolutional Neural Network
verfasst von
Wentao Mao
Wenpeng Wang
Zhi Dou
Yuan Li
Publikationsdatum
03.01.2018
Verlag
Springer US
Erschienen in
Fire Technology / Ausgabe 2/2018
Print ISSN: 0015-2684
Elektronische ISSN: 1572-8099
DOI
https://doi.org/10.1007/s10694-017-0695-6

Weitere Artikel der Ausgabe 2/2018

Fire Technology 2/2018 Zur Ausgabe