Skip to main content

2016 | OriginalPaper | Buchkapitel

Non-stationary VFD Evaluation Kit: Dataset and Metrics to Fuel Video-Based Fire Detection Development

verfasst von : Cristiano Rafael Steffens, Ricardo Nagel Rodrigues, Silvia Silva da Costa Botelho

Erschienen in: Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Datasets play a major role in the advance of computer vision techniques nowadays. Open, complete and challenging ground truth data, combined with standardized metrics are essential to push the development and allow the proper evaluation of computer vision algorithms. Even though a significant amount of work on VFD (video-based fire detection) systems has been developed, compare different algorithms is a laborious task due to the lack of common evaluation schemes and evaluation datasets. We address both of these issues by presenting a dataset of fire videos along with frame by frame annotations to be used for non-stationary fire detection algorithms training and validation. By the time, this is the largest dataset released on this subject matter. Standard video file formats and open markup languages where used to allow compatibility and convenient integration with the most popular computer vision libraries. The dataset includes hand-held, robot attached and drone attached footages and aims to boost the development of fully autonomous firefighter robots. The presented ground truth and metrics adapt to the majority of the state-of-the-art techniques and provides a reliable and unbiased solution to compare them. The dataset, example source-code and documentation are publicly available under the Creative Commons 3.0 license on GitHub.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Borges, P.V.K., Izquierdo, E.: A probabilistic approach for vision-based fire detection in videos. IEEE Trans. Circ. Syst. Video Technol. 20(5), 721–731 (2010)CrossRef Borges, P.V.K., Izquierdo, E.: A probabilistic approach for vision-based fire detection in videos. IEEE Trans. Circ. Syst. Video Technol. 20(5), 721–731 (2010)CrossRef
3.
Zurück zum Zitat Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25(11), 120–126 (2000) Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools 25(11), 120–126 (2000)
4.
Zurück zum Zitat Celik, T.: Fast and efficient method for fire detection using image processing. ETRI J. 32(6), 881–890 (2010)MathSciNetCrossRef Celik, T.: Fast and efficient method for fire detection using image processing. ETRI J. 32(6), 881–890 (2010)MathSciNetCrossRef
5.
Zurück zum Zitat Celik, T., Demirel, H.: Fire detection in video sequences using a generic color model. Fire Saf. J. 44(2), 147–158 (2009)CrossRef Celik, T., Demirel, H.: Fire detection in video sequences using a generic color model. Fire Saf. J. 44(2), 147–158 (2009)CrossRef
6.
Zurück zum Zitat Celik, T., Ozkaramanli, H., Demirel, H.: Fire and smoke detection without sensors: image processing-based approach. In: 15th European Signal Processing Conference, EUSIPCO, pp. 147–158 (2007) Celik, T., Ozkaramanli, H., Demirel, H.: Fire and smoke detection without sensors: image processing-based approach. In: 15th European Signal Processing Conference, EUSIPCO, pp. 147–158 (2007)
7.
Zurück zum Zitat Chen, J., He, Y., Wang, J.: Multi-feature fusion based fast video flame detection. Build. Environ. 45(5), 1113–1122 (2010)MathSciNetCrossRef Chen, J., He, Y., Wang, J.: Multi-feature fusion based fast video flame detection. Build. Environ. 45(5), 1113–1122 (2010)MathSciNetCrossRef
8.
Zurück zum Zitat Chen, T.H., Wu, P.H., Chiou, Y.C.: An early fire-detection method based on image processing. In: 2004 International Conference on Image Processing, ICIP 2004, vol. 3, pp. 1707–1710. IEEE (2004) Chen, T.H., Wu, P.H., Chiou, Y.C.: An early fire-detection method based on image processing. In: 2004 International Conference on Image Processing, ICIP 2004, vol. 3, pp. 1707–1710. IEEE (2004)
9.
Zurück zum Zitat Chenebert, A., Breckon, T.P., Gaszczak, A.: A non-temporal texture driven approach to real-time fire detection. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 1741–1744. IEEE (2011) Chenebert, A., Breckon, T.P., Gaszczak, A.: A non-temporal texture driven approach to real-time fire detection. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 1741–1744. IEEE (2011)
11.
Zurück zum Zitat Collumeau, J.F., Laurent, H., Hafiane, A., Chetehouna, K.: Fire scene segmentations for forest fire characterization: a comparative study. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 2973–2976. IEEE (2011) Collumeau, J.F., Laurent, H., Hafiane, A., Chetehouna, K.: Fire scene segmentations for forest fire characterization: a comparative study. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 2973–2976. IEEE (2011)
12.
Zurück zum Zitat Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 248–255. IEEE (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 248–255. IEEE (2009)
13.
Zurück zum Zitat Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes (VOC) challenge. Int. J. Comput. Vis. 88(2), 303–338 (2010)CrossRef Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes (VOC) challenge. Int. J. Comput. Vis. 88(2), 303–338 (2010)CrossRef
14.
Zurück zum Zitat Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 106(1), 59–70 (2007)CrossRef Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 106(1), 59–70 (2007)CrossRef
16.
Zurück zum Zitat Foo, S.Y.: A rule-based machine vision system for fire detection in aircraft dry bays and engine compartments. Knowl.-Based Syst. 9(8), 531–540 (1996)CrossRef Foo, S.Y.: A rule-based machine vision system for fire detection in aircraft dry bays and engine compartments. Knowl.-Based Syst. 9(8), 531–540 (1996)CrossRef
17.
Zurück zum Zitat Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the kitti dataset. Int. J. Robot. Res. 32(11), 1231–1237 (2013). 0278364913491297CrossRef Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the kitti dataset. Int. J. Robot. Res. 32(11), 1231–1237 (2013). 0278364913491297CrossRef
19.
Zurück zum Zitat Gunay, O., Cetin, A.E.: Real-time dynamic texture recognition using random sampling and dimension reduction. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3087–3091. IEEE (2015) Gunay, O., Cetin, A.E.: Real-time dynamic texture recognition using random sampling and dimension reduction. In: 2015 IEEE International Conference on Image Processing (ICIP), pp. 3087–3091. IEEE (2015)
20.
Zurück zum Zitat Habiboglu, Y.H., Gunay, O., Cetin, A.E.: Real-time wildfire detection using correlation descriptors. In: 19th European Signal Processing Conference (EUSIPCO 2011), Special Session on Signal Processing for Disaster Management and Prevention, pp. 894–898 (2011) Habiboglu, Y.H., Gunay, O., Cetin, A.E.: Real-time wildfire detection using correlation descriptors. In: 19th European Signal Processing Conference (EUSIPCO 2011), Special Session on Signal Processing for Disaster Management and Prevention, pp. 894–898 (2011)
21.
Zurück zum Zitat Hafiane, A., Chabrier, S., Rosenberger, C., Laurent, H.: A new supervised evaluation criterion for region based segmentation methods. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 439–448. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74607-2_40 CrossRef Hafiane, A., Chabrier, S., Rosenberger, C., Laurent, H.: A new supervised evaluation criterion for region based segmentation methods. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2007. LNCS, vol. 4678, pp. 439–448. Springer, Heidelberg (2007). doi:10.​1007/​978-3-540-74607-2_​40 CrossRef
22.
Zurück zum Zitat Hamins, A., Yang, J., Kashiwagi, T.: An experimental investigation of the pulsation frequency of flames. Symp. (Int.) Combust. 24(1), 1695–1702 (1992). ElsevierCrossRef Hamins, A., Yang, J., Kashiwagi, T.: An experimental investigation of the pulsation frequency of flames. Symp. (Int.) Combust. 24(1), 1695–1702 (1992). ElsevierCrossRef
23.
Zurück zum Zitat Haralick, R.M.: Ridges and valleys on digital images. Comput. Vis. Graph. Image Process. 22(1), 28–38 (1983)MathSciNetCrossRef Haralick, R.M.: Ridges and valleys on digital images. Comput. Vis. Graph. Image Process. 22(1), 28–38 (1983)MathSciNetCrossRef
24.
Zurück zum Zitat Healey, G., Slater, D., Lin, T., Drda, B., et al.: A system for real-time fire detection. In: 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Proceedings, CVPR 1993, pp. 605–606. IEEE (1993) Healey, G., Slater, D., Lin, T., Drda, B., et al.: A system for real-time fire detection. In: 1993 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Proceedings, CVPR 1993, pp. 605–606. IEEE (1993)
26.
Zurück zum Zitat Jin, D., Li, S., Kim, H.: Robust fire detection using logistic regression and randomness testing for real-time video surveillance. In: 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA), pp. 608–613. IEEE (2015) Jin, D., Li, S., Kim, H.: Robust fire detection using logistic regression and randomness testing for real-time video surveillance. In: 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA), pp. 608–613. IEEE (2015)
27.
Zurück zum Zitat Kong, S.G., Jin, D., Li, S., Kim, H.: Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf. J. 79, 37–43 (2016)CrossRef Kong, S.G., Jin, D., Li, S., Kim, H.: Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Saf. J. 79, 37–43 (2016)CrossRef
28.
Zurück zum Zitat Kwak, J., Ko, B.C., Nam, J.Y.: Forest smoke detection using CCD camera and spatial-temporal variation of smoke visual patterns. In: 2011 Eighth International Conference on Computer Graphics, Imaging and Visualization (CGIV), pp. 141–144. IEEE (2011) Kwak, J., Ko, B.C., Nam, J.Y.: Forest smoke detection using CCD camera and spatial-temporal variation of smoke visual patterns. In: 2011 Eighth International Conference on Computer Graphics, Imaging and Visualization (CGIV), pp. 141–144. IEEE (2011)
29.
Zurück zum Zitat Labati, D., Genovese, A., Piuri, V., Scotti, F.: Wildfire smoke detection using computational intelligence techniques enhanced with synthetic smoke plume generation. IEEE Trans. Syst. Man Cybern. Syst. 43(4), 1003–1012 (2013)CrossRef Labati, D., Genovese, A., Piuri, V., Scotti, F.: Wildfire smoke detection using computational intelligence techniques enhanced with synthetic smoke plume generation. IEEE Trans. Syst. Man Cybern. Syst. 43(4), 1003–1012 (2013)CrossRef
30.
Zurück zum Zitat Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE (2010) Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 94–101. IEEE (2010)
31.
Zurück zum Zitat Matthews, B.W.: Comparison of the predicted and observed secondary structure of t4 phage lysozyme. Biochim. Biophys. Acta (BBA)-Protein Struct. 405(2), 442–451 (1975)CrossRef Matthews, B.W.: Comparison of the predicted and observed secondary structure of t4 phage lysozyme. Biochim. Biophys. Acta (BBA)-Protein Struct. 405(2), 442–451 (1975)CrossRef
32.
Zurück zum Zitat McDuff, D., El Kaliouby, R., Senechal, T., Amr, M., Cohn, J.F., Picard, R.: Affectiva-MIT facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected in-the-wild. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 881–888. IEEE (2013) McDuff, D., El Kaliouby, R., Senechal, T., Amr, M., Cohn, J.F., Picard, R.: Affectiva-MIT facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected in-the-wild. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 881–888. IEEE (2013)
33.
Zurück zum Zitat Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)CrossRef Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)CrossRef
34.
Zurück zum Zitat Nguyen-Ti, T., Nguyen-Phuc, T., Do-Hong, T.: Fire detection based on video processing method. In: 2013 International Conference on Advanced Technologies for Communications (ATC), pp. 106–110. IEEE (2013) Nguyen-Ti, T., Nguyen-Phuc, T., Do-Hong, T.: Fire detection based on video processing method. In: 2013 International Conference on Advanced Technologies for Communications (ATC), pp. 106–110. IEEE (2013)
35.
Zurück zum Zitat Park, J., Ko, B., Nam, J.Y., Kwak, S.: Wildfire smoke detection using spatiotemporal bag-of-features of smoke. In: 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 200–205. IEEE (2013) Park, J., Ko, B., Nam, J.Y., Kwak, S.: Wildfire smoke detection using spatiotemporal bag-of-features of smoke. In: 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 200–205. IEEE (2013)
36.
Zurück zum Zitat Plumb, O., Richards, R.: Development of an economical video based fire detection and location system. US Department of Commerce, Technology Administration (1996) Plumb, O., Richards, R.: Development of an economical video based fire detection and location system. US Department of Commerce, Technology Administration (1996)
37.
Zurück zum Zitat Rudz, S., Chetehouna, K., Hafiane, A., Laurent, H., et al.: Investigation of a novel image segmentation method dedicated to forest fire applications. Meas. Sci. Technol. 24(7), 075403 (2013)CrossRef Rudz, S., Chetehouna, K., Hafiane, A., Laurent, H., et al.: Investigation of a novel image segmentation method dedicated to forest fire applications. Meas. Sci. Technol. 24(7), 075403 (2013)CrossRef
38.
Zurück zum Zitat Shidik, G.F., Adnan, F.N., Supriyanto, C., Pramunendar, R.A., Andono, P.N.: Multi color feature, background subtraction and time frame selection for fire detection. In: Robotics, Biomimetics, and Intelligent Computational Systems (ROBIONETICS), 2013 IEEE International Conference on, pp. 115–120 (2013). doi:10.1109/ROBIONETICS.2013.6743589 Shidik, G.F., Adnan, F.N., Supriyanto, C., Pramunendar, R.A., Andono, P.N.: Multi color feature, background subtraction and time frame selection for fire detection. In: Robotics, Biomimetics, and Intelligent Computational Systems (ROBIONETICS), 2013 IEEE International Conference on, pp. 115–120 (2013). doi:10.​1109/​ROBIONETICS.​2013.​6743589
39.
Zurück zum Zitat Steffens, C.R., Rodrigues, R.N., da Costa Botelho, S.S.: An unconstrained dataset for non-stationary video based fire detection. In: IEEE LARS/SBR 2015. Uberlândia, October 2015 Steffens, C.R., Rodrigues, R.N., da Costa Botelho, S.S.: An unconstrained dataset for non-stationary video based fire detection. In: IEEE LARS/SBR 2015. Uberlândia, October 2015
40.
Zurück zum Zitat Stipaničev, D., Vuko, T., Krstinić, D., Štula, M., Bodrožić, L.: Forest fire protection by advanced video detection system-croatian experiences. In: Third TIEMS Workshop-Improvement of Disaster Management System, pp. 26–27. Citeseer (2006) Stipaničev, D., Vuko, T., Krstinić, D., Štula, M., Bodrožić, L.: Forest fire protection by advanced video detection system-croatian experiences. In: Third TIEMS Workshop-Improvement of Disaster Management System, pp. 26–27. Citeseer (2006)
41.
Zurück zum Zitat Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 573–580. IEEE (2012) Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 573–580. IEEE (2012)
42.
Zurück zum Zitat Toreyin, B.U., Cetin, A.E.: Wildfire detection using LMS based active learning. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2009, pp. 1461–1464. IEEE (2009) Toreyin, B.U., Cetin, A.E.: Wildfire detection using LMS based active learning. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2009, pp. 1461–1464. IEEE (2009)
43.
Zurück zum Zitat Töreyin, B.U., Dedeoğlu, Y., Güdükbay, U., Cetin, A.E.: Computer vision based method for real-time fire and flame detection. Pattern Recogn. Lett. 27(1), 49–58 (2006)CrossRef Töreyin, B.U., Dedeoğlu, Y., Güdükbay, U., Cetin, A.E.: Computer vision based method for real-time fire and flame detection. Pattern Recogn. Lett. 27(1), 49–58 (2006)CrossRef
44.
Zurück zum Zitat Toreyin, B., Dedeoglu, Y., Cetin, A.: Wavelet based real-time smoke detection in video. In: 13th European Signal Processing Conference, pp. 1–4, September 2005 Toreyin, B., Dedeoglu, Y., Cetin, A.: Wavelet based real-time smoke detection in video. In: 13th European Signal Processing Conference, pp. 1–4, September 2005
45.
Zurück zum Zitat Toreyin, B., Dedeoglu, Y., Cetin, A.: Contour based smoke detection in video using wavelets. In: 14th European Signal Processing Conference, pp. 1–5, September 2006 Toreyin, B., Dedeoglu, Y., Cetin, A.: Contour based smoke detection in video using wavelets. In: 14th European Signal Processing Conference, pp. 1–5, September 2006
46.
Zurück zum Zitat Toulouse, T., Rossi, L., Akhloufi, M., Celik, T., Maldague, X.: Benchmarking of wildland fire colour segmentation algorithms. IET Image Process. 9(12), 1064–1072 (2015)CrossRef Toulouse, T., Rossi, L., Akhloufi, M., Celik, T., Maldague, X.: Benchmarking of wildland fire colour segmentation algorithms. IET Image Process. 9(12), 1064–1072 (2015)CrossRef
47.
Zurück zum Zitat Zhou, X.L., Yu, F.X., Wen, Y.C., Lu, Z.M., Song, G.H.: Early fire detection based on flame contours in video. Inf. Technol. J. 9(5), 899–908 (2010)CrossRef Zhou, X.L., Yu, F.X., Wen, Y.C., Lu, Z.M., Song, G.H.: Early fire detection based on flame contours in video. Inf. Technol. J. 9(5), 899–908 (2010)CrossRef
Metadaten
Titel
Non-stationary VFD Evaluation Kit: Dataset and Metrics to Fuel Video-Based Fire Detection Development
verfasst von
Cristiano Rafael Steffens
Ricardo Nagel Rodrigues
Silvia Silva da Costa Botelho
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47247-8_9

Neuer Inhalt