Skip to main content

2021 | OriginalPaper | Buchkapitel

Infrared Thermography and Computational Intelligence in Analysis of Facial Video-Records

verfasst von : Aleš Procházka, Hana Charvátová, Oldřich Vyšata

Erschienen in: Advances in Computational Collective Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Infrared thermography has a wide range of applications both in engineering and biomedicine. Resulting video-images provide immediate information about thermal conditions on the surface of the observed object but for the more sophisticated analysis the detail evaluation of separate images is necessary. The processing of thermal images is based upon data acquisition by special non-invasive sensors, efficient communication systems, and the application of selected machine learning methods in many cases. The present paper is devoted to the recognition of thermal regions in the facial area, detection of the body temperature, and evaluation of breathing frequency and its possible disorders. Data include video-sequences acquired on the home exercise bike and recorded during different load conditions. The proposed general methodology combines the use of neural networks and machine learning methods for the detection of the changing temperature ranges of the thermal camera. Selected digital signal processing methods are then used to find the mean body temperature and breathing frequency during the specified time period. Results show the temperature changes and breathing frequency between 0.48 and 0.56 Hz for selected experiments and different body loads.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aario, S., Gorad, A., Arvonen, M., Sarkka, S.: Respiratory pattern recognition from low-resolution thermal imaging. In: The European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2020, pp. 469–474. IEEE (2020) Aario, S., Gorad, A., Arvonen, M., Sarkka, S.: Respiratory pattern recognition from low-resolution thermal imaging. In: The European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2020, pp. 469–474. IEEE (2020)
2.
Zurück zum Zitat Alkali, A., Saatchi, R., Elphick, H., Burke, D.: Thermal image processing for real-time noncontact respiration rate monitoring. IET Circuits Devices Syst. 11(2), 142–148 (2017)CrossRef Alkali, A., Saatchi, R., Elphick, H., Burke, D.: Thermal image processing for real-time noncontact respiration rate monitoring. IET Circuits Devices Syst. 11(2), 142–148 (2017)CrossRef
3.
Zurück zum Zitat Basu, A., Routray, A., Mukherjee, R., Shit, S.: Infrared imaging based hyperventilation monitoring through respiration rate estimation. Infrared Phys. Technol. 77, 382–390 (2016)CrossRef Basu, A., Routray, A., Mukherjee, R., Shit, S.: Infrared imaging based hyperventilation monitoring through respiration rate estimation. Infrared Phys. Technol. 77, 382–390 (2016)CrossRef
5.
Zurück zum Zitat Charvátová, H., Procházka, A., Zálešák, M.: computer simulation of temperature distribution during cooling of the thermally insulated room. MDPI: Energies 11, 3205:1–3205:16 (2018) Charvátová, H., Procházka, A., Zálešák, M.: computer simulation of temperature distribution during cooling of the thermally insulated room. MDPI: Energies 11, 3205:1–3205:16 (2018)
6.
Zurück zum Zitat Erden, F., Velipasalar, S., Alkar, A., Cetin, A.: Sensors in assisted living. IEEE Signal Process. Mag. 33(2), 36–44 (2016)CrossRef Erden, F., Velipasalar, S., Alkar, A., Cetin, A.: Sensors in assisted living. IEEE Signal Process. Mag. 33(2), 36–44 (2016)CrossRef
7.
Zurück zum Zitat Garde, A., Karlen, W., Ansermino, J.M., Dumont, G.A.: Estimating respiratory and heart rates from the correntropy spectral density of the photoplethysmogram. PLoS ONE 9(1), e86427:1–e86427:11 (2014) Garde, A., Karlen, W., Ansermino, J.M., Dumont, G.A.: Estimating respiratory and heart rates from the correntropy spectral density of the photoplethysmogram. PLoS ONE 9(1), e86427:1–e86427:11 (2014)
9.
Zurück zum Zitat Hanawa, D., Ohguchi, T., Oguchi, K.: Basic study on non-contact measurement of human oral breathing by using far infra-red imaging. In: N., H. (ed.) 39th International Conference on Telecommunications and Signal Processing, pp. 681–684. IEEE (2016) Hanawa, D., Ohguchi, T., Oguchi, K.: Basic study on non-contact measurement of human oral breathing by using far infra-red imaging. In: N., H. (ed.) 39th International Conference on Telecommunications and Signal Processing, pp. 681–684. IEEE (2016)
10.
Zurück zum Zitat Hošťálková, E., Vyšata, O., Procházka, A.: Multi-dimensional biomedical image de-noising using Haar transform. In: Proceedings of the 15th International Conference on Digital Signal Processing, pp. 175–179. IEEE, Cardiff (2007) Hošťálková, E., Vyšata, O., Procházka, A.: Multi-dimensional biomedical image de-noising using Haar transform. In: Proceedings of the 15th International Conference on Digital Signal Processing, pp. 175–179. IEEE, Cardiff (2007)
11.
Zurück zum Zitat Huang, Z., Wang, W., de Haan, G.: Nose breathing or mouth breathing? A thermography-based new measurement for sleep monitoring. In: CVPR workshop, pp. 1–7. IEEE, Eindhoven University of Technology, NL (2021) Huang, Z., Wang, W., de Haan, G.: Nose breathing or mouth breathing? A thermography-based new measurement for sleep monitoring. In: CVPR workshop, pp. 1–7. IEEE, Eindhoven University of Technology, NL (2021)
12.
Zurück zum Zitat Jagedev, P., Giri, L.: Human respiration monitoring using infrared thermography and artificial intelligence. Biomed. Phys. Eng. Express 6(3), 035007 (2020) Jagedev, P., Giri, L.: Human respiration monitoring using infrared thermography and artificial intelligence. Biomed. Phys. Eng. Express 6(3), 035007 (2020)
13.
Zurück zum Zitat Jerhotová, E., Švihlík, J., Procházka, A.: Biomedical image volumes denoising via the wavelet transform, pp. 435–458. INTECH (2011) Jerhotová, E., Švihlík, J., Procházka, A.: Biomedical image volumes denoising via the wavelet transform, pp. 435–458. INTECH (2011)
14.
Zurück zum Zitat Mishra, C., Gupta, D.L.: Deep machine learning and neural networks: an overview. Int. J. Hybrid Inf. Technol. 9(11), 401–414 (2016) Mishra, C., Gupta, D.L.: Deep machine learning and neural networks: an overview. Int. J. Hybrid Inf. Technol. 9(11), 401–414 (2016)
15.
Zurück zum Zitat Monkaresi, H., Calvo, R.A., Yan, H.: A machine learning approach to improve contactless heart rate monitoring using a webcam. IEEE J. Biomed. Health Inform. 18(4), 1153–1160 (2014)CrossRef Monkaresi, H., Calvo, R.A., Yan, H.: A machine learning approach to improve contactless heart rate monitoring using a webcam. IEEE J. Biomed. Health Inform. 18(4), 1153–1160 (2014)CrossRef
16.
Zurück zum Zitat Mutlu, K., Esquivelzeta Rabell, J., Martindel Olmo, P., Haesler, S.: IR thermography-based monitoring of respiration phase without image segmentation. J. Neurosci. Methods 301, 1–18 (2018)CrossRef Mutlu, K., Esquivelzeta Rabell, J., Martindel Olmo, P., Haesler, S.: IR thermography-based monitoring of respiration phase without image segmentation. J. Neurosci. Methods 301, 1–18 (2018)CrossRef
17.
Zurück zum Zitat Pereira, C., Yu, X., Czaplik, M., Rossaint, R., Blazek, V.: Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 6(11), 4378 (2015)CrossRef Pereira, C., Yu, X., Czaplik, M., Rossaint, R., Blazek, V.: Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 6(11), 4378 (2015)CrossRef
18.
Zurück zum Zitat Procházka, A., Charvátová, H., Vaseghi, S., Vyšata, O.: Machine learning in rehabilitation assesment for thermal and heart rate data processing. IEEE Trans. Neural Syst. Rehabil. Eng. 26(6), 1209–12141 (2018)CrossRef Procházka, A., Charvátová, H., Vaseghi, S., Vyšata, O.: Machine learning in rehabilitation assesment for thermal and heart rate data processing. IEEE Trans. Neural Syst. Rehabil. Eng. 26(6), 1209–12141 (2018)CrossRef
19.
Zurück zum Zitat Procházka, A., Charvátová, H., Vyšata, O., Jarchi, D., Sanei, S.: Discrimination of cycling patterns using accelerometric data and deep learning techniques. Neural Computing and Applications (2020) Procházka, A., Charvátová, H., Vyšata, O., Jarchi, D., Sanei, S.: Discrimination of cycling patterns using accelerometric data and deep learning techniques. Neural Computing and Applications (2020)
20.
Zurück zum Zitat Procházka, A., Charvátová, H., Vyšata, O., Kopal, J., Chambers, J.: Breathing analysis using thermal and depth imaging camera video records. MDPI: Sensors) 17, 1408:1–1408:10 (2017) Procházka, A., Charvátová, H., Vyšata, O., Kopal, J., Chambers, J.: Breathing analysis using thermal and depth imaging camera video records. MDPI: Sensors) 17, 1408:1–1408:10 (2017)
21.
Zurück zum Zitat Procházka, A., Dostál, O., Cejnar, P., Mohamed, H., Pavelek, Z., Vališ, M., Vyšata, O.: Deep learning for accelerometric data assessment and ataxic gait monitoring. IEEE Trans. Neural Syst. Rehabilit. Eng. 29, 33434133:1–33434133:8 (2021) Procházka, A., Dostál, O., Cejnar, P., Mohamed, H., Pavelek, Z., Vališ, M., Vyšata, O.: Deep learning for accelerometric data assessment and ataxic gait monitoring. IEEE Trans. Neural Syst. Rehabilit. Eng. 29, 33434133:1–33434133:8 (2021)
22.
Zurück zum Zitat Procházka, A., Kuchyňka, J., Vyšata, O., Cejnar, P., Vališ, M., Mařík, V.: Multi-class sleep stage analysis and adaptive pattern recognition. MDPI: Appl. Sci. 8(5), 697:1–697:14 (2018) Procházka, A., Kuchyňka, J., Vyšata, O., Cejnar, P., Vališ, M., Mařík, V.: Multi-class sleep stage analysis and adaptive pattern recognition. MDPI: Appl. Sci. 8(5), 697:1–697:14 (2018)
24.
Zurück zum Zitat Procházka, A., Schatz, M., Tupa, O.: The MS kinect image and depth sensors use for gait features detection. In: The IEEE International Conference on Image Processing, ICIP 2017, pp. 2271–2274. IEEE (2014) Procházka, A., Schatz, M., Tupa, O.: The MS kinect image and depth sensors use for gait features detection. In: The IEEE International Conference on Image Processing, ICIP 2017, pp. 2271–2274. IEEE (2014)
25.
Zurück zum Zitat Procházka, A., Vaseghi, S., Charvátová, H., Tupa, O., Vyšata, O.: Cycling segments multimodal analysis and classification using neural networks. MDPI: Appl. Sci. 7, 581:1–581:11 (2017) Procházka, A., Vaseghi, S., Charvátová, H., Tupa, O., Vyšata, O.: Cycling segments multimodal analysis and classification using neural networks. MDPI: Appl. Sci. 7, 581:1–581:11 (2017)
Metadaten
Titel
Infrared Thermography and Computational Intelligence in Analysis of Facial Video-Records
verfasst von
Aleš Procházka
Hana Charvátová
Oldřich Vyšata
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-88113-9_51