Top

Published in:

2017 | OriginalPaper | Chapter

Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions

Authors : Jacek Ruminski, Alicja Kwasniewska

Published in: Application of Infrared to Biomedical Sciences

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Respiratory rate is very important vital sign that should be measured and documented in many medical situations. The remote measurement of respiration rate can be especially valuable for medical screening purposes (e.g. severe acute respiratory syndrome (SARS), pandemic influenza, etc.). In this chapter we present a review of many different studies focused on the measurements and estimation of respiration rate using thermal imaging methods. Additionally, we present results of our research focused on the evaluation of different respiration rate estimators for the needs of data processing of image sequences recorded by small, mobile thermal cameras. We used small thermal camera modules in the prototypes of smart glasses for the evaluation of different parameters related to respiration activities. The chapter presents the used methodology and results of the respiration rate analysis, detection of apnea events, description of respiration patterns and other parameters that can be analyzed for respiration waveforms derived from the regions of the nostrils or mouth in thermal video sequences.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Active Dynamic Thermography in Medical Diagnostics

next chapter Applications of Infrared Thermography for Noncontact and Noninvasive Mass Screening of Febrile International Travelers at Airport Quarantine Stations

Moses, S.: Tachypnea (increased respiratory rate). Family Practice Notebook (2016). http://www.fpnotebook.com/lung/exam/Tchypn.htm. Accessed 20 Apr 2016

World Health Organization. Geneva, Switzerland: The Management of Acute Respiratory Infections in Children: Practical Guidelines for Outpatient Care (1996)

Smith, I., Mackay, J., Fahrid, N., Krucheck, D.: Respiratory rate measurement: a comparison of methods. Br. J. Healthc. Assistants 05(01), 18–23 (2011)CrossRef

Neuman, M.I., Monuteaux, M.C., Scully, K.J., Bachur, R.G.: Prediction of pneumonia in a pediatric emergency department. Pediatrics 128, 246–253 (2011)CrossRef

Nijman, R.G., Thompson, M., van Veen, M., Perera, R., Moll, H.A., Oostenbrink, R., et al.: Derivation and validation of age and temperature specific reference values and centile charts to predict lower respiratory tract infection in children with fever: prospective observational study. BMJ 2012(345), e4224 (2012)CrossRef

Bonita, R., Beaglehole, R., Kjellstrom, T.: Basic Epidemiology, 2nd edn. WHO, Geneva (2006)

Cretikos, M.A., Bellomo, R., Hillman, K., Chen, J., Finfer, S., Flabouris, A.: Respiratory rate: the neglected vital sign. Med. J. Aust. 188, 657–659 (2008)

Nelson, N.M.: Members of task force on prolonged apnea. Reports of the task force on prolonged apnea of the American Academy of Pediatrics. Pediatrics 61, 651–652 (1978)

Eckert, D.J., Jordan, A.S., Merchia, P., Malhotra, A.: Central sleep apnea. Pathophysiology and treatment. Chest 131(2), 595–607 (2007)CrossRef

10.

Stanifer, J.W.: A peculiar type of dyspnea: Kussmaul, Cheyne-Stokes, and Biot respiration. Historia Med. 3(1), 1–7 (2015)

11.

Braun, S.R.: Respiratory rate and pattern. In: Walker, H.K., Hall, W.D., Hurst, J.W. (eds.) Clinical Methods: The History, Physical, and Laboratory Examinations (Chapter 43), 3rd edn. Butterworths, Boston. Available from: http://www.ncbi.nlm.nih.gov/books/NBK365/

12.

Ruminski, J., Nowakowski, A., Kaczmarek, M., Hryciuk, M.: Model-based parametric images in dynamic thermography. Pol. J. Med. Phys. Eng. 6(3), 159–165 (2000)

13.

Ruminski, J., Kaczmarek, M., Renkielska, A., Nowakowski, A.: Thermal parametric imaging in the evaluation of skin burn depth. IEEE Trans. Biomed. Eng. 54(2), 303–312 (2007)CrossRef

14.

Kaczmarek, M., Nowakowski, A., Suchowirski, M., Siebert, J., Strojek, W.: Active dynamic thermography in cardiosurgery. QIRT J. 4(1), 107–123 (2007)CrossRef

15.

Nowakowski, A., Kaczmarek, M., Stojek, W., Trzeciak, B., Topolewicz, J., Rogowski, J., Siebert, J.: IR-thermal monitoring of cardiosurgery interventions. In: Sloten, V., et al. (eds.) Proceedings of the 4th European Conference of the International Federation for Medical and Biological Engineering; IFMBE, vol. 22, pp. 1329–1333. ISSN 1680-0737; CD-ROM, Springer (2008)

16.

Ng, E.Y.K., Acharya, U.R., Suri, J.S.: Performance Evaluation of Breast Cancer, Screening, Diagnosis and Treatment. American Scientific Publishers, California, USA (2010)

17.

Arora, N., Martins, D., Ruggerio, D., Tousimis, E., Swistel, A.J., Osborne, M.P., Simmons, R.M.: Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancer. Am. J. Surg. 196(4), 523–526 (2008). doi:10.1016/j.amjsurg.2008.06.015 CrossRef

18.

Han, F., Shi, G., Liang, C., Wang, L., Li, K.: A simple and efficient method for breast cancer diagnosis based on infrared thermal imaging. Cell Biochem. Biophys. 71(1), 491–498 (2015). doi:10.1007/s12013-014-0229-5 CrossRef

19.

Ring, E.F.J.: The historical development of temperature measurement in medicine. Infrared Phys. Technol. 49, 297–301 (2007)CrossRef

20.

Ring, F., Jung, A., Żuber, J.: Infrared Imaging. IOP Publishing (2015). doi:10.1088/978-0-7503-1143-4

21.

Fei, J., Zhu, Z., Pavlidis, I.: Imaging breathing rate in the CO₂ absorption band. In: Proceedings of the 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1–4 September 2005

22.

Murthy, R., Pavlidis, I.: Non-contact monitoring of respiratory function using infrared imaging. IEEE Eng. Med. Biol. Mag. 25, 57–68 (2006)CrossRef

23.

Murthy, J.N., van Jaarsveld, J., Fei, J., Pavlidis, I., Harrykissoon, R., Lucke, J.F.: Thermal infrared imaging. A novel method to monitor airflow during polysomnography. Sleep 32, 1521–1527 (2009)

24.

Fei, J., Pavlidis, I.: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans. Biomed. Eng. 57(4), 988–998 (2010)CrossRef

25.

Zhu, Z., Fei, J., Pavlidis, I.: Tracking human breath in infrared imaging. In: Proceedings of IEEE BIBE 2005, pp. 227–231, Minnesota, USA (2005)

26.

Zhou, Y., Tsiamyrtzis, P., Lindner, P., Timofeyev, I., Pavlidis, I.: Spatio-temporal smoothing as a basis for facial tissue tracking in thermal imaging. IEEE Trans. Biomed. Eng. 60(5), 1280–1289 (2013)CrossRef

27.

Abbas, K., Heiman, K., Orlikowsky, T., Leonhardt, S.: Non-contact respiratory monitoring based on real-time IR-thermography. In: Proceedings of WC2009 IFMBE, 25/IV, pp. 1306–1309 (2009)

28.

Pereira, C.B., Yu, X., Czaplik, M., Rossaint, R., Blazek, V., Leonhardt, S.: Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 6(11), 4378–4394 (2015)CrossRef

29.

Pereira, C.B., Yu, X., Blazek, V., Leonhardt, S.: Robust remote monitoring of breathing function by using infrared thermography. In: Proceedings of IEEE Engineering in Medicine and Biology Society (IEEE 2015), pp. 4250–4253 (2015)

30.

Xu, B., Mestha, L.K., Pennington, G.: Monitoring respiration with a thermal imaging system, US20120289850 A1 (2012)

31.

Lewis, G.F., Gatto, R.G., Porges, S.W.: A novel method for extracting respiration rate and relative tidal volume from infrared thermography. Psychophysiology 48(7), 877–887 (2011)CrossRef

32.

AL-Khalidi, F.Q., Saatchi, R., Burke, D., Elphick, H.: Tracking human face features in thermal images for respiration monitoring. In: ACS/IEEE International Conference on Computer Systems and Applications—AICCSA 2010, pp. 1–6, Hammamet (2010)

33.

AL-Khalidi, F.Q., Saatchi, R., Elphick, H., Burke, D.: An evaluation of thermal imaging based respiration rate monitoring in children. Am. J. Eng. Appl. Sci. 4(4), 586–597 (2011)CrossRef

34.

AL-Khalidi, F.Q., Saatchi, R., Burke, D., Elphick, H., Tan, S.: Respiration rate monitoring methods: a review. Pediatr. Pulmonol. 46, 523–529 (2011)CrossRef

35.

AL-Khalidi, F.Q., Elphick, H., Saatchi, R., Burke, D.: Respiratory rate measurement in children using a thermal imaging camera. Int. J. Sci. Eng. Res. 6(4), 1747–1756 (2015)

36.

Koide, T., Yamakawa, S., Hanawa, D., Oguchi, K.: Breathing detection by far infrared (FIR) imaging in a home health care system. In: Proceedings of IEEE ISBB 2009 [USB-Memory], pp. 206–209, Melbourne, Australia (2009)

37.

Hanawa, D., Yaginuma, Y., Enomoto, Y., Koide, T., Terada, S., Oguchi, K.: Automation of non-intrusive nasal breathing detection by using far-infrared imaging. In: Proceedings on u-Healthcare 2010 (2010)

38.

Hanawa, D., Morimoto, T., Terada, S., Sakai, T., Shimazaki, S., Igarashi, K., Oguchi, K.: Nose detection on far infrared image for non-contact measurement of breathing. In: Proceedings on IEEE-EMBS BHI 2012 [USB-Memory], pp. 878–881, Hongkong and Shenzhen, China (2012)

39.

Mostafa, E., Hammoud, R., Ali, A., Farag, A.: Face recognition in low resolution thermal images. Comput. Vis. Image Underst. 117(12), 1689–1694 (2013)

40.

Dawoud, N.N., Samir, B.B., Janier, J.: Fast template matching method based optimized sum of absolute difference algorithm for face localization. Int. J. Comput. Appl. 18(8), 30–34 (2011)

41.

Poorna, B., Priscilla, C.V.: Invariant recognition of face. In: 2010 International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 1–6, Karur (2010)

42.

Kith, V., El-Sharkawy, M., Bergeson-Dana, T., El-Ramly, S., Elnoubi, S.: A feature and appearance based method for eye detection on gray intensity face images. In: International Conference on Computer Engineering and Systems, ICCES 2008, pp. 41–47, Cairo (2008)

43.

Marzec, M., Koprowski, K., Wróbel, Z.: Detection of selected face areas on thermograms with elimination of typical problems. J. Med. Inform. Technol. 16 (2010)

44.

Wang, S., Liu, Z., Shen, P., Ji, Q.: Eye localization from thermal infrared images. Pattern Recognit. 46(10), 2613–2621 (2013)

45.

Chieh-Li, C., Bo-Lin, J.: Infrared thermal facial image sequence registration analysis and verification. Infrared Phys. Technol. 69, 1–6 (2015)

46.

Bhattacharjee, D., Seal, A., Ganguly, S., Nasipuri, M., Kumar Basu, D.: Comparative study of human thermal face recognition based on Haar wavelet transform and local binary pattern. Intell. Neurosci. 6, 1 pp (2012)

47.

Philip, K.E.J., Pack, E., Cambiano, V., Rollmann, H., Weil, S., O’Beirne, J.: The accuracy of respiratory rate assessment by doctors in a London teaching hospital: a cross-sectional study. J. Clin. Monit. Comput. 29(4), 455–460 (2015)CrossRef

48.

Rumiński, J.: Analysis of parameters of respiration patterns extracted from thermal image sequences. Biocybern. Biomed. Eng. 2016, 1–12 (2016)

49.

Ruminski, J.: Estimation of respiration rate using an accelerometer and thermal camera in eGlasses. In: Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, 4 pp, Gdansk (2016)

50.

Ruminski, J.: Evaluation of the respiration rate and pattern using a portable thermal camera. In: Proceedings of the 13th Quantitative Infrared Thermography Conference, pp. 1–6, Gdansk (2016). doi:10.21611/qirt.2016.107

51.

Ruminski, J.: Analysis of the parameters of respiration patterns extracted from thermal image sequences. Biocybern. Biomed. Eng. (2016) doi:10.1016/j.bbe.2016.07.006

52.

Kwasniewska, A., Ruminski, J.: Face detection in image sequences using a portable thermal camera. In: Proceedings of the 13th Quantitative Infrared Thermography Conference, pp. 1–7, Gdansk (2016) doi:10.21611/qirt.2016.071

53.

Kwasniewska, A., Ruminski, J.: Real-time facial feature tracking in poor quality thermal imagery. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore, pp. 504–510, Portsmouth, United Kingdom, (2016). doi:10.1109/HSI.2016.7529681

54.

Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2) (2004)

55.

OpenCV documentation. http://docs.opencv.org/. Accessed 02 May 2016

56.

Wiley Publishing, Inc., Hoboken, New Jersey: Webster’s New World Medical Dictionary, 3rd edn. MedicineNet.Com (2008). Accessed 25 May 2016

57.

Brouillette, R.T., Morrow, A.S., Weese-Mayer, D.E., Hunt, C.E.: Comparison of respiratory inductive plethysmograpy and thoracic impedance for apnea. J. Pediatr. 111(3), 377–383 (1987)CrossRef

58.

Anaxsys Technology Ltd.: RespiR8. http://www.respir8.com/about_respiR8.html (2011). Accessed 23 May 2016

59.

Macknet, M.R., Kimball-Jones, P.L., Applegate, R.L., Martin, R.D., Allard, M.W.: Accuracy and tolerance of a novel bioacoustic respiratory sensor in pediatric patients. Anesthesiology A84 (2007)

60.

Hernandez, J., McDuff, D., Picard, R.W.: Biowatch: estimation of heart and breathing rates from wrist motions. In: 9th Pervasive Health Conference, pp. 167–176, Istanbul (2015)

61.

Standards of Practice Committe of the American Sleep Disorders Association: Practice parameters for the indications for polysomnography and related procedures. Sleep 20, 406–422 (1997)

62.

Przystup, P., Bujnowski, A., Ruminski, J., Wtorek, J.: A multisensor detector of a sleep apnea for using at home. In: The 6th HSI Conference, IEEE Xplore, pp. 513–517 (2013)

63.

Duong, D., Shastri, D., Tsiamyrtzis, P., Pavlidis, I.: Spatiotemporal reconstruction of the breathing function. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2012, pp. 149–156, LNCS 7510, Springer (2012)

64.

Sörnmo, L., Laguna, P.: Bioelectrical Signal Processing in Cardiac and Neurological Applications. Academic Press (2005)

65.

Barlow, J.S.: The Electroencephalogram: Its Patterns and Origins. MIT Press (1993)

66.

Rumiński, J.: Reliability of pulse measurements in videoplethysmography. Metrol. Measur. Syst. 23(3), 359–371 (2016)

67.

Ruminski, J.: The accuracy of pulse rate estimation from the sequence of face images. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore , pp. 518–524, Portsmouth, United Kingdom (2016). doi:10.1109/HSI.2016.7529683

68.

Smiatacz, M., Rumiński, J.: Local texture pattern selection for efficient face recognition and tracking. In: Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015, Advances in Intelligent Systems and Computing, pp. 359–368, Springer International Publishing (2016)

69.

Ruminski, J., Smiatacz, M., Bujnowski, A., Andrushevich, A., Biallas, M., Kistler, R.: Interactions with recognized patients using smart glasses. In: Proceedings of HSI 2015 Conference, IEEE Xplore, pp. 187–194 (2015)

70.

Ruminski, J., Bujnowski, A., Kocejko, T., Andrushevich, A., Biallas, M., Kistler, R.: The data exchange between smart glasses and healthcare information systems using the HL7 FHIR standard. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore, pp. 525–531, Portsmouth, United Kingdom, (2016). doi:10.1109/HSI.2016.7529684

Title: Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions
Authors: Jacek Ruminski
Alicja Kwasniewska
Publisher: Springer Singapore
Book: Application of Infrared to Biomedical Sciences
Print ISBN: 978-981-10-3146-5

Electronic ISBN: 978-981-10-3147-2

Copyright Year: 2017
DOI: https://doi.org/10.1007/978-981-10-3147-2_18