Skip to main content

2021 | OriginalPaper | Buchkapitel

Biometric Recognition of PPG Cardiac Signals Using Transformed Spectrogram Images

verfasst von : Ruggero Donida Labati, Vincenzo Piuri, Francesco Rundo, Fabio Scotti, Concetto Spampinato

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, the number of mobile, wearable, and embedded devices integrating sensors for acquiring cardiac signals is constantly increasing. In particular, plethysmographic (PPG) sensors are widely diffused thanks to their small form factor and limited cost. For example, PPG sensors are used for monitoring cardiac activities in automotive applications and in wearable devices as smartwatches, activity trackers, and wristbands. Recent studies focused on using PPG signals to secure mobile devices by performing biometric recognitions. Although their results are promising, all of these methods process PPG acquisitions as one-dimensional signals. In the literature, feature extraction techniques based on transformations of the spectrogram have been successfully used to increase the accuracy of signal processing techniques designed for other application scenarios. This paper presents a preliminary study on a biometric recognition approach that extracts features from different transformations of the spectrogram of PPG signals and classifies the obtained feature representations using machine learning techniques. To the best of our knowledge, this is the first study in the literature on biometric systems that extracts features from the spectrogram of PPG signals. Furthermore, with respect to most of the state-of-the-art biometric recognition techniques, the proposed approach presents the advantage of not requiring the search of fiducial points, thus reducing the computational complexity and increasing the robustness of the signal preprocessing step. We performed tests using a dataset of samples collected from 42 individuals, obtaining an average classification accuracy of \(99.16\%\) for identity verification (FMR of 0.56% at FNMR of 13.50%), and a rank-1 identification error of \(7.24\%\) for identification. The results obtained for the considered dataset are better or comparable with respect to the ones of the best-performing methods in the literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Biswas, D., et al.: CorNET: deep learning framework for PPG-based heart rate estimation and biometric identification in ambulant environment. IEEE Trans. Biomed. Circuits Syst. 13(2), 282–291 (2019)CrossRef Biswas, D., et al.: CorNET: deep learning framework for PPG-based heart rate estimation and biometric identification in ambulant environment. IEEE Trans. Biomed. Circuits Syst. 13(2), 282–291 (2019)CrossRef
2.
Zurück zum Zitat Bonissi, A., Donida Labati, R., Perico, L., Sassi, R., Scotti, F., Sparagino, L.: A preliminary study on continuous authentication methods for photoplethysmographic biometrics. In: Proceedings of the 2013 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BioMS), pp. 28–33 (2013) Bonissi, A., Donida Labati, R., Perico, L., Sassi, R., Scotti, F., Sparagino, L.: A preliminary study on continuous authentication methods for photoplethysmographic biometrics. In: Proceedings of the 2013 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BioMS), pp. 28–33 (2013)
3.
Zurück zum Zitat Byeon, Y., Pan, S., Kwak, K.: Ensemble deep learning models for ECG-based biometrics. In: Proceedings of the 2020 Cybernetics Informatics (K I), pp. 1–5 (2020) Byeon, Y., Pan, S., Kwak, K.: Ensemble deep learning models for ECG-based biometrics. In: Proceedings of the 2020 Cybernetics Informatics (K I), pp. 1–5 (2020)
4.
Zurück zum Zitat Byeon, Y.H., Kwak, K.C.: Pre-configured deep convolutional neural networks with various time-frequency representations for biometrics from ECG signals (2019) Byeon, Y.H., Kwak, K.C.: Pre-configured deep convolutional neural networks with various time-frequency representations for biometrics from ECG signals (2019)
5.
Zurück zum Zitat Chakraborty, S., Pal, S.: Photoplethysmogram signal based biometric recognition using linear discriminant classifier. In: Proceedings of the 2016 2nd International Conference on Control, Instrumentation, Energy Communication (CIEC) pp. 183–187 (2016) Chakraborty, S., Pal, S.: Photoplethysmogram signal based biometric recognition using linear discriminant classifier. In: Proceedings of the 2016 2nd International Conference on Control, Instrumentation, Energy Communication (CIEC) pp. 183–187 (2016)
6.
Zurück zum Zitat Chauhan, U., Reithinger, N., Mackey, J.R.: Real-time stress assessment through PPG sensor for VR biofeedback. In: Proceedings of the 20th International Conference on Multimodal Interaction: Adjunct (2018) Chauhan, U., Reithinger, N., Mackey, J.R.: Real-time stress assessment through PPG sensor for VR biofeedback. In: Proceedings of the 20th International Conference on Multimodal Interaction: Adjunct (2018)
8.
Zurück zum Zitat Donida Labati, R., Muñoz, E., Piuri, V., Sassi, R., Scotti, F.: Deep-ECG: convolutional neural networks for ECG biometric recognition. Pattern Recogn. Lett. 126, 78–85 (2019)CrossRef Donida Labati, R., Muñoz, E., Piuri, V., Sassi, R., Scotti, F.: Deep-ECG: convolutional neural networks for ECG biometric recognition. Pattern Recogn. Lett. 126, 78–85 (2019)CrossRef
9.
Zurück zum Zitat Everson, L., et al.: BiometricNet: deep learning based biometric identification using wrist-worn PPG. In: Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–5 (2018) Everson, L., et al.: BiometricNet: deep learning based biometric identification using wrist-worn PPG. In: Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–5 (2018)
10.
Zurück zum Zitat Faragó, P., Groza, R., Ivanciu, L., Hintea, S.: A correlation-based biometric identification technique for ECG, PPG and EMG. In: Proceedings of the 2019 42nd International Conference on Telecommunications and Signal Processing (TSP), pp. 716–719 (2019) Faragó, P., Groza, R., Ivanciu, L., Hintea, S.: A correlation-based biometric identification technique for ECG, PPG and EMG. In: Proceedings of the 2019 42nd International Conference on Telecommunications and Signal Processing (TSP), pp. 716–719 (2019)
11.
12.
Zurück zum Zitat He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef
13.
Zurück zum Zitat Hwang, D.Y., Taha, B., Lee, D.S., Hatzinakos, D.: Evaluation of the time stability and uniqueness in PPG-based biometric system. IEEE Trans. Inf. Forensics Secur. 16, 116–130 (2021)CrossRef Hwang, D.Y., Taha, B., Lee, D.S., Hatzinakos, D.: Evaluation of the time stability and uniqueness in PPG-based biometric system. IEEE Trans. Inf. Forensics Secur. 16, 116–130 (2021)CrossRef
14.
Zurück zum Zitat Jaafar, N.A.L., Sidek, K.A., Mohd Azam, S.N.A.: Acceleration plethysmogram based biometric identification. In: Proceedings of the 2015 International Conference on BioSignal Analysis, Processing and Systems (ICBAPS), pp. 16–21 (2015) Jaafar, N.A.L., Sidek, K.A., Mohd Azam, S.N.A.: Acceleration plethysmogram based biometric identification. In: Proceedings of the 2015 International Conference on BioSignal Analysis, Processing and Systems (ICBAPS), pp. 16–21 (2015)
15.
Zurück zum Zitat Jain, A.K., Flynn, P., Ross, A.A.: Handbook of Biometrics, 1st edn. Springer Publishing Company, Incorporated (2010) Jain, A.K., Flynn, P., Ross, A.A.: Handbook of Biometrics, 1st edn. Springer Publishing Company, Incorporated (2010)
16.
Zurück zum Zitat Jang, J., Kim, H.: Performance Measures, pp. 1062–1068. Springer, US, Boston, MA (2009) Jang, J., Kim, H.: Performance Measures, pp. 1062–1068. Springer, US, Boston, MA (2009)
17.
Zurück zum Zitat Jindal, V., Birjandtalab, J., Pouyan, M.B., Nourani, M.: An adaptive deep learning approach for PPG-based identification. In: Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6401–6404 (2016) Jindal, V., Birjandtalab, J., Pouyan, M.B., Nourani, M.: An adaptive deep learning approach for PPG-based identification. In: Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6401–6404 (2016)
18.
Zurück zum Zitat Karimian, N., Guo, Z., Tehranipoor, M., Forte, D.: Human recognition from photoplethys mography (PPG) based on non-fiducial features. In: Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4636–4640 (2017) Karimian, N., Guo, Z., Tehranipoor, M., Forte, D.: Human recognition from photoplethys mography (PPG) based on non-fiducial features. In: Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4636–4640 (2017)
19.
Zurück zum Zitat Karimian, N., Tehranipoor, M., Forte, D.: Non-fiducial PPG-based authentication for healthcare application. In: Proceedings of the 2017 IEEE EMBS International Conference on Biomedical Health Informatics (BHI), pp. 429–432 (2017) Karimian, N., Tehranipoor, M., Forte, D.: Non-fiducial PPG-based authentication for healthcare application. In: Proceedings of the 2017 IEEE EMBS International Conference on Biomedical Health Informatics (BHI), pp. 429–432 (2017)
20.
Zurück zum Zitat Karlen, W., Raman, S., Ansermino, J.M., Dumont, G.A.: Multiparameter respiratory rate estimation from the photoplethysmogram. IEEE Trans. Bio-Med. Eng. 60(7), 1946–53 (2013)CrossRef Karlen, W., Raman, S., Ansermino, J.M., Dumont, G.A.: Multiparameter respiratory rate estimation from the photoplethysmogram. IEEE Trans. Bio-Med. Eng. 60(7), 1946–53 (2013)CrossRef
21.
Zurück zum Zitat Karlen, W., Turner, M., Cooke, E., Dumont, G., Ansermino, J.M.: CapnoBase: signal database and tools to collect, share and annotate respiratory signals. In: Annual Meeting of the Society for Technology in Anesthesia (STA). West Palm Beach (2010) Karlen, W., Turner, M., Cooke, E., Dumont, G., Ansermino, J.M.: CapnoBase: signal database and tools to collect, share and annotate respiratory signals. In: Annual Meeting of the Society for Technology in Anesthesia (STA). West Palm Beach (2010)
22.
Zurück zum Zitat Khan, M.U., Aziz, S., Hassan Naqvi, S.Z., Zaib, A., Maqsood, A.: Pattern analysis towards human verification using photoplethysmograph signals. In: Proceedings of the 2020 International Conference on Emerging Trends in Smart Technologies (ICETST), pp. 1–6 (2020) Khan, M.U., Aziz, S., Hassan Naqvi, S.Z., Zaib, A., Maqsood, A.: Pattern analysis towards human verification using photoplethysmograph signals. In: Proceedings of the 2020 International Conference on Emerging Trends in Smart Technologies (ICETST), pp. 1–6 (2020)
23.
Zurück zum Zitat Lee, A., Kim, Y.: Photoplethysmography as a form of biometric authentication. In: Proceedings of the 2015 IEEE SENSORS, pp. 1–2 (2015) Lee, A., Kim, Y.: Photoplethysmography as a form of biometric authentication. In: Proceedings of the 2015 IEEE SENSORS, pp. 1–2 (2015)
24.
Zurück zum Zitat Lee, E., Ho, A., Wang, Y., Huang, C., Lee, C.: Cross-domain adaptation for biometric identification using photoplethysmogram. In: Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1289–1293 (2020) Lee, E., Ho, A., Wang, Y., Huang, C., Lee, C.: Cross-domain adaptation for biometric identification using photoplethysmogram. In: Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1289–1293 (2020)
25.
Zurück zum Zitat Lovisotto, G., Turner, H., Eberz, S., Martinovic, I.: Seeing red: PPG biometrics using smartphone cameras. In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 3565–3574 (2020) Lovisotto, G., Turner, H., Eberz, S., Martinovic, I.: Seeing red: PPG biometrics using smartphone cameras. In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 3565–3574 (2020)
26.
Zurück zum Zitat Luque, J., Cortès, G., Segura, C., Maravilla, A., Esteban, J., Fabregat, J.: END-to-END Photopleth YsmographY (PPG) based biometric authentication by using Convolutional Neural Networks. In: Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), pp. 538–542 (2018) Luque, J., Cortès, G., Segura, C., Maravilla, A., Esteban, J., Fabregat, J.: END-to-END Photopleth YsmographY (PPG) based biometric authentication by using Convolutional Neural Networks. In: Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), pp. 538–542 (2018)
27.
Zurück zum Zitat Maiorana, E., Campisi, P., Gonzalez-Carballo, N., Neri, A.: Keystroke dynamics authentication for mobile phones. In: Proceedings of the 2011 ACM Symposium on Applied Computing, pp. 21–26 (2011) Maiorana, E., Campisi, P., Gonzalez-Carballo, N., Neri, A.: Keystroke dynamics authentication for mobile phones. In: Proceedings of the 2011 ACM Symposium on Applied Computing, pp. 21–26 (2011)
28.
Zurück zum Zitat Merone, M., Soda, P., Sansone, M., Sansone, C.: ECG databases for biometric systems: a systematic review. Expert Syst. Appl. 67, 189–202 (2017)CrossRef Merone, M., Soda, P., Sansone, M., Sansone, C.: ECG databases for biometric systems: a systematic review. Expert Syst. Appl. 67, 189–202 (2017)CrossRef
29.
Zurück zum Zitat Namini, S.P.M., Rashidi, S.: Implementation of artificial features in improvement of biometrics based PPG. In: Proceedings of the 2016 6th International Conference on Computer and Knowledge Engineering (ICCKE), pp. 342–346 (2016) Namini, S.P.M., Rashidi, S.: Implementation of artificial features in improvement of biometrics based PPG. In: Proceedings of the 2016 6th International Conference on Computer and Knowledge Engineering (ICCKE), pp. 342–346 (2016)
30.
Zurück zum Zitat Rundo, F., Conoci, S., Ortis, A., Battiato, S.: An advanced bio-inspired photoplethysmography (PPG) and ECG pattern recognition system for medical assessment. Sensors 18(2), (2018) Rundo, F., Conoci, S., Ortis, A., Battiato, S.: An advanced bio-inspired photoplethysmography (PPG) and ECG pattern recognition system for medical assessment. Sensors 18(2), (2018)
32.
Zurück zum Zitat Sancho, J., Iglesias, Á.A., García, J.: Biometric authentication using the PPG: a long-term feasibility study. Sensors 18(5), 1525 (2018) Sancho, J., Iglesias, Á.A., García, J.: Biometric authentication using the PPG: a long-term feasibility study. Sensors 18(5), 1525 (2018)
33.
Zurück zum Zitat Spooren, J., Preuveneers, D., Joosen, W.: PPG2Live: using dual PPG for active authentication and liveness detection. In: Proceedings of the 2019 International Conference on Biometrics (ICB), pp. 1–6 (2019) Spooren, J., Preuveneers, D., Joosen, W.: PPG2Live: using dual PPG for active authentication and liveness detection. In: Proceedings of the 2019 International Conference on Biometrics (ICB), pp. 1–6 (2019)
34.
Zurück zum Zitat Tan, L., Jiang, J.: Digital Signal Processing: Fundamentals and Applications. Elsevier Science (2018) Tan, L., Jiang, J.: Digital Signal Processing: Fundamentals and Applications. Elsevier Science (2018)
35.
Zurück zum Zitat Walia, A., Kaul, A.: Human recognition via PPG signal using temporal correlation. In: Proceedings of the 2019 5th International Conference on Signal Processing, Computing and Control (ISPCC), pp. 144–147 (2019) Walia, A., Kaul, A.: Human recognition via PPG signal using temporal correlation. In: Proceedings of the 2019 5th International Conference on Signal Processing, Computing and Control (ISPCC), pp. 144–147 (2019)
36.
Zurück zum Zitat Yadav, U., Abbas, S.N., Hatzinakos, D.: Evaluation of PPG biometrics for authentication in different states. In: Proceedings of the 2018 International Conference on Biometrics (ICB), pp. 277–282 (2018) Yadav, U., Abbas, S.N., Hatzinakos, D.: Evaluation of PPG biometrics for authentication in different states. In: Proceedings of the 2018 International Conference on Biometrics (ICB), pp. 277–282 (2018)
37.
Zurück zum Zitat Zhao, T., Wang, Y., Liu, J., Chen, Y., Cheng, J., Yu, J.: TrueHeart: continuous authentication on wrist-worn wearables using PPG-based biometrics. In: Proceedings of the IEEE Conference on Computer Communications (INFOCOM), pp. 30–39 (2020) Zhao, T., Wang, Y., Liu, J., Chen, Y., Cheng, J., Yu, J.: TrueHeart: continuous authentication on wrist-worn wearables using PPG-based biometrics. In: Proceedings of the IEEE Conference on Computer Communications (INFOCOM), pp. 30–39 (2020)
Metadaten
Titel
Biometric Recognition of PPG Cardiac Signals Using Transformed Spectrogram Images
verfasst von
Ruggero Donida Labati
Vincenzo Piuri
Francesco Rundo
Fabio Scotti
Concetto Spampinato
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68793-9_17