Skip to main content
Erschienen in: Neural Processing Letters 3/2020

07.09.2020

Robust Biometrics from Motion Wearable Sensors Using a D-vector Approach

verfasst von: Manuel Gil-Martín, Rubén San-Segundo, Ricardo de Córdoba, José Manuel Pardo

Erschienen in: Neural Processing Letters | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a d-vector approach for extracting robust biometrics from inertial signals recorded with wearable sensors. The d-vector approach generates identity representations using a deep learning architecture composed of Convolutional Neural Networks. This architecture includes two convolutional layers for learning features from the inertial signal spectrum. These layers were pretrained using data from 154 subjects. After that, additional fully connected layers were attached to perform user identification and verification, considering 36 new subjects. This paper compares the proposed d-vector approach with previous proposed algorithms using in-the-wild recordings in different scenarios. The results demonstrated the robustness of the proposed d-vector approach for in-the-wild conditions: 97.69% and 94.16% accuracies (for user identification) and 99.89% and 99.67% Areas Under the Curve (for user verification) were obtained using one (walking) or several activities (walking, jogging and stairs) respectively. These results were also verified in laboratory conditions improving the performance reported in previous works. All the analyses were carried out using public datasets recorded at the Wireless Sensor Data Mining laboratory.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Angulo J, Wästlund E (2012) Exploring touch-screen biometrics for user identification on smart phones. Springer, Berlin, pp 130–143 Angulo J, Wästlund E (2012) Exploring touch-screen biometrics for user identification on smart phones. Springer, Berlin, pp 130–143
2.
Zurück zum Zitat Matsumoto T, Matsumoto H, Yamada K, Hoshino S (2002) Impact of artificial “Gummy” fingers on fingerprint systems. In: 4th Conference on optical security and counterfeit deterrence techniques, San Jose, CA, vol 4677, pp 275–289 Matsumoto T, Matsumoto H, Yamada K, Hoshino S (2002) Impact of artificial “Gummy” fingers on fingerprint systems. In: 4th Conference on optical security and counterfeit deterrence techniques, San Jose, CA, vol 4677, pp 275–289
3.
Zurück zum Zitat San-Segundo R, Echeverry-Correa JD, Salamea-Palacios C, Lutfi SL, Pardo JM (2017) I-vector analysis for Gait-based Person Identification using smartphone inertial signals. Pervasive Mob Comput 38:140–153CrossRef San-Segundo R, Echeverry-Correa JD, Salamea-Palacios C, Lutfi SL, Pardo JM (2017) I-vector analysis for Gait-based Person Identification using smartphone inertial signals. Pervasive Mob Comput 38:140–153CrossRef
4.
Zurück zum Zitat Variani E, Lei X, McDermott E, Moreno IL, Gonzalez-Dominguez J (2014) IEEE, Deep neural networks for small footprint text-dependent speaker verification. In: IEEE international conference on acoustics, speech and signal processing (ICASSP), Florence, Italy Variani E, Lei X, McDermott E, Moreno IL, Gonzalez-Dominguez J (2014) IEEE, Deep neural networks for small footprint text-dependent speaker verification. In: IEEE international conference on acoustics, speech and signal processing (ICASSP), Florence, Italy
5.
Zurück zum Zitat Lockhart JW, Weiss GM, Xue JC, Gallagher ST, Grosner AB, Pulickal TT (2011) Design considerations for the WISDM smart phone-based sensor mining architecture. In: Presented at the proceedings of the fifth international workshop on knowledge discovery from sensor data, San Diego, CA. https://doi.org/10.1145/2003653.2003656 Lockhart JW, Weiss GM, Xue JC, Gallagher ST, Grosner AB, Pulickal TT (2011) Design considerations for the WISDM smart phone-based sensor mining architecture. In: Presented at the proceedings of the fifth international workshop on knowledge discovery from sensor data, San Diego, CA. https://​doi.​org/​10.​1145/​2003653.​2003656
6.
Zurück zum Zitat Weiss GM, Lockhart JW, Pulickal TT, McHugh PT, Ronan IH, Timko JL (2016) Actitracker: a smartphone-based activity recognition system for improving health and well-being. In: 2016 IEEE international conference on data science and advanced analytics (DSAA), pp 682–688 Weiss GM, Lockhart JW, Pulickal TT, McHugh PT, Ronan IH, Timko JL (2016) Actitracker: a smartphone-based activity recognition system for improving health and well-being. In: 2016 IEEE international conference on data science and advanced analytics (DSAA), pp 682–688
7.
Zurück zum Zitat Weiss GM, Yoneda K, Hayajneh T (2019) Smartphone and smartwatch-based biometrics using activities of daily living. IEEE Access 7:133190–133202CrossRef Weiss GM, Yoneda K, Hayajneh T (2019) Smartphone and smartwatch-based biometrics using activities of daily living. IEEE Access 7:133190–133202CrossRef
8.
Zurück zum Zitat Li Z, Zuo W, Li S (2020) Zeroing dynamics method for motion control of industrial upper-limb exoskeleton system with minimal potential energy modulation. Measurement 163:107964CrossRef Li Z, Zuo W, Li S (2020) Zeroing dynamics method for motion control of industrial upper-limb exoskeleton system with minimal potential energy modulation. Measurement 163:107964CrossRef
9.
Zurück zum Zitat Li Z, Li C, Li S, Cao X (2019) A fault-tolerant method for motion planning of industrial redundant manipulator. In: IEEE transactions on industrial informatics, p 1 Li Z, Li C, Li S, Cao X (2019) A fault-tolerant method for motion planning of industrial redundant manipulator. In: IEEE transactions on industrial informatics, p 1
10.
Zurück zum Zitat Chen D, Li S, Wu Q (2020) A novel supertwisting zeroing neural network with application to mobile robot manipulators. In: IEEE transactions on neural networks and learning systems, 2020-May-11 2020 Chen D, Li S, Wu Q (2020) A novel supertwisting zeroing neural network with application to mobile robot manipulators. In: IEEE transactions on neural networks and learning systems, 2020-May-11 2020
11.
Zurück zum Zitat San-Segundo R, Cordoba R, Ferreiros J, D’Haro-Enriquez LF (2016) Frequency features and GMM-UBM approach for gait-based person identification using smartphone inertial signals’. Pattern Recognit Lett 73:60–67CrossRef San-Segundo R, Cordoba R, Ferreiros J, D’Haro-Enriquez LF (2016) Frequency features and GMM-UBM approach for gait-based person identification using smartphone inertial signals’. Pattern Recognit Lett 73:60–67CrossRef
12.
Zurück zum Zitat Sun FM, Zang WL, Gravina R, Fortino G, Li Y (2020) Gait-based identification for elderly users in wearable healthcare systems. Information Fusion 53:134–144CrossRef Sun FM, Zang WL, Gravina R, Fortino G, Li Y (2020) Gait-based identification for elderly users in wearable healthcare systems. Information Fusion 53:134–144CrossRef
13.
Zurück zum Zitat Pasero E, Balzanelli E, Caffarelli F (2015) Intruder recognition using ECG signal. In: 2015 International joint conference on neural networks (IJCNN), pp 1–8 Pasero E, Balzanelli E, Caffarelli F (2015) Intruder recognition using ECG signal. In: 2015 International joint conference on neural networks (IJCNN), pp 1–8
14.
Zurück zum Zitat Plataniotis KN, Hatzinakos D, Lee JKM, IEEE (2006) ECG biometric recognition without fiducial detection. In: 2006 Biometrics symposium: special session on research at the biometric consortium conference, p 90 Plataniotis KN, Hatzinakos D, Lee JKM, IEEE (2006) ECG biometric recognition without fiducial detection. In: 2006 Biometrics symposium: special session on research at the biometric consortium conference, p 90
15.
Zurück zum Zitat Wang M, El-Fiqi H, Hu J, Abbass HA (2019) Convolutional Neural networks using dynamic functional connectivity for EEG-based person identification in diverse human states. IEEE Trans Inf Forensics Secur 14(12):3259–3272CrossRef Wang M, El-Fiqi H, Hu J, Abbass HA (2019) Convolutional Neural networks using dynamic functional connectivity for EEG-based person identification in diverse human states. IEEE Trans Inf Forensics Secur 14(12):3259–3272CrossRef
16.
Zurück zum Zitat Wahid R, Ghali NI, Own HS, Kim TH, Hassanien AE (2012) A Gaussian mixture models approach to human heart signal verification using different feature extraction algorithms. Comput Appl Bio-Technol Multim Ubiquitous City 353:16 Wahid R, Ghali NI, Own HS, Kim TH, Hassanien AE (2012) A Gaussian mixture models approach to human heart signal verification using different feature extraction algorithms. Comput Appl Bio-Technol Multim Ubiquitous City 353:16
17.
Zurück zum Zitat Zhao Z, Shen Q (2011) A human identification system based on Heart sounds and Gaussian Mixture Models. In: 2011 4th international conference on biomedical engineering and informatics (BMEI), vol 2, pp 597–601 Zhao Z, Shen Q (2011) A human identification system based on Heart sounds and Gaussian Mixture Models. In: 2011 4th international conference on biomedical engineering and informatics (BMEI), vol 2, pp 597–601
18.
Zurück zum Zitat Fatemian SZ, Agrafioti F, Hatzinakos D (2010) HeartID: Cardiac biometric recognition. In: 2010 Fourth IEEE international conference on biometrics: theory, applications and systems (BTAS), pp 1–5 Fatemian SZ, Agrafioti F, Hatzinakos D (2010) HeartID: Cardiac biometric recognition. In: 2010 Fourth IEEE international conference on biometrics: theory, applications and systems (BTAS), pp 1–5
19.
Zurück zum Zitat Prabhakar S, Pankanti S, Jain AK (2003) Biometric recognition: security and privacy concerns. IEEE Secur Priv 1(2):33–42CrossRef Prabhakar S, Pankanti S, Jain AK (2003) Biometric recognition: security and privacy concerns. IEEE Secur Priv 1(2):33–42CrossRef
20.
Zurück zum Zitat Jain AK, Ross A, Prabhakar S (2004) An introduction to biometric recognition. IEEE Trans Circuits Syst Video Technol 14(1):4–20CrossRef Jain AK, Ross A, Prabhakar S (2004) An introduction to biometric recognition. IEEE Trans Circuits Syst Video Technol 14(1):4–20CrossRef
21.
Zurück zum Zitat Roman VY, Venu G (2010) Taxonomy of behavioural biometrics. Behavioral biometrics for human identification: intelligent applications. IGI Global, Hershey, pp 1–43 Roman VY, Venu G (2010) Taxonomy of behavioural biometrics. Behavioral biometrics for human identification: intelligent applications. IGI Global, Hershey, pp 1–43
22.
Zurück zum Zitat Maghsoudi J, Tappert CC (2016) A behavioral biometrics user authentication study using motion data from android smartphones. In: Conference on European intelligence and security informatics conference (EISIC), Uppsala, Sweden, pp 184–187 Maghsoudi J, Tappert CC (2016) A behavioral biometrics user authentication study using motion data from android smartphones. In: Conference on European intelligence and security informatics conference (EISIC), Uppsala, Sweden, pp 184–187
23.
Zurück zum Zitat Dehzangi O, Taherisadr M, ChangalVala R (2017) IMU-based gait recognition using convolutional neural networks and multi-sensor fusion. Sensors 17(12): Art. no. 2735 Dehzangi O, Taherisadr M, ChangalVala R (2017) IMU-based gait recognition using convolutional neural networks and multi-sensor fusion. Sensors 17(12): Art. no. 2735
24.
Zurück zum Zitat Zhao Y, Zhou S (2017) Wearable device-based gait recognition using angle embedded gait dynamic images and a convolutional neural network. Sensors 17(3): Art. no. 478 Zhao Y, Zhou S (2017) Wearable device-based gait recognition using angle embedded gait dynamic images and a convolutional neural network. Sensors 17(3): Art. no. 478
25.
Zurück zum Zitat Giorgi G, Martinelli F, Saracino A, Sheikhalishahi M (2017) Try walking in my shoes, if you can: accurate gait recognition through deep learning. Springer, Cham, pp 384–395 Giorgi G, Martinelli F, Saracino A, Sheikhalishahi M (2017) Try walking in my shoes, if you can: accurate gait recognition through deep learning. Springer, Cham, pp 384–395
26.
Zurück zum Zitat Gadaleta M, Rossi M (2018) IDNet: smartphone-based gait recognition with convolutional neural networks. Pattern Recognit 74:25–37CrossRef Gadaleta M, Rossi M (2018) IDNet: smartphone-based gait recognition with convolutional neural networks. Pattern Recognit 74:25–37CrossRef
27.
Zurück zum Zitat Jung J, Heo H, Yang I, Yoon S, Shim H, Yu H (2017) D-vector based speaker verification system using Raw Waveform CNN. In: Proceedings of the 2017 international seminar on artificial intelligence, networking and information technology (Anit 2017), vol 150, pp 126–131 Jung J, Heo H, Yang I, Yoon S, Shim H, Yu H (2017) D-vector based speaker verification system using Raw Waveform CNN. In: Proceedings of the 2017 international seminar on artificial intelligence, networking and information technology (Anit 2017), vol 150, pp 126–131
28.
Zurück zum Zitat Baldwin J, Burnham R, Meyer A, Dora R, Wright R, Aaai (2019) Beyond speech: generalizing d-vectors for biometric verification. In: Thirty-third Aaai conference on artificial intelligence/thirty-first innovative applications of artificial intelligence conference/ninth Aaai symposium on educational advances in artificial intelligence, pp 842–849 Baldwin J, Burnham R, Meyer A, Dora R, Wright R, Aaai (2019) Beyond speech: generalizing d-vectors for biometric verification. In: Thirty-third Aaai conference on artificial intelligence/thirty-first innovative applications of artificial intelligence conference/ninth Aaai symposium on educational advances in artificial intelligence, pp 842–849
29.
Zurück zum Zitat Hermansky H (1990) Perceptual linear predictive (PLP) analysis of speech. J Acoust Soc Am 87(4):1738–1752CrossRef Hermansky H (1990) Perceptual linear predictive (PLP) analysis of speech. J Acoust Soc Am 87(4):1738–1752CrossRef
30.
Zurück zum Zitat San-Segundo R, Manuel Montero J, Barra-Chicote R, Fernandez F, Manuel Pardo J (2016) Feature extraction from smartphone inertial signals for human activity segmentation. Signal Process 120:359–372CrossRef San-Segundo R, Manuel Montero J, Barra-Chicote R, Fernandez F, Manuel Pardo J (2016) Feature extraction from smartphone inertial signals for human activity segmentation. Signal Process 120:359–372CrossRef
31.
Zurück zum Zitat Reynolds DA, Quatieri TF, Dunn RB (2000) Speaker verification using adapted Gaussian mixture models. Digital Signal Process 10(1):19–41CrossRef Reynolds DA, Quatieri TF, Dunn RB (2000) Speaker verification using adapted Gaussian mixture models. Digital Signal Process 10(1):19–41CrossRef
32.
Zurück zum Zitat Kenny P, Ouellet P, Dehak N, Gupta V, Dumouchel P (2008) A study of interspeaker variability in speaker verification. IEEE Trans Audio Speech Lang Process 16(5):980–988CrossRef Kenny P, Ouellet P, Dehak N, Gupta V, Dumouchel P (2008) A study of interspeaker variability in speaker verification. IEEE Trans Audio Speech Lang Process 16(5):980–988CrossRef
33.
Zurück zum Zitat Dehak N, Kenny PJ, Dehak R, Dumouchel P, Ouellet P (2011) Front-end factor analysis for speaker verification. IEEE Trans Audio Speech Lang Process 19(4):788–798CrossRef Dehak N, Kenny PJ, Dehak R, Dumouchel P, Ouellet P (2011) Front-end factor analysis for speaker verification. IEEE Trans Audio Speech Lang Process 19(4):788–798CrossRef
34.
Zurück zum Zitat Weiss NA (2017) Introductory statistics. Pearson Weiss NA (2017) Introductory statistics. Pearson
36.
Zurück zum Zitat Weiss G (2019) WISDM smartphone and smartwatch activity and biometrics dataset data set Weiss G (2019) WISDM smartphone and smartwatch activity and biometrics dataset data set
Metadaten
Titel
Robust Biometrics from Motion Wearable Sensors Using a D-vector Approach
verfasst von
Manuel Gil-Martín
Rubén San-Segundo
Ricardo de Córdoba
José Manuel Pardo
Publikationsdatum
07.09.2020
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10339-z

Weitere Artikel der Ausgabe 3/2020

Neural Processing Letters 3/2020 Zur Ausgabe

Neuer Inhalt