Skip to main content

2016 | OriginalPaper | Buchkapitel

Gesture Recognition Benchmark Based on Mobile Phone

verfasst von : Chunyu Xie, Shangzhen Luan, Hainan Wang, Baochang Zhang

Erschienen in: Biometric Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Mobile phone plays an important role in our daily life. This paper develops a gesture recognition benchmark based on sensors of mobile phone. The built-in micro gyroscope and accelerometer of mobile phone can efficiently measure the accelerations and angular velocities along x-, y- and z-axis, which are used as the input data. We calculate the energy of the input data to reduce the effect of the phone’s posture variations. A large database is collected, which contains more than 1,000 samples of 8 gestures. The Hidden Markov Model (HMM), K-Nearest Neighbor (KNN) and Support Vector Machine (SVM) are tested on the benchmark. The experimental results indicated that the employed methods can effectively recognize the gestures. To promote research on this topic, the source code and database are made available to the public. (mpl.​buaa.​edu.​cn or correspondence author)

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lane, N.D., Miluzzo, E., Lu, H., et al.: A survey of mobile phone sensing. J. IEEE Commun. Mag. 48(9), 140–150 (2010)CrossRef Lane, N.D., Miluzzo, E., Lu, H., et al.: A survey of mobile phone sensing. J. IEEE Commun. Mag. 48(9), 140–150 (2010)CrossRef
2.
Zurück zum Zitat Choi, E.S., Bang, W.C., Cho, S.J., et al.: Beatbox music phone: gesture-based interactive mobile phone using a tri-axis accelerometer. In: 2005 IEEE International Conference on Industrial Technology, pp. 97–102. IEEE Press, Hong Kong (2005) Choi, E.S., Bang, W.C., Cho, S.J., et al.: Beatbox music phone: gesture-based interactive mobile phone using a tri-axis accelerometer. In: 2005 IEEE International Conference on Industrial Technology, pp. 97–102. IEEE Press, Hong Kong (2005)
3.
Zurück zum Zitat Mantyla, V.M, Mantyjarvi, J., Seppanen, T., et al.: Hand gesture recognition of a mobile device user. In: 2000 IEEE International Conference on Multimedia and Expo, pp. 281–284. IEEE Press, New York (2000) Mantyla, V.M, Mantyjarvi, J., Seppanen, T., et al.: Hand gesture recognition of a mobile device user. In: 2000 IEEE International Conference on Multimedia and Expo, pp. 281–284. IEEE Press, New York (2000)
4.
Zurück zum Zitat Liu, J., Zhong, L., Wickramasuriya, J., et al.: uWave: accelerometer-based personalized gesture recognition and its applications. Pervasive Mob. Comput. 5, 657–675 (2009)CrossRef Liu, J., Zhong, L., Wickramasuriya, J., et al.: uWave: accelerometer-based personalized gesture recognition and its applications. Pervasive Mob. Comput. 5, 657–675 (2009)CrossRef
5.
Zurück zum Zitat Yazdi, N., Ayazi, F., Najafi, K.: Micromachined inertial sensors. Proc. IEEE 86, 1640–1659 (1998)CrossRef Yazdi, N., Ayazi, F., Najafi, K.: Micromachined inertial sensors. Proc. IEEE 86, 1640–1659 (1998)CrossRef
6.
Zurück zum Zitat Rekimoto, J.: Gesturewrist and Gesturepad: unobtrusive wearable interaction devices. In: Fifth International Symposium on Wearable Computers, pp. 21–27. IEEE Press, Zurich (2001) Rekimoto, J.: Gesturewrist and Gesturepad: unobtrusive wearable interaction devices. In: Fifth International Symposium on Wearable Computers, pp. 21–27. IEEE Press, Zurich (2001)
7.
Zurück zum Zitat Jang, I.J., Park, W.B.: Signal processing of the accelerometer for gesture awareness on handheld devices. In: The 12th IEEE International Workshop on Robot and Human Interactive Communication, pp. 139–144. IEEE Press, Roman (2003) Jang, I.J., Park, W.B.: Signal processing of the accelerometer for gesture awareness on handheld devices. In: The 12th IEEE International Workshop on Robot and Human Interactive Communication, pp. 139–144. IEEE Press, Roman (2003)
8.
Zurück zum Zitat Ferscha, A., Resmerita, S.: Gestural interaction in the pervasive computing landscape. e & i Elektrotechnik und Informationstechnik. 124, 17–25 (2007)CrossRef Ferscha, A., Resmerita, S.: Gestural interaction in the pervasive computing landscape. e & i Elektrotechnik und Informationstechnik. 124, 17–25 (2007)CrossRef
9.
Zurück zum Zitat Kallio, S., Kela, J., Mantyjarvi, J.: Online gesture recognition system for mobile interaction. In: IEEE International Conference on Man and Cybernetics, pp. 2070–2076. IEEE Press, Washington, D.C (2003) Kallio, S., Kela, J., Mantyjarvi, J.: Online gesture recognition system for mobile interaction. In: IEEE International Conference on Man and Cybernetics, pp. 2070–2076. IEEE Press, Washington, D.C (2003)
10.
Zurück zum Zitat Hofmann, F.G., Heyer, P., Hommel, G.: Velocity profile based recognition of dynamic gestures with discrete hidden markov models. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, pp. 81–95. Springer, Heidelberg (1998)CrossRef Hofmann, F.G., Heyer, P., Hommel, G.: Velocity profile based recognition of dynamic gestures with discrete hidden markov models. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, pp. 81–95. Springer, Heidelberg (1998)CrossRef
11.
Zurück zum Zitat Baek, J., Jang, I.-J., Park, K., Kang, H.-S., Yun, B.-J.: Human computer interaction for the accelerometer-based mobile game. In: Sha, E., Han, S.-K., Xu, C.-Z., Kim, M.-H., Yang, L.T., Xiao, B. (eds.) EUC 2006. LNCS, vol. 4096, pp. 509–518. Springer, Heidelberg (2006)CrossRef Baek, J., Jang, I.-J., Park, K., Kang, H.-S., Yun, B.-J.: Human computer interaction for the accelerometer-based mobile game. In: Sha, E., Han, S.-K., Xu, C.-Z., Kim, M.-H., Yang, L.T., Xiao, B. (eds.) EUC 2006. LNCS, vol. 4096, pp. 509–518. Springer, Heidelberg (2006)CrossRef
12.
Zurück zum Zitat Phillips, P.J, Flynn, P.J, Scruggs, T., et al.: Overview of the face recognition grand challenge. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), pp. 947–954. IEEE Press, San Diego (2005) Phillips, P.J, Flynn, P.J, Scruggs, T., et al.: Overview of the face recognition grand challenge. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), pp. 947–954. IEEE Press, San Diego (2005)
13.
Zurück zum Zitat Phillips, P.J., Moon, H., Rizvi, S.A., et al.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1090–1104 (2000)CrossRef Phillips, P.J., Moon, H., Rizvi, S.A., et al.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1090–1104 (2000)CrossRef
14.
Zurück zum Zitat Chen, C., Jafari, R., Kehtarnavaz, N.: Improving human action recognition using fusion of depth camera and inertial sensors. IEEE Trans. Hum.-Mach. Syst. 45, 51–61 (2015)CrossRef Chen, C., Jafari, R., Kehtarnavaz, N.: Improving human action recognition using fusion of depth camera and inertial sensors. IEEE Trans. Hum.-Mach. Syst. 45, 51–61 (2015)CrossRef
15.
Zurück zum Zitat Chen, C., Jafari, R., Kehtarnavaz, N.: A real-time human action recognition system using depth and inertial sensor fusion. IEEE Sens. J. 16, 773–781 (2016)CrossRef Chen, C., Jafari, R., Kehtarnavaz, N.: A real-time human action recognition system using depth and inertial sensor fusion. IEEE Sens. J. 16, 773–781 (2016)CrossRef
16.
Zurück zum Zitat Liu, K., Chen, C., Jafari, R., et al.: Fusion of inertial and depth sensor data for robust hand gesture recognition. IEEE Sens. J. 14, 1898–1903 (2014)CrossRef Liu, K., Chen, C., Jafari, R., et al.: Fusion of inertial and depth sensor data for robust hand gesture recognition. IEEE Sens. J. 14, 1898–1903 (2014)CrossRef
17.
Zurück zum Zitat Chen, C., Jafari, R., Kehtarnavaz, N.: A survey of depth and inertial sensor fusion for human action recognition. Multimedia Tools Appl. 1–21 (2015) Chen, C., Jafari, R., Kehtarnavaz, N.: A survey of depth and inertial sensor fusion for human action recognition. Multimedia Tools Appl. 1–21 (2015)
18.
Zurück zum Zitat Chen, C., Liu, M., Zhang, B., Han, J., Jiang, J., Liu, H.: 3D action recognition using multi-temporal depth motion maps and fisher vector. In: International Joint Conference on Artificial Intelligence, pp. 3331–3337 (2016) Chen, C., Liu, M., Zhang, B., Han, J., Jiang, J., Liu, H.: 3D action recognition using multi-temporal depth motion maps and fisher vector. In: International Joint Conference on Artificial Intelligence, pp. 3331–3337 (2016)
19.
Zurück zum Zitat Zhang, B., Perina, A., Li, Z., Murino, V., Liu, J., Ji, R.: Bounding multiple gaussians uncertainty with application to object tracking. Int. J. Comput. Vis. 118, 364–379 (2016)MathSciNetCrossRef Zhang, B., Perina, A., Li, Z., Murino, V., Liu, J., Ji, R.: Bounding multiple gaussians uncertainty with application to object tracking. Int. J. Comput. Vis. 118, 364–379 (2016)MathSciNetCrossRef
21.
Zurück zum Zitat Zhang, B., Perina, A., Murino, V., Bue, A.D.: Sparse representation classification with manifold constraints transfer. In: Computer Vision and Pattern Recognition, pp. 4557–4565. IEEE press, Boston (2015) Zhang, B., Perina, A., Murino, V., Bue, A.D.: Sparse representation classification with manifold constraints transfer. In: Computer Vision and Pattern Recognition, pp. 4557–4565. IEEE press, Boston (2015)
Metadaten
Titel
Gesture Recognition Benchmark Based on Mobile Phone
verfasst von
Chunyu Xie
Shangzhen Luan
Hainan Wang
Baochang Zhang
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46654-5_48