Skip to main content

2019 | OriginalPaper | Buchkapitel

Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks

verfasst von : Jiajun Zhang, Jinkun Tao, Zhiguo Shi

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Hand gesture recognition has long been a study topic in the field of Human Computer Interaction. Traditional camera-based hand gesture recognition systems can not work properly under dark circumstances. In this paper, a Doppler-Radar based hand gesture recognition system using convolutional neural networks is proposed. A cost-effective Dopper radar sensor with dual receiving channels at 5.8 GHz is used to acquire a big database of four standard gestures. The received hand gesture signals are then processed with time-frequency analysis. Convolutional neural networks are used to classify different gestures. Experimental results verify the effectiveness of the system with an accuracy of 98%. Besides, related factors such as recognition distance and gesture scale are investigated.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hjelmås, E., Low, B.K.: Face detection: a survey. Comput. Vis. Image Underst. 83(3), 236–274 (2001) Hjelmås, E., Low, B.K.: Face detection: a survey. Comput. Vis. Image Underst. 83(3), 236–274 (2001)
2.
Zurück zum Zitat Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. (CSUR) 35(4), 399–458 (2003) Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. (CSUR) 35(4), 399–458 (2003)
3.
Zurück zum Zitat Gavrila, D.M.: The visual analysis of human movement: a survey. Comput. Vis. Image Underst. 73(1), 82–98 (1999) Gavrila, D.M.: The visual analysis of human movement: a survey. Comput. Vis. Image Underst. 73(1), 82–98 (1999)
4.
Zurück zum Zitat Molchanov, P., Gupta, S., Kim, K., Pulli, K.: Multi-sensor system for driver’s hand-gesture recognition. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), vol. 1, pp. 1–8. IEEE (2015) Molchanov, P., Gupta, S., Kim, K., Pulli, K.: Multi-sensor system for driver’s hand-gesture recognition. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), vol. 1, pp. 1–8. IEEE (2015)
5.
Zurück zum Zitat Molchanov, P., Gupta, S., Kim, K., Pulli, K.: Short-range FMCW monopulse radar for hand-gesture sensing. In: RadarCon, pp. 1491–1496. IEEE (2015) Molchanov, P., Gupta, S., Kim, K., Pulli, K.: Short-range FMCW monopulse radar for hand-gesture sensing. In: RadarCon, pp. 1491–1496. IEEE (2015)
6.
Zurück zum Zitat Arbabian, A., Callender, S., Kang, S., Rangwala, M., Niknejad, A.M.: A 94 GHz mm-wave-to-baseband pulsed-radar transceiver with applications in imaging and gesture recognition. IEEE J. Solid-State Circ. 48(4), 1055–1071 (2013) Arbabian, A., Callender, S., Kang, S., Rangwala, M., Niknejad, A.M.: A 94 GHz mm-wave-to-baseband pulsed-radar transceiver with applications in imaging and gesture recognition. IEEE J. Solid-State Circ. 48(4), 1055–1071 (2013)
7.
Zurück zum Zitat Hügler, P., Geiger, M., Waldschmidt, C.: Rcs measurements of a human hand for radar-based gesture recognition at e-band. In: Microwave Conference (GeMiC) 2016, German, pp. 259–262. IEEE (2016) Hügler, P., Geiger, M., Waldschmidt, C.: Rcs measurements of a human hand for radar-based gesture recognition at e-band. In: Microwave Conference (GeMiC) 2016, German, pp. 259–262. IEEE (2016)
8.
Zurück zum Zitat Pu, Q., Gupta, S., Gollakota, S., Patel, S.: Whole-home gesture recognition using wireless signals. In: Proceedings of the 19th Annual International Conference on Mobile Computing and Networking, pp. 27–38. ACM (2013) Pu, Q., Gupta, S., Gollakota, S., Patel, S.: Whole-home gesture recognition using wireless signals. In: Proceedings of the 19th Annual International Conference on Mobile Computing and Networking, pp. 27–38. ACM (2013)
9.
Zurück zum Zitat Mercuri, M., Soh, P.J., Pandey, G., Karsmakers, P., Vandenbosch, G.A., Leroux, P., Schreurs, D.: Analysis of an indoor biomedical radar-based system for health monitoring. IEEE Trans. Microw. Theor. Tech. 61(5), 2061–2068 (2013) Mercuri, M., Soh, P.J., Pandey, G., Karsmakers, P., Vandenbosch, G.A., Leroux, P., Schreurs, D.: Analysis of an indoor biomedical radar-based system for health monitoring. IEEE Trans. Microw. Theor. Tech. 61(5), 2061–2068 (2013)
10.
Zurück zum Zitat Peng, Z., Muñoz-Ferreras, J.-M., Gómez-García, R., Li, C.: FMCW radar fall detection based on isar processing utilizing the properties of rcs, range, and doppler. In: IEEE MTT-S International on Microwave Symposium (IMS) 2016, pp. 1–3. IEEE (2016) Peng, Z., Muñoz-Ferreras, J.-M., Gómez-García, R., Li, C.: FMCW radar fall detection based on isar processing utilizing the properties of rcs, range, and doppler. In: IEEE MTT-S International on Microwave Symposium (IMS) 2016, pp. 1–3. IEEE (2016)
11.
Zurück zum Zitat Zhou, Z., Zhang, J., Zhang, Y.D.: Ultra-wideband radar and vision based human motion classification for assisted living. In: 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM), pp. 1–5. IEEE (2016) Zhou, Z., Zhang, J., Zhang, Y.D.: Ultra-wideband radar and vision based human motion classification for assisted living. In: 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM), pp. 1–5. IEEE (2016)
12.
Zurück zum Zitat Sejdić, E., Djurović, I., Jiang, J.: Time-frequency feature representation using energy concentration: an overview of recent advances. Digit. Signal Proc. 19(1), 153–183 (2009) Sejdić, E., Djurović, I., Jiang, J.: Time-frequency feature representation using energy concentration: an overview of recent advances. Digit. Signal Proc. 19(1), 153–183 (2009)
13.
Zurück zum Zitat Mallat, S.: A Wavelet Tour of Signal Processing. Academic press, New York (1999) Mallat, S.: A Wavelet Tour of Signal Processing. Academic press, New York (1999)
14.
Zurück zum Zitat LeCun, Y., Kavukcuoglu, K., Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 253–256. IEEE (2010) LeCun, Y., Kavukcuoglu, K., Farabet, C.: Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 253–256. IEEE (2010)
15.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998) LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)
16.
Zurück zum Zitat Fan, J., Xu, W., Wu, Y., Gong, Y.: Human tracking using convolutional neural networks. IEEE Trans. Neural Netw. 21(10), 1610–1623 (2010) Fan, J., Xu, W., Wu, Y., Gong, Y.: Human tracking using convolutional neural networks. IEEE Trans. Neural Netw. 21(10), 1610–1623 (2010)
17.
Zurück zum Zitat LeCun, Y., Huang, F.J., Bottou, L.: Learning methods for generic object recognition with invariance to pose and lighting. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2004, vol. 2, pp. II–104. IEEE (2004) LeCun, Y., Huang, F.J., Bottou, L.: Learning methods for generic object recognition with invariance to pose and lighting. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2004, vol. 2, pp. II–104. IEEE (2004)
18.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
19.
Zurück zum Zitat Ciresan, D.C., Meier, U., Masci, J., Maria Gambardella, L., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: IJCAI Proceedings, vol. 22(1), p. 1237. Barcelona, Spain (2011) Ciresan, D.C., Meier, U., Masci, J., Maria Gambardella, L., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: IJCAI Proceedings, vol. 22(1), p. 1237. Barcelona, Spain (2011)
20.
Zurück zum Zitat Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014) Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
21.
Zurück zum Zitat Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015) Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:​1511.​06434 (2015)
22.
Zurück zum Zitat Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., Wei, W.: Deformable convolutional networks. arXiv preprint arXiv:1703.06211 (2017) Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., Wei, W.: Deformable convolutional networks. arXiv preprint arXiv:​1703.​06211 (2017)
Metadaten
Titel
Doppler-Radar Based Hand Gesture Recognition System Using Convolutional Neural Networks
verfasst von
Jiajun Zhang
Jinkun Tao
Zhiguo Shi
Copyright-Jahr
2019
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-6571-2_132

Neuer Inhalt