Skip to main content
Top

2017 | OriginalPaper | Chapter

10. Recognizing Constrained 3D Human Motion: An Inference Approach

Authors : Honghai Liu, Zhaojie Ju, Xiaofei Ji, Chee Seng Chan, Mehdi Khoury

Published in: Human Motion Sensing and Recognition

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Enormous uncertainties in unconstrained human motions lead to a fundamental challenge that many recognising algorithms have to face in practice: motion recognition has to be efficiently correct, but verifying whether or not the algorithm is robustly following the true target motion tends to be demanding, especially when human kinematic motions heavily overlap and occlusion occurs. Due to the lack of a good solution to this problem, many existing methods tend to be either effective but computationally intensive or efficient but vulnerable to false alarms. This chapter presents a novel inference engine for recognising occluded 3D human motion assisted by the recognition context. First, uncertainties are wrapped into a fuzzy membership function via a novel method called fuzzy quantile generation which employs metrics derived from the probabilistic quantile function. Then, time-dependent and context-aware rules are produced via a genetic programming to smooth the qualitative outputs represented by fuzzy membership functions. Finally, occlusion in motion recognition is taken care of by introducing new procedures for feature selection and feature reconstruction. Experimental results demonstrate the effectiveness of the proposed inference engine for 3D occluded human motion recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference S. Mitra and T. Acharya. Gesture Recognition: A Survey. IEEE Transactions on systems, man and cybernetics. Part C, Applications and reviews, 37(3):311–324, 2007. S. Mitra and T. Acharya. Gesture Recognition: A Survey. IEEE Transactions on systems, man and cybernetics. Part C, Applications and reviews, 37(3):311–324, 2007.
2.
go back to reference T.B. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104(2–3):90–126, 2006. T.B. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 104(2–3):90–126, 2006.
3.
go back to reference T. Wan, Y. Wang, and J. Li. Hand gesture recognition system using depth data. In International Conference on Consumer Electronics, Communications and Networks, pages 1063–1066, April 2012. T. Wan, Y. Wang, and J. Li. Hand gesture recognition system using depth data. In International Conference on Consumer Electronics, Communications and Networks, pages 1063–1066, April 2012.
4.
go back to reference A. Fernndez-Baena, A. Susin, and X. Lligadas. Biomechanical validation of upper-body and lower-body joint movements of kinect motion capture data for rehabilitation treatments. In International Conference on Intelligent Networking and Collaborative Systems, pages 656–661, Sept. 2012. A. Fernndez-Baena, A. Susin, and X. Lligadas. Biomechanical validation of upper-body and lower-body joint movements of kinect motion capture data for rehabilitation treatments. In International Conference on Intelligent Networking and Collaborative Systems, pages 656–661, Sept. 2012.
5.
go back to reference J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1297–1304. IEEE, 2011. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1297–1304. IEEE, 2011.
6.
go back to reference Z. Ju, Y. Wang, W. Zeng, S. Chen, and H. Liu. Depth and rgb image alignment for hand gesture segmentation using kinect. In International Conference on Machine Learning and Cybernetics, volume 2, pages 913–919. IEEE, 2013. Z. Ju, Y. Wang, W. Zeng, S. Chen, and H. Liu. Depth and rgb image alignment for hand gesture segmentation using kinect. In International Conference on Machine Learning and Cybernetics, volume 2, pages 913–919. IEEE, 2013.
7.
go back to reference Zhou Ren, Junsong Yuan, Jingjing Meng, and Zhengyou Zhang. Robust part-based hand gesture recognition using kinect sensor. IEEE transactions on multimedia, 15(5):1110–1120, 2013. Zhou Ren, Junsong Yuan, Jingjing Meng, and Zhengyou Zhang. Robust part-based hand gesture recognition using kinect sensor. IEEE transactions on multimedia, 15(5):1110–1120, 2013.
8.
go back to reference Nianfeng Li, Yinfei Dai, Rongquan Wang, and Yanhui Shao. Study on action recognition based on kinect and its application in rehabilitation training. In Big Data and Cloud Computing (BDCloud), 2015 IEEE Fifth International Conference on, pages 265–269. IEEE, 2015. Nianfeng Li, Yinfei Dai, Rongquan Wang, and Yanhui Shao. Study on action recognition based on kinect and its application in rehabilitation training. In Big Data and Cloud Computing (BDCloud), 2015 IEEE Fifth International Conference on, pages 265–269. IEEE, 2015.
9.
go back to reference Hesham Alabbasi, Alex Gradinaru, Florica Moldoveanu, and Alin Moldoveanu. Human motion tracking & evaluation using kinect v2 sensor. In E-Health and Bioengineering Conference (EHB), 2015, pages 1–4. IEEE, 2015. Hesham Alabbasi, Alex Gradinaru, Florica Moldoveanu, and Alin Moldoveanu. Human motion tracking & evaluation using kinect v2 sensor. In E-Health and Bioengineering Conference (EHB), 2015, pages 1–4. IEEE, 2015.
10.
go back to reference Z. Ren, J. Meng, J. Yuan, and Z. Zhang. Robust hand gesture recognition with kinect sensor. In Proceedings of the 19th ACM international conference on Multimedia, pages 759–760. ACM, 2011. Z. Ren, J. Meng, J. Yuan, and Z. Zhang. Robust hand gesture recognition with kinect sensor. In Proceedings of the 19th ACM international conference on Multimedia, pages 759–760. ACM, 2011.
11.
go back to reference A.F. Bobick and A.D. Wilson. A state-based approach to the representation and recognition of gesture. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(12):1325–1337, 1997. A.F. Bobick and A.D. Wilson. A state-based approach to the representation and recognition of gesture. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(12):1325–1337, 1997.
12.
go back to reference P. Remagnino, T. Tan, and K. Baker. Agent orientated annotation in model based visual surveillance. In Proceeding of International Conference on Computer Vision, pages 857–862, 1998. P. Remagnino, T. Tan, and K. Baker. Agent orientated annotation in model based visual surveillance. In Proceeding of International Conference on Computer Vision, pages 857–862, 1998.
13.
go back to reference J. Yamato, J. Ohya, and K. Ishii. Recognizing human action in time-sequential images using hidden markov model. In Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 379–385, 1992. J. Yamato, J. Ohya, and K. Ishii. Recognizing human action in time-sequential images using hidden markov model. In Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 379–385, 1992.
14.
go back to reference K. Takahashi, S. Seki, E. Kojima, and R.E. Oka. Recognition of dexterous manipulations from time-varying images. In Proceedings of the 1994 IEEE Workshop on Motion of Non-Rigid and Articulated Objects, pages 23–28, 1994. K. Takahashi, S. Seki, E. Kojima, and R.E. Oka. Recognition of dexterous manipulations from time-varying images. In Proceedings of the 1994 IEEE Workshop on Motion of Non-Rigid and Articulated Objects, pages 23–28, 1994.
15.
go back to reference J. Davis and M. Shah. Visual gesture recognition. IEEE Proceedings-Vision, Image and Signal Processing, 141(2):101–106, 1994. J. Davis and M. Shah. Visual gesture recognition. IEEE Proceedings-Vision, Image and Signal Processing, 141(2):101–106, 1994.
16.
go back to reference John L., Andrew M., and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning, pages 282–289. Morgan Kaufmann, San Francisco, CA, 2001. John L., Andrew M., and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. 18th International Conf. on Machine Learning, pages 282–289. Morgan Kaufmann, San Francisco, CA, 2001.
17.
go back to reference D.L. Vail. Conditional Random Fields for Activity Recognition. PhD thesis, CMU School of Computer Science, 2008. D.L. Vail. Conditional Random Fields for Activity Recognition. PhD thesis, CMU School of Computer Science, 2008.
18.
go back to reference J. Sung, C. Ponce, B. Selman, and A. Saxena. Unstructured human activity detection from rgbd images. In IEEE International Conference on Robotics and Automation, pages 842–849. IEEE, 2012. J. Sung, C. Ponce, B. Selman, and A. Saxena. Unstructured human activity detection from rgbd images. In IEEE International Conference on Robotics and Automation, pages 842–849. IEEE, 2012.
19.
go back to reference G. Welch and G. Bishop. An introduction to the kalman filter. Technical Report TR 95-041, University of North Carolina at Chapel Hill, Department of Computer Science, Chapel Hill, NC 27599-3175, 1995. G. Welch and G. Bishop. An introduction to the kalman filter. Technical Report TR 95-041, University of North Carolina at Chapel Hill, Department of Computer Science, Chapel Hill, NC 27599-3175, 1995.
20.
go back to reference M. Isard and A. Blake. Contour tracking by stochastic propagation of conditional density. European Conference on Computer Vision, 1(2), 1996. M. Isard and A. Blake. Contour tracking by stochastic propagation of conditional density. European Conference on Computer Vision, 1(2), 1996.
21.
go back to reference F. Endres, J. Hess, and W. Burgard. Graph-based action models for human motion classification. In German Conference on Robotics, ROBOTIK, pages 1–6, May 2012. F. Endres, J. Hess, and W. Burgard. Graph-based action models for human motion classification. In German Conference on Robotics, ROBOTIK, pages 1–6, May 2012.
22.
go back to reference B.E. Boser, I.M. Guyon, and V.N. Vapnik. A training algorithm for optimal margin classifiers. In David Haussler, editor, Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, pages 144–152, Pittsburgh, PA, July 1992. ACM Press. B.E. Boser, I.M. Guyon, and V.N. Vapnik. A training algorithm for optimal margin classifiers. In David Haussler, editor, Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, pages 144–152, Pittsburgh, PA, July 1992. ACM Press.
23.
go back to reference F. Guo and G. Qian. Dance posture recognition using wide-baseline orthogonal stereo cameras. In International Conference on Automatic Face and Gesture Recognition, pages 481–486, 2–6 2006. F. Guo and G. Qian. Dance posture recognition using wide-baseline orthogonal stereo cameras. In International Conference on Automatic Face and Gesture Recognition, pages 481–486, 2–6 2006.
24.
go back to reference T. Jan, M. Piccardi, and T. Hintz. Neural network classifiers for automated video surveillance. 13th IEEE Workshop on Neural Networks for Signal Processing, pages 729–738, 2003. T. Jan, M. Piccardi, and T. Hintz. Neural network classifiers for automated video surveillance. 13th IEEE Workshop on Neural Networks for Signal Processing, pages 729–738, 2003.
25.
go back to reference M.H. Yang and N. Ahuja. Extraction and classification of visual motion patterns for hand gesture recognition. In in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 892–897, June 1998. M.H. Yang and N. Ahuja. Extraction and classification of visual motion patterns for hand gesture recognition. In in Proc. IEEE Conf. Computer Vision and Pattern Recognition, pages 892–897, June 1998.
26.
go back to reference K. Symeonidis. Hand gesture recognition using neural networks. Neural Networks, 13:5.1, 1996. K. Symeonidis. Hand gesture recognition using neural networks. Neural Networks, 13:5.1, 1996.
27.
go back to reference Y.A. Ivanov and A.F. Bobick. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):852–872, August 2000. Y.A. Ivanov and A.F. Bobick. Recognition of visual activities and interactions by stochastic parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):852–872, August 2000.
28.
go back to reference A.F. Bobick and J.W. Davis. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:257–267, 2001. A.F. Bobick and J.W. Davis. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:257–267, 2001.
29.
go back to reference H. Bourlard and C.J. Wellekens. Links between markov models and multilayer perceptrons. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(12):1167–1178, December 1990. H. Bourlard and C.J. Wellekens. Links between markov models and multilayer perceptrons. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(12):1167–1178, December 1990.
30.
go back to reference S.K. Korde and K.C. Jondhale. Hand gesture recognition system using standard fuzzy c-means algorithm for recognizing hand gesture with angle variations for unsupervised users. In International Conference on Emerging Trends in Engineering and Technology, pages 681–685, 16–18 2008. S.K. Korde and K.C. Jondhale. Hand gesture recognition system using standard fuzzy c-means algorithm for recognizing hand gesture with angle variations for unsupervised users. In International Conference on Emerging Trends in Engineering and Technology, pages 681–685, 16–18 2008.
31.
go back to reference L.A. Zadeh. Toward human level machine intelligence - is it achievable? the need for a paradigm shift. Computational Intelligence Magazine, IEEE, Volume 3(3):11–22, August 2008. L.A. Zadeh. Toward human level machine intelligence - is it achievable? the need for a paradigm shift. Computational Intelligence Magazine, IEEE, Volume 3(3):11–22, August 2008.
32.
go back to reference D. Dubois and H. Prade. Possibility theory, probability theory and multiple-valued logics: A clarification. Annals of Mathematics and Artificial Intelligence, 32:35–66, 2001. D. Dubois and H. Prade. Possibility theory, probability theory and multiple-valued logics: A clarification. Annals of Mathematics and Artificial Intelligence, 32:35–66, 2001.
33.
go back to reference G. Nieradka and B.S. Butkiewicz. A method for automatic membership function estimation based on fuzzy measures. In Lecture Notes in Computer Science, volume 4529, pages 451–460. Springer, 2007. G. Nieradka and B.S. Butkiewicz. A method for automatic membership function estimation based on fuzzy measures. In Lecture Notes in Computer Science, volume 4529, pages 451–460. Springer, 2007.
34.
go back to reference L.A. Zadeh. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems, 1:3–28, 1978. L.A. Zadeh. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems, 1:3–28, 1978.
35.
go back to reference Tapio F. Timing of fuzzy membership functions from data. Academic Dissertation - University of Oulu - Finland, July 2001. Tapio F. Timing of fuzzy membership functions from data. Academic Dissertation - University of Oulu - Finland, July 2001.
36.
go back to reference International Society of Biomechanics. Isb recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion–part i: ankle, hip, and spine. Journal of Biomechanics, 35(4):543–548, 2002. International Society of Biomechanics. Isb recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion–part i: ankle, hip, and spine. Journal of Biomechanics, 35(4):543–548, 2002.
37.
go back to reference J. Favre, R. Aissaoui, B.M. Jolles, O. Siegrist, J.A. de Guise, and K. Aminian. 3d joint rotation measurement using mems inertial sensors: Application to the knee joint. In ISB-3D: 3-D Analysis of Human Movement, Valenciennes, France., 2006. J. Favre, R. Aissaoui, B.M. Jolles, O. Siegrist, J.A. de Guise, and K. Aminian. 3d joint rotation measurement using mems inertial sensors: Application to the knee joint. In ISB-3D: 3-D Analysis of Human Movement, Valenciennes, France., 2006.
38.
go back to reference C.S. Chan, H. Liu, and D.J. Brown. Recognition of human motion from qualitative normalised templates. Journal of Intelligent and Robotic Systems, 48(1):79–95, January 2007. C.S. Chan, H. Liu, and D.J. Brown. Recognition of human motion from qualitative normalised templates. Journal of Intelligent and Robotic Systems, 48(1):79–95, January 2007.
39.
go back to reference M. Meredith and S. Maddock. Motion capture file formats explained. Technical report, Computer Science Department, University of Sheffield, 2000. M. Meredith and S. Maddock. Motion capture file formats explained. Technical report, Computer Science Department, University of Sheffield, 2000.
40.
go back to reference A.F. Gobi and W. Pedrycz. Fuzzy modelling through logic optimization. International Journal of Approximate Reasoning, 45(3):488–510, 2007. A.F. Gobi and W. Pedrycz. Fuzzy modelling through logic optimization. International Journal of Approximate Reasoning, 45(3):488–510, 2007.
41.
go back to reference T. Yu, D. Wilkinson, and D. Xie. A hybrid GP-fuzzy approach for resevoir characterization. In R.L. Riolo and B. Worzel, editors, Genetic Programming Theory and Practice, chapter 17, pages 271–290. Kluwer, 2003. T. Yu, D. Wilkinson, and D. Xie. A hybrid GP-fuzzy approach for resevoir characterization. In R.L. Riolo and B. Worzel, editors, Genetic Programming Theory and Practice, chapter 17, pages 271–290. Kluwer, 2003.
43.
go back to reference R. Jensen and Q. Shen. New approaches to fuzzy-rough feature selection. IEEE Transactions on Fuzzy Systems, 17(4):824–838, 2009. R. Jensen and Q. Shen. New approaches to fuzzy-rough feature selection. IEEE Transactions on Fuzzy Systems, 17(4):824–838, 2009.
44.
go back to reference H. Liu. A fuzzy qualitative framework for connecting robot qualitative and quantitative representations. IEEE Transactions on Fuzzy Systems, 16(6):1522–1530, 2008. H. Liu. A fuzzy qualitative framework for connecting robot qualitative and quantitative representations. IEEE Transactions on Fuzzy Systems, 16(6):1522–1530, 2008.
46.
go back to reference C. Cokes. The Complete Book of Boxing for Fighters and Fight Fans. Etc Publications, 1980. C. Cokes. The Complete Book of Boxing for Fighters and Fight Fans. Etc Publications, 1980.
47.
go back to reference M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten. The weka data mining software: An update. ACM SIGKDD Explorations Newsletter, 11(1):10–18, 2009. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten. The weka data mining software: An update. ACM SIGKDD Explorations Newsletter, 11(1):10–18, 2009.
Metadata
Title
Recognizing Constrained 3D Human Motion: An Inference Approach
Authors
Honghai Liu
Zhaojie Ju
Xiaofei Ji
Chee Seng Chan
Mehdi Khoury
Copyright Year
2017
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-53692-6_10

Premium Partner