Skip to main content
Top

01-12-2016 | Original Article

Real time vision/sensor based features processing for efficient HCI employing canonical correlation analysis

Authors: Ehab H. El-Shazly, Moataz M. Abdelwahab, Atsushi Shimada, Rin-ichiro Taniguchi

Published in: Journal of Reliable Intelligent Environments | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a global algorithm for facial and gesture recognition is presented. The algorithm basically consists of three modules: features sensing and processing, dominant features selection and finally features matching. Depending on the type of data used (vision or sensor based), the proposed algorithm exploits multiple features employing 2DPCA that efficiently compact features’ descriptors maintain the spatial and temporal alignment of features’ components. Canonical Correlation Analysis (CCA) is employed to fuse different features from different descriptors or different performers. CCA also transforms training and testing features sets into new space where similar pairs become highly correlated pairs. Different experiments were conducted using well known data sets in addition to our newly collected data sets to verify the efficiency of the proposed algorithm. Excellent recognition accuracy, and fast performance are factors that promotes the proposed algorithm for real time implementation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
2.
go back to reference Turk MA, Pentland AP (1991) Face recognition using eigen faces. In: IEEE Computer Society Conference on computer vision and pattern recognition, Proceedings CVPR’91. IEEE, pp 586–591 Turk MA, Pentland AP (1991) Face recognition using eigen faces. In: IEEE Computer Society Conference on computer vision and pattern recognition, Proceedings CVPR’91. IEEE, pp 586–591
3.
go back to reference Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7(2):179–188CrossRef Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7(2):179–188CrossRef
4.
go back to reference Comon P (1994) Independent component analysis, a new concept? Signal Process 36(3):287–314CrossRefMATH Comon P (1994) Independent component analysis, a new concept? Signal Process 36(3):287–314CrossRefMATH
5.
go back to reference Yuan Y-H, Sun Q-S (2014) Multiset canonical correlations using globality preserving projections with applications to feature extraction and recognition. IEEE Trans Neural Netw Learn Syst 25(6):1131–1146MathSciNetCrossRef Yuan Y-H, Sun Q-S (2014) Multiset canonical correlations using globality preserving projections with applications to feature extraction and recognition. IEEE Trans Neural Netw Learn Syst 25(6):1131–1146MathSciNetCrossRef
6.
go back to reference Kim T-K, Wong S-F, Cipolla R (2007) Tensor canonical correlation analysis for action classification. In: IEEE conference on computer vision and pattern recognition, CVPR’07. IEEE, pp 1–8 Kim T-K, Wong S-F, Cipolla R (2007) Tensor canonical correlation analysis for action classification. In: IEEE conference on computer vision and pattern recognition, CVPR’07. IEEE, pp 1–8
7.
go back to reference Peng Y, Zhang D, Zhang J (2010) A new canonical correlation analysis algorithm with local discrimination. Neural Process Lett 31(1):1–15CrossRef Peng Y, Zhang D, Zhang J (2010) A new canonical correlation analysis algorithm with local discrimination. Neural Process Lett 31(1):1–15CrossRef
8.
go back to reference Guan N et al (2012) Sparse representation based discriminative canonical correlation analysis for face recognition. In: 11th international conference on machine learning and applications (ICMLA), vol 1. IEEE, pp 51–56 Guan N et al (2012) Sparse representation based discriminative canonical correlation analysis for face recognition. In: 11th international conference on machine learning and applications (ICMLA), vol 1. IEEE, pp 51–56
9.
go back to reference Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324CrossRef Mitra S, Acharya T (2007) Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C Appl Rev 37(3):311–324CrossRef
10.
go back to reference Zhu C, Sheng W (2011) Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living. IEEE Trans Syst Man Cybern A Syst Hum 41(3):569–573CrossRef Zhu C, Sheng W (2011) Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living. IEEE Trans Syst Man Cybern A Syst Hum 41(3):569–573CrossRef
11.
go back to reference Wang J, Chuang F (2012) An accelerometer-based digital pen with a trajectory recognition algorithm for handwritten digit and gesture recognition. IEEE Trans Ind Electron 59(7):2998–3007CrossRef Wang J, Chuang F (2012) An accelerometer-based digital pen with a trajectory recognition algorithm for handwritten digit and gesture recognition. IEEE Trans Ind Electron 59(7):2998–3007CrossRef
12.
go back to reference Hatano A, Araki K, Matsuhara M (2009) A Japanese input method for mobile terminals using surface EMG signals. In: Proceedings of 22nd Annu. Conf. Jpn.-Soc. Artif. Intell., pp 5–14 Hatano A, Araki K, Matsuhara M (2009) A Japanese input method for mobile terminals using surface EMG signals. In: Proceedings of 22nd Annu. Conf. Jpn.-Soc. Artif. Intell., pp 5–14
13.
go back to reference Li C-G, Guo J, Zhang H-G (2010) Local sparse representation based classification. In: 20th international conference on pattern recognition (ICPR), pp 649–652 Li C-G, Guo J, Zhang H-G (2010) Local sparse representation based classification. In: 20th international conference on pattern recognition (ICPR), pp 649–652
14.
go back to reference Zhang D, Chen S, Zhou Z-H (2005) A new face recognition method based on svd perturbation for single example image per person. Appl Math Comput 163(2):895–907MathSciNetCrossRefMATH Zhang D, Chen S, Zhou Z-H (2005) A new face recognition method based on svd perturbation for single example image per person. Appl Math Comput 163(2):895–907MathSciNetCrossRefMATH
15.
go back to reference Li J, Pan J-S (2008) A novel pose and illumination robust face recognition with a single training image per person algorithm. Chin Opt Lett 6(4):255–257CrossRef Li J, Pan J-S (2008) A novel pose and illumination robust face recognition with a single training image per person algorithm. Chin Opt Lett 6(4):255–257CrossRef
16.
go back to reference Chen YM, Chiang J-H (2010) Face recognition using combined multiple feature extraction based on Fourier-Mellin approach for single example image per person. Pattern Recognit Lett 31(13):1833–1841MathSciNetCrossRef Chen YM, Chiang J-H (2010) Face recognition using combined multiple feature extraction based on Fourier-Mellin approach for single example image per person. Pattern Recognit Lett 31(13):1833–1841MathSciNetCrossRef
17.
go back to reference Kuo C-H, Lee J-D (2012) Face recognition based on a two-view projective transformation using one sample per subject. IET Comput Vis 6(5):489–498MathSciNetCrossRef Kuo C-H, Lee J-D (2012) Face recognition based on a two-view projective transformation using one sample per subject. IET Comput Vis 6(5):489–498MathSciNetCrossRef
18.
go back to reference Araabi BN, Gharibshah Z (2012) Face recognition with manifold-based kernel discriminant analysis. In: The 2012 international joint conference on neural networks (IJCNN), pp 1–8 Araabi BN, Gharibshah Z (2012) Face recognition with manifold-based kernel discriminant analysis. In: The 2012 international joint conference on neural networks (IJCNN), pp 1–8
19.
20.
go back to reference Liao S, Fan W, Chung ACS, Yeung D-Y (2006) Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features. In: IEEE international conference on image processing, pp 665–668 Liao S, Fan W, Chung ACS, Yeung D-Y (2006) Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features. In: IEEE international conference on image processing, pp 665–668
21.
go back to reference Cheng F, Jiangsheng Y, Xiong H (2010) Facial expression recognition in jaffe data set based on gaussian process classication. IEEE Trans Neural Netw 21(10):1685–1690CrossRef Cheng F, Jiangsheng Y, Xiong H (2010) Facial expression recognition in jaffe data set based on gaussian process classication. IEEE Trans Neural Netw 21(10):1685–1690CrossRef
22.
go back to reference Saha A, Wu QMJ (2010) Facial expression recognition using curvelet based local binary patterns. In: IEEE international conference on acoustics speech and signal processing (ICASSP), pp 2470–2473 Saha A, Wu QMJ (2010) Facial expression recognition using curvelet based local binary patterns. In: IEEE international conference on acoustics speech and signal processing (ICASSP), pp 2470–2473
25.
go back to reference Lu Z, Chen X, Li Q, Zhang X, Zhou P (2014) A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices. IEEE Trans Hum Mach Syst 44(2):293–299 Lu Z, Chen X, Li Q, Zhang X, Zhou P (2014) A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices. IEEE Trans Hum Mach Syst 44(2):293–299
Metadata
Title
Real time vision/sensor based features processing for efficient HCI employing canonical correlation analysis
Authors
Ehab H. El-Shazly
Moataz M. Abdelwahab
Atsushi Shimada
Rin-ichiro Taniguchi
Publication date
01-12-2016
Publisher
Springer International Publishing
Published in
Journal of Reliable Intelligent Environments / Issue 4/2016
Print ISSN: 2199-4668
Electronic ISSN: 2199-4676
DOI
https://doi.org/10.1007/s40860-016-0028-4

Premium Partner