Abstract
The information of expression texture extracted by the completed local ternary patterns (CLTP) method is not accurate enough, which may cause low recognition rate. Therefore, an improved completed local ternary patterns (ICLTP) is proposed here. Firstly, the Scharr operator is used to calculate gradient magnitudes of images to enhance the detail of texture, which is beneficial to obtaining more accurate expression features. Secondly, two different neighborhoods of CLTP features are combined to obtain much information of facial expression. Finally, K nearest neighbor (KNN) and sparse representation classifier (SRC) are combined for classification and a 10-fold cross-validation method is tested in the JAFFE and CK+ databases. The results show that the ICLTP method can improve the recognition rate of facial expression and reduce the confusion between various expressions. Especially, the misrecognition rate of other six expressions recognized as neutral is reduced in the 7-class expression recognition.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Shan C, Gong S and Mcowan P W, Image & Vision Computing 27, 803 (2009).
Zhao G and Pietikäinen M, Pattern Recognition Letters 30, 1117 (2009).
Doshi N P, Schaefer G and Hossain S, Improved Dominant Local Binary Pattern Texture Features, IEEE International Conference on Informatics, Electronics and Vision, 1157 (2016).
Jabid T, Kabir M H and Chae O, ETRI Journal 32, 784 (2010).
Tan X and Triggs B, IEEE Transactions on Image Processing 19, 1635 (2010).
Rassem T H and Khoo B E, The Scientific World Journal 2014, 254 (2014).
Rassem T H, Mohammed M F and Khoo B E, Performance Evaluation of Completed Local Ternary Patterns (CLTP) for Medical, Scene and Event Image Categorisation, IEEE International Conference on Software Engineering and Computer Systems, 33 (2015).
Ahmed F and Hossain E, Chinese Journal of Engineering 2013, 1 (2013).
Ameur B, Masmoudi S and Derbel A G, Fusing Gabor and LBP Feature Sets for KNN and SRC-based Face Recognition, IEEE International Conference on Advanced Technologies for Signal and Image Processing, 453 (2016).
A.R. Rivera, J.R. Castillo and O. Chae, Pattern Recognition Letters 51, 94 (2015).
A.R. Rivera, J.R. Castillo and O. Chae, IEEE Transactions on Image Processing 22, 1740 (2013).
Holder R P and Tapamo J R, EURASIP Journal on Image & Video Processing 2017, 42 (2017).
W.L. Chao, J.J. Ding and J.Z. Liu, Signal Processing 117, 1 (2015).
Sun Y and Yu J, Facial Expression Recognition by Fusing Gabor and Local Binary Pattern Features, MultiMedia Modeling, Springer International Publishing, 2017.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work has been supported by the National Natural Science Foundation of China (No.51604056), and the Chongqing Science and Technology Commission (No.cstc2015jcyjBX0066).
Rights and permissions
About this article
Cite this article
Luo, Y., Liu, Xy., Zhang, Y. et al. Facial expression recognition based on improved completed local ternary patterns. Optoelectron. Lett. 15, 224–230 (2019). https://doi.org/10.1007/s11801-019-8136-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11801-019-8136-z