Skip to main content
Top
Published in: Calcolo 1/2020

01-03-2020

Tensor-Train decomposition for image recognition

Authors: D. Brandoni, V. Simoncini

Published in: Calcolo | Issue 1/2020

Login to get access

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We explore the potential of Tensor-Train (TT) decompositions in the context of multi-feature face or object recognition strategies. We devise a new recognition algorithm that can handle three or more way tensors in the TT format, and propose a truncation strategy to limit memory usage. Numerical comparisons with other related methods—including the well established recognition algorithm based on high-order SVD—illustrate the features of the various strategies on benchmark datasets.
Footnotes
1
Each slice of \(\mathcal {A}\), that is \(A^e\), is normalized before solving (4.1).
 
2
\(\times _i\) is the image-mode multiplication, \(\times _e\) is the expression-mode multiplication, \(\times _p\) is the person-mode multiplication.
 
3
The parameters r, s can be set arbitrarily and depend on the desired data compression.
 
4
Each image has been reduced to the pixel size \(20\times 15\), instead of the original \(640\times 480\) size.
 
5
In our experiments only the training set of the database is considered for generating the training and test phases.
 
Literature
1.
go back to reference Bader, B.W., Kolda, T.G., et al.: Matlab tensor toolbox version 3.0-dev, October 2017 (2017) Bader, B.W., Kolda, T.G., et al.: Matlab tensor toolbox version 3.0-dev, October 2017 (2017)
2.
go back to reference Boussé, M., Vervliet, N., Debals, O., De Lathauwer, L.: Face recognition as a Kronecker product equation. In: 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), pp. 1–5, Dec. 2017 (2017) Boussé, M., Vervliet, N., Debals, O., De Lathauwer, L.: Face recognition as a Kronecker product equation. In: 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP), pp. 1–5, Dec. 2017 (2017)
3.
go back to reference Ceulemans, E., Kiers, H.: Selecting among three-mode principal component models of different types and complexities: a numerical convex hull based method. Br. J. Math. Stat. Psychol. 59(1), 133–150 (2006)MathSciNetCrossRef Ceulemans, E., Kiers, H.: Selecting among three-mode principal component models of different types and complexities: a numerical convex hull based method. Br. J. Math. Stat. Psychol. 59(1), 133–150 (2006)MathSciNetCrossRef
4.
5.
go back to reference Cichocki, A., Mandic, D.P., Phan, A.H., Caiafa, C.F., Zhou, G., Zhao, Q., De Lathauwer, L.: Tensor decompositions for signal processing applications from two-way to multiway component analysis. arXiv:1403.4462 (2014) Cichocki, A., Mandic, D.P., Phan, A.H., Caiafa, C.F., Zhou, G., Zhao, Q., De Lathauwer, L.: Tensor decompositions for signal processing applications from two-way to multiway component analysis. arXiv:​1403.​4462 (2014)
6.
go back to reference De Lathauwer, L., De Moor, B., Vandewalle, J.: A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21(4), 1253–1278 (2000)MathSciNetCrossRef De Lathauwer, L., De Moor, B., Vandewalle, J.: A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21(4), 1253–1278 (2000)MathSciNetCrossRef
7.
go back to reference Delac, K., Grgic, M., Grgic, S.: Recent Advances in Face Recognition. BoD-Books on Demand, Norderstedt (2008)CrossRef Delac, K., Grgic, M., Grgic, S.: Recent Advances in Face Recognition. BoD-Books on Demand, Norderstedt (2008)CrossRef
8.
go back to reference Eldén, L.: Matrix Methods in Data Mining and Pattern Recognition (Fundamentals of Algorithms). Society for Industrial and Applied Mathematics, USA (2007)CrossRef Eldén, L.: Matrix Methods in Data Mining and Pattern Recognition (Fundamentals of Algorithms). Society for Industrial and Applied Mathematics, USA (2007)CrossRef
9.
go back to reference Golub, G.H., Van Loan, C.F.: Matrix Computations. Johns Hopkins Studies in the Mathematical Sciences. Hopkins University Press, Baltimore (2013) Golub, G.H., Van Loan, C.F.: Matrix Computations. Johns Hopkins Studies in the Mathematical Sciences. Hopkins University Press, Baltimore (2013)
10.
go back to reference Gong, W., Sapienza, M., Cuzzolin, F.: Fisher tensor decomposition for unconstrained gait recognition. In: ECML/PKDD Workshop, 01 (2013) Gong, W., Sapienza, M., Cuzzolin, F.: Fisher tensor decomposition for unconstrained gait recognition. In: ECML/PKDD Workshop, 01 (2013)
11.
go back to reference Hao, N., Kilmer, M.E., Braman, K., Hoover, R.C.: Facial recognition using tensor–tensor decompositions. SIAM J. Imaging Sci. 6(1), 437–463 (2013)MathSciNetCrossRef Hao, N., Kilmer, M.E., Braman, K., Hoover, R.C.: Facial recognition using tensor–tensor decompositions. SIAM J. Imaging Sci. 6(1), 437–463 (2013)MathSciNetCrossRef
13.
go back to reference Krämer, A.: A Geometric Description of Feasible Singular Values in the Tensor Train Format. SIAM, Philadelphia (2019)CrossRef Krämer, A.: A Geometric Description of Feasible Singular Values in the Tensor Train Format. SIAM, Philadelphia (2019)CrossRef
17.
go back to reference Oseledets, I.V., Tyrtyshnikov, E.: Tt-cross approximation for multidimensional arrays. Linear Algebra Appl. 432(1), 70–88 (2010)MathSciNetCrossRef Oseledets, I.V., Tyrtyshnikov, E.: Tt-cross approximation for multidimensional arrays. Linear Algebra Appl. 432(1), 70–88 (2010)MathSciNetCrossRef
18.
go back to reference Phan, A.H., Cichocki, A., Uschmajew, A., Tichavský, P., Luta, G., Mandic, D.P.: Tensor networks for latent variable analysis. part I: algorithms for tensor train decomposition. arXiv:1609.09230 (2016) Phan, A.H., Cichocki, A., Uschmajew, A., Tichavský, P., Luta, G., Mandic, D.P.: Tensor networks for latent variable analysis. part I: algorithms for tensor train decomposition. arXiv:​1609.​09230 (2016)
19.
go back to reference Savas, B., Eldén, L.: Handwritten digit classification using higher order singular value decomposition. Pattern Recognit. 40(3), 993–1003 (2007)CrossRef Savas, B., Eldén, L.: Handwritten digit classification using higher order singular value decomposition. Pattern Recognit. 40(3), 993–1003 (2007)CrossRef
20.
go back to reference Senior, A.W., Bolle, R.M.: Face Recognition and its Application, Chapter 10. Springer, Boston (2002) Senior, A.W., Bolle, R.M.: Face Recognition and its Application, Chapter 10. Springer, Boston (2002)
21.
go back to reference Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009)CrossRef Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009)CrossRef
22.
go back to reference Tock, D.: Tensor decomposition and its applications. Master’s thesis, University of Chester (2010) Tock, D.: Tensor decomposition and its applications. Master’s thesis, University of Chester (2010)
23.
go back to reference Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: tensorfaces. In: European Conference on Computer Vision, pp. 447–460. Springer (2002) Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: tensorfaces. In: European Conference on Computer Vision, pp. 447–460. Springer (2002)
24.
go back to reference Vasilescu, M.A.O., Terzopoulos, D.: Multilinear image analysis for facial recognition. In: Object Recognition Supported by User Interaction for Service Robots, vol. 2, pp. 511–514. IEEE (2002) Vasilescu, M.A.O., Terzopoulos, D.: Multilinear image analysis for facial recognition. In: Object Recognition Supported by User Interaction for Service Robots, vol. 2, pp. 511–514. IEEE (2002)
25.
Metadata
Title
Tensor-Train decomposition for image recognition
Authors
D. Brandoni
V. Simoncini
Publication date
01-03-2020
Publisher
Springer International Publishing
Published in
Calcolo / Issue 1/2020
Print ISSN: 0008-0624
Electronic ISSN: 1126-5434
DOI
https://doi.org/10.1007/s10092-020-0358-8

Other articles of this Issue 1/2020

Calcolo 1/2020 Go to the issue

Premium Partner