Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2023

21-02-2023 | Industrial and Commercial Application

Regularized denoising latent subspace based linear regression for image classification

Authors: Ziyi Su, Wang Wenbo, Weibin Zhang

Published in: Pattern Analysis and Applications | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a novel method, called Regularized Denoising Latent Subspace based Linear Regression (RDLSLR), for noisy image classification. RDLSLR model divides the traditional subspace learning model into two steps. The first step is adding a denoising latent space between the vision space and label space to obtain clean data by an undercomplete autoencoder and the second step is using another transformation matrix to learn regression target by clean data. In order to further optimize the distribution of data in subspace, an additional Laplacian Regularization is introduced to label space with the help of manifold learning. In addition, \(\epsilon\)-dragging technique is used in the label space to make the RDLSLR model more discriminative. In the RDLSLR model, data denoising, local structure, and label relaxation are considered at the same time. A joint optimization model is constructed, and an efficient iterative algorithm is designed to solve the proposed model. In order to verify the effectiveness of the RDLSLR model, several experiments involving the face, biometric, object, and deep feature recognition have been conducted. The experimental results show that the proposed RDLSLR model is achieved compared with many state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yang C, Guan N (2019) Correlation maximization machine for multi-modalities multiclass classification. Pattern Analy Appl Yang C, Guan N (2019) Correlation maximization machine for multi-modalities multiclass classification. Pattern Analy Appl
2.
go back to reference Yanping Z, Liang Q, Zou K, Li Z, Sun W, Wang Y (2022) Self-supervised part segmentation via motion imitation. Image Vis Comput 120:104393CrossRef Yanping Z, Liang Q, Zou K, Li Z, Sun W, Wang Y (2022) Self-supervised part segmentation via motion imitation. Image Vis Comput 120:104393CrossRef
3.
go back to reference Kokil P, Pratap T (2020) Additive white gaussian noise level estimation for natural images using linear scale-space features. Circuit Syst Signal Process (5) Kokil P, Pratap T (2020) Additive white gaussian noise level estimation for natural images using linear scale-space features. Circuit Syst Signal Process (5)
4.
go back to reference Hu X, Li Y, Jia L, Qiu M (2022) A novel two-stage unsupervised fault recognition framework combining feature extraction and fuzzy clustering for collaborative aiot. IEEE Trans Indus Inform 18(2):1291–1300CrossRef Hu X, Li Y, Jia L, Qiu M (2022) A novel two-stage unsupervised fault recognition framework combining feature extraction and fuzzy clustering for collaborative aiot. IEEE Trans Indus Inform 18(2):1291–1300CrossRef
5.
go back to reference Shen B, Xie W, Kong ZJ (2021) Clustered discriminant regression for high-dimensional data feature extraction and its applications in healthcare and additive manufacturing. IEEE Trans Autom Sci Eng 18(4):1998–2010CrossRef Shen B, Xie W, Kong ZJ (2021) Clustered discriminant regression for high-dimensional data feature extraction and its applications in healthcare and additive manufacturing. IEEE Trans Autom Sci Eng 18(4):1998–2010CrossRef
6.
go back to reference Ryu S, Choi H, Lee H, Kim H (2020) Convolutional autoencoder based feature extraction and clustering for customer load analysis. IEEE Trans Power Syst 35(2):1048–1060CrossRef Ryu S, Choi H, Lee H, Kim H (2020) Convolutional autoencoder based feature extraction and clustering for customer load analysis. IEEE Trans Power Syst 35(2):1048–1060CrossRef
7.
go back to reference Tu B, Liao X, Zhou C, Chen S, He W (2021) Feature extraction using multitask superpixel auxiliary learning for hyperspectral classification. IEEE Trans Instrum Meas 70:1–16 Tu B, Liao X, Zhou C, Chen S, He W (2021) Feature extraction using multitask superpixel auxiliary learning for hyperspectral classification. IEEE Trans Instrum Meas 70:1–16
8.
go back to reference Lu X, Yang D, Jia F, Yang Y, Zhang L (2021) Hyperspectral image classification based on multilevel joint feature extraction network. IEEE J Selected Topics Appl Earth Obs Remote Sens 14:10977–10989CrossRef Lu X, Yang D, Jia F, Yang Y, Zhang L (2021) Hyperspectral image classification based on multilevel joint feature extraction network. IEEE J Selected Topics Appl Earth Obs Remote Sens 14:10977–10989CrossRef
9.
go back to reference Sunitha G, Geetha K, Neelakandan S, Singh Pundir AK, Hemalatha S, Kumar V (2022) Intelligent deep learning based ethnicity recognition and classification using facial images. Image Vision Comput 121:104404CrossRef Sunitha G, Geetha K, Neelakandan S, Singh Pundir AK, Hemalatha S, Kumar V (2022) Intelligent deep learning based ethnicity recognition and classification using facial images. Image Vision Comput 121:104404CrossRef
10.
go back to reference Zhang XY, Wang L, Xiang S, Liu CL (2015) Retargeted least squares regression algorithm. IEEE Trans Neural Netw Learn Syst 26(9):2206MathSciNetCrossRef Zhang XY, Wang L, Xiang S, Liu CL (2015) Retargeted least squares regression algorithm. IEEE Trans Neural Netw Learn Syst 26(9):2206MathSciNetCrossRef
11.
go back to reference Fang X, Xu Y, Li X, Lai Z, Fang B (2018) Regularized label relaxation linear regression. IEEE Trans Neural Netw Learn Syst 29(4):1006–1018CrossRef Fang X, Xu Y, Li X, Lai Z, Fang B (2018) Regularized label relaxation linear regression. IEEE Trans Neural Netw Learn Syst 29(4):1006–1018CrossRef
12.
go back to reference Chen Z, Wu XJ, Kittler J (2020) Low-rank discriminative least squares regression for image classification. Signal Process 173:107485CrossRef Chen Z, Wu XJ, Kittler J (2020) Low-rank discriminative least squares regression for image classification. Signal Process 173:107485CrossRef
13.
go back to reference Xiang S, Meng G, Pan C, Zhang C, Nie F (2012) Discriminative least squares regression for multiclass classification and feature selection. IEEE Trans Neural Netw Learn Syst 23(11):1738–1754CrossRef Xiang S, Meng G, Pan C, Zhang C, Nie F (2012) Discriminative least squares regression for multiclass classification and feature selection. IEEE Trans Neural Netw Learn Syst 23(11):1738–1754CrossRef
14.
go back to reference Robles-Kelly A, Wei R (2016) Semi-supervised image labelling using barycentric graph embeddings. In: International conference on pattern recognition Robles-Kelly A, Wei R (2016) Semi-supervised image labelling using barycentric graph embeddings. In: International conference on pattern recognition
15.
go back to reference Chen S (2011) Orthogonal least squares regression: an efficient approach for parsimonious modelling from large data. In: 11th UK workshop on computational intelligence Chen S (2011) Orthogonal least squares regression: an efficient approach for parsimonious modelling from large data. In: 11th UK workshop on computational intelligence
16.
go back to reference Geladi P, Kowalski BR (1986) An example of 2-block predictive partial least-squares regression with simulated data. Anal Chim Acta 185:19–32CrossRef Geladi P, Kowalski BR (1986) An example of 2-block predictive partial least-squares regression with simulated data. Anal Chim Acta 185:19–32CrossRef
17.
go back to reference Takayanagi M, Tabei Y, Suzuki E, Saigo H (2021) Sparse nonnegative interaction models. In: 2018 IEEE international conference on data mining (ICDM) Takayanagi M, Tabei Y, Suzuki E, Saigo H (2021) Sparse nonnegative interaction models. In: 2018 IEEE international conference on data mining (ICDM)
18.
go back to reference Huang P, Yang Z, Wang W, Zhang F (2022) Denoising low-rank discrimination based least squares regression for image classification. Inform Sci 587:247–264CrossRef Huang P, Yang Z, Wang W, Zhang F (2022) Denoising low-rank discrimination based least squares regression for image classification. Inform Sci 587:247–264CrossRef
19.
go back to reference Wang W, Fang L, Zhang W (2023) Robust double relaxed regression for image classification. Signal Process 203:108796CrossRef Wang W, Fang L, Zhang W (2023) Robust double relaxed regression for image classification. Signal Process 203:108796CrossRef
20.
go back to reference Fang X, Teng S, Lai Z (2017) Robust latent subspace learning for image classification. IEEE Trans Neural Netw Learn Syst 29(6):2502–2515MathSciNetCrossRef Fang X, Teng S, Lai Z (2017) Robust latent subspace learning for image classification. IEEE Trans Neural Netw Learn Syst 29(6):2502–2515MathSciNetCrossRef
22.
go back to reference Shi Q, Cheung Y-M, Zhao Q, Lu H (2019) Feature extraction for incomplete data via low-rank tensor decomposition with feature regularization. IEEE Trans Neural Netw Learn Syst 30(6):1803–1817MathSciNetCrossRef Shi Q, Cheung Y-M, Zhao Q, Lu H (2019) Feature extraction for incomplete data via low-rank tensor decomposition with feature regularization. IEEE Trans Neural Netw Learn Syst 30(6):1803–1817MathSciNetCrossRef
23.
go back to reference Tu B, Liao X, Zhou C, Chen S, He W (2021) Feature extraction using multitask superpixel auxiliary learning for hyperspectral classification. IEEE Trans Instrum Meas 70:1–16 Tu B, Liao X, Zhou C, Chen S, He W (2021) Feature extraction using multitask superpixel auxiliary learning for hyperspectral classification. IEEE Trans Instrum Meas 70:1–16
24.
go back to reference Peng B, Wan S, Bi Y, Xue B, Zhang M (2021) Automatic feature extraction and construction using genetic programming for rotating machinery fault diagnosis. IEEE Trans Cybern 51(10):4909–4923CrossRef Peng B, Wan S, Bi Y, Xue B, Zhang M (2021) Automatic feature extraction and construction using genetic programming for rotating machinery fault diagnosis. IEEE Trans Cybern 51(10):4909–4923CrossRef
25.
go back to reference Chen Z, Wu XJ, Kittler J (2019) A sparse regularized nuclear norm based matrix regression for face recognition with contiguous occlusion. Pattern Recogn Lett 125:494–499CrossRef Chen Z, Wu XJ, Kittler J (2019) A sparse regularized nuclear norm based matrix regression for face recognition with contiguous occlusion. Pattern Recogn Lett 125:494–499CrossRef
26.
go back to reference Wen J, Xu Y, Zuoyong L, Zhongli M, Xu Y (2018) Inter-class sparsity based discriminative least square regression. Neural Netw 102:36–47CrossRefMATH Wen J, Xu Y, Zuoyong L, Zhongli M, Xu Y (2018) Inter-class sparsity based discriminative least square regression. Neural Netw 102:36–47CrossRefMATH
27.
go back to reference Chen C, He B, Ye Y, Yuan X (2016) The direct extension of admm for multi-block convex minimization problems is not necessarily convergent. Math Programm 155(1–2):57–79MathSciNetCrossRefMATH Chen C, He B, Ye Y, Yuan X (2016) The direct extension of admm for multi-block convex minimization problems is not necessarily convergent. Math Programm 155(1–2):57–79MathSciNetCrossRefMATH
28.
go back to reference Martínez A, Benavente R (1988) The ar face database. Cvc Technical Report, 24 Martínez A, Benavente R (1988) The ar face database. Cvc Technical Report, 24
29.
go back to reference Hart P, Cover T (2004) Nearest neighbor pattern classification. IEEE Trans Circuits Syst Video Technol 14(1):4–20MATH Hart P, Cover T (2004) Nearest neighbor pattern classification. IEEE Trans Circuits Syst Video Technol 14(1):4–20MATH
30.
go back to reference Ganesh A, Sastry S, Ma Y, Wright J, Yang AY (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Machine Intell 31(2):210–227 Ganesh A, Sastry S, Ma Y, Wright J, Yang AY (2008) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Machine Intell 31(2):210–227
31.
go back to reference Naseem I, Togneri R, Bennamoun M (2010) Linear regression for face recognition. IEEE Trans Pattern Anal Machine Intell 32(11):2106–2112CrossRef Naseem I, Togneri R, Bennamoun M (2010) Linear regression for face recognition. IEEE Trans Pattern Anal Machine Intell 32(11):2106–2112CrossRef
32.
go back to reference Yang M, Zhang L, Feng X (2011) Sparse representation or collaborative representation: Which helps face recognition? In: Computer vision (ICCV), 2011 IEEE international conference on, pp 471–478 Yang M, Zhang L, Feng X (2011) Sparse representation or collaborative representation: Which helps face recognition? In: Computer vision (ICCV), 2011 IEEE international conference on, pp 471–478
33.
go back to reference Cai S, Zhang L, Zuo W, Feng X (2016) A probabilistic collaborative representation based approach for pattern classification. In: IEEE conference on computer vision & pattern recognition Cai S, Zhang L, Zuo W, Feng X (2016) A probabilistic collaborative representation based approach for pattern classification. In: IEEE conference on computer vision & pattern recognition
34.
go back to reference Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Computer ence Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Computer ence
35.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition.
36.
go back to reference Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv e-prints, parXiv:1704.04861, April 2017 Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv e-prints, parXiv:​1704.​04861, April 2017
37.
go back to reference Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1251–1258 Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1251–1258
38.
go back to reference Sim T, Baker S, Bsat M (2004) The cmu pose, illumination, and expression database. IEEE Trans Pattern Anal Machine Intell 25(12):1615–1618 Sim T, Baker S, Bsat M (2004) The cmu pose, illumination, and expression database. IEEE Trans Pattern Anal Machine Intell 25(12):1615–1618
39.
go back to reference Zhang D, Guo Z, Lu G, Zhang L, Zuo W (2010) An online system of multispectral palmprint verification. IEEE Trans Instrum Meas 59(2):480–490CrossRef Zhang D, Guo Z, Lu G, Zhang L, Zuo W (2010) An online system of multispectral palmprint verification. IEEE Trans Instrum Meas 59(2):480–490CrossRef
40.
go back to reference Yu PF, Zhou H, Li HY (2014) Personal identification using finger-knuckle-print based on local binary pattern. Appl Mech Mater 441:703–706CrossRef Yu PF, Zhou H, Li HY (2014) Personal identification using finger-knuckle-print based on local binary pattern. Appl Mech Mater 441:703–706CrossRef
41.
go back to reference Rate C, Retrieval C (2011) Columbia object image library (coil-20). Computer Rate C, Retrieval C (2011) Columbia object image library (coil-20). Computer
42.
go back to reference Pezzotti N, Lelieveldt BPF, Van Der Maaten L, Hllt T, Vilanova A (2016) Approximated and user steerable tsne for progressive visual analytics. IEEE Trans Visual Comput Graph 23(7):1739–1752CrossRef Pezzotti N, Lelieveldt BPF, Van Der Maaten L, Hllt T, Vilanova A (2016) Approximated and user steerable tsne for progressive visual analytics. IEEE Trans Visual Comput Graph 23(7):1739–1752CrossRef
43.
go back to reference Chen L, Man H, Nefian AV (2005) Face recognition based on multi-class mapping of fisher scores. Pattern Recogn 38(6):799–811CrossRef Chen L, Man H, Nefian AV (2005) Face recognition based on multi-class mapping of fisher scores. Pattern Recogn 38(6):799–811CrossRef
Metadata
Title
Regularized denoising latent subspace based linear regression for image classification
Authors
Ziyi Su
Wang Wenbo
Weibin Zhang
Publication date
21-02-2023
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 3/2023
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-023-01149-9

Other articles of this Issue 3/2023

Pattern Analysis and Applications 3/2023 Go to the issue

Premium Partner