Skip to main content
Top
Published in:
Cover of the book

2023 | OriginalPaper | Chapter

MMA: Multi-Metric-Autoencoder for Analyzing High-Dimensional and Incomplete Data

Authors : Cheng Liang, Di Wu, Yi He, Teng Huang, Zhong Chen, Xin Luo

Published in: Machine Learning and Knowledge Discovery in Databases: Research Track

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

High-dimensional and incomplete (HDI) data usually arise in various complex applications, e.g., bioinformatics and recommender systems, making them commonly heterogeneous and inclusive. Deep neural networks (DNNs)-based approaches have provided state-of-the-art representation learning performance on HDI data. However, most prior studies adopt fixed and exclusive \(L_2\)-norm-oriented loss and regularization terms. Such a single-metric-oriented model yields limited performance on heterogeneous and inclusive HDI data. Motivated by this, we propose a Multi-Metric-Autoencoder (MMA) whose main ideas are two-fold: 1) employing different \(L_p\)-norms to build four variant Autoencoders, each of which resides in a unique metric representation space with different loss and regularization terms, and 2) aggregating these Autoencoders with a tailored, self-adaptive weighting strategy. Theoretical analysis guarantees that our MMA could attain a better representation from a set of dispersed metric spaces. Extensive experiments on four real-world datasets demonstrate that our MMA significantly outperforms seven state-of-the-art models. Our code is available at the link https://​github.​com/​wudi1989/​MMA/​

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alhayani, B.S., et al.: Visual sensor intelligent module based image transmission in industrial manufacturing for monitoring and manipulation problems. J. Intell. Manuf. 32(2), 597–610 (2021)CrossRef Alhayani, B.S., et al.: Visual sensor intelligent module based image transmission in industrial manufacturing for monitoring and manipulation problems. J. Intell. Manuf. 32(2), 597–610 (2021)CrossRef
2.
go back to reference Cai, D., Qian, S., Fang, Q., Xu, C.: Heterogeneous hierarchical feature aggregation network for personalized micro-video recommendation. IEEE Trans. Multimedia 24, 805–818 (2021)CrossRef Cai, D., Qian, S., Fang, Q., Xu, C.: Heterogeneous hierarchical feature aggregation network for personalized micro-video recommendation. IEEE Trans. Multimedia 24, 805–818 (2021)CrossRef
3.
go back to reference Chen, J., Luo, X., Zhou, M.: Hierarchical particle swarm optimization-incorporated latent factor analysis for large-scale incomplete matrices. IEEE Trans. Big Data 8(6), 1524–1536 (2021) Chen, J., Luo, X., Zhou, M.: Hierarchical particle swarm optimization-incorporated latent factor analysis for large-scale incomplete matrices. IEEE Trans. Big Data 8(6), 1524–1536 (2021)
4.
go back to reference Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH
5.
go back to reference Dong, X., Yu, Z., Cao, W., Shi, Y., Ma, Q.: A survey on ensemble learning. Front. Comp. Sci. 14(2), 241–258 (2020)CrossRef Dong, X., Yu, Z., Cao, W., Shi, Y., Ma, Q.: A survey on ensemble learning. Front. Comp. Sci. 14(2), 241–258 (2020)CrossRef
6.
go back to reference Fang, L., Du, B., Wu, C.: Differentially private recommender system with variational autoencoders. Knowl.-Based Syst. 250, 109044 (2022)CrossRef Fang, L., Du, B., Wu, C.: Differentially private recommender system with variational autoencoders. Knowl.-Based Syst. 250, 109044 (2022)CrossRef
9.
go back to reference Han, S.C., Lim, T., Long, S., Burgstaller, B., Poon, J.: Glocal-k: global and local kernels for recommender systems. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3063–3067 (2021) Han, S.C., Lim, T., Long, S., Burgstaller, B., Poon, J.: Glocal-k: global and local kernels for recommender systems. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3063–3067 (2021)
10.
go back to reference Hu, L., Pan, X., Tang, Z., Luo, X.: A fast fuzzy clustering algorithm for complex networks via a generalized momentum method. IEEE Trans. Fuzzy Syst. 30(9), 3473–3485 (2021)CrossRef Hu, L., Pan, X., Tang, Z., Luo, X.: A fast fuzzy clustering algorithm for complex networks via a generalized momentum method. IEEE Trans. Fuzzy Syst. 30(9), 3473–3485 (2021)CrossRef
11.
go back to reference Hu, L., Yang, S., Luo, X., Yuan, H., Sedraoui, K., Zhou, M.: A distributed framework for large-scale protein-protein interaction data analysis and prediction using mapreduce. IEEE/CAA J. Automatica Sinica 9(1), 160–172 (2021)CrossRef Hu, L., Yang, S., Luo, X., Yuan, H., Sedraoui, K., Zhou, M.: A distributed framework for large-scale protein-protein interaction data analysis and prediction using mapreduce. IEEE/CAA J. Automatica Sinica 9(1), 160–172 (2021)CrossRef
12.
go back to reference Hu, L., Yang, S., Luo, X., Zhou, M.: An algorithm of inductively identifying clusters from attributed graphs. IEEE Trans. Big Data 8(2), 523–534 (2020) Hu, L., Yang, S., Luo, X., Zhou, M.: An algorithm of inductively identifying clusters from attributed graphs. IEEE Trans. Big Data 8(2), 523–534 (2020)
13.
go back to reference Hu, L., Zhang, J., Pan, X., Luo, X., Yuan, H.: An effective link-based clustering algorithm for detecting overlapping protein complexes in protein-protein interaction networks. IEEE Trans. Netw. Sci. Eng. 8(4), 3275–3289 (2021)CrossRef Hu, L., Zhang, J., Pan, X., Luo, X., Yuan, H.: An effective link-based clustering algorithm for detecting overlapping protein complexes in protein-protein interaction networks. IEEE Trans. Netw. Sci. Eng. 8(4), 3275–3289 (2021)CrossRef
16.
go back to reference Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)CrossRef Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)CrossRef
17.
go back to reference Li, P., Wang, Z., Ren, Z., Bing, L., Lam, W.: Neural rating regression with abstractive tips generation for recommendation. In: Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 345–354 (2017) Li, P., Wang, Z., Ren, Z., Bing, L., Lam, W.: Neural rating regression with abstractive tips generation for recommendation. In: Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval, pp. 345–354 (2017)
18.
go back to reference Li, Y., Sun, H., Yan, W., Cui, Q.: R-CTSVM+: robust capped L1-norm twin support vector machine with privileged information. Inf. Sci. 574, 12–32 (2021)CrossRef Li, Y., Sun, H., Yan, W., Cui, Q.: R-CTSVM+: robust capped L1-norm twin support vector machine with privileged information. Inf. Sci. 574, 12–32 (2021)CrossRef
20.
go back to reference Liu, Z., Luo, X., Wang, Z.: Convergence analysis of single latent factor-dependent, nonnegative, and multiplicative update-based nonnegative latent factor models. IEEE Trans. Neural Netw. Learn. Syst. 32(4), 1737–1749 (2020)MathSciNetCrossRef Liu, Z., Luo, X., Wang, Z.: Convergence analysis of single latent factor-dependent, nonnegative, and multiplicative update-based nonnegative latent factor models. IEEE Trans. Neural Netw. Learn. Syst. 32(4), 1737–1749 (2020)MathSciNetCrossRef
21.
go back to reference Luo, X., Chen, M., Wu, H., Liu, Z., Yuan, H., Zhou, M.: Adjusting learning depth in nonnegative latent factorization of tensors for accurately modeling temporal patterns in dynamic QoS data. IEEE Trans. Autom. Sci. Eng. 18(4), 2142–2155 (2021)CrossRef Luo, X., Chen, M., Wu, H., Liu, Z., Yuan, H., Zhou, M.: Adjusting learning depth in nonnegative latent factorization of tensors for accurately modeling temporal patterns in dynamic QoS data. IEEE Trans. Autom. Sci. Eng. 18(4), 2142–2155 (2021)CrossRef
22.
go back to reference Luo, X., Wu, H., Li, Z.: NeuLFT: a novel approach to nonlinear canonical polyadic decomposition on high-dimensional incomplete tensors. IEEE Trans. Knowl. Data Eng. 35(6), 6148–6166 (2023) Luo, X., Wu, H., Li, Z.: NeuLFT: a novel approach to nonlinear canonical polyadic decomposition on high-dimensional incomplete tensors. IEEE Trans. Knowl. Data Eng. 35(6), 6148–6166 (2023)
23.
go back to reference Luo, X., Zhou, Y., Liu, Z., Hu, L., Zhou, M.: Generalized Nesterov’s acceleration-incorporated, non-negative and adaptive latent factor analysis. IEEE Trans. Serv. Comput. 15(5), 2809–2823 (2021)CrossRef Luo, X., Zhou, Y., Liu, Z., Hu, L., Zhou, M.: Generalized Nesterov’s acceleration-incorporated, non-negative and adaptive latent factor analysis. IEEE Trans. Serv. Comput. 15(5), 2809–2823 (2021)CrossRef
25.
go back to reference Muller, L., Martel, J., Indiveri, G.: Kernelized synaptic weight matrices. In: International Conference on Machine Learning, pp. 3654–3663. PMLR (2018) Muller, L., Martel, J., Indiveri, G.: Kernelized synaptic weight matrices. In: International Conference on Machine Learning, pp. 3654–3663. PMLR (2018)
26.
go back to reference Natarajan, S., Vairavasundaram, S., Natarajan, S., Gandomi, A.H.: Resolving data sparsity and cold start problem in collaborative filtering recommender system using linked open data. Expert Syst. Appl. 149, 113248 (2020)CrossRef Natarajan, S., Vairavasundaram, S., Natarajan, S., Gandomi, A.H.: Resolving data sparsity and cold start problem in collaborative filtering recommender system using linked open data. Expert Syst. Appl. 149, 113248 (2020)CrossRef
27.
go back to reference Park, J., Cho, J., Chang, H.J., Choi, J.Y.: Unsupervised hyperbolic representation learning via message passing auto-encoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5516–5526 (2021) Park, J., Cho, J., Chang, H.J., Choi, J.Y.: Unsupervised hyperbolic representation learning via message passing auto-encoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5516–5526 (2021)
28.
go back to reference Raza, S., Ding, C.: A regularized model to trade-off between accuracy and diversity in a news recommender system. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 551–560. IEEE (2020) Raza, S., Ding, C.: A regularized model to trade-off between accuracy and diversity in a news recommender system. In: 2020 IEEE International Conference on Big Data (Big Data), pp. 551–560. IEEE (2020)
29.
go back to reference Saberi-Movahed, F., et al.: Dual regularized unsupervised feature selection based on matrix factorization and minimum redundancy with application in gene selection. Knowl.-Based Syst. 256, 109884 (2022)CrossRef Saberi-Movahed, F., et al.: Dual regularized unsupervised feature selection based on matrix factorization and minimum redundancy with application in gene selection. Knowl.-Based Syst. 256, 109884 (2022)CrossRef
30.
go back to reference Sedhain, S., Menon, A.K., Sanner, S., Xie, L.: AutoRec: autoencoders meet collaborative filtering. In: Proceedings of the 24th International Conference on World Wide Web, pp. 111–112 (2015) Sedhain, S., Menon, A.K., Sanner, S., Xie, L.: AutoRec: autoencoders meet collaborative filtering. In: Proceedings of the 24th International Conference on World Wide Web, pp. 111–112 (2015)
31.
go back to reference Shang, M., Yuan, Y., Luo, X., Zhou, M.: An \(\alpha \)-\(\beta \)-divergence-generalized recommender for highly accurate predictions of missing user preferences. IEEE Trans. Cybern. 52(8), 8006–8018 (2021)CrossRef Shang, M., Yuan, Y., Luo, X., Zhou, M.: An \(\alpha \)-\(\beta \)-divergence-generalized recommender for highly accurate predictions of missing user preferences. IEEE Trans. Cybern. 52(8), 8006–8018 (2021)CrossRef
32.
go back to reference Shao, B., Li, X., Bian, G.: A survey of research hotspots and frontier trends of recommendation systems from the perspective of knowledge graph. Expert Syst. Appl. 165, 113764 (2021)CrossRef Shao, B., Li, X., Bian, G.: A survey of research hotspots and frontier trends of recommendation systems from the perspective of knowledge graph. Expert Syst. Appl. 165, 113764 (2021)CrossRef
34.
go back to reference Shi, X., Kang, Q., An, J., Zhou, M.: Novel L1 regularized extreme learning machine for soft-sensing of an industrial process. IEEE Trans. Ind. Inf. 18(2), 1009–1017 (2021)CrossRef Shi, X., Kang, Q., An, J., Zhou, M.: Novel L1 regularized extreme learning machine for soft-sensing of an industrial process. IEEE Trans. Ind. Inf. 18(2), 1009–1017 (2021)CrossRef
35.
go back to reference Song, Y., Zhu, Z., Li, M., Yang, G., Luo, X.: Non-negative latent factor analysis-incorporated and feature-weighted fuzzy double c-means clustering for incomplete data. IEEE Trans. Fuzzy Syst. 30(10), 4165–4176 (2022)CrossRef Song, Y., Zhu, Z., Li, M., Yang, G., Luo, X.: Non-negative latent factor analysis-incorporated and feature-weighted fuzzy double c-means clustering for incomplete data. IEEE Trans. Fuzzy Syst. 30(10), 4165–4176 (2022)CrossRef
36.
go back to reference Tay, Y., Anh Tuan, L., Hui, S.C.: Latent relational metric learning via memory-based attention for collaborative ranking. In: Proceedings of the 2018 World Wide Web Conference, pp. 729–739 (2018) Tay, Y., Anh Tuan, L., Hui, S.C.: Latent relational metric learning via memory-based attention for collaborative ranking. In: Proceedings of the 2018 World Wide Web Conference, pp. 729–739 (2018)
39.
go back to reference Wang, X., Chen, H., Zhou, Y., Ma, J., Zhu, W.: Disentangled representation learning for recommendation. IEEE Trans. Pattern Anal. Mach. Intell. 45(1), 408–424 (2022)CrossRef Wang, X., Chen, H., Zhou, Y., Ma, J., Zhu, W.: Disentangled representation learning for recommendation. IEEE Trans. Pattern Anal. Mach. Intell. 45(1), 408–424 (2022)CrossRef
40.
go back to reference Wu, D., Luo, X.: Robust latent factor analysis for precise representation of high-dimensional and sparse data. IEEE/CAA J. Automatica Sinica 8(4), 796–805 (2021)MathSciNetCrossRef Wu, D., Luo, X.: Robust latent factor analysis for precise representation of high-dimensional and sparse data. IEEE/CAA J. Automatica Sinica 8(4), 796–805 (2021)MathSciNetCrossRef
43.
go back to reference Wu, H., Luo, X., Zhou, M., Rawa, M.J., Sedraoui, K., Albeshri, A.: A PID-incorporated latent factorization of tensors approach to dynamically weighted directed network analysis. IEEE/CAA J. Automatica Sinica 9(3), 533–546 (2021)CrossRef Wu, H., Luo, X., Zhou, M., Rawa, M.J., Sedraoui, K., Albeshri, A.: A PID-incorporated latent factorization of tensors approach to dynamically weighted directed network analysis. IEEE/CAA J. Automatica Sinica 9(3), 533–546 (2021)CrossRef
44.
go back to reference Yuan, Y., He, Q., Luo, X., Shang, M.: A multilayered-and-randomized latent factor model for high-dimensional and sparse matrices. IEEE Trans. Big Data 8(3), 784–794 (2020)CrossRef Yuan, Y., He, Q., Luo, X., Shang, M.: A multilayered-and-randomized latent factor model for high-dimensional and sparse matrices. IEEE Trans. Big Data 8(3), 784–794 (2020)CrossRef
46.
go back to reference Zhang, S., Yao, L., Wu, B., Xu, X., Zhang, X., Zhu, L.: Unraveling metric vector spaces with factorization for recommendation. IEEE Trans. Ind. Inf. 16(2), 732–742 (2019)CrossRef Zhang, S., Yao, L., Wu, B., Xu, X., Zhang, X., Zhu, L.: Unraveling metric vector spaces with factorization for recommendation. IEEE Trans. Ind. Inf. 16(2), 732–742 (2019)CrossRef
47.
go back to reference Zheng, Y., Wang, D.X.: A survey of recommender systems with multi-objective optimization. Neurocomputing 474, 141–153 (2022)CrossRef Zheng, Y., Wang, D.X.: A survey of recommender systems with multi-objective optimization. Neurocomputing 474, 141–153 (2022)CrossRef
Metadata
Title
MMA: Multi-Metric-Autoencoder for Analyzing High-Dimensional and Incomplete Data
Authors
Cheng Liang
Di Wu
Yi He
Teng Huang
Zhong Chen
Xin Luo
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-43424-2_1

Premium Partner