Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 1/2023

09-09-2022 | Original Article

Knowledge transfer based hierarchical few-shot learning via tree-structured knowledge graph

Authors: Zhong Zhang, Zhiping Wu, Hong Zhao, Minjie Hu

Published in: International Journal of Machine Learning and Cybernetics | Issue 1/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Few-shot learning poses a great challenge for obtaining a classifier that recognizes new classes from a few labeled examples. Existing solutions perform well by leveraging meta-learning models driven by data information. However, these models only utilize the flat data information and ignore the existing hierarchical knowledge structure among classes. In this paper, we propose a knowledge transfer based hierarchical few-shot learning model, which takes advantage of a tree-structured knowledge graph to facilitate the classification results. First, we consider a tree-structured class hierarchy according to the semantic information among classes as a knowledge graph to alleviate the low-data problem. Second, we divide the tree structure into class structure and data, and build a multi-layer classifier to obtain classification results in the two parts. Finally, we consider the tradeoff between structure loss and data loss for hierarchical few-shot learning, which takes class structure information to assist learning. Experimental results on benchmark datasets show that our model outperforms several state-of-the-art models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference AbuSalih B, AlTawil M, Aljarah I, Faris H, Wongthongtham P, Chan KY, Beheshti A (2021) Relational learning analysis of social politics using knowledge graph embedding. Data Min Knowl Disc 1–40 AbuSalih B, AlTawil M, Aljarah I, Faris H, Wongthongtham P, Chan KY, Beheshti A (2021) Relational learning analysis of social politics using knowledge graph embedding. Data Min Knowl Disc 1–40
2.
go back to reference Andrychowicz M, Denil M, Gomez S, Hoffman MW, Pfau D, Schaul T, De Freitas N (2016) Learning to learn by gradient descent by gradient descent. In: International conference on neural information processing systems Andrychowicz M, Denil M, Gomez S, Hoffman MW, Pfau D, Schaul T, De Freitas N (2016) Learning to learn by gradient descent by gradient descent. In: International conference on neural information processing systems
3.
go back to reference Ayoub A, Jia Z, Szepesvari C, Wang M, Yang L (2020) Model-based reinforcement learning with value-targeted regression. In: International conference on machine learning Ayoub A, Jia Z, Szepesvari C, Wang M, Yang L (2020) Model-based reinforcement learning with value-targeted regression. In: International conference on machine learning
4.
go back to reference Bellet A, Habrard A, Sebban M (2015) Metric learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 9(1):1–151MATH Bellet A, Habrard A, Sebban M (2015) Metric learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 9(1):1–151MATH
5.
go back to reference Chen Y, Liu Z, Xu H, Darrell T, Wang X (2021) Meta-baseline: exploring simple meta-learning for few-shot learning. In: IEEE/CVF International Conference on Computer Vision Chen Y, Liu Z, Xu H, Darrell T, Wang X (2021) Meta-baseline: exploring simple meta-learning for few-shot learning. In: IEEE/CVF International Conference on Computer Vision
6.
go back to reference Dekel O, Keshet J, Singer Y (2004) Large margin hierarchical classification. In: International Conference on Machine Learning Dekel O, Keshet J, Singer Y (2004) Large margin hierarchical classification. In: International Conference on Machine Learning
7.
go back to reference Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2D knowledge graph embeddings. In: Proceedings of the AAAI Conference on Artificial Intelligence
8.
go back to reference Dhillon GS, Chaudhari P, Ravichandran A, Soatto S (2020) A baseline for few-shot image classification. In: International Conference on Learning Representations Dhillon GS, Chaudhari P, Ravichandran A, Soatto S (2020) A baseline for few-shot image classification. In: International Conference on Learning Representations
9.
go back to reference Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A (2010) The pascal visual object classes (VOC) challenge. Int J Comput Vision 88(2):303–338CrossRef Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A (2010) The pascal visual object classes (VOC) challenge. Int J Comput Vision 88(2):303–338CrossRef
10.
go back to reference Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International Conference on Machine Learning Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International Conference on Machine Learning
11.
go back to reference Ge Y, Li S, Li X, Fan F, Xie W, You J, Liu X (2021) Embedding semantic hierarchy in discrete optimal transport for risk minimization. In: IEEE international conference on acoustics, speech and signal processing Ge Y, Li S, Li X, Fan F, Xie W, You J, Liu X (2021) Embedding semantic hierarchy in discrete optimal transport for risk minimization. In: IEEE international conference on acoustics, speech and signal processing
12.
go back to reference Guo S, Zhao H, Yang W (2021) Hierarchical feature selection with multi-granularity clustering structure. Inf Sci 568:448–462CrossRef Guo S, Zhao H, Yang W (2021) Hierarchical feature selection with multi-granularity clustering structure. Inf Sci 568:448–462CrossRef
13.
go back to reference He J, Hong R, Liu X, Xu M, Zha Z, Wang M (2020) Memory-augmented relation network for few-shot learning. In: International Conference on Multimedia He J, Hong R, Liu X, Xu M, Zha Z, Wang M (2020) Memory-augmented relation network for few-shot learning. In: International Conference on Multimedia
14.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
15.
go back to reference Hu Z, Li Z, Wang X, Zheng S (2022) Unsupervised descriptor selection based meta-learning networks for few-shot classification. Pattern Recogn 122:108304CrossRef Hu Z, Li Z, Wang X, Zheng S (2022) Unsupervised descriptor selection based meta-learning networks for few-shot classification. Pattern Recogn 122:108304CrossRef
16.
go back to reference Hui B, Zhu P, Hu Q, Wang Q (2019) Self-attention relation network for few-shot learning. In: IEEE International Conference on Multimedia and Expo Workshops Hui B, Zhu P, Hu Q, Wang Q (2019) Self-attention relation network for few-shot learning. In: IEEE International Conference on Multimedia and Expo Workshops
17.
go back to reference Jamal MA, Qi G (2019) Task agnostic meta-learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Jamal MA, Qi G (2019) Task agnostic meta-learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
18.
go back to reference Jiang R, Zhang J, Yan R, Tang H (2021) Few-shot learning in spiking neural networks by multi-timescale optimization. Neural Comput 33(9):2439–2472CrossRefMATH Jiang R, Zhang J, Yan R, Tang H (2021) Few-shot learning in spiking neural networks by multi-timescale optimization. Neural Comput 33(9):2439–2472CrossRefMATH
19.
go back to reference Kang D, Kwon H, Min J, Cho M (2021) Relational embedding for few-shot classification. In: IEEE/CVF International Conference on Computer Vision Kang D, Kwon H, Min J, Cho M (2021) Relational embedding for few-shot classification. In: IEEE/CVF International Conference on Computer Vision
20.
go back to reference Kosmopoulos A, Partalas I, Gaussier E, Paliouras G, Androutsopoulos I (2015) Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Min Knowl Disc 29(3):820–865CrossRefMATH Kosmopoulos A, Partalas I, Gaussier E, Paliouras G, Androutsopoulos I (2015) Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Min Knowl Disc 29(3):820–865CrossRefMATH
21.
go back to reference Kulis B et al (2012) Metric learning: a survey. Foundations and Trends in Machine. Learning 5(4):287–364MATH Kulis B et al (2012) Metric learning: a survey. Foundations and Trends in Machine. Learning 5(4):287–364MATH
22.
go back to reference Laenen S, Bertinetto L (2021) On episodes, prototypical networks, and few-shot learning. Adv Neural Inf Process Syst 34:24581–24592 Laenen S, Bertinetto L (2021) On episodes, prototypical networks, and few-shot learning. Adv Neural Inf Process Syst 34:24581–24592
23.
go back to reference Lee K, Maji S, Ravichandran A, Soatto S (2019) Meta-learning with differentiable convex optimization. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Lee K, Maji S, Ravichandran A, Soatto S (2019) Meta-learning with differentiable convex optimization. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
24.
go back to reference Li A, Luo T, Lu Z, Xiang T, Wang L (2019) Large-scale few-shot learning: knowledge transfer with class hierarchy. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Li A, Luo T, Lu Z, Xiang T, Wang L (2019) Large-scale few-shot learning: knowledge transfer with class hierarchy. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
25.
go back to reference Li D, Ju Y, Zou Q (2016) Protein folds prediction with hierarchical structured svm. Curr Proteomics 13(2):79–85CrossRef Li D, Ju Y, Zou Q (2016) Protein folds prediction with hierarchical structured svm. Curr Proteomics 13(2):79–85CrossRef
26.
go back to reference Li J, Li Y, Mi Y, Wu W (2020) Meso-granularity labeled method for multi-granularity formal concept analysis. Journal of Computer Research and Development 57(2):447–458 Li J, Li Y, Mi Y, Wu W (2020) Meso-granularity labeled method for multi-granularity formal concept analysis. Journal of Computer Research and Development 57(2):447–458
27.
go back to reference Li X, Sun Z, Xue JH, Ma Z (2021) A concise review of recent few-shot meta-learning methods. Neurocomputing 456:463–468CrossRef Li X, Sun Z, Xue JH, Ma Z (2021) A concise review of recent few-shot meta-learning methods. Neurocomputing 456:463–468CrossRef
28.
go back to reference Lim JY, Lim KM, Ooi SY, Lee CP (2021) Efficient-prototypicalnet with self knowledge distillation for few-shot learning. Neurocomputing 459:327–337CrossRef Lim JY, Lim KM, Ooi SY, Lee CP (2021) Efficient-prototypicalnet with self knowledge distillation for few-shot learning. Neurocomputing 459:327–337CrossRef
29.
go back to reference Liu Y, Lee J, Park M, Kim S, Yang E, Hwang S, Yang Y (2019) Learning to propagate labels: transductive propagation network for few-shot learning. In: International Conference on Learning Representations Liu Y, Lee J, Park M, Kim S, Yang E, Hwang S, Yang Y (2019) Learning to propagate labels: transductive propagation network for few-shot learning. In: International Conference on Learning Representations
30.
go back to reference Liu Z, Winata GI, Xu P, Fung P (2020) Coach: a coarse-to-fine approach for cross-domain slot filling. In: Annual Meeting of the Association for Computational Linguistics Liu Z, Winata GI, Xu P, Fung P (2020) Coach: a coarse-to-fine approach for cross-domain slot filling. In: Annual Meeting of the Association for Computational Linguistics
31.
go back to reference Löffler C, Reeb L, Dzibela D, Marzilger R, Witt N, Eskofier BM, Mutschler C (2021) Deep siamese metric learning: a highly scalable approach to searching unordered sets of trajectories. ACM Trans Intell Syst Technol 13(1):1–23CrossRef Löffler C, Reeb L, Dzibela D, Marzilger R, Witt N, Eskofier BM, Mutschler C (2021) Deep siamese metric learning: a highly scalable approach to searching unordered sets of trajectories. ACM Trans Intell Syst Technol 13(1):1–23CrossRef
32.
go back to reference Miller GA (1995) WordNet: a lexical database for english. Commun ACM 38(11):39–41CrossRef Miller GA (1995) WordNet: a lexical database for english. Commun ACM 38(11):39–41CrossRef
33.
go back to reference Oreshkin B, Rodriguez P, Lacoste A (2020) TADAM: task dependent adaptive metric for improved few-shot learning. In: International Conference on Neural Information Processing Systems Oreshkin B, Rodriguez P, Lacoste A (2020) TADAM: task dependent adaptive metric for improved few-shot learning. In: International Conference on Neural Information Processing Systems
34.
go back to reference Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: International Conference on Learning Representations Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: International Conference on Learning Representations
35.
go back to reference Ravichandran A, Bhotika R, Soatto S (2019) Few-shot learning with embedded class models and shot-free meta training. In: IEEE/CVF International Conference on Computer Vision Ravichandran A, Bhotika R, Soatto S (2019) Few-shot learning with embedded class models and shot-free meta training. In: IEEE/CVF International Conference on Computer Vision
36.
go back to reference Ren M, Triantafillou E, Ravi S, Snell J, Swersky K, Tenenbaum JB, Larochelle H, Zemel RS (2018) Meta-learning for semi-supervised few-shot classification. In: International Conference on Learning Representations Ren M, Triantafillou E, Ravi S, Snell J, Swersky K, Tenenbaum JB, Larochelle H, Zemel RS (2018) Meta-learning for semi-supervised few-shot classification. In: International Conference on Learning Representations
37.
go back to reference Rossi A, Barbosa D, Firmani D, Matinata A, Merialdo P (2021) Knowledge graph embedding for link prediction: a comparative analysis. ACM Trans Knowl Discov Data 15(2):1–49CrossRef Rossi A, Barbosa D, Firmani D, Matinata A, Merialdo P (2021) Knowledge graph embedding for link prediction: a comparative analysis. ACM Trans Knowl Discov Data 15(2):1–49CrossRef
38.
go back to reference Simon C, Koniusz P, Nock R, Harandi M (2020) Adaptive subspaces for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Simon C, Koniusz P, Nock R, Harandi M (2020) Adaptive subspaces for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
39.
go back to reference Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: International Conference on Neural Information Processing Systems Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: International Conference on Neural Information Processing Systems
40.
go back to reference Sun Q, Liu Y, Chua TS, Schiele B (2019) Meta-transfer learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Sun Q, Liu Y, Chua TS, Schiele B (2019) Meta-transfer learning for few-shot learning. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
41.
go back to reference Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to compare: relation network for few-shot learning. In: IEEE Conference on Computer Vision and Pattern Recognition Sung F, Yang Y, Zhang L, Xiang T, Torr PH, Hospedales TM (2018) Learning to compare: relation network for few-shot learning. In: IEEE Conference on Computer Vision and Pattern Recognition
42.
go back to reference Tian Y, Wang Y, Krishnan D, Tenenbaum JB, Isola P (2020) Rethinking few-shot image classification: a good embedding is all you need? In: European Conference on Computer Vision Tian Y, Wang Y, Krishnan D, Tenenbaum JB, Isola P (2020) Rethinking few-shot image classification: a good embedding is all you need? In: European Conference on Computer Vision
43.
go back to reference Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: International Conference on Neural Information Processing Systems Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: International Conference on Neural Information Processing Systems
44.
go back to reference Wang G (2017) DGCC: data-driven granular cognitive computing. Granular Computing 2(4):343–355CrossRef Wang G (2017) DGCC: data-driven granular cognitive computing. Granular Computing 2(4):343–355CrossRef
45.
go back to reference Wang S, Zhu W (2018) Sparse graph embedding unsupervised feature selection. IEEE Transactions on Systems Man and Cybernetics Systems 48(3):329–341CrossRef Wang S, Zhu W (2018) Sparse graph embedding unsupervised feature selection. IEEE Transactions on Systems Man and Cybernetics Systems 48(3):329–341CrossRef
46.
go back to reference Wang X, Li J (2020) New advances in three-way decision, granular computing and concept lattice. Int J Mach Learn Cybern 11(5):945–946CrossRef Wang X, Li J (2020) New advances in three-way decision, granular computing and concept lattice. Int J Mach Learn Cybern 11(5):945–946CrossRef
47.
go back to reference Wang X, Wang P, Yang X, Yao Y (2021) Attribution reduction based on sequential three-way search of granularity. International Journal of Machine Learning and Cybernetics 12(5):1439–1458CrossRef Wang X, Wang P, Yang X, Yao Y (2021) Attribution reduction based on sequential three-way search of granularity. International Journal of Machine Learning and Cybernetics 12(5):1439–1458CrossRef
48.
go back to reference Wang Y, Wang Z, Hu Q, Zhou Y, Su H (2021) Hierarchical semantic risk minimization for large-scale classification, IEEE Transactions on Cybernetics, 1–13 Wang Y, Wang Z, Hu Q, Zhou Y, Su H (2021) Hierarchical semantic risk minimization for large-scale classification, IEEE Transactions on Cybernetics, 1–13
49.
go back to reference Yang F, Wang R, Chen X (2022) SEGA: semantic guided attention on visual prototype for few-shot learning. In: IEEE/CVF Winter Conference on Applications of Computer Vision Yang F, Wang R, Chen X (2022) SEGA: semantic guided attention on visual prototype for few-shot learning. In: IEEE/CVF Winter Conference on Applications of Computer Vision
50.
go back to reference Yang J, Wang G, Zhang Q (2018) Knowledge distance measure in multigranulation spaces of fuzzy equivalence relations. Inf Sci 448:18–35CrossRefMATH Yang J, Wang G, Zhang Q (2018) Knowledge distance measure in multigranulation spaces of fuzzy equivalence relations. Inf Sci 448:18–35CrossRefMATH
51.
go back to reference Ye H, Hu H, Zhan D, Sha F (2020) Few-shot learning via embedding adaptation with set-to-set functions. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Ye H, Hu H, Zhan D, Sha F (2020) Few-shot learning via embedding adaptation with set-to-set functions. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
52.
go back to reference Zhang C, Cai Y, Lin G, Shen C (2020) DeepEMD: few-shot image classification with differentiable earth mover’s distance and structured classifiers. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Zhang C, Cai Y, Lin G, Shen C (2020) DeepEMD: few-shot image classification with differentiable earth mover’s distance and structured classifiers. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition
54.
go back to reference Zhao H, Hu Q, Zhu P, Wang Y, Wang P (2021) A recursive regularization based feature selection framework for hierarchical classification. IEEE Trans Knowl Data Eng 33(7):2833–2846CrossRef Zhao H, Hu Q, Zhu P, Wang Y, Wang P (2021) A recursive regularization based feature selection framework for hierarchical classification. IEEE Trans Knowl Data Eng 33(7):2833–2846CrossRef
55.
go back to reference Zhu Q, Mao Q, Jia H, Noi OEN, Tu J (2022) Convolutional relation network for facial expression recognition in the wild with few-shot learning. Expert Syst Appl 189:116046CrossRef Zhu Q, Mao Q, Jia H, Noi OEN, Tu J (2022) Convolutional relation network for facial expression recognition in the wild with few-shot learning. Expert Syst Appl 189:116046CrossRef
Metadata
Title
Knowledge transfer based hierarchical few-shot learning via tree-structured knowledge graph
Authors
Zhong Zhang
Zhiping Wu
Hong Zhao
Minjie Hu
Publication date
09-09-2022
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 1/2023
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01640-5

Other articles of this Issue 1/2023

International Journal of Machine Learning and Cybernetics 1/2023 Go to the issue