Skip to main content

2018 | OriginalPaper | Buchkapitel

Affinity Propagation Based Closed-Form Semi-supervised Metric Learning Framework

verfasst von : Ujjal Kr Dutta, C. Chandra Sekhar

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recent state-of-the-art deep metric learning approaches require large number of labeled examples for their success. They cannot directly exploit unlabeled data. When labeled data is scarce, it is very essential to be able to make use of additionally available unlabeled data to learn a distance metric in a semi-supervised manner. Despite the presence of a few traditional, non-deep semi-supervised metric learning approaches, they mostly rely on the min-max principle to encode the pairwise constraints, although there are a number of other ways as offered by traditional weakly-supervised metric learning approaches. Moreover, there is no flow of information from the available pairwise constraints to the unlabeled data, which could be beneficial. This paper proposes to learn a new metric by constraining it to be close to a prior metric while propagating the affinities among pairwise constraints to the unlabeled data via a closed-form solution. The choice of a different prior metric thus enables encoding of the pairwise constraints by following formulations other than the min-max principle.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Atzmon, Y., Shalit, U., Chechik, G.: Learning sparse metrics, one feature at a time. J. Mach. Learn. Res. (JMLR) 1, 1–48 (2015) Atzmon, Y., Shalit, U., Chechik, G.: Learning sparse metrics, one feature at a time. J. Mach. Learn. Res. (JMLR) 1, 1–48 (2015)
2.
Zurück zum Zitat Baghshah, M.S., Shouraki, S.B.: Semi-supervised metric learning using pairwise constraints. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 1217–1222 (2009) Baghshah, M.S., Shouraki, S.B.: Semi-supervised metric learning using pairwise constraints. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 1217–1222 (2009)
3.
Zurück zum Zitat Bhojanapalli, S., Boumal, N., Jain, P., Netrapalli, P.: Smoothed analysis for low-rank solutions to semidefinite programs in quadratic penalty form. arXiv preprint arXiv:1803.00186 (2018) Bhojanapalli, S., Boumal, N., Jain, P., Netrapalli, P.: Smoothed analysis for low-rank solutions to semidefinite programs in quadratic penalty form. arXiv preprint arXiv:​1803.​00186 (2018)
4.
Zurück zum Zitat Bhojanapalli, S., Kyrillidis, A., Sanghavi, S.: Dropping convexity for faster semi-definite optimization. In: Proceedings of Conference on Learning Theory (COLT), pp. 530–582 (2016) Bhojanapalli, S., Kyrillidis, A., Sanghavi, S.: Dropping convexity for faster semi-definite optimization. In: Proceedings of Conference on Learning Theory (COLT), pp. 530–582 (2016)
5.
Zurück zum Zitat Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from national university of Singapore. In: Proceedings of ACM International Conference on Image and Video Retrieval (CIVR), p. 48 (2009) Chua, T.S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.: NUS-WIDE: a real-world web image database from national university of Singapore. In: Proceedings of ACM International Conference on Image and Video Retrieval (CIVR), p. 48 (2009)
6.
Zurück zum Zitat Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proceedings of International Conference on Machine Learning (ICML), pp. 209–216 (2007) Davis, J.V., Kulis, B., Jain, P., Sra, S., Dhillon, I.S.: Information-theoretic metric learning. In: Proceedings of International Conference on Machine Learning (ICML), pp. 209–216 (2007)
7.
Zurück zum Zitat Dong, W., Moses, C., Li, K.: Efficient k-nearest neighbor graph construction for generic similarity measures. In: Proceedings of International Conference on World Wide Web (WWW), pp. 577–586. ACM (2011) Dong, W., Moses, C., Li, K.: Efficient k-nearest neighbor graph construction for generic similarity measures. In: Proceedings of International Conference on World Wide Web (WWW), pp. 577–586. ACM (2011)
8.
Zurück zum Zitat Duan, Y., Zheng, W., Lin, X., Lu, J., Zhou, J.: Deep adversarial metric learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2780–2789 (2018) Duan, Y., Zheng, W., Lin, X., Lu, J., Zhou, J.: Deep adversarial metric learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2780–2789 (2018)
9.
Zurück zum Zitat Faraki, M., Harandi, M.T., Porikli, F.: Large-scale metric learning: a voyage from shallow to deep. IEEE Trans. Neural Netw. Learn. Syst. 29(9), 4339–4346 (2018)CrossRef Faraki, M., Harandi, M.T., Porikli, F.: Large-scale metric learning: a voyage from shallow to deep. IEEE Trans. Neural Netw. Learn. Syst. 29(9), 4339–4346 (2018)CrossRef
10.
Zurück zum Zitat Gray, D., Brennan, S., Tao, H.: Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE International Workshop on Performance Evaluation for Tracking and Surveillance (PETS), vol. 3 (2007) Gray, D., Brennan, S., Tao, H.: Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE International Workshop on Performance Evaluation for Tracking and Surveillance (PETS), vol. 3 (2007)
11.
Zurück zum Zitat Harandi, M., Salzmann, M., Hartley, R.: Joint dimensionality reduction and metric learning: a geometric take. In: Proceedings of International Conference on Machine Learning (ICML) (2017) Harandi, M., Salzmann, M., Hartley, R.: Joint dimensionality reduction and metric learning: a geometric take. In: Proceedings of International Conference on Machine Learning (ICML) (2017)
12.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
13.
Zurück zum Zitat He, X., Niyogi, P.: Locality preserving projections. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 153–160 (2003) He, X., Niyogi, P.: Locality preserving projections. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 153–160 (2003)
14.
Zurück zum Zitat Hoi, S.C., Liu, W., Chang, S.F.: Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Trans. Multimed. Comput. Commun. Appl. 6(3), 18 (2010)CrossRef Hoi, S.C., Liu, W., Chang, S.F.: Semi-supervised distance metric learning for collaborative image retrieval and clustering. ACM Trans. Multimed. Comput. Commun. Appl. 6(3), 18 (2010)CrossRef
15.
Zurück zum Zitat Iscen, A., Tolias, G., Avrithis, Y., Chum, O.: Mining on manifolds: metric learning without labels. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018) Iscen, A., Tolias, G., Avrithis, Y., Chum, O.: Mining on manifolds: metric learning without labels. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018)
16.
Zurück zum Zitat Koestinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2288–2295 (2012) Koestinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2288–2295 (2012)
17.
Zurück zum Zitat Liu, W., Ma, S., Tao, D., Liu, J., Liu, P.: Semi-supervised sparse metric learning using alternating linearization optimization. In: Proc. of ACM International Conference on Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD), pp. 1139–1148 (2010) Liu, W., Ma, S., Tao, D., Liu, J., Liu, P.: Semi-supervised sparse metric learning using alternating linearization optimization. In: Proc. of ACM International Conference on Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD), pp. 1139–1148 (2010)
18.
Zurück zum Zitat Movshovitz-Attias, Y., Toshev, A., Leung, T.K., Ioffe, S., Singh, S.: No fuss distance metric learning using proxies. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2017) Movshovitz-Attias, Y., Toshev, A., Leung, T.K., Ioffe, S., Singh, S.: No fuss distance metric learning using proxies. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2017)
19.
Zurück zum Zitat Niu, G., Dai, B., Yamada, M., Sugiyama, M.: Information-theoretic semi-supervised metric learning via entropy regularization. Neural Comput. 26(8), 1717–1762 (2014)MathSciNetCrossRef Niu, G., Dai, B., Yamada, M., Sugiyama, M.: Information-theoretic semi-supervised metric learning via entropy regularization. Neural Comput. 26(8), 1717–1762 (2014)MathSciNetCrossRef
20.
Zurück zum Zitat Oh Song, H., Xiang, Y., Jegelka, S., Savarese, S.: Deep metric learning via lifted structured feature embedding. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4004–4012 (2016) Oh Song, H., Xiang, Y., Jegelka, S., Savarese, S.: Deep metric learning via lifted structured feature embedding. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4004–4012 (2016)
21.
Zurück zum Zitat Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823 (2015) Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823 (2015)
22.
Zurück zum Zitat Sohn, K.: Improved deep metric learning with multi-class n-pair loss objective. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 1857–1865 (2016) Sohn, K.: Improved deep metric learning with multi-class n-pair loss objective. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 1857–1865 (2016)
23.
Zurück zum Zitat Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9 (2015) Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9 (2015)
24.
Zurück zum Zitat Wah, C., Branson, S., Welinder, P., Perona, P., Belongie, S.: The Caltech-UCSD Birds-200-2011 Dataset. Technical report (2011) Wah, C., Branson, S., Welinder, P., Perona, P., Belongie, S.: The Caltech-UCSD Birds-200-2011 Dataset. Technical report (2011)
25.
Zurück zum Zitat Wang, J., Zhou, F., Wen, S., Liu, X., Lin, Y.: Deep metric learning with angular loss. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2017) Wang, J., Zhou, F., Wen, S., Liu, X., Lin, Y.: Deep metric learning with angular loss. In: Proceedings of IEEE International Conference on Computer Vision (ICCV) (2017)
26.
Zurück zum Zitat Xian, Y., Lampert, C.H., Schiele, B., Akata, Z.: Zero-shot learning-a comprehensive evaluation of the good, the bad and the ugly. arXiv preprint arXiv:1707.00600 (2017) Xian, Y., Lampert, C.H., Schiele, B., Akata, Z.: Zero-shot learning-a comprehensive evaluation of the good, the bad and the ugly. arXiv preprint arXiv:​1707.​00600 (2017)
27.
Zurück zum Zitat Ying, S., Wen, Z., Shi, J., Peng, Y., Peng, J., Qiao, H.: Manifold preserving: an intrinsic approach for semisupervised distance metric learning. IEEE Trans. Neural Netw. Learn. Syst. (2017) Ying, S., Wen, Z., Shi, J., Peng, Y., Peng, J., Qiao, H.: Manifold preserving: an intrinsic approach for semisupervised distance metric learning. IEEE Trans. Neural Netw. Learn. Syst. (2017)
28.
Zurück zum Zitat Zadeh, P., Hosseini, R., Sra, S.: Geometric mean metric learning. In: Proceedings of International Conference on Machine Learning (ICML), pp. 2464–2471 (2016) Zadeh, P., Hosseini, R., Sra, S.: Geometric mean metric learning. In: Proceedings of International Conference on Machine Learning (ICML), pp. 2464–2471 (2016)
Metadaten
Titel
Affinity Propagation Based Closed-Form Semi-supervised Metric Learning Framework
verfasst von
Ujjal Kr Dutta
C. Chandra Sekhar
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_55