Skip to main content

2016 | OriginalPaper | Buchkapitel

Multi-label Active Learning Based on Maximum Correntropy Criterion: Towards Robust and Discriminative Labeling

verfasst von : Zengmao Wang, Bo Du, Lefei Zhang, Liangpei Zhang, Meng Fang, Dacheng Tao

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-label learning is a challenging problem in computer vision field. In this paper, we propose a novel active learning approach to reduce the annotation costs greatly for multi-label classification. State-of-the-art active learning methods either annotate all the relevant samples without diagnosing discriminative information in the labels or annotate only limited discriminative samples manually, that has weak immunity for the outlier labels. To overcome these problems, we propose a multi-label active learning method based on Maximum Correntropy Criterion (MCC) by merging uncertainty and representativeness. We use the the labels of labeled data and the prediction labels of unknown data to enhance the uncertainty and representativeness measurement by merging strategy, and use the MCC to alleviate the influence of outlier labels for discriminative labeling. Experiments on several challenging benchmark multi-label datasets show the superior performance of our proposed method to the state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agrawal, P., Girshick, R., Malik, J.: Analyzing the performance of multilayer neural networks for object recognition. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 329–344. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10584-0_22 Agrawal, P., Girshick, R., Malik, J.: Analyzing the performance of multilayer neural networks for object recognition. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 329–344. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10584-0_​22
2.
Zurück zum Zitat Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural Parallel Sci. Comput. 11(4), 351–368 (2003)MathSciNetMATH Bezdek, J.C., Hathaway, R.J.: Convergence of alternating optimization. Neural Parallel Sci. Comput. 11(4), 351–368 (2003)MathSciNetMATH
3.
Zurück zum Zitat Boyd, S., Vandenberghe, L.: Convex optimization. Cambridge University Press, Cambridge (2004)CrossRefMATH Boyd, S., Vandenberghe, L.: Convex optimization. Cambridge University Press, Cambridge (2004)CrossRefMATH
4.
Zurück zum Zitat Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)CrossRefMATH Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)CrossRefMATH
5.
Zurück zum Zitat Chakraborty, S., Balasubramanian, V., Sun, Q., Panchanathan, S., Ye, J.: Active batch selection via convex relaxations with guaranteed solution bounds. TPAMI 37(10), 1945–1958 (2015)CrossRef Chakraborty, S., Balasubramanian, V., Sun, Q., Panchanathan, S., Ye, J.: Active batch selection via convex relaxations with guaranteed solution bounds. TPAMI 37(10), 1945–1958 (2015)CrossRef
6.
Zurück zum Zitat Chen, X., Shrivastava, A., Gupta, A.: Neil: extracting visual knowledge from web data. In: CVPR, pp. 1409–1416 (2013) Chen, X., Shrivastava, A., Gupta, A.: Neil: extracting visual knowledge from web data. In: CVPR, pp. 1409–1416 (2013)
7.
Zurück zum Zitat Chen, Y., Krause, A.: Near-optimal batch mode active learning and adaptive submodular optimization. In: CVPR, pp. 160–168 (2013) Chen, Y., Krause, A.: Near-optimal batch mode active learning and adaptive submodular optimization. In: CVPR, pp. 160–168 (2013)
8.
Zurück zum Zitat Elhamifar, E., Sapiro, G., Yang, A., Sasrty, S.: A convex optimization framework for active learning. In: ICCV, pp. 209–216 (2013) Elhamifar, E., Sapiro, G., Yang, A., Sasrty, S.: A convex optimization framework for active learning. In: ICCV, pp. 209–216 (2013)
9.
Zurück zum Zitat Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: Liblinear: a library for large linear classification. JMLR 9, 1871–1874 (2008)MATH Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: Liblinear: a library for large linear classification. JMLR 9, 1871–1874 (2008)MATH
10.
Zurück zum Zitat Freytag, A., Rodner, E., Denzler, J.: Selecting influential examples: active learning with expected model output changes. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 562–577. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10593-2_37 Freytag, A., Rodner, E., Denzler, J.: Selecting influential examples: active learning with expected model output changes. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 562–577. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10593-2_​37
11.
Zurück zum Zitat He, R., Tan, T., Wang, L., Zheng, W.S.: \(l_{2,1}\) regularized correntropy for robust feature selection. In: CVPR, pp. 2504–2511. IEEE (2012) He, R., Tan, T., Wang, L., Zheng, W.S.: \(l_{2,1}\) regularized correntropy for robust feature selection. In: CVPR, pp. 2504–2511. IEEE (2012)
12.
Zurück zum Zitat He, R., Zheng, W.S., Hu, B.G.: Maximum correntropy criterion for robust face recognition. CVPR 33(8), 1561–1576 (2011) He, R., Zheng, W.S., Hu, B.G.: Maximum correntropy criterion for robust face recognition. CVPR 33(8), 1561–1576 (2011)
13.
Zurück zum Zitat He, R., Zheng, W.S., Tan, T., Sun, Z.: Half-quadratic-based iterative minimization for robust sparse representation. TPAMI 36(2), 261–275 (2014)CrossRef He, R., Zheng, W.S., Tan, T., Sun, Z.: Half-quadratic-based iterative minimization for robust sparse representation. TPAMI 36(2), 261–275 (2014)CrossRef
14.
Zurück zum Zitat Huang, S.J., Chen, S., Zhou, Z.H.: Multi-label active learning: query type matters. In: IJCAI, pp. 946–952. AAAI Press (2015) Huang, S.J., Chen, S., Zhou, Z.H.: Multi-label active learning: query type matters. In: IJCAI, pp. 946–952. AAAI Press (2015)
15.
Zurück zum Zitat Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples. TPAMI 36(10), 1936–1949 (2014)CrossRef Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples. TPAMI 36(10), 1936–1949 (2014)CrossRef
16.
Zurück zum Zitat Huang, S.J., Zhou, Z.H.: Active query driven by uncertainty and diversity for incremental multi-label learning. In: ICDM, pp. 1079–1084. IEEE (2013) Huang, S.J., Zhou, Z.H.: Active query driven by uncertainty and diversity for incremental multi-label learning. In: ICDM, pp. 1079–1084. IEEE (2013)
17.
Zurück zum Zitat Jing, L., Yang, L., Yu, J., Ng, M.K.: Semi-supervised low-rank mapping learning for multi-label classification. In: CVPR, June 2015 Jing, L., Yang, L., Yu, J., Ng, M.K.: Semi-supervised low-rank mapping learning for multi-label classification. In: CVPR, June 2015
18.
Zurück zum Zitat Kading, C., Freytag, A., Rodner, E., Bodesheim, P., Denzler, J.: Active learning and discovery of object categories in the presence of unnameable instances. In: CVPR, pp. 4343–4352. IEEE (2015) Kading, C., Freytag, A., Rodner, E., Bodesheim, P., Denzler, J.: Active learning and discovery of object categories in the presence of unnameable instances. In: CVPR, pp. 4343–4352. IEEE (2015)
19.
Zurück zum Zitat Li, X.X., Dai, D.Q., Zhang, X.F., Ren, C.X.: Structured sparse error coding for face recognition with occlusion. TIP 22(5), 1889–1900 (2013)MathSciNet Li, X.X., Dai, D.Q., Zhang, X.F., Ren, C.X.: Structured sparse error coding for face recognition with occlusion. TIP 22(5), 1889–1900 (2013)MathSciNet
20.
Zurück zum Zitat Li, X., Guo, Y.: Active learning with multi-label SVM classification. In: IJCAI. Citeseer (2013) Li, X., Guo, Y.: Active learning with multi-label SVM classification. In: IJCAI. Citeseer (2013)
21.
Zurück zum Zitat Li, X., Guo, Y.: Multi-level adaptive active learning for scene classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 234–249. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10584-0_16 Li, X., Guo, Y.: Multi-level adaptive active learning for scene classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 234–249. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10584-0_​16
22.
Zurück zum Zitat Liu, C., Yuen, J., Torralba, A., Sivic, J., Freeman, W.T.: SIFT flow: dense correspondence across different scenes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5304, pp. 28–42. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88690-7_3 CrossRef Liu, C., Yuen, J., Torralba, A., Sivic, J., Freeman, W.T.: SIFT flow: dense correspondence across different scenes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5304, pp. 28–42. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-88690-7_​3 CrossRef
23.
25.
Zurück zum Zitat Long, C., Hua, G.: Multi-class multi-annotator active learning with robust gaussian process for visual recognition. In: ICCV, December 2015 Long, C., Hua, G.: Multi-class multi-annotator active learning with robust gaussian process for visual recognition. In: ICCV, December 2015
26.
Zurück zum Zitat Mac Aodha, O., Campbell, N., Kautz, J., Brostow, G.: Hierarchical subquery evaluation for active learning on a graph. In: CVPR, pp. 564–571 (2014) Mac Aodha, O., Campbell, N., Kautz, J., Brostow, G.: Hierarchical subquery evaluation for active learning on a graph. In: CVPR, pp. 564–571 (2014)
27.
Zurück zum Zitat Qian, J., Yang, J., Zhang, F., Lin, Z.: Robust low-rank regularized regression for face recognition with occlusion. In: CVPRW, pp. 21–26 (2014) Qian, J., Yang, J., Zhang, F., Lin, Z.: Robust low-rank regularized regression for face recognition with occlusion. In: CVPRW, pp. 21–26 (2014)
28.
Zurück zum Zitat Settles, B.: Active learning literature survey. University of Wisconsin, Madison, vol. 52, no. 55–66, p. 11 (2010) Settles, B.: Active learning literature survey. University of Wisconsin, Madison, vol. 52, no. 55–66, p. 11 (2010)
30.
Zurück zum Zitat Singh, G., Kosecka, J.: Nonparametric scene parsing with adaptive feature relevance and semantic context. In: CVPR, pp. 3151–3157 (2013) Singh, G., Kosecka, J.: Nonparametric scene parsing with adaptive feature relevance and semantic context. In: CVPR, pp. 3151–3157 (2013)
31.
Zurück zum Zitat Singh, M., Curran, E., Cunningham, P.: Active learning for multi-label image annotation. In: ICAIC, pp. 173–182 (2009) Singh, M., Curran, E., Cunningham, P.: Active learning for multi-label image annotation. In: ICAIC, pp. 173–182 (2009)
32.
Zurück zum Zitat Tao, D., Li, X., Xindong, W., Maybank, S.: General tensor discriminant analysis and gabor features for gait recognition. TPAMI 29(10), 1700–1715 (2007)CrossRef Tao, D., Li, X., Xindong, W., Maybank, S.: General tensor discriminant analysis and gabor features for gait recognition. TPAMI 29(10), 1700–1715 (2007)CrossRef
33.
Zurück zum Zitat Tao, D., Li, X., Xindong, W., Maybank, S.: Geometric mean for subspace selection. TPAMI 31(2), 260–274 (2009)CrossRef Tao, D., Li, X., Xindong, W., Maybank, S.: Geometric mean for subspace selection. TPAMI 31(2), 260–274 (2009)CrossRef
34.
Zurück zum Zitat Tao, D., Tang, X., Li, X., Wu, X.: Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. TPAMI 28(7), 1088–1099 (2006)CrossRef Tao, D., Tang, X., Li, X., Wu, X.: Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. TPAMI 28(7), 1088–1099 (2006)CrossRef
35.
Zurück zum Zitat Vijayanarasimhan, S., Grauman, K.: Large-scale live active learning: training object detectors with crawled data and crowds. IJCV 108(1–2), 97–114 (2014)MathSciNetCrossRef Vijayanarasimhan, S., Grauman, K.: Large-scale live active learning: training object detectors with crawled data and crowds. IJCV 108(1–2), 97–114 (2014)MathSciNetCrossRef
36.
Zurück zum Zitat Xiong, X., Torre, F.: Supervised descent method and its applications to face alignment. In: CVPR, pp. 532–539 (2013) Xiong, X., Torre, F.: Supervised descent method and its applications to face alignment. In: CVPR, pp. 532–539 (2013)
37.
Zurück zum Zitat Xu, C., Tao, D., Xu, C.: Multi-view intact space learning. TPAMI 37(12), 2531–2544 (2015)CrossRef Xu, C., Tao, D., Xu, C.: Multi-view intact space learning. TPAMI 37(12), 2531–2544 (2015)CrossRef
38.
Zurück zum Zitat Yan, R., Yang, J., Hauptmann, A.: Automatically labeling video data using multi-class active learning. In: CVPR, pp. 516–523. IEEE (2003) Yan, R., Yang, J., Hauptmann, A.: Automatically labeling video data using multi-class active learning. In: CVPR, pp. 516–523. IEEE (2003)
39.
Zurück zum Zitat Yang, Y., Ma, Z., Nie, F., Chang, X., Hauptmann, A.G.: Multi-class active learning by uncertainty sampling with diversity maximization. IJCV 113(2), 113–127 (2015)MathSciNetCrossRef Yang, Y., Ma, Z., Nie, F., Chang, X., Hauptmann, A.G.: Multi-class active learning by uncertainty sampling with diversity maximization. IJCV 113(2), 113–127 (2015)MathSciNetCrossRef
40.
Zurück zum Zitat Yuan, X.T., Hu, B.G.: Robust feature extraction via information theoretic learning. In: ICML. ACM (2009) Yuan, X.T., Hu, B.G.: Robust feature extraction via information theoretic learning. In: ICML. ACM (2009)
41.
Zurück zum Zitat Zha, Z.J., Wang, M., Zheng, Y.T., Yang, Y., Hong, R., Chua, T.S.: Interactive video indexing with statistical active learning. TMM 14(1), 17–27 (2012) Zha, Z.J., Wang, M., Zheng, Y.T., Yang, Y., Hong, R., Chua, T.S.: Interactive video indexing with statistical active learning. TMM 14(1), 17–27 (2012)
42.
Zurück zum Zitat Zhao, F., Huang, Y., Wang, L., Tan, T.: Deep semantic ranking based hashing for multi-label image retrieval. In: CVPR, June 2015 Zhao, F., Huang, Y., Wang, L., Tan, T.: Deep semantic ranking based hashing for multi-label image retrieval. In: CVPR, June 2015
Metadaten
Titel
Multi-label Active Learning Based on Maximum Correntropy Criterion: Towards Robust and Discriminative Labeling
verfasst von
Zengmao Wang
Bo Du
Lefei Zhang
Liangpei Zhang
Meng Fang
Dacheng Tao
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46487-9_28