Skip to main content

2015 | OriginalPaper | Buchkapitel

An Informative Logistic Regression for Cross-Domain Image Classification

verfasst von : Guangtang Zhu, Hanfang Yang, Lan Lin, Guichun Zhou, Xiangdong Zhou

Erschienen in: Computer Vision Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cross-domain image classification is a challenge problem in numerous practical applications and has attracted a lot of interests from research and industry communities. It differs from traditional closed set image classification due to the variance between the training and testing datesets. Although the semantics of the image categories are the same, the image variance between testing and training often results in significant loss of performance. To solve the problem, most previous works resort to data pre-processing approaches, such as minimizing the difference between the distributions of the training and testing datasets. In this paper, we propose a novel informative feature preserving classifier for cross-domain image classification. We introduce the idea of maximizing the variance of unlabeled training data into a L1 based logistic regression model, so that the informative features can be preserved in the model training which consequently leads to performance improvement in the testing. Experiments conducted on commonly used benchmarks for cross-domain image classification show that our method significantly outperforms the state-of-the-art.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Scheirer, W.J., Rocha, A.R., Sapkota, A., Boult, T.E.: Toward open set recognition. Pattern Anal. Mach. Intell. 35(7), 1757–1772 (2013)CrossRef Scheirer, W.J., Rocha, A.R., Sapkota, A., Boult, T.E.: Toward open set recognition. Pattern Anal. Mach. Intell. 35(7), 1757–1772 (2013)CrossRef
2.
Zurück zum Zitat Baktashmotlagh, M., Harandi, M.T., Lovell, B.C., Salzmann, M.: Domain adaptation on the statistical manifold. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2481–2488 (2014) Baktashmotlagh, M., Harandi, M.T., Lovell, B.C., Salzmann, M.: Domain adaptation on the statistical manifold. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2481–2488 (2014)
3.
Zurück zum Zitat Pan, S.J., Yang, Q.: A survey on transfer learning. Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef Pan, S.J., Yang, Q.: A survey on transfer learning. Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef
4.
Zurück zum Zitat Long, M., Wang, J., Ding, G., Sun, J., Yu, P.S.: Transfer feature learning with joint distribution adaptation. In: ICCV, pp. 2200–2207 (2013) Long, M., Wang, J., Ding, G., Sun, J., Yu, P.S.: Transfer feature learning with joint distribution adaptation. In: ICCV, pp. 2200–2207 (2013)
5.
Zurück zum Zitat Gretton, A., Borgwardt, K.M., Rasch, M.J., Schölkopf, B., Smola, A.J.: A kernel method for the two-sample-problem. In: NIPS, pp. 513–520 (2006) Gretton, A., Borgwardt, K.M., Rasch, M.J., Schölkopf, B., Smola, A.J.: A kernel method for the two-sample-problem. In: NIPS, pp. 513–520 (2006)
6.
Zurück zum Zitat Dong, Y., Guo, H., Zhi, W., Fan, M.: Class imbalance oriented logistic regression. In: International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 187–192 (2014) Dong, Y., Guo, H., Zhi, W., Fan, M.: Class imbalance oriented logistic regression. In: International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 187–192 (2014)
7.
Zurück zum Zitat Tan, M., Tsang, I.W., Wang, L.: Minimax sparse logistic regression for very high-dimensional feature selection. Trans. Neural Netw. Learn. Syst. 24(10), 1609–1622 (2013)CrossRef Tan, M., Tsang, I.W., Wang, L.: Minimax sparse logistic regression for very high-dimensional feature selection. Trans. Neural Netw. Learn. Syst. 24(10), 1609–1622 (2013)CrossRef
8.
Zurück zum Zitat Zou, H., Hastie, T., Tibshirani, R.: Sparse principal component analysis. Comput. Graph. Stat. 15(2), 265–286 (2006)MathSciNetCrossRef Zou, H., Hastie, T., Tibshirani, R.: Sparse principal component analysis. Comput. Graph. Stat. 15(2), 265–286 (2006)MathSciNetCrossRef
9.
Zurück zum Zitat Naikal, N., Yang, A.Y., Sastry, S.: Informative feature selection for object recognition via sparse PCA. In: ICCV, pp. 818–825 (2011) Naikal, N., Yang, A.Y., Sastry, S.: Informative feature selection for object recognition via sparse PCA. In: ICCV, pp. 818–825 (2011)
10.
Zurück zum Zitat Shwartz, S.S., Tewari, A.: Stochastic methods for L1-regularized loss minimization. In: Machine Learning Research, pp. 1865–1892 (2011) Shwartz, S.S., Tewari, A.: Stochastic methods for L1-regularized loss minimization. In: Machine Learning Research, pp. 1865–1892 (2011)
11.
Zurück zum Zitat Yuan, G., Chang, K., Hsieh, C., Lin, C.: A comparison of optimization methods and software for large-scale L1-regularized linear classification. Mach. Learn. Res. 11, 3183–3234 (2010)MATHMathSciNet Yuan, G., Chang, K., Hsieh, C., Lin, C.: A comparison of optimization methods and software for large-scale L1-regularized linear classification. Mach. Learn. Res. 11, 3183–3234 (2010)MATHMathSciNet
12.
Zurück zum Zitat Bradley, J.K., Kyrola, A., Bickson, D., Guestrin, C.: Parallel coordinate descent for l1-regularized loss minimization. In: Proceedings of ICML, pp. 321–328 (2011) Bradley, J.K., Kyrola, A., Bickson, D., Guestrin, C.: Parallel coordinate descent for l1-regularized loss minimization. In: Proceedings of ICML, pp. 321–328 (2011)
13.
Zurück zum Zitat Shi, B.G.Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2066–2073 (2012) Shi, B.G.Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2066–2073 (2012)
14.
Zurück zum Zitat Hastie, T., Tibshirani, R.: The Elements of Statistical Learning. Springer, Heidelberg (2009)MATHCrossRef Hastie, T., Tibshirani, R.: The Elements of Statistical Learning. Springer, Heidelberg (2009)MATHCrossRef
15.
Zurück zum Zitat Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. Trans. neural Netw. 22(2), 199–210 (2011)CrossRef Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. Trans. neural Netw. 22(2), 199–210 (2011)CrossRef
16.
Zurück zum Zitat Long, M., Wang, J., Sun, J., Yu, P.S.: Domain invariant transfer kernel learning. Trans. Knowl. Data Eng. 11, 1–14 (2014) Long, M., Wang, J., Sun, J., Yu, P.S.: Domain invariant transfer kernel learning. Trans. Knowl. Data Eng. 11, 1–14 (2014)
17.
Zurück zum Zitat Long, M., Ding, G., Wang, J., Sun, J., Guo, Y., Yu, P.S.: Transfer sparse coding for robust image representation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 407–414 (2013) Long, M., Ding, G., Wang, J., Sun, J., Guo, Y., Yu, P.S.: Transfer sparse coding for robust image representation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 407–414 (2013)
18.
Zurück zum Zitat Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R.B., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of ACM International Conference on Multimedia, pp. 675–678 (2014) Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R.B., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of ACM International Conference on Multimedia, pp. 675–678 (2014)
19.
Zurück zum Zitat Tsuruoka, Y., Tsujii, J., Ananiadou, S.: Stochastic gradient descent training for L1-regularized log-linear models with cumulative penalty. In: ACL and AFNL, pp. 477–485 (2009) Tsuruoka, Y., Tsujii, J., Ananiadou, S.: Stochastic gradient descent training for L1-regularized log-linear models with cumulative penalty. In: ACL and AFNL, pp. 477–485 (2009)
20.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)
21.
Zurück zum Zitat Ji, C., Zhou, X., Lin, L., Yang, W.: Labeling images by integrating sparse multiple distance learning and semantic context modeling. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 688–701. Springer, Heidelberg (2012) CrossRef Ji, C., Zhou, X., Lin, L., Yang, W.: Labeling images by integrating sparse multiple distance learning and semantic context modeling. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 688–701. Springer, Heidelberg (2012) CrossRef
Metadaten
Titel
An Informative Logistic Regression for Cross-Domain Image Classification
verfasst von
Guangtang Zhu
Hanfang Yang
Lan Lin
Guichun Zhou
Xiangdong Zhou
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-20904-3_14