Skip to main content

2016 | OriginalPaper | Buchkapitel

Hyper-Parameter Tuning for Graph Kernels via Multiple Kernel Learning

verfasst von : Carlo M. Massimo, Nicolò Navarin, Alessandro Sperduti

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Kernelized learning algorithms have seen a steady growth in popularity during the last decades. The procedure to estimate the performances of these kernels in real applications is typical computationally demanding due to the process of hyper-parameter selection. This is especially true for graph kernels, which are computationally quite expensive. In this paper, we study an approach that substitutes the commonly adopted procedure for kernel hyper-parameter selection by a multiple kernel learning procedure that learns a linear combination of kernel matrices obtained by the same kernel with different values for the hyper-parameters. Empirical results on real-world graph datasets show that the proposed methodology is faster than the baseline method when the number of parameter configurations is large, while always maintaining comparable and in some cases superior performances.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
A graph where vertices are atoms and edges are chemical bonds; the label attached to each vertex reports the atom type.
 
Literatur
1.
Zurück zum Zitat Aiolli, F., Da San Martino, G., Sperduti, A.: A kernel method for the optimization of the margin distribution. In: Kůrková, V., Neruda, R., Koutník, J. (eds.) ICANN 2008, Part I. LNCS, vol. 5163, pp. 305–314. Springer, Heidelberg (2008)CrossRef Aiolli, F., Da San Martino, G., Sperduti, A.: A kernel method for the optimization of the margin distribution. In: Kůrková, V., Neruda, R., Koutník, J. (eds.) ICANN 2008, Part I. LNCS, vol. 5163, pp. 305–314. Springer, Heidelberg (2008)CrossRef
2.
Zurück zum Zitat Aiolli, F., Donini, M.: EasyMKL: a scalable multiple kernel learning algorithm. Neurocomputing 169, 215–224 (2015)CrossRef Aiolli, F., Donini, M.: EasyMKL: a scalable multiple kernel learning algorithm. Neurocomputing 169, 215–224 (2015)CrossRef
3.
Zurück zum Zitat Aiolli, F., Donini, M., Navarin, N., Sperduti, A.: Multiple graph-kernel learning. In: IEEE SSCI, Cape Town, pp. 1607–1614. IEEE (2015) Aiolli, F., Donini, M., Navarin, N., Sperduti, A.: Multiple graph-kernel learning. In: IEEE SSCI, Cape Town, pp. 1607–1614. IEEE (2015)
4.
Zurück zum Zitat Da San Martino, G., Navarin, N., Sperduti, A.: A tree-based kernel for graphs. In: SDM, pp. 975–986 (2012) Da San Martino, G., Navarin, N., Sperduti, A.: A tree-based kernel for graphs. In: SDM, pp. 975–986 (2012)
5.
Zurück zum Zitat Da San Martino, G., Navarin, N., Sperduti, A.: Ordered decompositional, DAG kernel enhancements. Neurocomputing 192, 92–103 (2016)CrossRef Da San Martino, G., Navarin, N., Sperduti, A.: Ordered decompositional, DAG kernel enhancements. Neurocomputing 192, 92–103 (2016)CrossRef
6.
Zurück zum Zitat Da San Martino, G., Sperduti, A.: Mining structured data. IEEE Comput. Intell. Mag. 5(1), 42–49 (2010)CrossRef Da San Martino, G., Sperduti, A.: Mining structured data. IEEE Comput. Intell. Mag. 5(1), 42–49 (2010)CrossRef
7.
Zurück zum Zitat Dobson, P.D., Doig, A.J.: Distinguishing enzyme structures from non-enzymes without alignments. J. Mol. Biol. 330(4), 771–783 (2003)CrossRef Dobson, P.D., Doig, A.J.: Distinguishing enzyme structures from non-enzymes without alignments. J. Mol. Biol. 330(4), 771–783 (2003)CrossRef
8.
9.
Zurück zum Zitat Hastie, T., Rosset, S., Tibshirani, R., Zhu, J.: The entire regularization path for the support vector machine. JMLR 5(2), 1391–1415 (2004)MathSciNetMATH Hastie, T., Rosset, S., Tibshirani, R., Zhu, J.: The entire regularization path for the support vector machine. JMLR 5(2), 1391–1415 (2004)MathSciNetMATH
10.
Zurück zum Zitat Helma, C., Cramer, T., Kramer, S., Raedt, L.D.: Data mining and machine learning techniques for the identification of mutagenicity inducing substructures and structure activity relationships of noncongeneric compounds. J. Chem. Inf. Model. 44(4), 1402–1411 (2004) Helma, C., Cramer, T., Kramer, S., Raedt, L.D.: Data mining and machine learning techniques for the identification of mutagenicity inducing substructures and structure activity relationships of noncongeneric compounds. J. Chem. Inf. Model. 44(4), 1402–1411 (2004)
11.
Zurück zum Zitat Navarin, N., Sperduti, A., Tesselli, R.: Extending local features with contextual information in graph kernels. In: Arik, S., Huang, T., Lai, W.K., Liu, Q. (eds.) ICONIP 2015. LNCS, vol. 9492, pp. 271–279. Springer, Heidelberg (2015). doi:10.1007/978-3-319-26561-2_33 CrossRef Navarin, N., Sperduti, A., Tesselli, R.: Extending local features with contextual information in graph kernels. In: Arik, S., Huang, T., Lai, W.K., Liu, Q. (eds.) ICONIP 2015. LNCS, vol. 9492, pp. 271–279. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-26561-2_​33 CrossRef
12.
Zurück zum Zitat Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, New York (2004)CrossRefMATH Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, New York (2004)CrossRefMATH
13.
Zurück zum Zitat Shervashidze, N., Borgwardt, K.M.: Fast subtree kernels on graphs. In: Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.) NIPS, pp. 1660–1668. Curran Associates Inc., Red Hook (2009) Shervashidze, N., Borgwardt, K.M.: Fast subtree kernels on graphs. In: Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.) NIPS, pp. 1660–1668. Curran Associates Inc., Red Hook (2009)
14.
Zurück zum Zitat Tesselli, R.: Adding contextual information to graph kernels. Master’s thesis, Università di Padova (2015) Tesselli, R.: Adding contextual information to graph kernels. Master’s thesis, Università di Padova (2015)
15.
Zurück zum Zitat Wale, N., Watson, I.A., Karypis, G.: Comparison of descriptor spaces for chemical compound retrieval and classification. Knowl. Inf. Syst. 14(3), 347–375 (2008)CrossRef Wale, N., Watson, I.A., Karypis, G.: Comparison of descriptor spaces for chemical compound retrieval and classification. Knowl. Inf. Syst. 14(3), 347–375 (2008)CrossRef
16.
Zurück zum Zitat Weislow, O.S., Kiser, R., Fine, D.L., Bader, J., Shoemaker, R.H., Boyd, M.R.: New soluble-formazan assay for HIV-1 cytopathic effects: application to high-flux screening of synthetic and natural products for AIDS-antiviral activity. J. Natl. Cancer Inst. 81(8), 577–586 (1989)CrossRef Weislow, O.S., Kiser, R., Fine, D.L., Bader, J., Shoemaker, R.H., Boyd, M.R.: New soluble-formazan assay for HIV-1 cytopathic effects: application to high-flux screening of synthetic and natural products for AIDS-antiviral activity. J. Natl. Cancer Inst. 81(8), 577–586 (1989)CrossRef
Metadaten
Titel
Hyper-Parameter Tuning for Graph Kernels via Multiple Kernel Learning
verfasst von
Carlo M. Massimo
Nicolò Navarin
Alessandro Sperduti
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46672-9_25