Skip to main content

2018 | OriginalPaper | Buchkapitel

Kernel Graph Convolutional Neural Networks

verfasst von : Giannis Nikolentzos, Polykarpos Meladianos, Antoine Jean-Pierre Tixier, Konstantinos Skianis, Michalis Vazirgiannis

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph kernels have been successfully applied to many graph classification problems. Typically, a kernel is first designed, and then an SVM classifier is trained based on the features defined implicitly by this kernel. This two-stage approach decouples data representation from learning, which is suboptimal. On the other hand, Convolutional Neural Networks (CNNs) have the capability to learn their own features directly from the raw data during training. Unfortunately, they cannot handle irregular data such as graphs. We address this challenge by using graph kernels to embed meaningful local neighborhoods of the graphs in a continuous vector space. A set of filters is then convolved with these patches, pooled, and the output is then passed to a feedforward network. With limited parameter tuning, our approach outperforms strong baselines on 7 out of 10 benchmark datasets. Code and data are publicly available (https://​github.​com/​giannisnik/​cnn-graph-classification).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The datasets, further references and statistics are available at https://​ls11-www.​cs.​tu-dortmund.​de/​staff/​morris/​graphkerneldatas​ets.
 
Literatur
1.
Zurück zum Zitat Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. JSTAT 2008(10), 1–12 (2008)CrossRef Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. JSTAT 2008(10), 1–12 (2008)CrossRef
2.
Zurück zum Zitat Borgwardt, K.M., Kriegel, H.: Shortest-path kernels on graphs. In: ICDM, pp. 74–81 (2005) Borgwardt, K.M., Kriegel, H.: Shortest-path kernels on graphs. In: ICDM, pp. 74–81 (2005)
3.
Zurück zum Zitat Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and locally connected networks on graphs. In: ICLR (2014) Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and locally connected networks on graphs. In: ICLR (2014)
4.
Zurück zum Zitat Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp. 3837–3845 (2016) Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp. 3837–3845 (2016)
5.
6.
Zurück zum Zitat Horváth, T., Gärtner, T., Wrobel, S.: Cyclic Pattern Kernels for Predictive Graph Mining. In: KDD, pp. 158–167 (2004) Horváth, T., Gärtner, T., Wrobel, S.: Cyclic Pattern Kernels for Predictive Graph Mining. In: KDD, pp. 158–167 (2004)
7.
Zurück zum Zitat Johansson, F., Jethava, V., Dubhashi, D., Bhattacharyya, C.: Global graph kernels using geometric embeddings. In: ICML, pp. 694–702 (2014) Johansson, F., Jethava, V., Dubhashi, D., Bhattacharyya, C.: Global graph kernels using geometric embeddings. In: ICML, pp. 694–702 (2014)
8.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017)
9.
Zurück zum Zitat Kondor, R., Pan, H.: The multiscale laplacian graph kernel. In: NIPS, pp. 2982–2990 (2016) Kondor, R., Pan, H.: The multiscale laplacian graph kernel. In: NIPS, pp. 2982–2990 (2016)
10.
Zurück zum Zitat Niepert, M., Ahmed, M., Kutzkov, K.: Learning convolutional neural networks for graphs. In: ICML (2016) Niepert, M., Ahmed, M., Kutzkov, K.: Learning convolutional neural networks for graphs. In: ICML (2016)
11.
Zurück zum Zitat Nikolentzos, G., Meladianos, P., Vazirgiannis, M.: Matching node embeddings for graph similarity. In: AAAI, pp. 2429–2435 (2017) Nikolentzos, G., Meladianos, P., Vazirgiannis, M.: Matching node embeddings for graph similarity. In: AAAI, pp. 2429–2435 (2017)
12.
Zurück zum Zitat Shervashidze, N., Schweitzer, P., Van Leeuwen, E.J., Mehlhorn, K., Borgwardt, K.M.: Weisfeiler-Lehman graph kernels. JMLR 12, 2539–2561 (2011)MathSciNetMATH Shervashidze, N., Schweitzer, P., Van Leeuwen, E.J., Mehlhorn, K., Borgwardt, K.M.: Weisfeiler-Lehman graph kernels. JMLR 12, 2539–2561 (2011)MathSciNetMATH
13.
Zurück zum Zitat Shervashidze, N., Vishwanathan, S., Petri, T., Mehlhorn, K., Borgwardt, K.M.: Efficient graphlet kernels for large graph comparison. In: AISTATS, pp. 488–495 (2009) Shervashidze, N., Vishwanathan, S., Petri, T., Mehlhorn, K., Borgwardt, K.M.: Efficient graphlet kernels for large graph comparison. In: AISTATS, pp. 488–495 (2009)
14.
Zurück zum Zitat Tixier, A., Nikolentzos, G., Meladianos, P., Vazirgiannis, M.: Classifying graphs as images with convolutional neural networks. arXiv:1708.02218 (2017) Tixier, A., Nikolentzos, G., Meladianos, P., Vazirgiannis, M.: Classifying graphs as images with convolutional neural networks. arXiv:​1708.​02218 (2017)
15.
Zurück zum Zitat Vialatte, J.C., Gripon, V., Mercier, G.: Generalizing the convolution operator to extend CNNs to irregular domains. arXiv preprint arXiv:1606.01166 (2016) Vialatte, J.C., Gripon, V., Mercier, G.: Generalizing the convolution operator to extend CNNs to irregular domains. arXiv preprint arXiv:​1606.​01166 (2016)
16.
Zurück zum Zitat Vishwanathan, S.V.N., Schraudolph, N.N., Kondor, R., Borgwardt, K.M.: Graph kernels. JMLR 11, 1201–1242 (2010)MathSciNetMATH Vishwanathan, S.V.N., Schraudolph, N.N., Kondor, R., Borgwardt, K.M.: Graph kernels. JMLR 11, 1201–1242 (2010)MathSciNetMATH
17.
Zurück zum Zitat Williams, C.K., Seeger, M.: Using the Nyström method to speed up kernel machines. In: NIPS, pp. 661–667 (2000) Williams, C.K., Seeger, M.: Using the Nyström method to speed up kernel machines. In: NIPS, pp. 661–667 (2000)
18.
Zurück zum Zitat Yanardag, P., Vishwanathan, S.: A structural smoothing framework for robust graph comparison. In: NIPS, pp. 2125–2133 (2015) Yanardag, P., Vishwanathan, S.: A structural smoothing framework for robust graph comparison. In: NIPS, pp. 2125–2133 (2015)
19.
Zurück zum Zitat Yanardag, P., Vishwanathan, S.: Deep graph kernels. In: KDD, pp. 1365–1374 (2015) Yanardag, P., Vishwanathan, S.: Deep graph kernels. In: KDD, pp. 1365–1374 (2015)
20.
Zurück zum Zitat Zhang, Y., Liang, P., Wainwright, M.J.: Convexified convolutional neural networks. In: ICML, pp. 4044–4053 (2017) Zhang, Y., Liang, P., Wainwright, M.J.: Convexified convolutional neural networks. In: ICML, pp. 4044–4053 (2017)
Metadaten
Titel
Kernel Graph Convolutional Neural Networks
verfasst von
Giannis Nikolentzos
Polykarpos Meladianos
Antoine Jean-Pierre Tixier
Konstantinos Skianis
Michalis Vazirgiannis
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01418-6_3