Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 2/2024

19-08-2023

An anomaly aware network embedding framework for unsupervised anomalous link detection

Authors: Dongsheng Duan, Cheng Zhang, Lingling Tong, Jie Lu, Cunchi Lv, Wei Hou, Yangxi Li, Xiaofang Zhao

Published in: Data Mining and Knowledge Discovery | Issue 2/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most existing network embedding based anomalous link detection methods regard network embedding and anomalous link detection as two independent tasks. However, removing anomalous links from the original network can reduce the data noise, thus hopefully improving the performance of network embedding models and anomalous link detection. In this paper, we propose an Anomaly Aware Network Embedding (AANE) framework by simultaneously learning node embedding and detecting anomalous links in a unified way. To instantiate the AANE framework, we propose a heuristic anomalous link selection based model AANE-H and an embedding disentangling based model AANE-D on Graph Auto-Encoder (GAE). In AANE-H, we adopt an anomalous link selector to iteratively select significant anomalous links based on a heuristic rule during model training, while in AANE-D the normal and anomalous links are generated by disentangled normal and anomalous embedding respectively. For the evaluation purpose, we propose a heuristic anomalous link generation algorithm to inject synthetic anomalous links into six real-world network datasets used in our experiments. Experimental results show that AANE outperforms both the state-of-the-art network embedding models and anomalous node detection models in terms of anomalous link detection performance. As a general network embedding model, AANE can also improve other downstream tasks like node classification.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Akoglu L, Tong H, Koutra D (2015) Graph based anomaly detection and description: a survey. Data Min Knowl Disc 29(3):626–688MathSciNetCrossRef Akoglu L, Tong H, Koutra D (2015) Graph based anomaly detection and description: a survey. Data Min Knowl Disc 29(3):626–688MathSciNetCrossRef
go back to reference Bandyopadhyay S, Lokesh N, Murty MN (2019) Outlier aware network embedding for attributed networks. In: AAAI, pp 12–19 Bandyopadhyay S, Lokesh N, Murty MN (2019) Outlier aware network embedding for attributed networks. In: AAAI, pp 12–19
go back to reference Bandyopadhyay S, N L, Vivek SV, Murty MN (2020) Outlier resistant unsupervised deep architectures for attributed network embedding. In: WSDM, pp 25–33 Bandyopadhyay S, N L, Vivek SV, Murty MN (2020) Outlier resistant unsupervised deep architectures for attributed network embedding. In: WSDM, pp 25–33
go back to reference Bruna J, Zaremba W, Szlam A, Lecun Y (2014) Spectral networks and locally connected networks on graphs. In: ICLR Bruna J, Zaremba W, Szlam A, Lecun Y (2014) Spectral networks and locally connected networks on graphs. In: ICLR
go back to reference Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv 41(3):15–158CrossRef Chandola V, Banerjee A, Kumar V (2009) Anomaly detection: a survey. ACM Comput Surv 41(3):15–158CrossRef
go back to reference Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp 3844–3852 Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp 3844–3852
go back to reference Ding Q, Katenka N, Barford P, Kolaczyk ED, Crovella M (2012) Intrusion as (anti)social communication: characterization and detection. In: Knowledge Discovery and Data Mining, pp 886–894 Ding Q, Katenka N, Barford P, Kolaczyk ED, Crovella M (2012) Intrusion as (anti)social communication: characterization and detection. In: Knowledge Discovery and Data Mining, pp 886–894
go back to reference Ding K, Li J, Bhanushali R, Liu H (2019) Deep anomaly detection on attributed networks. In: SDM Ding K, Li J, Bhanushali R, Liu H (2019) Deep anomaly detection on attributed networks. In: SDM
go back to reference Duan D, Tong L, Li Y, Lu J, Shi L, Zhang C (2020) Aane: anomaly aware network embedding for anomalous link detection. In: ICDM, pp 1002–1007 Duan D, Tong L, Li Y, Lu J, Shi L, Zhang C (2020) Aane: anomaly aware network embedding for anomalous link detection. In: ICDM, pp 1002–1007
go back to reference Fang L, Feng K, Gui J, Feng S, Hu A (2023) Anonymous edge representation for inductive anomaly detection in dynamic bipartite graph. Proc VLDB Endow 16(5):1154–1167CrossRef Fang L, Feng K, Gui J, Feng S, Hu A (2023) Anonymous edge representation for inductive anomaly detection in dynamic bipartite graph. Proc VLDB Endow 16(5):1154–1167CrossRef
go back to reference Fan H, Zhang F, Li Z (2020) Anomalydae: Dual autoencoder for anomaly detection on attributed networks. In: ICASSP, pp 5685–5689 Fan H, Zhang F, Li Z (2020) Anomalydae: Dual autoencoder for anomaly detection on attributed networks. In: ICASSP, pp 5685–5689
go back to reference Freeman LC (1977) A set of measures of centrality based on betweenness. Sociometry 40(1):35–41CrossRef Freeman LC (1977) A set of measures of centrality based on betweenness. Sociometry 40(1):35–41CrossRef
go back to reference Gao Y, Wang X, He X, Liu Z, Feng H, Zhang Y (2023) Alleviating structural distribution shift in graph anomaly detection. In: WSDM, pp 357–365 Gao Y, Wang X, He X, Liu Z, Feng H, Zhang Y (2023) Alleviating structural distribution shift in graph anomaly detection. In: WSDM, pp 357–365
go back to reference Gupte M, Eliassirad T (2012) Measuring tie strength in implicit social networks. In: Web Science, pp 109–118 Gupte M, Eliassirad T (2012) Measuring tie strength in implicit social networks. In: Web Science, pp 109–118
go back to reference Hamilton W, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: NIPS, pp 1024–1034 Hamilton W, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: NIPS, pp 1024–1034
go back to reference Kingma DP, Ba J (2015) A method for stochastic optimization. In: ICLR Kingma DP, Ba J (2015) A method for stochastic optimization. In: ICLR
go back to reference Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR
go back to reference Liben-Nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inform Sci Technol 58(7):1019–1031CrossRef Liben-Nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inform Sci Technol 58(7):1019–1031CrossRef
go back to reference Li J, Dani H, Xia H, Liu H (2017) Radar: Residual analysis for anomaly detection in attributed networks. In: IJCAI Li J, Dani H, Xia H, Liu H (2017) Radar: Residual analysis for anomaly detection in attributed networks. In: IJCAI
go back to reference Li Y, Huang X, Li J, Du M, Zou N (2019) Specae: spectral autoencoder for anomaly detection in attributed networks. arXiv: Learning Li Y, Huang X, Li J, Du M, Zou N (2019) Specae: spectral autoencoder for anomaly detection in attributed networks. arXiv:​ Learning
go back to reference Luo X, Wu J, Beheshti A, Yang J, Zhang X, Wang Y, Xue S (2022) Comga: Community-aware attributed graph anomaly detection. In: WSDM, pp 657–665 Luo X, Wu J, Beheshti A, Yang J, Zhang X, Wang Y, Xue S (2022) Comga: Community-aware attributed graph anomaly detection. In: WSDM, pp 657–665
go back to reference Mikolov T, Corrado Gs, Chen K, Dean J (2013) Efficient estimation of word representations in vector space. In: ICLR Mikolov T, Corrado Gs, Chen K, Dean J (2013) Efficient estimation of word representations in vector space. In: ICLR
go back to reference Pei1 Y, Huang T, van Ipenburg W, Pechenizkiy M, (2022) Resgcn: attention-based deep residual modeling for anomaly detection on attributed networks. Mach Learn 111:519–541 Pei1 Y, Huang T, van Ipenburg W, Pechenizkiy M, (2022) Resgcn: attention-based deep residual modeling for anomaly detection on attributed networks. Mach Learn 111:519–541
go back to reference Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks. In: ICLR Veličković P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks. In: ICLR
go back to reference Vincent P, Larochelle H, Bengio Y, Manzagol P-A (2008) Extracting and composing robust features with denoising autoencoders. In: ICML, pp 1096–1103 Vincent P, Larochelle H, Bengio Y, Manzagol P-A (2008) Extracting and composing robust features with denoising autoencoders. In: ICML, pp 1096–1103
go back to reference Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: KDD, pp 1225–1234 Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: KDD, pp 1225–1234
go back to reference Xu Z, Li L, Li H, Sun Q, Hu S, Ji R (2023) Self-supervised graph representation learning for black market account detection. In: WSDM, pp 330–338 Xu Z, Li L, Li H, Sun Q, Hu S, Ji R (2023) Self-supervised graph representation learning for black market account detection. In: WSDM, pp 330–338
go back to reference Xu B, Shen H, Cao Q, Qiu Y, Cheng X (2019) Graph wavelet neural network. In: ICLR Xu B, Shen H, Cao Q, Qiu Y, Cheng X (2019) Graph wavelet neural network. In: ICLR
go back to reference Xu X, Yuruk N, Feng Z, Schweiger TAJ (2007) Scan: a structural clustering algorithm for networks. Data Mining and Knowledge Discovery, pp 824–833 Xu X, Yuruk N, Feng Z, Schweiger TAJ (2007) Scan: a structural clustering algorithm for networks. Data Mining and Knowledge Discovery, pp 824–833
go back to reference Zheng L, Li Z, Li J, Li Z, Gao J (2019) Addgraph: Anomaly detection in dynamic graph using attention-based temporal gcn. In: IJCAI, pp 4419–4425 Zheng L, Li Z, Li J, Li Z, Gao J (2019) Addgraph: Anomaly detection in dynamic graph using attention-based temporal gcn. In: IJCAI, pp 4419–4425
Metadata
Title
An anomaly aware network embedding framework for unsupervised anomalous link detection
Authors
Dongsheng Duan
Cheng Zhang
Lingling Tong
Jie Lu
Cunchi Lv
Wei Hou
Yangxi Li
Xiaofang Zhao
Publication date
19-08-2023
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 2/2024
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-023-00960-6

Other articles of this Issue 2/2024

Data Mining and Knowledge Discovery 2/2024 Go to the issue

Premium Partner