Skip to main content
Top
Published in: Multimedia Systems 5/2022

27-04-2022 | Regular Aricle

RMVAE: one-class classification via divergence regularization and maximization mutual information

Authors: Chen Hong, LongQuan Dai

Published in: Multimedia Systems | Issue 5/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One-class classification aims to learn the classifier from only one class of data. Variational auto-encoder (VAE) has been widely used in it. Trained on the normal samples, all the images reconstructed by the VAE in the test stage are similar to the normal samples. Thus, the VAE can produce higher reconstruction errors for abnormal samples than normal ones, which can be used as a classification criterion. However, the VAE can reconstruct abnormal samples well and produce lower reconstruction errors due to the model generalization. It leads to the wrong classification for the normal images. To alleviate this shortcoming of the VAE, we propose to use mutual information module and divergence regularization to enhance the VAE. The new model is called RMVAE. Firstly, we refer to the idea of contrast learning to maximize the mutual information between the input image and the corresponding latent representation so that the encoder can express the unique characteristics of the normal class. Besides, the attention mechanism is used in the encoder to enhance the feature extraction capabilities of the model. Secondly, we introduce divergence regularization to make the latent representation of the normal samples evenly distributed in the latent space. Extensive experiments demonstrate that the proposed method achieves a better effect against other state-of-the-art methods on the three public benchmark datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ruff, L., Vandermeulen, R., Goernitz N., et al.: Deep one-class classification. In: Proceedings of the International Conference on Machine Learning, pp. 4393–4402 (2018) Ruff, L., Vandermeulen, R., Goernitz N., et al.: Deep one-class classification. In: Proceedings of the International Conference on Machine Learning, pp. 4393–4402 (2018)
2.
go back to reference Li, Z., Liu, G., Jiang, C.: Deep representation learning with full center loss for credit card fraud detection. IEEE Trans. Comput. Soc. Syst. 7(2), 569–579 (2020)CrossRef Li, Z., Liu, G., Jiang, C.: Deep representation learning with full center loss for credit card fraud detection. IEEE Trans. Comput. Soc. Syst. 7(2), 569–579 (2020)CrossRef
3.
go back to reference Markovitz, A., Sharir, G., Friedman, I., et al.: Graph embedded pose clustering for anomaly detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10539–10547 (2020) Markovitz, A., Sharir, G., Friedman, I., et al.: Graph embedded pose clustering for anomaly detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10539–10547 (2020)
4.
go back to reference Zong, B., Song, Q., Min, M.R., et al.: Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: Proceedings of the International Conference on Learning Representations (2018) Zong, B., Song, Q., Min, M.R., et al.: Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: Proceedings of the International Conference on Learning Representations (2018)
6.
go back to reference Abati, D., Porrello, A., Calderara, S., et al.: Latent space autoregression for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 481–490 (2019) Abati, D., Porrello, A., Calderara, S., et al.: Latent space autoregression for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 481–490 (2019)
7.
go back to reference Gong, D., Liu, L., Le, V., et al.: Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1705–1714 (2019) Gong, D., Liu, L., Le, V., et al.: Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1705–1714 (2019)
8.
go back to reference Perera, P., Nallapati ,R., Xiang, B.: Ocgan: One-class novelty detection using gans with constrained latent representations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2898–2906 (2019) Perera, P., Nallapati ,R., Xiang, B.: Ocgan: One-class novelty detection using gans with constrained latent representations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2898–2906 (2019)
9.
go back to reference Akcay, S., Atapour-Abarghouei, A., Breckon, T.P.: Ganomaly: semi-supervised anomaly detection via adversarial training. In: Proceedings of the Asian Conference on Computer Vision, pp. 622–637 (2018) Akcay, S., Atapour-Abarghouei, A., Breckon, T.P.: Ganomaly: semi-supervised anomaly detection via adversarial training. In: Proceedings of the Asian Conference on Computer Vision, pp. 622–637 (2018)
10.
go back to reference Schölkopf, B., Platt, J.C., Shawe-Taylor, J., et al.: Estimating the support of a high-dimensional distribution. Neural Comput. 13(7), 1443–1471 (2001)CrossRef Schölkopf, B., Platt, J.C., Shawe-Taylor, J., et al.: Estimating the support of a high-dimensional distribution. Neural Comput. 13(7), 1443–1471 (2001)CrossRef
11.
go back to reference Tax, D.M.J., Duin, R.P.W.: Support vector data description. Mach. Learn. 54(1), 45–66 (2004)CrossRef Tax, D.M.J., Duin, R.P.W.: Support vector data description. Mach. Learn. 54(1), 45–66 (2004)CrossRef
12.
go back to reference Pidhorskyi, S., Almohsen, R., Adjeroh, D.A., et al.: Generative probabilistic novelty detection with adversarial autoencoders (2018). arXiv:1807.02588 Pidhorskyi, S., Almohsen, R., Adjeroh, D.A., et al.: Generative probabilistic novelty detection with adversarial autoencoders (2018). arXiv:​1807.​02588
13.
go back to reference Nguyen, D.T., Lou, Z., Klar, M., et al.: Anomaly detection with multiple-hypotheses predictions. In: Proceedings of the International Conference on Machine Learning, pp. 4800–4809 (2019) Nguyen, D.T., Lou, Z., Klar, M., et al.: Anomaly detection with multiple-hypotheses predictions. In: Proceedings of the International Conference on Machine Learning, pp. 4800–4809 (2019)
14.
go back to reference Sakurada, M., Yairi, T.: Anomaly detection using autoencoders with nonlinear dimensionality reduction. In: Proceedings of the MLSDA workshop on machine learning for sensory data analysis, pp. 4–11 (2014) Sakurada, M., Yairi, T.: Anomaly detection using autoencoders with nonlinear dimensionality reduction. In: Proceedings of the MLSDA workshop on machine learning for sensory data analysis, pp. 4–11 (2014)
15.
go back to reference Schlegl, T., Seeböck, P., Waldstein, S.M., et al.: Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In: Proceedings of the International Conference on Information Processing in Medical imaging, pp. 146–157 (2017) Schlegl, T., Seeböck, P., Waldstein, S.M., et al.: Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In: Proceedings of the International Conference on Information Processing in Medical imaging, pp. 146–157 (2017)
16.
go back to reference Sabokrou, M., Khalooei, M., Fathy, M., et al.: Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018) Sabokrou, M., Khalooei, M., Fathy, M., et al.: Adversarially learned one-class classifier for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018)
17.
go back to reference Wang, Q., Wu, B., Zhu, P., et al.: Eca-net: efficient channel attention for deep convolutional neural networks (2019). arXiv:1910.03151 [CoRR] Wang, Q., Wu, B., Zhu, P., et al.: Eca-net: efficient channel attention for deep convolutional neural networks (2019). arXiv:​1910.​03151 [CoRR]
18.
go back to reference Kwon, G., Prabhushankar, M., Temel, D., et al.: Backpropagated gradient representations for anomaly detection. In: Proceedings of the European Conference on Computer Vision, pp. 206–226 (2020) Kwon, G., Prabhushankar, M., Temel, D., et al.: Backpropagated gradient representations for anomaly detection. In: Proceedings of the European Conference on Computer Vision, pp. 206–226 (2020)
19.
go back to reference Xia, Y., Cao, X., Wen, F., et al.: Learning discriminative reconstructions for unsupervised outlier removal. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1511–1519 (2015) Xia, Y., Cao, X., Wen, F., et al.: Learning discriminative reconstructions for unsupervised outlier removal. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1511–1519 (2015)
20.
go back to reference Breunig, M.M., Kriegel, H.P., Ng, R.T., et al.: LOF: identifying density-based local outliers. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 93–104 (2000) Breunig, M.M., Kriegel, H.P., Ng, R.T., et al.: LOF: identifying density-based local outliers. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 93–104 (2000)
21.
23.
go back to reference Abati, D., Porrello, A., Calderara, S., et al.: Latent space autoregression for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 481–490 (2019) Abati, D., Porrello, A., Calderara, S., et al.: Latent space autoregression for novelty detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 481–490 (2019)
24.
go back to reference Yan X., Zhang H., Xu X., et al.: Learning semantic context from normal samples for unsupervised anomaly detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 3110–3118 (2021) Yan X., Zhang H., Xu X., et al.: Learning semantic context from normal samples for unsupervised anomaly detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 3110–3118 (2021)
Metadata
Title
RMVAE: one-class classification via divergence regularization and maximization mutual information
Authors
Chen Hong
LongQuan Dai
Publication date
27-04-2022
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 5/2022
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-022-00932-8

Other articles of this Issue 5/2022

Multimedia Systems 5/2022 Go to the issue