Skip to main content

2021 | OriginalPaper | Buchkapitel

PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization

verfasst von : Thomas Defard, Aleksandr Setkov, Angelique Loesch, Romaric Audigier

Erschienen in: Pattern Recognition. ICPR International Workshops and Challenges

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a new framework for Patch Distribution Modeling, PaDiM, to concurrently detect and localize anomalies in images in a one-class learning setting. PaDiM makes use of a pretrained convolutional neural network (CNN) for patch embedding, and of multivariate Gaussian distributions to get a probabilistic representation of the normal class. It also exploits correlations between the different semantic levels of CNN to better localize anomalies. PaDiM outperforms current state-of-the-art approaches for both anomaly detection and localization on the MVTec AD and STC datasets. To match real-world visual industrial inspection, we extend the evaluation protocol to assess performance of anomaly localization algorithms on non-aligned dataset. The state-of-the-art performance and low complexity of PaDiM make it a good candidate for many industrial applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abati, D., Porrello, A., Calderara, S., Cucchiara, R.: Latent space autoregression for novelty detection. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 481–490 (2019) Abati, D., Porrello, A., Calderara, S., Cucchiara, R.: Latent space autoregression for novelty detection. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 481–490 (2019)
3.
Zurück zum Zitat Akçay, S., Atapour-Abarghouei, A., Breckon, T.P.: Skip-ganomaly: skip connected and adversarially trained encoder-decoder anomaly detection. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2019) Akçay, S., Atapour-Abarghouei, A., Breckon, T.P.: Skip-ganomaly: skip connected and adversarially trained encoder-decoder anomaly detection. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2019)
4.
Zurück zum Zitat Bergman, L., Cohen, N., Hoshen, Y.: Deep nearest neighbor anomaly detection. In: arXiv, 2002.10445 (2020) Bergman, L., Cohen, N., Hoshen, Y.: Deep nearest neighbor anomaly detection. In: arXiv, 2002.10445 (2020)
5.
Zurück zum Zitat Bergman, L., Hoshen, Y.: Classification-based anomaly detection for general data. In: International Conference on Learning Representations (ICPR) (2020) Bergman, L., Hoshen, Y.: Classification-based anomaly detection for general data. In: International Conference on Learning Representations (ICPR) (2020)
6.
Zurück zum Zitat Bergmann, P., Fauser, M., Sattlegger, D., Steger, C.: Mvtec ad-a comprehensive real-world dataset for unsupervised anomaly detection. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9584–9592 (2019) Bergmann, P., Fauser, M., Sattlegger, D., Steger, C.: Mvtec ad-a comprehensive real-world dataset for unsupervised anomaly detection. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9584–9592 (2019)
7.
Zurück zum Zitat Bergmann, P., Fauser, M., Sattlegger, D., Steger, C.: Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4182–4191 (2020) Bergmann, P., Fauser, M., Sattlegger, D., Steger, C.: Uninformed students: Student-teacher anomaly detection with discriminative latent embeddings. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4182–4191 (2020)
8.
Zurück zum Zitat Bergmann, P., Löwe, S., Fauser, M., Sattlegger, D., Steger, C.: Improving unsupervised defect segmentation by applying structural similarity to autoencoders. In: Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), vol. 5, VISAPP (2019) Bergmann, P., Löwe, S., Fauser, M., Sattlegger, D., Steger, C.: Improving unsupervised defect segmentation by applying structural similarity to autoencoders. In: Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP), vol. 5, VISAPP (2019)
9.
Zurück zum Zitat Cohen, N., Hoshen, Y.: Sub-image anomaly detection with deep pyramid correspondences. In: arXiv 2005.02357 (2020) Cohen, N., Hoshen, Y.: Sub-image anomaly detection with deep pyramid correspondences. In: arXiv 2005.02357 (2020)
10.
Zurück zum Zitat Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)CrossRef Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)CrossRef
11.
Zurück zum Zitat Deng, J., et al.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248–255 (2009) Deng, J., et al.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248–255 (2009)
12.
Zurück zum Zitat Gong, D., et al.: Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1705–1714 (2019) Gong, D., et al.: Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1705–1714 (2019)
13.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
14.
Zurück zum Zitat Huang, C., Ye, F., Cao, J., Li, M., Zhang, Y., Lu, C.: Attribute restoration framework for anomaly detection. In: arXiv, 1911.10676 (2019) Huang, C., Ye, F., Cao, J., Li, M., Zhang, Y., Lu, C.: Attribute restoration framework for anomaly detection. In: arXiv, 1911.10676 (2019)
15.
Zurück zum Zitat Kim, K.H., et al.: Rapp: Novelty detection with reconstruction along projection pathway. In: 2020 International Conference on Learning Representations (ICLR) (2020) Kim, K.H., et al.: Rapp: Novelty detection with reconstruction along projection pathway. In: 2020 International Conference on Learning Representations (ICLR) (2020)
16.
Zurück zum Zitat Kingma, D.P., Welling, M.: Auto-encoding variational bayes. In: Proceedings of the 2nd International Conference on Learning Representations (ICLR) (2014) Kingma, D.P., Welling, M.: Auto-encoding variational bayes. In: Proceedings of the 2nd International Conference on Learning Representations (ICLR) (2014)
17.
Zurück zum Zitat Lee, K., Lee, K., Lee, H., Shin, J.: A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS 2018, pp. 7167–7177. Curran Associates Inc., Red Hook, NY, USA (2018) Lee, K., Lee, K., Lee, H., Shin, J.: A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS 2018, pp. 7167–7177. Curran Associates Inc., Red Hook, NY, USA (2018)
18.
Zurück zum Zitat Liu, W., et al.: Towards visually explaining variational autoencoders. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8639–8648 (2020) Liu, W., et al.: Towards visually explaining variational autoencoders. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8639–8648 (2020)
19.
Zurück zum Zitat Liu, W., Luo, W., Lian, D., Gao, S.: Future frame prediction for anomaly detection - a new baseline. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6536–6545 (2018) Liu, W., Luo, W., Lian, D., Gao, S.: Future frame prediction for anomaly detection - a new baseline. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6536–6545 (2018)
20.
Zurück zum Zitat Mahalanobis, P.: On the generalized distance in statistics. In: National Institute of Science of India (1936) Mahalanobis, P.: On the generalized distance in statistics. In: National Institute of Science of India (1936)
21.
Zurück zum Zitat Napoletano, P., Piccoli, F., Schettini, R.: In: Sensors (Basel, Switzerland), vol. 18, p. 209 (2018) Napoletano, P., Piccoli, F., Schettini, R.: In: Sensors (Basel, Switzerland), vol. 18, p. 209 (2018)
22.
Zurück zum Zitat Pearson, K.: On lines and planes of closest fit to systems of points in space. London, Edinburgh, Dublin Philosophical Mag. J. Sci. 2(11), 559–572 (1901)CrossRef Pearson, K.: On lines and planes of closest fit to systems of points in space. London, Edinburgh, Dublin Philosophical Mag. J. Sci. 2(11), 559–572 (1901)CrossRef
23.
Zurück zum Zitat Perera, P., Nallapati, R., Xiang, B.: Ocgan: one-class novelty detection using gans with constrained latent representations. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2893–2901 (2019) Perera, P., Nallapati, R., Xiang, B.: Ocgan: one-class novelty detection using gans with constrained latent representations. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2893–2901 (2019)
24.
Zurück zum Zitat Pidhorskyi, S., Almohsen, R., Adjeroh, D.A., Doretto, G.: Generative probabilistic novelty detection with adversarial autoencoders. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS 2018, pp. 6823–6834. Curran Associates Inc., Red Hook, NY, USA (2018) Pidhorskyi, S., Almohsen, R., Adjeroh, D.A., Doretto, G.: Generative probabilistic novelty detection with adversarial autoencoders. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS 2018, pp. 6823–6834. Curran Associates Inc., Red Hook, NY, USA (2018)
25.
Zurück zum Zitat Rippel, O., Mertens, P., Merhof, D.: Modeling the distribution of normal data in pre-trained deep features for anomaly detection. In: arXiv, 2005.14140 (2020) Rippel, O., Mertens, P., Merhof, D.: Modeling the distribution of normal data in pre-trained deep features for anomaly detection. In: arXiv, 2005.14140 (2020)
26.
Zurück zum Zitat Ruff, L., et al.: Deep one-class classification. Proceedings of Machine Learning Research, vol. 80, pp. 4393–4402. PMLR, Stockholmsmässan, Stockholm Sweden (10–15 July 2018) Ruff, L., et al.: Deep one-class classification. Proceedings of Machine Learning Research, vol. 80, pp. 4393–4402. PMLR, Stockholmsmässan, Stockholm Sweden (10–15 July 2018)
27.
Zurück zum Zitat Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018) Sabokrou, M., Khalooei, M., Fathy, M., Adeli, E.: Adversarially learned one-class classifier for novelty detection. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3379–3388 (2018)
28.
Zurück zum Zitat Sato, K., Hama, K., Matsubara, T., Uehara, K.: Predictable uncertainty-aware unsupervised deep anomaly segmentation. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2019) Sato, K., Hama, K., Matsubara, T., Uehara, K.: Predictable uncertainty-aware unsupervised deep anomaly segmentation. In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2019)
29.
Zurück zum Zitat Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: Proceedings of Machine Learning Research, vol. 97, pp. 6105–6114. PMLR, Long Beach, California, USA (09–15 June 2019) Tan, M., Le, Q.: EfficientNet: rethinking model scaling for convolutional neural networks. In: Proceedings of Machine Learning Research, vol. 97, pp. 6105–6114. PMLR, Long Beach, California, USA (09–15 June 2019)
30.
Zurück zum Zitat Venkataramanan, S., Peng, K.C., Singh, R.V., Mahalanobis, A.: Attention guided anomaly localization in images. In: European Conference on Computer Vision (ECCV), vol. 2020 (2020) Venkataramanan, S., Peng, K.C., Singh, R.V., Mahalanobis, A.: Attention guided anomaly localization in images. In: European Conference on Computer Vision (ECCV), vol. 2020 (2020)
31.
Zurück zum Zitat Yi, J., Yoon, S.: Patch svdd: Patch-level svdd for anomaly detection and segmentation. In: arXiv, 2006.16067 (2020) Yi, J., Yoon, S.: Patch svdd: Patch-level svdd for anomaly detection and segmentation. In: arXiv, 2006.16067 (2020)
32.
Zurück zum Zitat Zagoruyko, S., Komodakis, N.: Wide residual networks. In: Richard C. Wilson, E.R.H., Smith, W.A.P. (eds.) Proceedings of the British Machine Vision Conference (BMVC). pp. 87.1-87.12. BMVA Press (September 2016) Zagoruyko, S., Komodakis, N.: Wide residual networks. In: Richard C. Wilson, E.R.H., Smith, W.A.P. (eds.) Proceedings of the British Machine Vision Conference (BMVC). pp. 87.1-87.12. BMVA Press (September 2016)
Metadaten
Titel
PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
verfasst von
Thomas Defard
Aleksandr Setkov
Angelique Loesch
Romaric Audigier
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-68799-1_35

Premium Partner