Skip to main content
Top

2016 | OriginalPaper | Chapter

Investigating a Dictionary-Based Non-negative Matrix Factorization in Superimposed Digits Classification Tasks

Authors : Somnuk Phon-Amnuaisuk, Soo-Young Lee

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Human visual system can recognize superimposed graphical components with ease while sophisticated computer vision systems still struggle to recognize them. This may be attributed to the fact that the image recognition task is framed as a classification task where a classification model is commonly constructed from appearance features. Hence, superimposed components are perceived as a single image unit. It seems logical to approach the recognition of superimposed digits by employing an approach that supports construction/deconstruction of superimposed components. Here, we resort to a dictionary-based non-negative matrix factorization (NMF). The dictionary-based NMF factors a given superimposed digit matrix, V, into the combination of entries in the dictionary matrix W. The H matrix from \(V \approx WH\) can be interpreted as corresponding superimposed digits. This work investigates three different dictionary representations: pixels’ intensity, Fourier coefficients and activations from RBM hidden layers. The results show that (i) NMF can be employed as a classifier and (ii) dictionary-based NMF is capable of classifying superimposed digits with only a small set of dictionary entries derived from single digits.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The database is available from http://​yann.​lecun.​com/​exdb/​mnist/​, it consists of 60,000 training examples (roughly 6,000 different handwritten examples for each digit) and 10,000 testing examples (roughly 1,000 different handwritten examples for each digit).
 
Literature
1.
go back to reference Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013). IEEECrossRef Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013). IEEECrossRef
2.
go back to reference Bottou, L., Cortes, C., Denker, J.S., Drucker, H., Guyon, I., Jackel, L.D., LeCun, Y., Müller, U.A., Säckinger, E., Simard, P., Vapnik, V.: Comparison of classifier methods: a case study in handwritten digit recognition. In: Proceedings of the 12th IAPR International. Conference on Pattern Recognition, vol. 2, pp. 77–82. Conference B: Computer Vision & Image Processing (1994) Bottou, L., Cortes, C., Denker, J.S., Drucker, H., Guyon, I., Jackel, L.D., LeCun, Y., Müller, U.A., Säckinger, E., Simard, P., Vapnik, V.: Comparison of classifier methods: a case study in handwritten digit recognition. In: Proceedings of the 12th IAPR International. Conference on Pattern Recognition, vol. 2, pp. 77–82. Conference B: Computer Vision & Image Processing (1994)
3.
go back to reference Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI 2011), pp. 1237–1242 (2011) Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI 2011), pp. 1237–1242 (2011)
4.
go back to reference Lecun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)CrossRef Lecun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)CrossRef
5.
go back to reference Phon-Amnuaisuk, S.: Applying non-negative matrix factorization to classify superimposed handwritten digits. Procedia Comput. Sci. 24(2013), 261–267 (2013)CrossRef Phon-Amnuaisuk, S.: Applying non-negative matrix factorization to classify superimposed handwritten digits. Procedia Comput. Sci. 24(2013), 261–267 (2013)CrossRef
6.
go back to reference Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)CrossRef Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)CrossRef
7.
go back to reference Sohn, K., Lee, H.: Learning invariant representations with local transformations. In: Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Edinburgh (2012) Sohn, K., Lee, H.: Learning invariant representations with local transformations. In: Proceedings of the 29th International Conference on Machine Learning, ICML 2012, Edinburgh (2012)
8.
go back to reference Song, H.A., Kim, B.K., Xuan, T.L., Lee, S.Y.: Hierarchical feature extraction by multi-layer non-negative matrix factorization network for classification task. Neurocomputing 165, 63–74 (2015)CrossRef Song, H.A., Kim, B.K., Xuan, T.L., Lee, S.Y.: Hierarchical feature extraction by multi-layer non-negative matrix factorization network for classification task. Neurocomputing 165, 63–74 (2015)CrossRef
9.
go back to reference Lee, S.Y., Mozer, M.C.: Robust recognition of noisy and superimposed patterns via selective attention. In: Proceedings of the International Conference on Neural Information Processing Systems (NIPS 1999), pp. 31–37 (1999) Lee, S.Y., Mozer, M.C.: Robust recognition of noisy and superimposed patterns via selective attention. In: Proceedings of the International Conference on Neural Information Processing Systems (NIPS 1999), pp. 31–37 (1999)
10.
go back to reference Zhou, Z., Wagner, A., Mobahi, H., Wright, J., Ma., Y.: Face recognition with contiguous occlusion using markov random fields. In: Proceedings of the International Conference on Computer Vision (ICCV 2009), pp. 1050–1057. IEEE (2009) Zhou, Z., Wagner, A., Mobahi, H., Wright, J., Ma., Y.: Face recognition with contiguous occlusion using markov random fields. In: Proceedings of the International Conference on Computer Vision (ICCV 2009), pp. 1050–1057. IEEE (2009)
11.
go back to reference Tang, Y., Salakhutdinov, R., Hinton, G.: Robust Boltzmann machines for recognition and denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 2264–2271. IEEE (2012) Tang, Y., Salakhutdinov, R., Hinton, G.: Robust Boltzmann machines for recognition and denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 2264–2271. IEEE (2012)
Metadata
Title
Investigating a Dictionary-Based Non-negative Matrix Factorization in Superimposed Digits Classification Tasks
Authors
Somnuk Phon-Amnuaisuk
Soo-Young Lee
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46675-0_37

Premium Partner