nach oben

Pattern Recognition and Image Analysis

Erschienen in:

01.01.2021 | PATTERN RECOGNITION AND IMAGE ANALYSIS MILIEU

Deep Neural Networks: Selected Aspects of Learning and Application

verfasst von: V. A. Golovko, A. A. Kroshchanka, E. V. Mikhno

Erschienen in: Pattern Recognition and Image Analysis | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Training methods for deep neural networks (DNNs) are analyzed. It is shown that maximizing the likelihood function of the distribution of the input data P(x) in the space of synaptic connections of a restricted Boltzmann machine (RBM) is equivalent to minimizing the cross-entropy (CE) of the network error function and minimizing the total mean squared error (MSE) of the network in the same space using linear neurons. The application of DNNs for the detection and recognition of productmarking is considered.

Vorheriger Artikel Analysis of Digital Images in Order to Control the Manufacturing of Integrated Circuits

Nächster Artikel Biomedical Image Recognition in Pulmonology and Oncology with the Use of Deep Learning

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

A. Krizhevsky, L. Sutskever, and G. Hinton, “ImageNet classification with deep convolutional neural networks,” in Proc. of the Intern. Conf. Advances in Neural Inform., Processing Systems (NIPS-2012) (Lake Tahoe, 2012), No. 25, pp. 1090–1098.

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature 521, 436–444 (2015).CrossRef

T. Mikolov et al., “Strategies for training large scale neural network language models,” in Proc. 2011 IEEE Workshop Automatic Speech Recognition and Understanding (Waikoloa, 2011), pp. 195–201.

G. Hinton et al., “Deep neural network for acoustic modeling in speech recognition,” IEEE Signal Process. Mag. 29, 82–97 (2012).CrossRef

Y. Bengio, “Learning deep architectures for AI,” Found. Trends Mach. Learn. 2 (1), 1–127 (2009).CrossRef

Y. Bengio et al., “Greedy layer-wise training of deep networks,” Adv. Neural Inf. Process. Syst. 11, 153–160 (2007).

D. Erhan et al., “Why does unsupervised pre-training help deep learning?,” J. Mach. Learn. Res. 11, 625–660 (2010).MathSciNetMATH

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature 521, 436–444 (2015).CrossRef

V. A. Golovko, “Deep learning: An overview and main paradigms,” Opt. Mem. Neural Networks 26, 1–17 (2017).CrossRef

10.

V. Golovko, A. Kroshchanka, M. Komar, and A. Sachenko, “Neural network approach for semantic coding of words,” in Lecture Notes in Computational Intelligence and Decision Making (Proc. of International Scientific Conference “Intellectual Systems of Decision Making and Problem of Computational Intelligence” (ISDMCI 2019)) (Springer, 2019), pp. 647–658.

11.

V. Golovko, A. Kroshchanka, E. Mikhno, M. Komar, and A. Sachenko, “Deep convolutional neural network for detection of solar panels,” in Data-Centric Business and Applications, Vol. 5: ICT Systems-Theory, Radio-Electronics, Information Technologies, and Cybersecurity (Springer, 2020), pp. 371–389.

12.

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature 521, 436–444 (2015).CrossRef

13.

G. E. Hinton, A Practical Guide to Training Restricted Boltzmann Machines (Toronto, 2010).

14.

G. E. Hinton, S. Osindero, and Yee-Whye Teh, “A fast learning algorithm for deep belief nets,” Neural Comput. 18, 1527–1554 (2006).MathSciNetCrossRef

15.

G. Hinton and R. Salakhutdinov, “Reducing the dimensionality of data with neural networks,” Science 313, 504–507 (2006).MathSciNetCrossRef

16.

H. Larochelle et al., “Exploring strategies for training deep neural networks,” J. Mach. Learn. Res. 10 (1), 1–40 (2009).MATH

17.

X. Glorot, A. Bordes, and Y. Bengio, “Deep sparse rectifier networks,” in Proc. Intern. Conf. on Artificial Intelligence and Statistics (2011), Vol. 15, pp. 315−323.

18.

V. Golovko et al., “A learning technique for deep belief neural networks,” in Neural Networks and Artificial Intelligence, Vol. 440: Communication in Computer and Information Science (Springer, Cham, 2014), pp. 136–146.

19.

V. Golovko, “From multilayers perceptrons to deep belief neural networks: Training paradigms and application,” in Lections on Neuroinformatics, Ed. by V. A. Golovko (NRNU MEPhI, Moscow, 2015), pp. 47–84.

20.

V. Golovko, “A new technique for restricted Boltzmann machine learning,” in Proceedings of the 8th IEEE International Conference IDAACS-2015 (Warsaw, 2015), pp. 182–186.

21.

V. Golovko, A. Kroschanka, and D. Treadwell, “The nature of unsupervised learning in deep neural networks: A new understanding and novel approach,” Opt. Mem. Neural Networks 25, 127–141 (2016).CrossRef

22.

V. A. Golovko, A. A. Kroshchanka, M. V. Kovalev, V. V. Taberko, and D. S. Ivaniuk, “Integration of artificial neural networks and knowledge bases,” in Open Semantic Technologies for Intelligent Systems, Ed. by V. Golenkov (BSUIR, Minsk, 2020), pp. 175–182.

23.

Omron Documentation. https://robotics.omron.com/browse-documents. Accessed June 2020.

24.

V. Golovko, A. Kroshchanka, and E. Mikhno, “Brands and caps labeling recognition in images using deep learning,” in Pattern Recognition and Information Processing, Vol. 1055: Communication in Computer and Information Science (Springer, 2019), pp. 35–51.

25.

A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications” (2017). https://arxiv.org/pdf/1704.04861.pdf. Accessed June 2020.

26.

Hui, J., “Object detection: Speed and accuracy comparison (Faster R-CNN, R-FCN, SSD, FPN, RetinaNet and YOLOv3)” (2018). https://jonathan-hui.medium.com/object-detection-speed-and-accuracy-comparison-faster-r-cnn-r-fcn-ssd-and-yolo-5425656ae359. Accessed June 2020.

27.

Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Ng, “Reading digits in natural images with unsupervised feature learning,” in NIPS Workshop on Deep Learning and Unsupervised Feature Learning (2011).

Titel: Deep Neural Networks: Selected Aspects of Learning and Application
verfasst von: V. A. Golovko
A. A. Kroshchanka
E. V. Mikhno
Publikationsdatum: 01.01.2021
Verlag: Pleiades Publishing
Erschienen in: Pattern Recognition and Image Analysis / Ausgabe 1/2021
Print ISSN: 1054-6618
Elektronische ISSN: 1555-6212
DOI: https://doi.org/10.1134/S1054661821010090

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 1/2021

A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network

Multi-Task Deep Neural Networks for Joint Sarcasm Detection and Sentiment Analysis

A Survey on the Usage of Pattern Recognition and Image Analysis Methods for the Lifestyle Improvement on Low Vision and Visually Impaired People

Pattern Recognition: Theoretical Research Experience and Applications

Multi-Modal Image Registration Based on Local Self-Similarity and Bidirectional Matching

Analysis of the Dynamical Biological Objects of Optical Microscopy

Premium Partner