nach oben

Artificial Intelligence Review

Erschienen in:

08.04.2019

Deep ensemble network based on multi-path fusion

verfasst von: Enhui Lv, Xuesong Wang, Yuhu Cheng, Qiang Yu

Erschienen in: Artificial Intelligence Review | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Deep convolutional network is commonly stacked by vast number of nonlinear convolutional layers. Deep fused network can improve the training process of deep convolutional network due to its capability of learning multi-scale representations and of optimizing information flow. However, the depth in a deep fused network does not contribute to the overall performance significantly. Therefore, a deep ensemble network consisting of deep fused network and branch channel is proposed. First, two base networks are combined in a concatenation and fusion manner to generate a deep fused network architecture. Then, an ensemble block with embedded learning mechanisms is formed to improve feature representation power of the model. Finally, the computational efficiency is improved by introducing group convolution without loss of performance. Experimental results on the standard recognition tasks have shown that the proposed network achieves better classification performance and has superior generalization ability compared to the original residual networks.

Vorheriger Artikel Establishment of a deep learning network based on feature extraction and its application in gearbox fault diagnosis

Nächster Artikel Primary user characterization for cognitive radio wireless networks using a neural system based on Deep Learning

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Abdi M, Nahavandi S (2017) Multi-residual networks: improving the speed and accuracy of residual networks. arXiv preprint. arXiv: 1609.05672

Alom MZ, Hasan M, Yakopcic C et al (2017) Inception recurrent convolutional neural network for object recognition. arXiv preprint. arXiv: 1704.07709

Bell S, Zitnick CL, Bala K et al (2016) Inside-outside net: detecting objects in context with skip pooling and recurrent neural networks. In: Proceedings of the 2016 IEEE computer society conference on computer vision and pattern recognition, pp 2874–2883

Deng J, Dong W, Socher R et al (2009) ImageNet: a large-scale hierarchical image database. In: Proceedings of the 2009 IEEE computer society conference on computer vision and pattern recognition, pp 248–255

Girshick R, Donahue J, Darrell T et al (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38(1):142–158CrossRef

Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. J Mach Learn Res 9:249–256

Guo JM, Zhang SF, Li JM (2016) Hash learning with convolutional neural networks for semantic based image retrieval. Lecture Notes in Computer Science, vol 9561, pp 227–238

He KM, Zhang XY, Ren SQ et al (2015) Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the 2015 IEEE international conference on computer vision, pp 1026–1034

He KM, Zhang XY, Ren SQ et al (2016) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE computer society conference on computer vision and pattern recognition, pp 770–778

He K, Zhang X, Ren SQ et al (2016) Identity mappings in deep residual networks. arXiv preprint. arXiv: 1603.05027

Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. arXiv preprint. arXiv: 1709.01507

Huang G, Liu S C, Maaten et al (2018) CondenseNet: an efficient DenseNet using learned group convolutions. arXiv preprint. arXiv: 1711.09224

Huang G, Liu Z, Weinberger KQ et al (2017) Densely connected convolutional networks. In: Proceedings of the 2017 IEEE computer society conference on computer vision and pattern recognition, pp 2261–2269

Huang G, Sun Y, Liu Z et al (2016) Deep networks with stochastic depth. Leture Notes in Computer Science, vol 9908, pp 646–661

Ioannou Y, Robertson D, Cipolla R et al (2017) Deep roots: improving CNN efficiency with hierarchical filter groups. In: Proceedings of the 2017 IEEE computer society conference on computer vision and pattern recognition, pp 5977–5986

Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd international conference on machine learning, vol 1, pp 448–456

Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90CrossRef

Larsson G, Maire M, Shakhnarovich G (2017) FractalNet: ultra-deep neural networks without residuals. arXiv preprint. arXiv: 1605.07648

Lin M, Chen Q, Yan S (2014) Network in network. arXiv preprint. arXiv: 1312.4400

Liu XL, Deng ZD, Yang YH (2018) Recent progress in semantic image segmentation. Artif Intell Rev. https://doi.org/10.1007/s10462-018-9641-3

Lv EH, Wang XS, Cheng YH et al (2018) Deep convolutional network based on pyramid architecture. IEEE Access 6:43125–43135CrossRef

Patil H, Kothari A, Bhurchandi K (2015) 3-D face recognition: features, databases, algorithms and challenges. Artif Intell Rev 44(3):393–441CrossRef

Romero A, Ballas N, Kahou SE et al (2015) Fitnets: hints for thin deep nets. arXiv preprint. arXiv: 1412.6550

Shang WL, Sohn K, Almeida D et al (2016) Understanding and improving convolutional neural networks via concatenated rectified linear units. In: Proceedings of the 33rd international conference on machine learning, vol 5, pp 3276–3284

Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef

Shen L, Lin ZC, Huang QM (2016) Relay backpropagation for effective learning of deep convolutional neural networks. In: Proceedings of the 14 European conference on computer vision, vol 9911, pp 467–482

Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv preprint. arXiv: 1409.1556

Srivastava RK, Greff K, Schmidhuber JG (2015) Training very deep networks. Advances in Neural Information Processing Systems 2377–2385:

Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetMATH

Szegedy C, Liu W, Jia YQ et al (2015) Going deeper with convolutions. In: Proceedings of the 2015 IEEE computer society conference on computer vision and pattern recognition, pp 1-9

Szegedy C, Vanhoucke V, Ioffe S et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the 2016 IEEE computer society conference on computer vision and pattern recognition, pp 2818–2826

Szegedy C, Ioffe S, Vanhoucke V et al (2017) Inception-v4, inception-resNet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI conference on artificial intelligence, pp 4278–4284

Targ S, Almeida D, Lyman K (2016) Resnet in resnet: generalizing residual architectures. arXiv preprint. arXiv: 1603.08029

Veit A, Wilber M, Belongie S (2016) Residual networks are exponential ensembles of relatively shallow networks. arXiv preprint. arXiv: 1605.06431

Wang JD, Zhen W, Zhang T et al (2016) Deeply-fused nets. arXiv preprint. arXiv: 1605.07716

Wang F, Jiang MQ, Qian C et al (2017) Residual attention network for image classification. In: Proceedings of the 2017 IEEE computer society conference on computer vision and pattern recognition, pp 6450–6458

Xie SN, Girshick R, Dollr P et al (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the 2017 IEEE computer society conference on computer vision and pattern recognition, pp 5987–5995

Zagoruyko S, Komodakis N (2017) Wide residual networks. arXiv preprint. arXiv: 1605.07146

Zhang T, Qi GJ, Xiao B et al (2017) Interleaved group convolutions for deep neural networks. arXiv preprint. arXiv: 1707.02725

Zhao LM, Wang JD, Li X et al (2016) On the connection of deep fusion to ensembling. arXiv preprint. arXiv: 1611.07718

Titel: Deep ensemble network based on multi-path fusion
verfasst von: Enhui Lv
Xuesong Wang
Yuhu Cheng
Qiang Yu
Publikationsdatum: 08.04.2019
Verlag: Springer Netherlands
Erschienen in: Artificial Intelligence Review / Ausgabe 1/2019
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI: https://doi.org/10.1007/s10462-019-09708-5

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 1/2019

Local structure learning of chain graphs with the false discovery rate control

Empirically grounded agent-based models of innovation diffusion: a critical review

A comparative study of neural-network feature weighting

A review of modularization techniques in artificial neural networks

Establishment of a deep learning network based on feature extraction and its application in gearbox fault diagnosis

Machine Learning and Deep Learning frameworks and libraries for large-scale data mining: a survey

Premium Partner