Skip to main content
Top

2018 | OriginalPaper | Chapter

Optimization Technology of CNN Based on DSP

Authors : YuXin Cai, Chen Liang, ZhiWei Tang, Huosheng Li

Published in: International Conference on Applications and Techniques in Cyber Security and Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Convolution neural network has important applications in the field of image recognition and retrieval, face recognition and object detection in deep learning. In the training of convolution neural network, 2D convolution, spatial pooling, linear mapping and other operations of forward propagation will have a huge computational complexity. In this paper, an effective optimization technique is proposed to map the convolutional neural network to the digital processor DSP. These technologies include: fixed-point conversion, data reorganization, weight deployment and LUT (look-up table). These technologies enable us to optimize the use of resources on the C66x DSP. The experiment is carried out on Texas Instruments C6678 development board, and the optimization technique proposed in this paper can be applied to multiple open-source network topologies.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE (1998) LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. In: Proceedings of the IEEE (1998)
2.
go back to reference LeCun, Y., et al.: CNP: An FPGA-based Processor for Convolutional Networks (2009) LeCun, Y., et al.: CNP: An FPGA-based Processor for Convolutional Networks (2009)
3.
go back to reference A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks (2013) A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks (2013)
4.
go back to reference Putnam, A., et al.: A reconfigurable fabric for accelerating large-scale datacenter services. In: International Symposium on Computer Architecture (2014) Putnam, A., et al.: A reconfigurable fabric for accelerating large-scale datacenter services. In: International Symposium on Computer Architecture (2014)
5.
go back to reference Jagath, A.: FPGA Implementations of Neural Networks. Springer (2006) Jagath, A.: FPGA Implementations of Neural Networks. Springer (2006)
6.
go back to reference Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks. ACM 978-1-4503-3315-3/15/02 (2015) Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks. ACM 978-1-4503-3315-3/15/02 (2015)
7.
go back to reference Accelerating Deep Convolutional Neural Networks Using Specialized Hardware (2015) Accelerating Deep Convolutional Neural Networks Using Specialized Hardware (2015)
8.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012)
9.
go back to reference Cong, J., Xiao, B.: Minimizing computation in convolutional neural networks. In: ICANN (2014) Cong, J., Xiao, B.: Minimizing computation in convolutional neural networks. In: ICANN (2014)
10.
go back to reference Courbariaux, M., David, J.-P.: Training deep neural networks with low precision multiplications (2015) Courbariaux, M., David, J.-P.: Training deep neural networks with low precision multiplications (2015)
11.
go back to reference Gupta, S., Agrawal, A., Gopalakrishnan, K.: Deep Learing with Limited Numberical Precision (2015) Gupta, S., Agrawal, A., Gopalakrishnan, K.: Deep Learing with Limited Numberical Precision (2015)
12.
go back to reference Vanhoucke, V., Senior, A.: Vanhoucke improveing the speed of neural network on CPUs (2011) Vanhoucke, V., Senior, A.: Vanhoucke improveing the speed of neural network on CPUs (2011)
13.
go back to reference Chen, T., Du, Z., Sun, N.: A Small-Footprint High-Throughput Accelerator for Ubiquitous Machine-Learning Chen, T., Du, Z., Sun, N.: A Small-Footprint High-Throughput Accelerator for Ubiquitous Machine-Learning
14.
go back to reference “2020 Roadmap, Rev. 1”, European New Car Assessment Programme (March 2015) “2020 Roadmap, Rev. 1”, European New Car Assessment Programme (March 2015)
15.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNetClassification with Deep Convolutional Neural Network. NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNetClassification with Deep Convolutional Neural Network. NIPS (2012)
16.
go back to reference TDA3x SoC Processors for Advanced Driver Assist Systems (ADAS) Technical Brief. Texas Instruments Inc. (2014) TDA3x SoC Processors for Advanced Driver Assist Systems (ADAS) Technical Brief. Texas Instruments Inc. (2014)
17.
go back to reference Sermanet, P., LeCun, Y.: Traffic sign recognition with multi-scale Convolutional Networks. In: International Joint Conference on Neural Networks (IJCNN) (2011) Sermanet, P., LeCun, Y.: Traffic sign recognition with multi-scale Convolutional Networks. In: International Joint Conference on Neural Networks (IJCNN) (2011)
18.
go back to reference Szegedy, C., Liu, W., Jia, Y., et al.: Going Deeper with Convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015) Szegedy, C., Liu, W., Jia, Y., et al.: Going Deeper with Convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
19.
go back to reference “TMS320C66x DSP: User Guide”, SPRUGW0C. Texas InstrumentsInc. (2013) “TMS320C66x DSP: User Guide”, SPRUGW0C. Texas InstrumentsInc. (2013)
20.
go back to reference Audhkhasi, K., Osoba, O., Kosko, B.: Noise benefits in backpropagation and deep bidirectional pre-training. In: 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2013) Audhkhasi, K., Osoba, O., Kosko, B.: Noise benefits in backpropagation and deep bidirectional pre-training. In: 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2013)
21.
go back to reference Baboulin, M., Buttari, A., Dongarra, J., Kurzak, J., Langou, J., Langou, J., Luszczek, P., Tomov, S.: Accelerating scientific computations with mixed precision algorithms. Comput. Phys. Commun. 180(12), 2526–2533 (2009)CrossRefMATH Baboulin, M., Buttari, A., Dongarra, J., Kurzak, J., Langou, J., Langou, J., Luszczek, P., Tomov, S.: Accelerating scientific computations with mixed precision algorithms. Comput. Phys. Commun. 180(12), 2526–2533 (2009)CrossRefMATH
Metadata
Title
Optimization Technology of CNN Based on DSP
Authors
YuXin Cai
Chen Liang
ZhiWei Tang
Huosheng Li
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-67071-3_9

Premium Partner