Skip to main content
Top

2021 | OriginalPaper | Chapter

Bi-RDNet: Performance Enhancement for Remote Sensing Scene Classification with Rotational Duplicate Layers

Authors : Erdem Safa Akkul, Berk Arıcan, Behçet Uğur Töreyin

Published in: Advances in Computational Collective Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We propose compact and effective network layer Rotational Duplicate Layer (RDLayer) that takes the place of regular convolution layer resulting up to 128\(\times \) in memory saving. Along with network accuracy, memory and power constraints affect design choices of computer vision tasks performed on resource-limited devices such as FPGAs (Field Programmable Gate Array). To overcome this limited availability, RDLayers are trained in a way that whole layer parameters are obtained from duplication and rotation of smaller learned kernel. Additionally, we speed up the forward pass via partial decompression methodology for data compressed with JPEG(Joint Photograpic Expert Group)2000. Our experiments on remote sensing scene classification showed that our network achieves \(\sim \)4\(\times \) reduction in model size in exchange of \(\sim \)4.5\(\%\) drop in accuracy, \(\sim \)27\(\times \) reduction with the cost of \(\sim \)10\(\%\) drop in accuracy, along with \(\sim \)2.6\(\times \) faster evaluation time on test samples.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cheng, G., Han, J., Xiaoqiang, L.: Remote sensing image scene classification: benchmark and state of the art. Proc. IEEE 105(10), 1865–1883 (2017)CrossRef Cheng, G., Han, J., Xiaoqiang, L.: Remote sensing image scene classification: benchmark and state of the art. Proc. IEEE 105(10), 1865–1883 (2017)CrossRef
2.
go back to reference Cheng, G., Yang, C., Yao, X., Guo, L., Han, J.: When deep learning meets metric learning: remote sensing image scene classification via learning discriminative CNNs. IEEE Trans. Geosci. Remote Sens. 56(5), 2811–2821 (2018)CrossRef Cheng, G., Yang, C., Yao, X., Guo, L., Han, J.: When deep learning meets metric learning: remote sensing image scene classification via learning discriminative CNNs. IEEE Trans. Geosci. Remote Sens. 56(5), 2811–2821 (2018)CrossRef
3.
go back to reference Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009) Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009)
4.
go back to reference Gao, H., et al.: DupNet: towards very tiny quantized CNN with improved accuracy for face detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019) Gao, H., et al.: DupNet: towards very tiny quantized CNN with improved accuracy for face detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019)
5.
go back to reference Gong, Y., Liu, L., Yang, M., Bourdev, L.: Compressing deep convolutional networks using vector quantization. arXiv preprint arXiv:1412.6115 (2014) Gong, Y., Liu, L., Yang, M., Bourdev, L.: Compressing deep convolutional networks using vector quantization. arXiv preprint arXiv:​1412.​6115 (2014)
6.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015)
7.
go back to reference Huang, G., Liu, Z., Weinberger, K.Q.: Densely connected convolutional networks. CoRR, abs/1608.06993 (2016) Huang, G., Liu, Z., Weinberger, K.Q.: Densely connected convolutional networks. CoRR, abs/1608.06993 (2016)
8.
go back to reference Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50\(\times \) fewer parameters and \(<\)0.5 mb model size. arXiv preprint arXiv:1602.07360 (2016) Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50\(\times \) fewer parameters and \(<\)0.5 mb model size. arXiv preprint arXiv:​1602.​07360 (2016)
9.
go back to reference Liu, C., et al.: Circulant binary convolutional networks: enhancing the performance of 1-bit DCNNs with circulant back propagation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2691–2699 (2019) Liu, C., et al.: Circulant binary convolutional networks: enhancing the performance of 1-bit DCNNs with circulant back propagation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2691–2699 (2019)
10.
go back to reference Liu, S., Deng, W.: Very deep convolutional neural network based image classification using small training sample size. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 730–734 (2015) Liu, S., Deng, W.: Very deep convolutional neural network based image classification using small training sample size. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 730–734 (2015)
11.
go back to reference Xiaoqiang, L., Sun, H., Zheng, X.: A feature aggregation convolutional neural network for remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 57(10), 7894–7906 (2019)CrossRef Xiaoqiang, L., Sun, H., Zheng, X.: A feature aggregation convolutional neural network for remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 57(10), 7894–7906 (2019)CrossRef
12.
go back to reference Byju, A.P., Sumbul, G., Demir, B., Bruzzone, L.: Remote-sensing image scene classification with deep neural networks in jpeg 2000 compressed domain. IEEE Trans. Geosci. Remote Sens. 59(4), 3458–3472 (2021)CrossRef Byju, A.P., Sumbul, G., Demir, B., Bruzzone, L.: Remote-sensing image scene classification with deep neural networks in jpeg 2000 compressed domain. IEEE Trans. Geosci. Remote Sens. 59(4), 3458–3472 (2021)CrossRef
14.
go back to reference Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
15.
go back to reference Szegedy, C., et al.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9 (2015) Szegedy, C., et al.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9 (2015)
16.
go back to reference Xia, G.-S., et al.: AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Remote Sens. 55(7), 3965–3981 (2017)CrossRef Xia, G.-S., et al.: AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Remote Sens. 55(7), 3965–3981 (2017)CrossRef
18.
go back to reference Zhang, J., Chaoquan, L., Li, X., Kim, H.-J., Wang, J.: A full convolutional network based on DenseNet for remote sensing scene classification. Math. Biosci. Eng. 16, 3345–3367 (2019)CrossRef Zhang, J., Chaoquan, L., Li, X., Kim, H.-J., Wang, J.: A full convolutional network based on DenseNet for remote sensing scene classification. Math. Biosci. Eng. 16, 3345–3367 (2019)CrossRef
Metadata
Title
Bi-RDNet: Performance Enhancement for Remote Sensing Scene Classification with Rotational Duplicate Layers
Authors
Erdem Safa Akkul
Berk Arıcan
Behçet Uğur Töreyin
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-88113-9_54

Premium Partner