Skip to main content
Top
Published in: Cluster Computing 1/2018

15-07-2017

DeepSIC: a deep model

For satellite image classification

Authors: Muhammad Amin, Tamleek Ali Tanveer, Shakirullah Shah, Muhammad Abdullah, Muhammad Shafi

Published in: Cluster Computing | Issue 1/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Satellite Image Classification is the problem of classifying satellite images into their corresponding classes. Using supervised deep learning, we provide an efficient classification mechanism of earth observation imagery captured by satellite. Promising classification results were obtained through Convolution Neural Network. Two sets of experiments were carried out. In the first set, the traditional pre-deep learning era approach was followed: features were extracted first which were then given as input to Support Vector Machines (SVM). In the second set of experiments, the images were directly provided as input to Convolution Neural Networks and the output features were then used as input to the SVM. The proposed schemes were tested on satellite images datasets AID, UC-merced and WHU-RS, having varied classes and heterogeneous image dimensions. We show that our model, with Convolution Neural Network, achieves 92% accuracy on the AID dataset and outperforms the previously reported best accuracy of 89.64% (Xia et al. in CoRR, arXiv:​1608.​05167, 2016).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Bay, H., Tuytelaars, T., Van Gool, L.: Surf: speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006) Bay, H., Tuytelaars, T., Van Gool, L.: Surf: speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer (2006)
3.
go back to reference Bosch, A., Muñoz, X., Martí, R.: Which is the best way to organize/classify images by content? Image Vis. Comput. 25(6), 778–791 (2007)CrossRef Bosch, A., Muñoz, X., Martí, R.: Which is the best way to organize/classify images by content? Image Vis. Comput. 25(6), 778–791 (2007)CrossRef
4.
go back to reference Boureau, Y.-L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2559–2566. IEEE (2010) Boureau, Y.-L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2559–2566. IEEE (2010)
5.
go back to reference Caffe, J.Y.: An open source convolutional architecture for fast feature embedding. In: ACM International Conference on Multimedia, ACM Caffe, J.Y.: An open source convolutional architecture for fast feature embedding. In: ACM International Conference on Multimedia, ACM
6.
go back to reference Chen, S., Tian, Y.L.: Pyramid of spatial relatons for scene-level land use classification. IEEE Trans. Geosci. Remote Sens. 53(4), 1947–1957 (2015)CrossRef Chen, S., Tian, Y.L.: Pyramid of spatial relatons for scene-level land use classification. IEEE Trans. Geosci. Remote Sens. 53(4), 1947–1957 (2015)CrossRef
7.
go back to reference Cheriyadat, A.M.: Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)CrossRef Cheriyadat, A.M.: Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)CrossRef
8.
go back to reference Coates, A., Lee, H., Ng, A.Y.: An analysis of single-layer networks in unsupervised feature learning. Ann Arbor 1001(48109), 2 (2010) Coates, A., Lee, H., Ng, A.Y.: An analysis of single-layer networks in unsupervised feature learning. Ann Arbor 1001(48109), 2 (2010)
9.
go back to reference Donaldson, D., Storeygard, A.: The view from above: applications of satellite data in economics. J. Econ. Perspect. 30(4), 171–198 (2016)CrossRef Donaldson, D., Storeygard, A.: The view from above: applications of satellite data in economics. J. Econ. Perspect. 30(4), 171–198 (2016)CrossRef
10.
go back to reference Gao, M.-L., Zhao, W.-J., Gong, Z.-N., Gong, H.-L., Chen, Z., Tang, X.-M.: Topographic correction of zy-3 satellite images and its effects on estimation of shrub leaf biomass in mountainous areas. Remote Sens. 6(4), 2745–2764 (2014)CrossRef Gao, M.-L., Zhao, W.-J., Gong, Z.-N., Gong, H.-L., Chen, Z., Tang, X.-M.: Topographic correction of zy-3 satellite images and its effects on estimation of shrub leaf biomass in mountainous areas. Remote Sens. 6(4), 2745–2764 (2014)CrossRef
11.
go back to reference Guenther, N., Schonlau, M., et al.: Support vector machines. Stata J. 16(4), 917–937 (2016) Guenther, N., Schonlau, M., et al.: Support vector machines. Stata J. 16(4), 917–937 (2016)
12.
go back to reference Guo, M., Yi, Y., Liu, J., Li, Y.: Scene text segmentation method based on mser and mlbp. In: China Academic Conference on Printing & Packaging and Media Technology, pp. 305–310. Springer (2016) Guo, M., Yi, Y., Liu, J., Li, Y.: Scene text segmentation method based on mser and mlbp. In: China Academic Conference on Printing & Packaging and Media Technology, pp. 305–310. Springer (2016)
13.
go back to reference Saxena, R., Mukherjee, S.: Application of remote sensing technology for land use/land cover change analysis. J. Indian Soc. Remote Sens. 27(2), 123–128 (1999)CrossRef Saxena, R., Mukherjee, S.: Application of remote sensing technology for land use/land cover change analysis. J. Indian Soc. Remote Sens. 27(2), 123–128 (1999)CrossRef
14.
go back to reference Ketkar, N.: Convolutional neural networks. In: Deep Learning with Python, pp. 61–76. Springer (2017) Ketkar, N.: Convolutional neural networks. In: Deep Learning with Python, pp. 61–76. Springer (2017)
15.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
16.
go back to reference Law, M.T., Thome, N., Cord, M.: Bag-of-words image representation: key ideas and further insight. In: Fusion in Computer Vision, pp. 29–52. Springer (2014) Law, M.T., Thome, N., Cord, M.: Bag-of-words image representation: key ideas and further insight. In: Fusion in Computer Vision, pp. 29–52. Springer (2014)
17.
go back to reference Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006) Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006)
18.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
19.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRef
20.
go back to reference Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., Clune, J.: Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: Advances in Neural Information Processing Systems, pp. 3387–3395 (2016) Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., Clune, J.: Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In: Advances in Neural Information Processing Systems, pp. 3387–3395 (2016)
21.
22.
go back to reference Rogan, J., Chen, D.M.: Remote sensing technology for mapping and monitoring land-cover and land-use change. Prog. Plan. 61(4), 301–325 (2004)CrossRef Rogan, J., Chen, D.M.: Remote sensing technology for mapping and monitoring land-cover and land-use change. Prog. Plan. 61(4), 301–325 (2004)CrossRef
23.
go back to reference Schultz, L., Molthan, A., Burks, J.E., Bell, J., McGrath, K., Cole, T.: Applications of earth remote sensing for identifying tornado and severe weather damage (2016) Schultz, L., Molthan, A., Burks, J.E., Bell, J., McGrath, K., Cole, T.: Applications of earth remote sensing for identifying tornado and severe weather damage (2016)
24.
go back to reference Shao, W., Yang, W., Xia, G.-S.: Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification. Int. J. Remote Sens. 34(23), 8588–8602 (2013)CrossRef Shao, W., Yang, W., Xia, G.-S.: Extreme value theory-based calibration for the fusion of multiple features in high-resolution satellite scene classification. Int. J. Remote Sens. 34(23), 8588–8602 (2013)CrossRef
25.
go back to reference Sheng, G., Yang, W., Tao, X., Sun, H.: High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int. J. Remote Sens. 33(8), 2395–2412 (2012)CrossRef Sheng, G., Yang, W., Tao, X., Sun, H.: High-resolution satellite scene classification using a sparse coding based multiple feature combination. Int. J. Remote Sens. 33(8), 2395–2412 (2012)CrossRef
26.
go back to reference Shin, H.-C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRef Shin, H.-C., Roth, H.R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., Summers, R.M.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRef
27.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556 (2014)
28.
go back to reference Sivic, J., Zisserman, A., et al.: Video google: a text retrieval approach to object matching in videos. In: iccv vol. 2, 1470–1477 (2003) Sivic, J., Zisserman, A., et al.: Video google: a text retrieval approach to object matching in videos. In: iccv vol. 2, 1470–1477 (2003)
29.
go back to reference Vaudour, E., Gilliot, J.-M., Bel, L., Brechet, L., Hamiache, J., Hadjar, D., Lemonnier, Y.: Uncertainty of soil reflectance retrieval from spot and rapideye multispectral satellite images using a per-pixel bootstrapped empirical line atmospheric correction over an agricultural region. Int. J. Appl. Earth Obs. Geoinf. 26, 217–234 (2014)CrossRef Vaudour, E., Gilliot, J.-M., Bel, L., Brechet, L., Hamiache, J., Hadjar, D., Lemonnier, Y.: Uncertainty of soil reflectance retrieval from spot and rapideye multispectral satellite images using a per-pixel bootstrapped empirical line atmospheric correction over an agricultural region. Int. J. Appl. Earth Obs. Geoinf. 26, 217–234 (2014)CrossRef
30.
go back to reference Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L.: AID: a benchmark dataset for performance evaluation of aerial scene classification. CoRR (2016). arXiv:1608.05167 Xia, G.-S., Hu, J., Hu, F., Shi, B., Bai, X., Zhong, Y., Zhang, L.: AID: a benchmark dataset for performance evaluation of aerial scene classification. CoRR (2016). arXiv:​1608.​05167
31.
go back to reference Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Maître, H.: Structural high-resolution satellite image indexing. In: ISPRS TC VII Symposium-100 Years ISPRS, vol. 38, pp. 298–303 (2010) Xia, G.-S., Yang, W., Delon, J., Gousseau, Y., Sun, H., Maître, H.: Structural high-resolution satellite image indexing. In: ISPRS TC VII Symposium-100 Years ISPRS, vol. 38, pp. 298–303 (2010)
32.
go back to reference Yong, X.U., Bo, H.U.A.N.G.: Spatial and temporal classification of synthetic satellite imagery: land cover mapping and accuracy validation. Geo-spat. Inf. Sci. 17(1), 1–7 (2014)CrossRef Yong, X.U., Bo, H.U.A.N.G.: Spatial and temporal classification of synthetic satellite imagery: land cover mapping and accuracy validation. Geo-spat. Inf. Sci. 17(1), 1–7 (2014)CrossRef
33.
go back to reference Yang, W., Yin, X., Xia, G.-S.: Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53(8), 4472–4482 (2015)CrossRef Yang, W., Yin, X., Xia, G.-S.: Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sens. 53(8), 4472–4482 (2015)CrossRef
34.
go back to reference Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM (2010) Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM (2010)
35.
go back to reference Yang, Y., Newsam, S.: Spatial pyramid co-occurrence for image classification. In: 2011 IEEE International Conference on Computer Vision (ICCV) Yang, Y., Newsam, S.: Spatial pyramid co-occurrence for image classification. In: 2011 IEEE International Conference on Computer Vision (ICCV)
36.
go back to reference Yeom, J.-M., Hwang, J., Jung, J.-H., Lee, K.-H., Lee, C.-S.: Initial radiometric characteristics of kompsat-3a multispectral imagery using the 6s radiative transfer model, well-known radiometric tarps, and mfrsr measurements. Remote Sens. 9(2), 130 (2017)CrossRef Yeom, J.-M., Hwang, J., Jung, J.-H., Lee, K.-H., Lee, C.-S.: Initial radiometric characteristics of kompsat-3a multispectral imagery using the 6s radiative transfer model, well-known radiometric tarps, and mfrsr measurements. Remote Sens. 9(2), 130 (2017)CrossRef
Metadata
Title
DeepSIC: a deep model
For satellite image classification
Authors
Muhammad Amin
Tamleek Ali Tanveer
Shakirullah Shah
Muhammad Abdullah
Muhammad Shafi
Publication date
15-07-2017
Publisher
Springer US
Published in
Cluster Computing / Issue 1/2018
Print ISSN: 1386-7857
Electronic ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-1010-5

Other articles of this Issue 1/2018

Cluster Computing 1/2018 Go to the issue

Premium Partner