Skip to main content
Top

2021 | OriginalPaper | Chapter

Super-Resolution Algorithm Applied in the Zoning of Aerial Images

Authors : J. A. Baldion, E. Cascavita, C. H. Rodriguez-Garavito

Published in: Applied Informatics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, multiple applications based on images and unmanned aerial vehicles (UAVs), such as autonomous flying, precision agriculture, and zoning for territorial planning, are possible thanks to the growing development of machine learning and the evolution of convolutional and adversarial networks. Nevertheless, this type of application implies a significant challenge because even though the images taken by a high-end drone are very accurate, it is not enough since the level of detail required for most precision agriculture and zoning applications is very high. So, it is necessary to further improve the images by implementing different techniques to recognize small details. Hence, an alternative to follow is the super-resolution method, which allows constructing an image with the information from multiple images. An efficient tool can be obtained by combining drones’ advantages with different image processing techniques. This article proposes a method to improve the quality of images taken on board in a drone by increasing information obtained from multiple images that present noise, vibration-induced displacements, and illumination changes. These higher resolution images, called super-resolution images, allow supervised training processes to perform different zoning methods better. In this study, GAN-type networks show the best results to recognize visually differentiated ones on an aerial image automatically. The quality measure of the super-resolution image obtained by different methods was defined using sharpness and entropy metrics, and a semantic confusion matrix measures the accuracy of the following semantic segmentation network. Finally, the results show that the super-resolution algorithm’s implementation and the automatic segmentation provide an acceptable accuracy according to the defined metrics.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Shakhatreh, H., et al.: Unmanned aerial vehicles (UAVs): a survey on civil applications and key research challenges. IEEE Access 7, 48572–48634 (2019) Shakhatreh, H., et al.: Unmanned aerial vehicles (UAVs): a survey on civil applications and key research challenges. IEEE Access 7, 48572–48634 (2019)
2.
go back to reference Del Gallego, N.P., Ilao, J.: Multiple-image super-resolution on mobile devices: an image warping approach. EURASIP J. Image Video Process. 2017(1), 1–15 (2017) Del Gallego, N.P., Ilao, J.: Multiple-image super-resolution on mobile devices: an image warping approach. EURASIP J. Image Video Process. 2017(1), 1–15 (2017)
3.
go back to reference Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017) Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
4.
go back to reference Wang, X., et al.: Esrgan: enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops, pp. 63–79 (2018) Wang, X., et al.: Esrgan: enhanced super-resolution generative adversarial networks. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops, pp. 63–79 (2018)
5.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRef
6.
go back to reference Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRef Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)MathSciNetCrossRef
7.
go back to reference Shaw, P., Rawlins, D.: The point-spread function of a confocal microscope: its measurement and use in deconvolution of 3-D data. J. Microscopy 163, 151–165 (1991) Shaw, P., Rawlins, D.: The point-spread function of a confocal microscope: its measurement and use in deconvolution of 3-D data. J. Microscopy 163, 151–165 (1991)
8.
go back to reference Kopriva, I., Ju, W., Zhang, B., Xiang, D.: Single-channel sparse nonnegative blind source separation method for automatic 3d delineation of lung tumor in PET images. IEEE J. Biomed. Health Inf 21, November 2017 Kopriva, I., Ju, W., Zhang, B., Xiang, D.: Single-channel sparse nonnegative blind source separation method for automatic 3d delineation of lung tumor in PET images. IEEE J. Biomed. Health Inf 21, November 2017
9.
go back to reference Panetta, K., Gao, C., Agaian, S.: No reference color image contrast and quality measures. IEEE Trans. Consum. Electron. 59(3), 643–651 (2013)CrossRef Panetta, K., Gao, C., Agaian, S.: No reference color image contrast and quality measures. IEEE Trans. Consum. Electron. 59(3), 643–651 (2013)CrossRef
10.
go back to reference Mlnsa, P., Rodríguez, J.: The Essential Guide to Image Processing. Academic Press, Estados Unidos (2009) Mlnsa, P., Rodríguez, J.: The Essential Guide to Image Processing. Academic Press, Estados Unidos (2009)
12.
go back to reference Jalife, A., Calderón, G., Fierro, A., Nakano, M.: Clasificación de Imágenes Urbanas Aéreas: Comparación entre Descriptores de Bajo Nivel y Aprendizaje Profundo. Información tecnológica 28(3), 209–224 (2017)CrossRef Jalife, A., Calderón, G., Fierro, A., Nakano, M.: Clasificación de Imágenes Urbanas Aéreas: Comparación entre Descriptores de Bajo Nivel y Aprendizaje Profundo. Información tecnológica 28(3), 209–224 (2017)CrossRef
13.
go back to reference Tharwat, A.: Classification assessment methods. Applied Computing and Informatics (2020) Tharwat, A.: Classification assessment methods. Applied Computing and Informatics (2020)
14.
go back to reference Ur, H., Gross, D.: Improved resolution from subpixel shifted pictures. CVGIP: Graph. Models Image Process. 54(2), 181–186 (1992) Ur, H., Gross, D.: Improved resolution from subpixel shifted pictures. CVGIP: Graph. Models Image Process. 54(2), 181–186 (1992)
15.
go back to reference Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)CrossRef Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)CrossRef
16.
go back to reference Li, K., Yang, S., Dong, R., Wang, X., Huang, J.: Survey of single image super-resolution reconstruction. IET Image Proc. 14(11), 2273–2290 (2020)CrossRef Li, K., Yang, S., Dong, R., Wang, X., Huang, J.: Survey of single image super-resolution reconstruction. IET Image Proc. 14(11), 2273–2290 (2020)CrossRef
17.
go back to reference Protter, M., Elad, M., Takeda, H., Milanfar, P.: Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Trans. Image Process. 18(1), 36–51 (2008)MathSciNetCrossRef Protter, M., Elad, M., Takeda, H., Milanfar, P.: Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Trans. Image Process. 18(1), 36–51 (2008)MathSciNetCrossRef
18.
go back to reference Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRef
19.
go back to reference Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Process. 15(8), 2226–2238 (2006)CrossRef Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Process. 15(8), 2226–2238 (2006)CrossRef
20.
go back to reference Zhang, K., Gao, X., Tao, D., Li, X.: Single image super-resolution with non-local means and steering kernel regression. IEEE Trans. Image Process. 21(11), 4544–4556 (2012)MathSciNetCrossRef Zhang, K., Gao, X., Tao, D., Li, X.: Single image super-resolution with non-local means and steering kernel regression. IEEE Trans. Image Process. 21(11), 4544–4556 (2012)MathSciNetCrossRef
21.
go back to reference Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136–144 (2017) Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136–144 (2017)
22.
go back to reference Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017) Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4681–4690 (2017)
23.
go back to reference Garcia-Ruiz, F., Sankaran, S., Maja, J.M., Lee, W.S., Rasmussen, J., Ehsani, R.: Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees. Comput. Electron. Agric. 91, 106–115 (2013)CrossRef Garcia-Ruiz, F., Sankaran, S., Maja, J.M., Lee, W.S., Rasmussen, J., Ehsani, R.: Comparison of two aerial imaging platforms for identification of Huanglongbing-infected citrus trees. Comput. Electron. Agric. 91, 106–115 (2013)CrossRef
24.
go back to reference Huang, Y., Thomson, S.J., Hoffmann, W.C., Lan, Y., Fritz, B.K.: Development and prospect of unmanned aerial vehicle technologies for agricultural production management. Int. J. Agric. Biol. Eng. 6(3), 1–10 (2013) Huang, Y., Thomson, S.J., Hoffmann, W.C., Lan, Y., Fritz, B.K.: Development and prospect of unmanned aerial vehicle technologies for agricultural production management. Int. J. Agric. Biol. Eng. 6(3), 1–10 (2013)
25.
go back to reference Mohamadi, F.: U.S. Patent No. 8,880,241. Washington, DC: U.S. Patent and Trademark Office (2014) Mohamadi, F.: U.S. Patent No. 8,880,241. Washington, DC: U.S. Patent and Trademark Office (2014)
26.
go back to reference Sampedro, C., Martinez, C., Chauhan, A., Campoy, P.: A supervised approach to electric tower detection and classification for power line inspection. In 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1970–1977. IEEE, July 2014 Sampedro, C., Martinez, C., Chauhan, A., Campoy, P.: A supervised approach to electric tower detection and classification for power line inspection. In 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1970–1977. IEEE, July 2014
27.
go back to reference Santos, M.J., Disney, M., Chave, J.: Detecting human presence and influence on neotropical forests with remote sensing. Remote Sens. 10(10), 1593 (2018)CrossRef Santos, M.J., Disney, M., Chave, J.: Detecting human presence and influence on neotropical forests with remote sensing. Remote Sens. 10(10), 1593 (2018)CrossRef
Metadata
Title
Super-Resolution Algorithm Applied in the Zoning of Aerial Images
Authors
J. A. Baldion
E. Cascavita
C. H. Rodriguez-Garavito
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-89654-6_25

Premium Partner