Skip to main content
Top

2020 | OriginalPaper | Chapter

A Parallel Drone Image Mosaic Method Based on Apache Spark

Authors : Yirui Wu, Lanbo Ge, Yuchi Luo, Deqiang Teng, Jun Feng

Published in: Cloud Computing, Smart Grid and Innovative Frontiers in Telecommunications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

MapReduce has been widely used to process large-scale data in the past decade. Among the quantity of such cloud computing applications, we pay special attention to distributed mosaic methods based on numerous drone images, which suffers from costly processing time. In this paper, a novel computing framework called Apache Spark is introduced to pursue instant responses for the quantity of drone image mosaic requests. To assure high performance of Spark-based algorithms in a complex cloud computing environment, we specially design a distributed and parallel drone image mosaic method. By modifying to be fit for fast and parallel running, all steps of the proposed mosaic method can be executed in an efficient and parallel manner. We implement the proposed method on Apache Spark platform and apply it to a few self-collected datasets. Experiments indicate that our Spark-based parallel algorithm is of great efficiency and is robust to process low-quality drone aerial images.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Capel, D.: Image mosaicing and super resolution. Ph.D. thesis, University of Oxford (2004) Capel, D.: Image mosaicing and super resolution. Ph.D. thesis, University of Oxford (2004)
4.
go back to reference Dean, J., Ghemawat, S.: Mapreduce: a flexible data processing tool. Commun. ACM 53(1), 72–77 (2010)CrossRef Dean, J., Ghemawat, S.: Mapreduce: a flexible data processing tool. Commun. ACM 53(1), 72–77 (2010)CrossRef
5.
go back to reference Huang, W., Meng, L., Zhang, D., Zhang, W.: In-memory parallel processing of massive remotely sensed data using an Apache Spark on Hadoop YARN model. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 10(1), 3–19 (2017)CrossRef Huang, W., Meng, L., Zhang, D., Zhang, W.: In-memory parallel processing of massive remotely sensed data using an Apache Spark on Hadoop YARN model. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 10(1), 3–19 (2017)CrossRef
6.
go back to reference Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of Computer Vision and Pattern Recognition, vol. 2, p. II. IEEE (2004) Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: Proceedings of Computer Vision and Pattern Recognition, vol. 2, p. II. IEEE (2004)
7.
go back to reference Lee, J.N., Kwak, K.C.: A trends analysis of image processing in unmanned aerial vehicle. Int. J. Comput. Inf. Sci. Eng. 8(2), 2–5 (2014) Lee, J.N., Kwak, K.C.: A trends analysis of image processing in unmanned aerial vehicle. Int. J. Comput. Inf. Sci. Eng. 8(2), 2–5 (2014)
9.
go back to reference Lyu, M.R., Song, J., Cai, M.: A comprehensive method for multilingual video text detection, localization, and extraction. IEEE Trans. Circuits Syst. Video Techn. 15(2), 243–255 (2005)CrossRef Lyu, M.R., Song, J., Cai, M.: A comprehensive method for multilingual video text detection, localization, and extraction. IEEE Trans. Circuits Syst. Video Techn. 15(2), 243–255 (2005)CrossRef
10.
go back to reference Ma, Y., et al.: Remote sensing big data computing: challenges and opportunities. Future Gener. Comput. Syst. 51, 47–60 (2015)CrossRef Ma, Y., et al.: Remote sensing big data computing: challenges and opportunities. Future Gener. Comput. Syst. 51, 47–60 (2015)CrossRef
11.
go back to reference Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef
12.
go back to reference Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef
13.
go back to reference Moravec, H.P.: Rover visual obstacle avoidance. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 785–790 (1981) Moravec, H.P.: Rover visual obstacle avoidance. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 785–790 (1981)
14.
15.
go back to reference Rodriguez, A., Boddeti, V.N., Kumar, B.V.K.V., Mahalanobis, A.: Maximum margin correlation filter: a new approach for localization and classification. IEEE Trans. Image Process. 22(2), 631–643 (2013)MathSciNetCrossRef Rodriguez, A., Boddeti, V.N., Kumar, B.V.K.V., Mahalanobis, A.: Maximum margin correlation filter: a new approach for localization and classification. IEEE Trans. Image Process. 22(2), 631–643 (2013)MathSciNetCrossRef
16.
go back to reference Taylor, G.W., Spiro, I., Bregler, C., Fergus, R.: Learning invariance through imitation. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 2729–2736 (2011) Taylor, G.W., Spiro, I., Bregler, C., Fergus, R.: Learning invariance through imitation. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 2729–2736 (2011)
17.
go back to reference Vavilapalli, V.K., et al.: Apache Hadoop YARN: yet another resource negotiator. In: Proceedings of ACM Symposium on Cloud Computing, pp. 5:1–5:16 (2013) Vavilapalli, V.K., et al.: Apache Hadoop YARN: yet another resource negotiator. In: Proceedings of ACM Symposium on Cloud Computing, pp. 5:1–5:16 (2013)
18.
go back to reference Wang, F.B., Tu, P., Wu, C., Chen, L., Feng, D.: Multi-image mosaic with SIFT and vision measurement for microscale structures processed by femtosecond laser. Opt. Lasers Eng. 100, 124–130 (2018)CrossRef Wang, F.B., Tu, P., Wu, C., Chen, L., Feng, D.: Multi-image mosaic with SIFT and vision measurement for microscale structures processed by femtosecond laser. Opt. Lasers Eng. 100, 124–130 (2018)CrossRef
19.
go back to reference Wang, J., et al.: Learning fine-grained image similarity with deep ranking. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 1386–1393 (2014) Wang, J., et al.: Learning fine-grained image similarity with deep ranking. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 1386–1393 (2014)
21.
go back to reference Xin, R., Deyhim, P., Ghodsi, A., Meng, X., Zaharia, M.: Graysort on apache spark by databricks. GraySort Competition (2014) Xin, R., Deyhim, P., Ghodsi, A., Meng, X., Zaharia, M.: Graysort on apache spark by databricks. GraySort Competition (2014)
22.
go back to reference Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I.: Spark: cluster computing with working sets. In: Proceedings of 2nd USENIX Workshop on Hot Topics in Cloud Computing (2010) Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I.: Spark: cluster computing with working sets. In: Proceedings of 2nd USENIX Workshop on Hot Topics in Cloud Computing (2010)
24.
go back to reference Zhou, G., et al.: Paper infrared image retrieval of power equipment based on perceptual hash and surf. In: Proceedings of International Conference on Advanced Infocomm Technology (ICAIT), pp. 387–392. IEEE (2017) Zhou, G., et al.: Paper infrared image retrieval of power equipment based on perceptual hash and surf. In: Proceedings of International Conference on Advanced Infocomm Technology (ICAIT), pp. 387–392. IEEE (2017)
25.
go back to reference Zhou, Z., Wang, Y., Wu, Q.J., Yang, C.N., Sun, X.: Effective and efficient global context verification for image copy detection. IEEE Trans. Inf. Forensics Secur. 12(1), 48–63 (2017)CrossRef Zhou, Z., Wang, Y., Wu, Q.J., Yang, C.N., Sun, X.: Effective and efficient global context verification for image copy detection. IEEE Trans. Inf. Forensics Secur. 12(1), 48–63 (2017)CrossRef
Metadata
Title
A Parallel Drone Image Mosaic Method Based on Apache Spark
Authors
Yirui Wu
Lanbo Ge
Yuchi Luo
Deqiang Teng
Jun Feng
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-48513-9_25

Premium Partner