Skip to main content
Erschienen in: Cluster Computing 2/2019

25.08.2018

Flow data processing paradigm and its application in smart city using a cluster analysis approach

verfasst von: Xiang Zou, Jinghua Cao, Wei Sun, Quan Guo, Tao Wen

Erschienen in: Cluster Computing | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the digital revolution era the work style of the people changed into real and live communicative systems. Smart cities are evolved from the smart ecosystem with various domains like healthcare, information exchange, transportation, buildings etc., the presence of multiple information system makes these smart cities into a heterogeneous which includes multiple data transfer based on the large no of interconnected sub systems. Since the systems provide data from various terminals to the host the amount of information generates is same as the chances of increasing the challenges and issues in the smart city. These flow data from various sources are handled using cluster computing and this proposed research provides the data flow in the smart city using cluster computing. Apache spark is the tool used to handle the issues in the smart city which is much better than the Hadoop. The results discuss the comparison between the applications in same environment on both the tools.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ranjbar, M., Amiri, M.: On the role of astrocyte analog circuit in neural frequency adaptation. Neural Comput. Appl. 28(5), 1109–1121 (2017)CrossRef Ranjbar, M., Amiri, M.: On the role of astrocyte analog circuit in neural frequency adaptation. Neural Comput. Appl. 28(5), 1109–1121 (2017)CrossRef
2.
Zurück zum Zitat Chen, Q., Zhang, G., Yang, X., Li, S., Li, Y., Wang, H.H.: Single image shadow detection and removal based on feature fusion and multiple dictionary learning. Multimed. Tools Appl. 77, 18601–18624 (2018)CrossRef Chen, Q., Zhang, G., Yang, X., Li, S., Li, Y., Wang, H.H.: Single image shadow detection and removal based on feature fusion and multiple dictionary learning. Multimed. Tools Appl. 77, 18601–18624 (2018)CrossRef
3.
Zurück zum Zitat Xiong, W., Shi, Y., Cao, J.: Stability analysis of two-dimensional neutral-type Cohen–Grossberg BAM neural networks. Neural Comput. Appl. 28(4), 703–716 (2017)CrossRef Xiong, W., Shi, Y., Cao, J.: Stability analysis of two-dimensional neutral-type Cohen–Grossberg BAM neural networks. Neural Comput. Appl. 28(4), 703–716 (2017)CrossRef
4.
Zurück zum Zitat Zhang, S., Wang, H., Huang, W., You, Z.: Plant diseased leaf segmentation and recognition by fusion of superpixel, K-means and PHOG. Optik Int. J. Light Electron Opt. 157, 866–872 (2018)CrossRef Zhang, S., Wang, H., Huang, W., You, Z.: Plant diseased leaf segmentation and recognition by fusion of superpixel, K-means and PHOG. Optik Int. J. Light Electron Opt. 157, 866–872 (2018)CrossRef
5.
Zurück zum Zitat Mansouri, I., Gholampour, A., Kisi, O., Ozbakkaloglu, T.: Evaluation of peak and residual conditions of actively confined concrete using neuro-fuzzy and neural computing techniques. Neural Comput. Appl. 29(3), 873–888 (2018)CrossRef Mansouri, I., Gholampour, A., Kisi, O., Ozbakkaloglu, T.: Evaluation of peak and residual conditions of actively confined concrete using neuro-fuzzy and neural computing techniques. Neural Comput. Appl. 29(3), 873–888 (2018)CrossRef
6.
Zurück zum Zitat Zhang, Y., Ren, J., Liu, J., Xu, C., Guo, H., Liu, Y.: A survey on emerging computing paradigms for big data. Chin. J. Electron. 26(1), 1–12 (2017)CrossRef Zhang, Y., Ren, J., Liu, J., Xu, C., Guo, H., Liu, Y.: A survey on emerging computing paradigms for big data. Chin. J. Electron. 26(1), 1–12 (2017)CrossRef
7.
Zurück zum Zitat Duan, M., Li, K., Tang, Z., Xiao, G., Li, K.: Selection and replacement algorithms for memory performance improvement in spark. Concurr. Comput. Pract. Exp. 28(8), 2473–2486 (2016)CrossRef Duan, M., Li, K., Tang, Z., Xiao, G., Li, K.: Selection and replacement algorithms for memory performance improvement in spark. Concurr. Comput. Pract. Exp. 28(8), 2473–2486 (2016)CrossRef
8.
Zurück zum Zitat Zhang, Y., Liu, M., Ma, B., Zhen, Y.: The performance evaluation of diagonal recurrent neural network with different chaos neurons. Neural Comput. Appl. 28(7), 1611–1618 (2017)CrossRef Zhang, Y., Liu, M., Ma, B., Zhen, Y.: The performance evaluation of diagonal recurrent neural network with different chaos neurons. Neural Comput. Appl. 28(7), 1611–1618 (2017)CrossRef
9.
Zurück zum Zitat Koçer, S., Tümer, A.E.: Classifying neuromuscular diseases using artificial neural networks with applied Autoregressive and Cepstral analysis. Neural Comput. Appl. 28(1), 945–952 (2017)CrossRef Koçer, S., Tümer, A.E.: Classifying neuromuscular diseases using artificial neural networks with applied Autoregressive and Cepstral analysis. Neural Comput. Appl. 28(1), 945–952 (2017)CrossRef
10.
Zurück zum Zitat Huang, W., Meng, L., Zhang, D., Zhang, W.: In-memory parallel processing of massive remotely sensed data using an apache spark on Hadoop YARN model. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 10(1), 3–19 (2017)CrossRef Huang, W., Meng, L., Zhang, D., Zhang, W.: In-memory parallel processing of massive remotely sensed data using an apache spark on Hadoop YARN model. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 10(1), 3–19 (2017)CrossRef
11.
Zurück zum Zitat Chen, J., Li, K., Tang, Z., Bilal, K., Yu, S., Weng, C., Li, K.: A parallel random forest algorithm for big data in a spark cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 28(4), 919–933 (2017)CrossRef Chen, J., Li, K., Tang, Z., Bilal, K., Yu, S., Weng, C., Li, K.: A parallel random forest algorithm for big data in a spark cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 28(4), 919–933 (2017)CrossRef
12.
Zurück zum Zitat Krim, H., Gentimis, T., Chintakunta, H.: Discovering the whole by the coarse: a topological paradigm for data analysis. IEEE Signal Process. Mag. 33(2), 95–104 (2016)CrossRef Krim, H., Gentimis, T., Chintakunta, H.: Discovering the whole by the coarse: a topological paradigm for data analysis. IEEE Signal Process. Mag. 33(2), 95–104 (2016)CrossRef
13.
Zurück zum Zitat Liu, H., Ning, H., Xiong, Q., Yang, L.T.: Shared authority based privacy-preserving authentication protocol in cloud computing. IEEE Trans. Parallel Distrib. Syst. 26(1), 241–251 (2015)CrossRef Liu, H., Ning, H., Xiong, Q., Yang, L.T.: Shared authority based privacy-preserving authentication protocol in cloud computing. IEEE Trans. Parallel Distrib. Syst. 26(1), 241–251 (2015)CrossRef
14.
Zurück zum Zitat Cao, D., Liu, P., Cui, W., Zhong, Y., An, B.: Cluster as a service: a resource sharing approach for private cloud. Tsinghua Sci. Technol. 21(6), 610–619 (2016)MATHCrossRef Cao, D., Liu, P., Cui, W., Zhong, Y., An, B.: Cluster as a service: a resource sharing approach for private cloud. Tsinghua Sci. Technol. 21(6), 610–619 (2016)MATHCrossRef
15.
Zurück zum Zitat Munir, A., Kansakar, P., Khan, S.U.: IFCIoT: integrated Fog Cloud IoT: a novel architectural paradigm for the future Internet of Things. IEEE Consum. Electron. Mag. 6(3), 74–82 (2017)CrossRef Munir, A., Kansakar, P., Khan, S.U.: IFCIoT: integrated Fog Cloud IoT: a novel architectural paradigm for the future Internet of Things. IEEE Consum. Electron. Mag. 6(3), 74–82 (2017)CrossRef
16.
Zurück zum Zitat Cai, H., Xu, B., Jiang, L., Vasilakos, A.V.: IoT-based big data storage systems in cloud computing: perspectives and challenges. IEEE Internet Things J. 4(1), 75–87 (2017) Cai, H., Xu, B., Jiang, L., Vasilakos, A.V.: IoT-based big data storage systems in cloud computing: perspectives and challenges. IEEE Internet Things J. 4(1), 75–87 (2017)
17.
Zurück zum Zitat Khalid, O., Khan, M.U.S., Huang, Y., Khan, S.U., Zomaya, A.: Evacsys: a cloud-based service for emergency evacuation. IEEE Cloud Comput. 3(1), 60–68 (2016)CrossRef Khalid, O., Khan, M.U.S., Huang, Y., Khan, S.U., Zomaya, A.: Evacsys: a cloud-based service for emergency evacuation. IEEE Cloud Comput. 3(1), 60–68 (2016)CrossRef
18.
Zurück zum Zitat Yassine, A., Singh, S., Alamri, A.: Mining human activity patterns from smart home big data for health care applications. IEEE Access 5, 13131–13141 (2017)CrossRef Yassine, A., Singh, S., Alamri, A.: Mining human activity patterns from smart home big data for health care applications. IEEE Access 5, 13131–13141 (2017)CrossRef
19.
Zurück zum Zitat Ma, Y., et al.: Remote sensing big data computing: challenges and opportunities. Future Gener. Comput. Syst. 51, 47–60 (2015)CrossRef Ma, Y., et al.: Remote sensing big data computing: challenges and opportunities. Future Gener. Comput. Syst. 51, 47–60 (2015)CrossRef
20.
Zurück zum Zitat Alves Filho, S.E., Burlamaqui, A.M.F., Aroca, R.V., Gonçalves, L.M.G.: NPi-cluster: a low power energy-proportional computing cluster architecture. IEEE Access 5, 16297–16313 (2017)CrossRef Alves Filho, S.E., Burlamaqui, A.M.F., Aroca, R.V., Gonçalves, L.M.G.: NPi-cluster: a low power energy-proportional computing cluster architecture. IEEE Access 5, 16297–16313 (2017)CrossRef
21.
Zurück zum Zitat Giachetta, R.: A framework for processing large scale geospatial and remote sensing data in map reduce environment. Comput. Graph 49, 37–46 (2015)CrossRef Giachetta, R.: A framework for processing large scale geospatial and remote sensing data in map reduce environment. Comput. Graph 49, 37–46 (2015)CrossRef
22.
Zurück zum Zitat Brisimi, T.S., Cassandras, C.G., Osgood, C., Paschalidis, I.C.H., Zhang, Y.: Sensing and classifying roadway obstacles in smart cities: the street bump system. IEEE Access 4, 1301–1312 (2016)CrossRef Brisimi, T.S., Cassandras, C.G., Osgood, C., Paschalidis, I.C.H., Zhang, Y.: Sensing and classifying roadway obstacles in smart cities: the street bump system. IEEE Access 4, 1301–1312 (2016)CrossRef
23.
Zurück zum Zitat Lyu, Y., et al.: High-performance scheduling model for multisensor gateway of cloud sensor system-based smart-living. Inf. Fusion 21, 42–56 (2015)CrossRef Lyu, Y., et al.: High-performance scheduling model for multisensor gateway of cloud sensor system-based smart-living. Inf. Fusion 21, 42–56 (2015)CrossRef
24.
Zurück zum Zitat Rehman, M.H., Liew, C.S., Wah, T.Y., Khan, M.K.: Towards next-generation heterogeneous mobile data stream mining applications: opportunities challenges and future research directions. J. Netw. Comput. Appl. 79, 1–24 (2017)CrossRef Rehman, M.H., Liew, C.S., Wah, T.Y., Khan, M.K.: Towards next-generation heterogeneous mobile data stream mining applications: opportunities challenges and future research directions. J. Netw. Comput. Appl. 79, 1–24 (2017)CrossRef
25.
Zurück zum Zitat Cickovski, T., Flor, T., Irving-Sachs, G., Novikov, P., Parda, J., Narasimhan, G.: GPUDePiCt: a parallel implementation of a clustering algorithm for computing degenerate primers on graphics processing units. IEEE/ACM Trans. Comput. Biol. Bioinform. 12(2), 445–454 (2015)CrossRef Cickovski, T., Flor, T., Irving-Sachs, G., Novikov, P., Parda, J., Narasimhan, G.: GPUDePiCt: a parallel implementation of a clustering algorithm for computing degenerate primers on graphics processing units. IEEE/ACM Trans. Comput. Biol. Bioinform. 12(2), 445–454 (2015)CrossRef
Metadaten
Titel
Flow data processing paradigm and its application in smart city using a cluster analysis approach
verfasst von
Xiang Zou
Jinghua Cao
Wei Sun
Quan Guo
Tao Wen
Publikationsdatum
25.08.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 2/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2839-y

Weitere Artikel der Ausgabe 2/2019

Cluster Computing 2/2019 Zur Ausgabe

Premium Partner