Skip to main content

2015 | OriginalPaper | Buchkapitel

Digital Filter Implementation in Hadoop Data Mining System

verfasst von : Dariusz Czerwinski

Erschienen in: Computer Networks

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Paper presents Savitzky-Golay digital filter implementation using the R software environment in private Hadoop Data Mining System. The idea of the research was the implementation of the digital filter to handle big data came from measurements. The study focused on proper filter implementation and comparison of the results with National Instruments Diadem – enterprise class system for data management and mining.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zyla, J., Finnon, P., Bulman, R., Bouffler, S., Badie, C., Polanska, J.: Investigation for genetic signature of radiosensitivity - data analysis. In: Gruca, A., Czachorski, T., Kozielski, S. (eds.) Man-Machine Interactions 3, vol. 242, pp. 219–227. Springer, Switzerland (2014)CrossRef Zyla, J., Finnon, P., Bulman, R., Bouffler, S., Badie, C., Polanska, J.: Investigation for genetic signature of radiosensitivity - data analysis. In: Gruca, A., Czachorski, T., Kozielski, S. (eds.) Man-Machine Interactions 3, vol. 242, pp. 219–227. Springer, Switzerland (2014)CrossRef
2.
Zurück zum Zitat Woźniak, M., Marszałek, Z., Gabryel, M., Nowicki, R.K.: Modified merge sort algorithm for large scale data sets. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013, Part II. LNCS, vol. 7895, pp. 612–622. Springer, Heidelberg (2013) CrossRef Woźniak, M., Marszałek, Z., Gabryel, M., Nowicki, R.K.: Modified merge sort algorithm for large scale data sets. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013, Part II. LNCS, vol. 7895, pp. 612–622. Springer, Heidelberg (2013) CrossRef
3.
Zurück zum Zitat Folkert, K., Bochenek, M., Huczała, Ł.: The concept of using data mining methods for creating efficiency and reliability model of middleware applications. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2012. CCIS, vol. 291, pp. 55–62. Springer, Heidelberg (2012) CrossRef Folkert, K., Bochenek, M., Huczała, Ł.: The concept of using data mining methods for creating efficiency and reliability model of middleware applications. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2012. CCIS, vol. 291, pp. 55–62. Springer, Heidelberg (2012) CrossRef
4.
Zurück zum Zitat Czajkowski, K., Drabowski, M.: Semantic data selections and mining in decision tables. In: Czachórski, T., Kozielski, S., Stańczyk, U. (eds.) Man-Machine Interactions 2. AISC, vol. 103, pp. 279–286. Springer, Heidelberg (2011) CrossRef Czajkowski, K., Drabowski, M.: Semantic data selections and mining in decision tables. In: Czachórski, T., Kozielski, S., Stańczyk, U. (eds.) Man-Machine Interactions 2. AISC, vol. 103, pp. 279–286. Springer, Heidelberg (2011) CrossRef
5.
Zurück zum Zitat Jestratjew, A., Kwiecień, A.: Using cloud storage in production monitoring systems. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2010. CCIS, vol. 79, pp. 226–235. Springer, Heidelberg (2010) CrossRef Jestratjew, A., Kwiecień, A.: Using cloud storage in production monitoring systems. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2010. CCIS, vol. 79, pp. 226–235. Springer, Heidelberg (2010) CrossRef
6.
Zurück zum Zitat Borzemski, L.: Data mining in evaluation of internet path performance. In: Orchard, B., Yang, C., Ali, M. (eds.) IEA/AIE 2004. LNCS (LNAI), vol. 3029, pp. 643–652. Springer, Heidelberg (2004) CrossRef Borzemski, L.: Data mining in evaluation of internet path performance. In: Orchard, B., Yang, C., Ali, M. (eds.) IEA/AIE 2004. LNCS (LNAI), vol. 3029, pp. 643–652. Springer, Heidelberg (2004) CrossRef
7.
Zurück zum Zitat Yao, K.T., Lucas, R., Gottschalk, T., Wagenbreth, G., Ward, C.: Data analysis for massively distributed simulations. In: Interservice/Industry Training, Simulation, and Education Conference IITSEC 2009 Paper No. 9350 (2009) Yao, K.T., Lucas, R., Gottschalk, T., Wagenbreth, G., Ward, C.: Data analysis for massively distributed simulations. In: Interservice/Industry Training, Simulation, and Education Conference IITSEC 2009 Paper No. 9350 (2009)
8.
Zurück zum Zitat Krauzowicz, Ł., Szostek, K., Dwornik, M., Oleksik, P., Piórkowski, A.: Numerical calculations for geophysics inversion problem using apache hadoop technology. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2012. CCIS, vol. 291, pp. 440–447. Springer, Heidelberg (2012) CrossRef Krauzowicz, Ł., Szostek, K., Dwornik, M., Oleksik, P., Piórkowski, A.: Numerical calculations for geophysics inversion problem using apache hadoop technology. In: Kwiecień, A., Gaj, P., Stera, P. (eds.) CN 2012. CCIS, vol. 291, pp. 440–447. Springer, Heidelberg (2012) CrossRef
9.
Zurück zum Zitat Ohri, A.: R for Cloud Computing, An Approach for Data Scientists. Springer, New York (2014) CrossRef Ohri, A.: R for Cloud Computing, An Approach for Data Scientists. Springer, New York (2014) CrossRef
11.
Zurück zum Zitat Ferzli, R., Khalife, I.: Mobile cloud computing educational tool for image/video processing algorithms. In: Digital Signal Processing Workshop and IEEE Signal Processing Education Workshop (DSP/SPE), pp. 529–533 (2011) Ferzli, R., Khalife, I.: Mobile cloud computing educational tool for image/video processing algorithms. In: Digital Signal Processing Workshop and IEEE Signal Processing Education Workshop (DSP/SPE), pp. 529–533 (2011)
12.
Zurück zum Zitat Sheng, C., Zhao, J., Leung, H., Wang, W.: Extended kalman filter based echo state network for time series prediction using mapreduce framework. In: Ninth IEEE International Conference on Mobile Ad-hoc and Sensor Networks, pp. 175–180. IEEE (2013) Sheng, C., Zhao, J., Leung, H., Wang, W.: Extended kalman filter based echo state network for time series prediction using mapreduce framework. In: Ninth IEEE International Conference on Mobile Ad-hoc and Sensor Networks, pp. 175–180. IEEE (2013)
13.
Zurück zum Zitat Torgo, L.: Data mining with R: learning with case studies. Chapman and Hall, CRC Data Mining and Knowledge Discovery Series (2010) Torgo, L.: Data mining with R: learning with case studies. Chapman and Hall, CRC Data Mining and Knowledge Discovery Series (2010)
19.
Zurück zum Zitat Kampf, M., Kantelhardt, J.W.: Hadoop.TS: large-scale time-series processing. Int. J. Comput. Appl. 74(17), 1–8 (2013) Kampf, M., Kantelhardt, J.W.: Hadoop.TS: large-scale time-series processing. Int. J. Comput. Appl. 74(17), 1–8 (2013)
20.
Zurück zum Zitat Li, L., Ma, Z., Liu, L., Fan, Y.: Hadoop-based ARIMA algorithm and its application in weather forecast. Int. J. Database Theory Appl. 6(5), 119–132 (2013)CrossRef Li, L., Ma, Z., Liu, L., Fan, Y.: Hadoop-based ARIMA algorithm and its application in weather forecast. Int. J. Database Theory Appl. 6(5), 119–132 (2013)CrossRef
21.
Zurück zum Zitat Stokely, M., Rohani, F., Tassone, E.: Large-scale parallel statistical forecasting computations in R. In: JSM Proceedings (2011) Stokely, M., Rohani, F., Tassone, E.: Large-scale parallel statistical forecasting computations in R. In: JSM Proceedings (2011)
22.
Zurück zum Zitat Nurmi, D., Wolski, R., Grzegorczyk, Ch., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The eucalyptus open-source cloud-computing system. In: 9th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID), pp. 124–131 (2009) Nurmi, D., Wolski, R., Grzegorczyk, Ch., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The eucalyptus open-source cloud-computing system. In: 9th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID), pp. 124–131 (2009)
23.
Zurück zum Zitat Donnelly, P., Bui, P., Thain, D.: Attaching cloud storage to a campus grid using parrot, chirp, and hadoop. In: IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp. 488–495 (2010) Donnelly, P., Bui, P., Thain, D.: Attaching cloud storage to a campus grid using parrot, chirp, and hadoop. In: IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp. 488–495 (2010)
24.
Zurück zum Zitat Kreps, D.: The time of our lives: understanding irreversible complex user experiences. In: Kimppa, K., Whitehouse, D., Kuusela, T., Phahlamohlaka, J. (eds.) HCC11 2014. IFIP AICT, vol. 431, pp. 47–56. Springer, Heidelberg (2014) CrossRef Kreps, D.: The time of our lives: understanding irreversible complex user experiences. In: Kimppa, K., Whitehouse, D., Kuusela, T., Phahlamohlaka, J. (eds.) HCC11 2014. IFIP AICT, vol. 431, pp. 47–56. Springer, Heidelberg (2014) CrossRef
29.
Zurück zum Zitat Adler, J.: R in a Nutshell, 2nd edn. O’Reilly, Sebastopol (2012) Adler, J.: R in a Nutshell, 2nd edn. O’Reilly, Sebastopol (2012)
31.
Zurück zum Zitat Czerwinski, D., Jaroszynski, L., Janowski, T., Kozak, J., Majka, M.: Analysis of alternating overcurrent response of 2G HTS tape for SFCL. IEEE Trans. Appl. Supercond. 24(3), Article no. 5600104 (2014). doi:10.1109/TASC.2013.2281494 Czerwinski, D., Jaroszynski, L., Janowski, T., Kozak, J., Majka, M.: Analysis of alternating overcurrent response of 2G HTS tape for SFCL. IEEE Trans. Appl. Supercond. 24(3), Article no. 5600104 (2014). doi:10.​1109/​TASC.​2013.​2281494
Metadaten
Titel
Digital Filter Implementation in Hadoop Data Mining System
verfasst von
Dariusz Czerwinski
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-19419-6_39

Premium Partner