Skip to main content

2018 | OriginalPaper | Buchkapitel

Big Data and Computational Intelligence: Background, Trends, Challenges, and Opportunities

verfasst von : Sukey Nakasima-López, Mauricio A. Sanchez, Juan R. Castro

Erschienen in: Computer Science and Engineering—Theory and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The boom of technologies such as social media, mobile devices, internet of things, and so on, has generated enormous amounts of data that represent a tremendous challenge, since they come from different sources, different formats and are being generated in real time at an exponential speed which brings with it new necessities, opportunities, and many challenges both in the technical and analytical area. Some of the prevailing necessities lie on the development of computationally efficient algorithms that can extract value and knowledge from data and can manage the noise within in it. Computational intelligence can be seen as a key alternative to manage inaccuracies and extract value from Big Data, using fuzzy logic techniques for a better representation of the problem. And, if the concept of granular computing is also added, we will have new opportunities to decomposition of a complex data model into smaller, more defined, and meaningful granularity levels, therefore different perspectives could yield more manageable models. In this paper, two related subjects are covered, (1) the fundamentals and concepts of Big Data are described, and (2) an analysis of how computational intelligence techniques could bring benefits to this area is discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Brynjolfsson E, Kahin B (2000) Understanding the digital economy: data, tools and research. Massachusetts Institute of Technology Brynjolfsson E, Kahin B (2000) Understanding the digital economy: data, tools and research. Massachusetts Institute of Technology
2.
Zurück zum Zitat Rifkin J (2011) The third industrial revolution: how lateral power is transforming energy, the economy, and the world Rifkin J (2011) The third industrial revolution: how lateral power is transforming energy, the economy, and the world
3.
Zurück zum Zitat Helbing D (2015) Thinking ahead—essays on big data, digital revolution, and participatory market society Helbing D (2015) Thinking ahead—essays on big data, digital revolution, and participatory market society
4.
Zurück zum Zitat Akoka J, Comyn-Wattaiau I, Laoufi N (2017) Research on big data—a systematic mapping study. Comput Stand Interfaces 54:105–115CrossRef Akoka J, Comyn-Wattaiau I, Laoufi N (2017) Research on big data—a systematic mapping study. Comput Stand Interfaces 54:105–115CrossRef
5.
Zurück zum Zitat Thomson JR (2015) High integrity systems and safety management in hazardous industries Thomson JR (2015) High integrity systems and safety management in hazardous industries
6.
Zurück zum Zitat Rodríguez-Mazahua L, Rodríguez-Enríquez CA, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomput 72(8):3073–3113CrossRef Rodríguez-Mazahua L, Rodríguez-Enríquez CA, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomput 72(8):3073–3113CrossRef
7.
Zurück zum Zitat Oussous A, Benjelloun FZ, Ait Lahcen A, Belfkih S (2017) Big data technologies: a survey. J King Saud Univ Comput Inf Sci Oussous A, Benjelloun FZ, Ait Lahcen A, Belfkih S (2017) Big data technologies: a survey. J King Saud Univ Comput Inf Sci
8.
Zurück zum Zitat McKinsey & Company (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute, p 156 McKinsey & Company (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute, p 156
9.
Zurück zum Zitat Niño M, Illarramendi A (2015) Entendiendo el Big Data: antecedentes, origen y desarrollo posterior. DYNA NEW Technol 2(3), p [8 p]–[8] Niño M, Illarramendi A (2015) Entendiendo el Big Data: antecedentes, origen y desarrollo posterior. DYNA NEW Technol 2(3), p [8 p]–[8]
10.
Zurück zum Zitat Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, vol 2 Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, vol 2
11.
Zurück zum Zitat Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35(2):137–144CrossRef Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35(2):137–144CrossRef
12.
Zurück zum Zitat Srilekha M (2015) Page rank algorithm in map reducing for big data. Int J Conceptions Comput Inf Technol 3(1):3–5 Srilekha M (2015) Page rank algorithm in map reducing for big data. Int J Conceptions Comput Inf Technol 3(1):3–5
13.
Zurück zum Zitat Chen M, Mao S, Liu Y (2014) Big data: a survey. Mobile Netw Appl 19(2):171–209CrossRef Chen M, Mao S, Liu Y (2014) Big data: a survey. Mobile Netw Appl 19(2):171–209CrossRef
14.
15.
Zurück zum Zitat Hashem IAT, Yaqoob I, Anuar NB, Mokhtar S, Gani A, Ullah Khan S (2015) The rise of ‘big data’ on cloud computing: review and open research issues. Inf Syst 47:98–115CrossRef Hashem IAT, Yaqoob I, Anuar NB, Mokhtar S, Gani A, Ullah Khan S (2015) The rise of ‘big data’ on cloud computing: review and open research issues. Inf Syst 47:98–115CrossRef
16.
Zurück zum Zitat Lee I (2017) Big data: dimensions, evolution, impacts, and challenges. Bus Horiz 60(3):293–303CrossRef Lee I (2017) Big data: dimensions, evolution, impacts, and challenges. Bus Horiz 60(3):293–303CrossRef
17.
Zurück zum Zitat Wang H, Xu Z, Pedrycz W (2017) An overview on the roles of fuzzy set techniques in big data processing: trends, challenges and opportunities. Knowl Based Syst 118:15–30CrossRef Wang H, Xu Z, Pedrycz W (2017) An overview on the roles of fuzzy set techniques in big data processing: trends, challenges and opportunities. Knowl Based Syst 118:15–30CrossRef
18.
Zurück zum Zitat Curry E (2016) The big data value chain: definitions, concepts, and theoretical approaches. In: New horizons for a data-driven economy: a roadmap for usage and exploitation of big data in Europe, pp 29–37 Curry E (2016) The big data value chain: definitions, concepts, and theoretical approaches. In: New horizons for a data-driven economy: a roadmap for usage and exploitation of big data in Europe, pp 29–37
19.
Zurück zum Zitat Lyko K, Nitzschke M, Ngomo A-CN (2016) Big data acquisition Lyko K, Nitzschke M, Ngomo A-CN (2016) Big data acquisition
20.
Zurück zum Zitat Freitas A, Curry E (2016) Big data curation Freitas A, Curry E (2016) Big data curation
21.
Zurück zum Zitat Strohbach M, Daubert J, Ravkin H, Lischka M (2016) Big data storage. In: New horizons for a data-driven economy, pp 119–141 Strohbach M, Daubert J, Ravkin H, Lischka M (2016) Big data storage. In: New horizons for a data-driven economy, pp 119–141
22.
Zurück zum Zitat Yaqoob I et al (2016) Big data: from beginning to future. Int J Inf Manage 36(6):1231–1247 PergamonCrossRef Yaqoob I et al (2016) Big data: from beginning to future. Int J Inf Manage 36(6):1231–1247 PergamonCrossRef
23.
Zurück zum Zitat Jin X, Wah BW, Cheng X, Wang Y (2015) Significance and challenges of big data research. Big Data Res 2(2):59–64CrossRef Jin X, Wah BW, Cheng X, Wang Y (2015) Significance and challenges of big data research. Big Data Res 2(2):59–64CrossRef
24.
Zurück zum Zitat Sivarajah U, Kamal MM, Irani Z, Weerakkody V (2017) Critical analysis of big data challenges and analytical methods. J Bus Res 70:263–286CrossRef Sivarajah U, Kamal MM, Irani Z, Weerakkody V (2017) Critical analysis of big data challenges and analytical methods. J Bus Res 70:263–286CrossRef
25.
Zurück zum Zitat Ahmed E et al (2017) The role of big data analytics in internet of things. Comput Netw Ahmed E et al (2017) The role of big data analytics in internet of things. Comput Netw
26.
Zurück zum Zitat Alharthi A, Krotov V, Bowman M (2017) Addressing barriers to big data. Bus Horiz 60(3):285–292CrossRef Alharthi A, Krotov V, Bowman M (2017) Addressing barriers to big data. Bus Horiz 60(3):285–292CrossRef
27.
Zurück zum Zitat Hill R (2010) Computational intelligence and emerging data technologies. In: Proceedings—2nd international conference on intelligent networking and collaborative systems, INCOS 2010, pp 449–454 Hill R (2010) Computational intelligence and emerging data technologies. In: Proceedings—2nd international conference on intelligent networking and collaborative systems, INCOS 2010, pp 449–454
28.
Zurück zum Zitat Jang J, E M, Sun CT (1997) Neuro-fuzzy and soft computing-a computational approach to learning and machine intelligence. Autom Control IEEE 42(10):1482–1484CrossRef Jang J, E M, Sun CT (1997) Neuro-fuzzy and soft computing-a computational approach to learning and machine intelligence. Autom Control IEEE 42(10):1482–1484CrossRef
29.
Zurück zum Zitat Engelbrecht AP (2007) Computational intelligence: an introduction, 2nd edn Engelbrecht AP (2007) Computational intelligence: an introduction, 2nd edn
30.
Zurück zum Zitat Kruse R, Borgelt C, Klawonn F, Moewes C, Steinbrecher M, Held P (2013) Computational intelligence. Springer, BerlinCrossRefMATH Kruse R, Borgelt C, Klawonn F, Moewes C, Steinbrecher M, Held P (2013) Computational intelligence. Springer, BerlinCrossRefMATH
31.
Zurück zum Zitat Kar AK (2016) Bio inspired computing—a review of algorithms and scope of applications. Expert Syst Appl 59:20–32CrossRef Kar AK (2016) Bio inspired computing—a review of algorithms and scope of applications. Expert Syst Appl 59:20–32CrossRef
32.
Zurück zum Zitat Kumar EP, Sharma EP (2014) Artificial neural networks—a study. Int J Emerg Eng Res Technol 2(2):143–148 Kumar EP, Sharma EP (2014) Artificial neural networks—a study. Int J Emerg Eng Res Technol 2(2):143–148
33.
Zurück zum Zitat Elmetwally MM, Aal FA, Awad ML, Omran S (2008) A hopfield neural network approach for integrated transmission network expansion planning. J Appl Sci Res 4(11):1387–1394 Elmetwally MM, Aal FA, Awad ML, Omran S (2008) A hopfield neural network approach for integrated transmission network expansion planning. J Appl Sci Res 4(11):1387–1394
34.
Zurück zum Zitat Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems. In: Artificial intelligence: a guide to intelligent systems. Pearson Education, pp 87–113 Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems. In: Artificial intelligence: a guide to intelligent systems. Pearson Education, pp 87–113
35.
Zurück zum Zitat Biryulev C, Yakymiv Y, Selemonavichus A (2010) Research of ANN usage in data mining and semantic integration. In: MEMSTECH’2010 Biryulev C, Yakymiv Y, Selemonavichus A (2010) Research of ANN usage in data mining and semantic integration. In: MEMSTECH’2010
36.
37.
Zurück zum Zitat Govind Maheswaran JJ, Jayarajan P, Johnes J (2013) K-means clustering algorithms: a comparative study Govind Maheswaran JJ, Jayarajan P, Johnes J (2013) K-means clustering algorithms: a comparative study
38.
Zurück zum Zitat Jain S (2017) Mining big data using genetic algorithm. Int Res J Eng Technol 4(7):743–747 Jain S (2017) Mining big data using genetic algorithm. Int Res J Eng Technol 4(7):743–747
39.
Zurück zum Zitat Ross TJ et al (2004) Fuzzy logic with engineering applications. IEEE Trans Inf Theory 58(3):1–19MATH Ross TJ et al (2004) Fuzzy logic with engineering applications. IEEE Trans Inf Theory 58(3):1–19MATH
40.
Zurück zum Zitat Fernández A, Carmona CJ, del Jesus MJ, Herrera F (2016) A view on fuzzy systems for big data: progress and opportunities. Int J Comput Intell Syst 9:69–80CrossRef Fernández A, Carmona CJ, del Jesus MJ, Herrera F (2016) A view on fuzzy systems for big data: progress and opportunities. Int J Comput Intell Syst 9:69–80CrossRef
41.
Zurück zum Zitat Almejalli K, Dahal K, Hossain A (2007) GA-based learning algorithms to identify fuzzy rules for fuzzy neural networks. In: Proceedings of the 7th international conference on intelligent systems design and applications, ISDA 2007, pp 289–294 Almejalli K, Dahal K, Hossain A (2007) GA-based learning algorithms to identify fuzzy rules for fuzzy neural networks. In: Proceedings of the 7th international conference on intelligent systems design and applications, ISDA 2007, pp 289–294
42.
Zurück zum Zitat Pal SK, Meher SK, Skowron A (2015) Data science, big data and granular mining. Pattern Recogn Lett 67:109–112CrossRef Pal SK, Meher SK, Skowron A (2015) Data science, big data and granular mining. Pattern Recogn Lett 67:109–112CrossRef
43.
Zurück zum Zitat Yao Y (2008) Human-inspired granular computing 2. Granular computing as human-inspired problem solving, No. 1972, pp 401–410 Yao Y (2008) Human-inspired granular computing 2. Granular computing as human-inspired problem solving, No. 1972, pp 401–410
44.
Zurück zum Zitat Qiu J, Wu Q, Ding G, Xu Y, Feng S (2016) A survey of machine learning for big data processing. EURASIP J Adv Sign Process 2016(1):67CrossRef Qiu J, Wu Q, Ding G, Xu Y, Feng S (2016) A survey of machine learning for big data processing. EURASIP J Adv Sign Process 2016(1):67CrossRef
45.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
46.
Zurück zum Zitat Baum LE, Petrie T (1966) Statistical inference for probabilistic functions of finite state Markov chains. Ann Math Stat 37(6):1554–1563MathSciNetCrossRefMATH Baum LE, Petrie T (1966) Statistical inference for probabilistic functions of finite state Markov chains. Ann Math Stat 37(6):1554–1563MathSciNetCrossRefMATH
47.
Zurück zum Zitat Rish I (2001) An empirical study of the Naïve Bayes classifier. IJCAI 2001 Work Empir Meth Artif Intell 3 Rish I (2001) An empirical study of the Naïve Bayes classifier. IJCAI 2001 Work Empir Meth Artif Intell 3
48.
Zurück zum Zitat Zarikas V, Papageorgiou E, Regner P (2015) Bayesian network construction using a fuzzy rule based approach for medical decision support. Expert Syst 32:344–369 Zarikas V, Papageorgiou E, Regner P (2015) Bayesian network construction using a fuzzy rule based approach for medical decision support. Expert Syst 32:344–369
49.
Zurück zum Zitat Erar B (2011) Mixture model cluster analysis under different covariance structures using information complexity Erar B (2011) Mixture model cluster analysis under different covariance structures using information complexity
50.
Zurück zum Zitat Pelleg D, Pelleg D, Moore AW, Moore AW (2000) X-means: extending K-means with efficient estimation of the number of clusters. In: Proceedings of the seventeenth international conference on machine learning, pp 727–734 Pelleg D, Pelleg D, Moore AW, Moore AW (2000) X-means: extending K-means with efficient estimation of the number of clusters. In: Proceedings of the seventeenth international conference on machine learning, pp 727–734
51.
Zurück zum Zitat Pandey D, Pandey P (2010) Approximate Q-learning: an introduction. In: 2010 second international conference on machine learning and computing, pp 317–320 Pandey D, Pandey P (2010) Approximate Q-learning: an introduction. In: 2010 second international conference on machine learning and computing, pp 317–320
52.
Zurück zum Zitat Desai S, Joshi K, Desai B (2016) Survey on reinforcement learning techniques. Int J Sci Res Publ 6(2):179–2250 Desai S, Joshi K, Desai B (2016) Survey on reinforcement learning techniques. Int J Sci Res Publ 6(2):179–2250
53.
Zurück zum Zitat Abramson M, Wechsler H (2001) Competitive reinforcement learning for combinatorial problems. In: Proceedings of the international joint conference on neural networks IJCNN’01, vol 4, pp 2333–2338 Abramson M, Wechsler H (2001) Competitive reinforcement learning for combinatorial problems. In: Proceedings of the international joint conference on neural networks IJCNN’01, vol 4, pp 2333–2338
54.
Zurück zum Zitat Zhou L, Pan S, Wang J, Vasilakos AV (2017) Machine learning on big data: opportunities and challenges. Neurocomputing 237:350–361CrossRef Zhou L, Pan S, Wang J, Vasilakos AV (2017) Machine learning on big data: opportunities and challenges. Neurocomputing 237:350–361CrossRef
Metadaten
Titel
Big Data and Computational Intelligence: Background, Trends, Challenges, and Opportunities
verfasst von
Sukey Nakasima-López
Mauricio A. Sanchez
Juan R. Castro
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-74060-7_10