Skip to main content

2020 | OriginalPaper | Buchkapitel

Big Data Analysis: Theory and Applications

verfasst von : Yong Shi, Pei Quan

Erschienen in: Large-Scale Scientific Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the continuous improvement of data processing capabilities and storage capabilities, Big Data Era has entered the public sight. Under such a circumstance, the generation of massive data has greatly facilitated the development of data mining algorithms. This paper describes the status of data mining and presents three of our works: optimization-based data mining, intelligent knowledge and the intelligence quotient of Artificial Intelligence respectively. Besides that, we also introduced some applications that have emerged in the context of big data. Furthermore, this paper indicates three potential directions for future research of big data analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cios, K.J., Moore, G.W.: Uniqueness of medical data mining. Artif. Intell. Med. 26(1–2), 1–24 (2002)CrossRef Cios, K.J., Moore, G.W.: Uniqueness of medical data mining. Artif. Intell. Med. 26(1–2), 1–24 (2002)CrossRef
2.
Zurück zum Zitat Freed, N., Glover, F.: Simple but powerful goal programming models for discriminant problems. Eur. J. Oper. Res. 7(1), 44–60 (1981)CrossRef Freed, N., Glover, F.: Simple but powerful goal programming models for discriminant problems. Eur. J. Oper. Res. 7(1), 44–60 (1981)CrossRef
3.
Zurück zum Zitat He, J., Liu, X., Shi, Y., Xu, W., Yan, N.: Classifications of credit cardholder behavior by using fuzzy linear programming. Int. J. Inf. Technol. Decis. Making 3(04), 633–650 (2004)CrossRef He, J., Liu, X., Shi, Y., Xu, W., Yan, N.: Classifications of credit cardholder behavior by using fuzzy linear programming. Int. J. Inf. Technol. Decis. Making 3(04), 633–650 (2004)CrossRef
4.
Zurück zum Zitat Kou, G.: Multi-class multi-criteria mathematical programming and its applications in large scale data mining problems. Ph.D. thesis, University of Nebraska at Omaha (2006) Kou, G.: Multi-class multi-criteria mathematical programming and its applications in large scale data mining problems. Ph.D. thesis, University of Nebraska at Omaha (2006)
5.
Zurück zum Zitat Kou, G., Liu, X., Peng, Y., Shi, Y., Wise, M., Xu, W.: Multiple criteria linear programming approach to data mining: models, algorithm designs and software development. Optim. Methods Softw. 18(4), 453–473 (2003)MathSciNetCrossRef Kou, G., Liu, X., Peng, Y., Shi, Y., Wise, M., Xu, W.: Multiple criteria linear programming approach to data mining: models, algorithm designs and software development. Optim. Methods Softw. 18(4), 453–473 (2003)MathSciNetCrossRef
6.
Zurück zum Zitat Kovalerchuk, B., Vityaev, E.: Data Mining in Finance: Advances in Relational and Hybrid Methods, vol. 547. Springer, Heidelberg (2006)MATH Kovalerchuk, B., Vityaev, E.: Data Mining in Finance: Advances in Relational and Hybrid Methods, vol. 547. Springer, Heidelberg (2006)MATH
7.
Zurück zum Zitat Li, A., Shi, Y., He, J.: MCLP-based methods for improving bad catching rate in credit cardholder behavior analysis. Appl. Soft Comput. 8(3), 1259–1265 (2008)CrossRef Li, A., Shi, Y., He, J.: MCLP-based methods for improving bad catching rate in credit cardholder behavior analysis. Appl. Soft Comput. 8(3), 1259–1265 (2008)CrossRef
8.
Zurück zum Zitat Liu, F., Shi, Y.: The search engine IQ test based on the internet IQ evaluation algorithm. Proc. Comput. Sci. 31, 1066–1073 (2014)CrossRef Liu, F., Shi, Y.: The search engine IQ test based on the internet IQ evaluation algorithm. Proc. Comput. Sci. 31, 1066–1073 (2014)CrossRef
9.
Zurück zum Zitat Liu, F., Shi, Y., Liu, Y.: Intelligence quotient and intelligence grade of artificial intelligence. Ann. Data Sci. 4(2), 179–191 (2017)CrossRef Liu, F., Shi, Y., Liu, Y.: Intelligence quotient and intelligence grade of artificial intelligence. Ann. Data Sci. 4(2), 179–191 (2017)CrossRef
10.
Zurück zum Zitat Liu, F., Shi, Y., Wang, B.: World search engine IQ test based on the internet IQ evaluation algorithms. Int. J. Inf. Technol. Decis. Making 14(02), 221–237 (2015)CrossRef Liu, F., Shi, Y., Wang, B.: World search engine IQ test based on the internet IQ evaluation algorithms. Int. J. Inf. Technol. Decis. Making 14(02), 221–237 (2015)CrossRef
11.
Zurück zum Zitat McGarry, K.: A survey of interestingness measures for knowledge discovery. Knowl. Eng. Rev. 20(1), 39–61 (2005)CrossRef McGarry, K.: A survey of interestingness measures for knowledge discovery. Knowl. Eng. Rev. 20(1), 39–61 (2005)CrossRef
12.
Zurück zum Zitat Nonaka, I., Toyama, R., Konno, N.: SECI, Ba and leadership: a unified model of dynamic knowledge creation. Long Range Plan. 33(1), 5–34 (2000)CrossRef Nonaka, I., Toyama, R., Konno, N.: SECI, Ba and leadership: a unified model of dynamic knowledge creation. Long Range Plan. 33(1), 5–34 (2000)CrossRef
13.
Zurück zum Zitat Peng, T., Zuo, W., He, F.: SVM based adaptive learning method for text classification from positive and unlabeled documents. Knowl. Inf. Syst. 16(3), 281–301 (2008)CrossRef Peng, T., Zuo, W., He, F.: SVM based adaptive learning method for text classification from positive and unlabeled documents. Knowl. Inf. Syst. 16(3), 281–301 (2008)CrossRef
14.
Zurück zum Zitat Peng, Y., Kou, G., Shi, Y., Chen, Z.: A descriptive framework for the field of data mining and knowledge discovery. Int. J. Inf. Technol. Decis. Making 7(04), 639–682 (2008)CrossRef Peng, Y., Kou, G., Shi, Y., Chen, Z.: A descriptive framework for the field of data mining and knowledge discovery. Int. J. Inf. Technol. Decis. Making 7(04), 639–682 (2008)CrossRef
15.
Zurück zum Zitat Romero, C., Ventura, S.: Data mining in education. Wiley Interdisc. Rev.: Data Min. Knowl. Discov. 3(1), 12–27 (2013) Romero, C., Ventura, S.: Data mining in education. Wiley Interdisc. Rev.: Data Min. Knowl. Discov. 3(1), 12–27 (2013)
16.
Zurück zum Zitat Shi, Y.: Multiple Criteria and Multiple Constraint Levels Linear Programming: Concepts, Techniques and Applications. World Scientific Publishing Company, Singapore (2001)CrossRef Shi, Y.: Multiple Criteria and Multiple Constraint Levels Linear Programming: Concepts, Techniques and Applications. World Scientific Publishing Company, Singapore (2001)CrossRef
17.
Zurück zum Zitat Shi, Y.: Big data: History, current status, and challenges going forward. Bridge 44(4), 6–11 (2014) Shi, Y.: Big data: History, current status, and challenges going forward. Bridge 44(4), 6–11 (2014)
18.
Zurück zum Zitat Shi, Y., Li, X.: Knowledge management platforms and intelligent knowledge beyond data mining. In: Shi, Y., Olsen, D.L., Stam, A. (eds.) Advances in Multiple Criteria Decision Making and Human Systems Management: Knowledge and Wisdom, pp. 272–288. IOS Press, Amsterdam (2007) Shi, Y., Li, X.: Knowledge management platforms and intelligent knowledge beyond data mining. In: Shi, Y., Olsen, D.L., Stam, A. (eds.) Advances in Multiple Criteria Decision Making and Human Systems Management: Knowledge and Wisdom, pp. 272–288. IOS Press, Amsterdam (2007)
19.
Zurück zum Zitat Shi, Y.: Introduction to Business Data Mining. New York, New York (2007) Shi, Y.: Introduction to Business Data Mining. New York, New York (2007)
20.
Zurück zum Zitat Shi, Y., Peng, Y., Xu, W., Tang, X.: Data mining via multiple criteria linear programming: applications in credit card portfolio management. Int. J. Inf. Technol. Decis. Making 1(01), 131–151 (2002)CrossRef Shi, Y., Peng, Y., Xu, W., Tang, X.: Data mining via multiple criteria linear programming: applications in credit card portfolio management. Int. J. Inf. Technol. Decis. Making 1(01), 131–151 (2002)CrossRef
22.
23.
Zurück zum Zitat Turner, V., Gantz, J.F., Reinsel, D., Minton, S.: The digital universe of opportunities: rich data and the increasing value of the internet of things. IDC Anal. Future 16 (2014) Turner, V., Gantz, J.F., Reinsel, D., Minton, S.: The digital universe of opportunities: rich data and the increasing value of the internet of things. IDC Anal. Future 16 (2014)
24.
Zurück zum Zitat Yan, N., Shi, Y., Chen, Z.: Multiple criteria nonlinear programming classification with the non-additive measure. In: Ehrgott, M., Naujoks, B., Stewart, T., Wallenius, J., et al. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 289–297. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-04045-0_25CrossRef Yan, N., Shi, Y., Chen, Z.: Multiple criteria nonlinear programming classification with the non-additive measure. In: Ehrgott, M., Naujoks, B., Stewart, T., Wallenius, J., et al. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 289–297. Springer, Heidelberg (2010). https://​doi.​org/​10.​1007/​978-3-642-04045-0_​25CrossRef
25.
Zurück zum Zitat Zhang, D., Tian, Y., Shi, Y.: A regression method by multiple criteria linear programming. In: 19th International Conference on Multiple Criteria Decision Making (2008) Zhang, D., Tian, Y., Shi, Y.: A regression method by multiple criteria linear programming. In: 19th International Conference on Multiple Criteria Decision Making (2008)
26.
Zurück zum Zitat Zhang, J., Shi, Y., Zhang, P.: Several multi-criteria programming methods for classification. Comput. Oper. Res. 36(3), 823–836 (2009)MathSciNetCrossRef Zhang, J., Shi, Y., Zhang, P.: Several multi-criteria programming methods for classification. Comput. Oper. Res. 36(3), 823–836 (2009)MathSciNetCrossRef
27.
Zurück zum Zitat Zhang, L., Li, J., Shi, Y., Liu, X.: Foundations of intelligent knowledge management. Hum. Syst. Manag. 28(4), 145–161 (2009)CrossRef Zhang, L., Li, J., Shi, Y., Liu, X.: Foundations of intelligent knowledge management. Hum. Syst. Manag. 28(4), 145–161 (2009)CrossRef
Metadaten
Titel
Big Data Analysis: Theory and Applications
verfasst von
Yong Shi
Pei Quan
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-41032-2_2