Skip to main content
Top

2020 | OriginalPaper | Chapter

Big Data Analysis: Theory and Applications

Authors : Yong Shi, Pei Quan

Published in: Large-Scale Scientific Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the continuous improvement of data processing capabilities and storage capabilities, Big Data Era has entered the public sight. Under such a circumstance, the generation of massive data has greatly facilitated the development of data mining algorithms. This paper describes the status of data mining and presents three of our works: optimization-based data mining, intelligent knowledge and the intelligence quotient of Artificial Intelligence respectively. Besides that, we also introduced some applications that have emerged in the context of big data. Furthermore, this paper indicates three potential directions for future research of big data analysis.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cios, K.J., Moore, G.W.: Uniqueness of medical data mining. Artif. Intell. Med. 26(1–2), 1–24 (2002)CrossRef Cios, K.J., Moore, G.W.: Uniqueness of medical data mining. Artif. Intell. Med. 26(1–2), 1–24 (2002)CrossRef
2.
go back to reference Freed, N., Glover, F.: Simple but powerful goal programming models for discriminant problems. Eur. J. Oper. Res. 7(1), 44–60 (1981)CrossRef Freed, N., Glover, F.: Simple but powerful goal programming models for discriminant problems. Eur. J. Oper. Res. 7(1), 44–60 (1981)CrossRef
3.
go back to reference He, J., Liu, X., Shi, Y., Xu, W., Yan, N.: Classifications of credit cardholder behavior by using fuzzy linear programming. Int. J. Inf. Technol. Decis. Making 3(04), 633–650 (2004)CrossRef He, J., Liu, X., Shi, Y., Xu, W., Yan, N.: Classifications of credit cardholder behavior by using fuzzy linear programming. Int. J. Inf. Technol. Decis. Making 3(04), 633–650 (2004)CrossRef
4.
go back to reference Kou, G.: Multi-class multi-criteria mathematical programming and its applications in large scale data mining problems. Ph.D. thesis, University of Nebraska at Omaha (2006) Kou, G.: Multi-class multi-criteria mathematical programming and its applications in large scale data mining problems. Ph.D. thesis, University of Nebraska at Omaha (2006)
5.
go back to reference Kou, G., Liu, X., Peng, Y., Shi, Y., Wise, M., Xu, W.: Multiple criteria linear programming approach to data mining: models, algorithm designs and software development. Optim. Methods Softw. 18(4), 453–473 (2003)MathSciNetCrossRef Kou, G., Liu, X., Peng, Y., Shi, Y., Wise, M., Xu, W.: Multiple criteria linear programming approach to data mining: models, algorithm designs and software development. Optim. Methods Softw. 18(4), 453–473 (2003)MathSciNetCrossRef
6.
go back to reference Kovalerchuk, B., Vityaev, E.: Data Mining in Finance: Advances in Relational and Hybrid Methods, vol. 547. Springer, Heidelberg (2006)MATH Kovalerchuk, B., Vityaev, E.: Data Mining in Finance: Advances in Relational and Hybrid Methods, vol. 547. Springer, Heidelberg (2006)MATH
7.
go back to reference Li, A., Shi, Y., He, J.: MCLP-based methods for improving bad catching rate in credit cardholder behavior analysis. Appl. Soft Comput. 8(3), 1259–1265 (2008)CrossRef Li, A., Shi, Y., He, J.: MCLP-based methods for improving bad catching rate in credit cardholder behavior analysis. Appl. Soft Comput. 8(3), 1259–1265 (2008)CrossRef
8.
go back to reference Liu, F., Shi, Y.: The search engine IQ test based on the internet IQ evaluation algorithm. Proc. Comput. Sci. 31, 1066–1073 (2014)CrossRef Liu, F., Shi, Y.: The search engine IQ test based on the internet IQ evaluation algorithm. Proc. Comput. Sci. 31, 1066–1073 (2014)CrossRef
9.
go back to reference Liu, F., Shi, Y., Liu, Y.: Intelligence quotient and intelligence grade of artificial intelligence. Ann. Data Sci. 4(2), 179–191 (2017)CrossRef Liu, F., Shi, Y., Liu, Y.: Intelligence quotient and intelligence grade of artificial intelligence. Ann. Data Sci. 4(2), 179–191 (2017)CrossRef
10.
go back to reference Liu, F., Shi, Y., Wang, B.: World search engine IQ test based on the internet IQ evaluation algorithms. Int. J. Inf. Technol. Decis. Making 14(02), 221–237 (2015)CrossRef Liu, F., Shi, Y., Wang, B.: World search engine IQ test based on the internet IQ evaluation algorithms. Int. J. Inf. Technol. Decis. Making 14(02), 221–237 (2015)CrossRef
11.
go back to reference McGarry, K.: A survey of interestingness measures for knowledge discovery. Knowl. Eng. Rev. 20(1), 39–61 (2005)CrossRef McGarry, K.: A survey of interestingness measures for knowledge discovery. Knowl. Eng. Rev. 20(1), 39–61 (2005)CrossRef
12.
go back to reference Nonaka, I., Toyama, R., Konno, N.: SECI, Ba and leadership: a unified model of dynamic knowledge creation. Long Range Plan. 33(1), 5–34 (2000)CrossRef Nonaka, I., Toyama, R., Konno, N.: SECI, Ba and leadership: a unified model of dynamic knowledge creation. Long Range Plan. 33(1), 5–34 (2000)CrossRef
13.
go back to reference Peng, T., Zuo, W., He, F.: SVM based adaptive learning method for text classification from positive and unlabeled documents. Knowl. Inf. Syst. 16(3), 281–301 (2008)CrossRef Peng, T., Zuo, W., He, F.: SVM based adaptive learning method for text classification from positive and unlabeled documents. Knowl. Inf. Syst. 16(3), 281–301 (2008)CrossRef
14.
go back to reference Peng, Y., Kou, G., Shi, Y., Chen, Z.: A descriptive framework for the field of data mining and knowledge discovery. Int. J. Inf. Technol. Decis. Making 7(04), 639–682 (2008)CrossRef Peng, Y., Kou, G., Shi, Y., Chen, Z.: A descriptive framework for the field of data mining and knowledge discovery. Int. J. Inf. Technol. Decis. Making 7(04), 639–682 (2008)CrossRef
15.
go back to reference Romero, C., Ventura, S.: Data mining in education. Wiley Interdisc. Rev.: Data Min. Knowl. Discov. 3(1), 12–27 (2013) Romero, C., Ventura, S.: Data mining in education. Wiley Interdisc. Rev.: Data Min. Knowl. Discov. 3(1), 12–27 (2013)
16.
go back to reference Shi, Y.: Multiple Criteria and Multiple Constraint Levels Linear Programming: Concepts, Techniques and Applications. World Scientific Publishing Company, Singapore (2001)CrossRef Shi, Y.: Multiple Criteria and Multiple Constraint Levels Linear Programming: Concepts, Techniques and Applications. World Scientific Publishing Company, Singapore (2001)CrossRef
17.
go back to reference Shi, Y.: Big data: History, current status, and challenges going forward. Bridge 44(4), 6–11 (2014) Shi, Y.: Big data: History, current status, and challenges going forward. Bridge 44(4), 6–11 (2014)
18.
go back to reference Shi, Y., Li, X.: Knowledge management platforms and intelligent knowledge beyond data mining. In: Shi, Y., Olsen, D.L., Stam, A. (eds.) Advances in Multiple Criteria Decision Making and Human Systems Management: Knowledge and Wisdom, pp. 272–288. IOS Press, Amsterdam (2007) Shi, Y., Li, X.: Knowledge management platforms and intelligent knowledge beyond data mining. In: Shi, Y., Olsen, D.L., Stam, A. (eds.) Advances in Multiple Criteria Decision Making and Human Systems Management: Knowledge and Wisdom, pp. 272–288. IOS Press, Amsterdam (2007)
19.
go back to reference Shi, Y.: Introduction to Business Data Mining. New York, New York (2007) Shi, Y.: Introduction to Business Data Mining. New York, New York (2007)
20.
go back to reference Shi, Y., Peng, Y., Xu, W., Tang, X.: Data mining via multiple criteria linear programming: applications in credit card portfolio management. Int. J. Inf. Technol. Decis. Making 1(01), 131–151 (2002)CrossRef Shi, Y., Peng, Y., Xu, W., Tang, X.: Data mining via multiple criteria linear programming: applications in credit card portfolio management. Int. J. Inf. Technol. Decis. Making 1(01), 131–151 (2002)CrossRef
23.
go back to reference Turner, V., Gantz, J.F., Reinsel, D., Minton, S.: The digital universe of opportunities: rich data and the increasing value of the internet of things. IDC Anal. Future 16 (2014) Turner, V., Gantz, J.F., Reinsel, D., Minton, S.: The digital universe of opportunities: rich data and the increasing value of the internet of things. IDC Anal. Future 16 (2014)
24.
go back to reference Yan, N., Shi, Y., Chen, Z.: Multiple criteria nonlinear programming classification with the non-additive measure. In: Ehrgott, M., Naujoks, B., Stewart, T., Wallenius, J., et al. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 289–297. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-04045-0_25CrossRef Yan, N., Shi, Y., Chen, Z.: Multiple criteria nonlinear programming classification with the non-additive measure. In: Ehrgott, M., Naujoks, B., Stewart, T., Wallenius, J., et al. (eds.) Multiple Criteria Decision Making for Sustainable Energy and Transportation Systems. LNE, vol. 634, pp. 289–297. Springer, Heidelberg (2010). https://​doi.​org/​10.​1007/​978-3-642-04045-0_​25CrossRef
25.
go back to reference Zhang, D., Tian, Y., Shi, Y.: A regression method by multiple criteria linear programming. In: 19th International Conference on Multiple Criteria Decision Making (2008) Zhang, D., Tian, Y., Shi, Y.: A regression method by multiple criteria linear programming. In: 19th International Conference on Multiple Criteria Decision Making (2008)
26.
go back to reference Zhang, J., Shi, Y., Zhang, P.: Several multi-criteria programming methods for classification. Comput. Oper. Res. 36(3), 823–836 (2009)MathSciNetCrossRef Zhang, J., Shi, Y., Zhang, P.: Several multi-criteria programming methods for classification. Comput. Oper. Res. 36(3), 823–836 (2009)MathSciNetCrossRef
27.
go back to reference Zhang, L., Li, J., Shi, Y., Liu, X.: Foundations of intelligent knowledge management. Hum. Syst. Manag. 28(4), 145–161 (2009)CrossRef Zhang, L., Li, J., Shi, Y., Liu, X.: Foundations of intelligent knowledge management. Hum. Syst. Manag. 28(4), 145–161 (2009)CrossRef
Metadata
Title
Big Data Analysis: Theory and Applications
Authors
Yong Shi
Pei Quan
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-41032-2_2

Premium Partner