Skip to main content

2017 | OriginalPaper | Buchkapitel

Context Injection as a Tool for Measuring Context Usage in Machine Learning

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Machine learning (ML) methods used to train computational models are one of the most valuable elements of the modern artificial intelligence. Thus preparing tools to evaluate ML training algorithms abilities to find inside the training data information (the context) crucial to build successful models is still an important topic. Within this text we introduce a new method of quantitative estimation of effectiveness of context usage by the ML training algorithms based on injection of predefined context to the training data sets. The results indicate that the proposed solution can be used as a general method of analyzing differences in context processing between ML training methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Gradient Boosting Machine training parameters: 50 trees, maximum tree depth = 5, learning rate = 0.1, implementation: H2O Flow 3.10.0.8.
 
2
Deep Neural Network training parameters: 100 × 100 hidden neurons, activation function: rectifier, max number of training epochs = 300, implementation: H2O Flow 3.10.0.8.
 
3
Random Forest classifier training parameters: bag size = 100, number of iterations = 100, unlimited tree size, implementation: Weka 3.8.0.
 
4
C4.5 tree (not pruned) implementation: C4.5 v8 by R. Quinlan.
 
Literatur
1.
Zurück zum Zitat Chen, P., Xu, B., Yang, M., Li, S.: Clause sentiment identification based on convolutional neural network with context embedding. In: 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), pp. 1532–1538. IEEE Press (2016) Chen, P., Xu, B., Yang, M., Li, S.: Clause sentiment identification based on convolutional neural network with context embedding. In: 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), pp. 1532–1538. IEEE Press (2016)
2.
Zurück zum Zitat Tang, K., Paluri, M., Fei-Fei, L., Fergus, R., Bourdev, L.: Improving image classification with location context. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1008–1016. IEEE Press (2015) Tang, K., Paluri, M., Fei-Fei, L., Fergus, R., Bourdev, L.: Improving image classification with location context. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1008–1016. IEEE Press (2015)
3.
Zurück zum Zitat Kapitsaki, G.M.: Reflecting user privacy preferences in context-aware web services. In: 2013 IEEE 20th International Conference on Web Services (ICWS), pp. 123–130. IEEE Press (2013) Kapitsaki, G.M.: Reflecting user privacy preferences in context-aware web services. In: 2013 IEEE 20th International Conference on Web Services (ICWS), pp. 123–130. IEEE Press (2013)
4.
Zurück zum Zitat Datta, S.K., Bonnet, C., Nikaein, N.: Self-adaptive battery and context aware mobile application development. In: 2014 International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 761–766 (2014) Datta, S.K., Bonnet, C., Nikaein, N.: Self-adaptive battery and context aware mobile application development. In: 2014 International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 761–766 (2014)
5.
Zurück zum Zitat Klingelschmitt, S., Eggert, J.: Using context information and probabilistic classification for making extended long-term trajectory predictions. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 705–711 (2015) Klingelschmitt, S., Eggert, J.: Using context information and probabilistic classification for making extended long-term trajectory predictions. In: 2015 IEEE 18th International Conference on Intelligent Transportation Systems, pp. 705–711 (2015)
6.
Zurück zum Zitat Spaulding, J., Krauss, A., Srinivasan, A.: Exploring an open WiFi detection vulnerability as a malware attack vector on iOS devices. In: 2012 7th International Conference on Malicious and Unwanted Software (MALWARE), pp. 87–93 (2012) Spaulding, J., Krauss, A., Srinivasan, A.: Exploring an open WiFi detection vulnerability as a malware attack vector on iOS devices. In: 2012 7th International Conference on Malicious and Unwanted Software (MALWARE), pp. 87–93 (2012)
7.
Zurück zum Zitat Nguyen, T.C., Nguyen, X.H., Nguyen, V.K.: Hybrid priority schemes for the message scheduling for CAN-based Networked Control Systems. In: 2014 IEEE Fifth International Conference on Communications and Electronics (ICCE), pp. 264–269 (2014) Nguyen, T.C., Nguyen, X.H., Nguyen, V.K.: Hybrid priority schemes for the message scheduling for CAN-based Networked Control Systems. In: 2014 IEEE Fifth International Conference on Communications and Electronics (ICCE), pp. 264–269 (2014)
8.
Zurück zum Zitat Murphy, R., Woods, D.D.: Beyond Asimov: the three laws of responsible robotics. IEEE Intell. Syst. 24, 14–20 (2009)CrossRef Murphy, R., Woods, D.D.: Beyond Asimov: the three laws of responsible robotics. IEEE Intell. Syst. 24, 14–20 (2009)CrossRef
9.
Zurück zum Zitat Wang, J., Qiu, M., Guo, B., Shen, Y., Li, Q.: Low-power sensor polling for context-aware services on smartphones. In: 2015 IEEE 12th International Conference on Embedded Software and Systems (ICESS), 2015 IEEE 7th International Symposium on Cyberspace Safety and Security (CSS), pp. 617–622 (2015) Wang, J., Qiu, M., Guo, B., Shen, Y., Li, Q.: Low-power sensor polling for context-aware services on smartphones. In: 2015 IEEE 12th International Conference on Embedded Software and Systems (ICESS), 2015 IEEE 7th International Symposium on Cyberspace Safety and Security (CSS), pp. 617–622 (2015)
10.
Zurück zum Zitat Pallotta, G., Jousselme, A.L.: Data-driven detection and context-based classification of maritime anomalies. In: 2015 18th International Conference on Information Fusion (Fusion), pp. 1152–1159 (2015) Pallotta, G., Jousselme, A.L.: Data-driven detection and context-based classification of maritime anomalies. In: 2015 18th International Conference on Information Fusion (Fusion), pp. 1152–1159 (2015)
11.
Zurück zum Zitat Duma, D., Sutton, C., Klein, E.: Context matters: towards extracting a citation’s context using linguistic features. In: 2016 IEEE/ACM Joint Conference on Digital Libraries (JCDL), pp. 201–202 (2016) Duma, D., Sutton, C., Klein, E.: Context matters: towards extracting a citation’s context using linguistic features. In: 2016 IEEE/ACM Joint Conference on Digital Libraries (JCDL), pp. 201–202 (2016)
12.
Zurück zum Zitat Kang, S., Kim, D., Cho, S.: Efficient feature selection-based on random forward search for virtual metrology modeling. IEEE Trans. Semicond. Manuf. 29, 391–398 (2016)CrossRef Kang, S., Kim, D., Cho, S.: Efficient feature selection-based on random forward search for virtual metrology modeling. IEEE Trans. Semicond. Manuf. 29, 391–398 (2016)CrossRef
13.
Zurück zum Zitat Chakraborty, G., Horie, S., Yokoha, H., Kokosiński, Z.: Minimizing sensors for system monitoring - a case study with EEG signals. In: 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF), pp. 206–211. IEEE Press (2015) Chakraborty, G., Horie, S., Yokoha, H., Kokosiński, Z.: Minimizing sensors for system monitoring - a case study with EEG signals. In: 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF), pp. 206–211. IEEE Press (2015)
14.
Zurück zum Zitat Fan, X., Tang, K.: Enhanced maximum AUC linear classifier. In: 2010 7th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp. 1540–1544 (2010) Fan, X., Tang, K.: Enhanced maximum AUC linear classifier. In: 2010 7th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp. 1540–1544 (2010)
15.
Zurück zum Zitat Yan, L., Dodier, R., Mozer, M.C., Wolniewicz, R.: Optimizing classifier performance via the Wilcoxon-Mann-Whitney statistic. In: 20th International Conference on Machine Learning (ICML-03), pp. 848–855. American Association for Artificial Intelligence (2003) Yan, L., Dodier, R., Mozer, M.C., Wolniewicz, R.: Optimizing classifier performance via the Wilcoxon-Mann-Whitney statistic. In: 20th International Conference on Machine Learning (ICML-03), pp. 848–855. American Association for Artificial Intelligence (2003)
16.
Zurück zum Zitat Trigg, L.: An entropy gain measure of numeric prediction performance. Working paper 98/11, Department of Computer Science, University of Waikato (1998) Trigg, L.: An entropy gain measure of numeric prediction performance. Working paper 98/11, Department of Computer Science, University of Waikato (1998)
17.
Zurück zum Zitat Patil, L.H., Atique, M.: A novel feature selection based on information gain using WordNet. In: Science and Information Conference (SAI), pp. 625–629 (2013) Patil, L.H., Atique, M.: A novel feature selection based on information gain using WordNet. In: Science and Information Conference (SAI), pp. 625–629 (2013)
18.
Zurück zum Zitat Wu, G., Wang, L., Zhao, N., Lin, H.: Improved expected cross entropy method for text feature selection. In: 2015 International Conference on Computer Science and Mechanical Automation (CSMA), pp. 49–54 (2015) Wu, G., Wang, L., Zhao, N., Lin, H.: Improved expected cross entropy method for text feature selection. In: 2015 International Conference on Computer Science and Mechanical Automation (CSMA), pp. 49–54 (2015)
19.
Zurück zum Zitat Wang, X.N., Wei, J.M., Jin, H., Yu, G., Zhang, H.W.: Probabilistic confusion entropy for evaluating classifiers. Entropy 15, 4969–4992 (2013)MathSciNetCrossRefMATH Wang, X.N., Wei, J.M., Jin, H., Yu, G., Zhang, H.W.: Probabilistic confusion entropy for evaluating classifiers. Entropy 15, 4969–4992 (2013)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Sofeikov, K.I., Tyukin, I.Y., Gorban, A.N., Mirkes, E.M., Prokhorov, D.V., Romanenko, I.V.: Learning optimization for decision tree classification of non-categorical data with information gain impurity criterion. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 3548–3555 (2014) Sofeikov, K.I., Tyukin, I.Y., Gorban, A.N., Mirkes, E.M., Prokhorov, D.V., Romanenko, I.V.: Learning optimization for decision tree classification of non-categorical data with information gain impurity criterion. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 3548–3555 (2014)
21.
Zurück zum Zitat Bhasin, V., Bedi, P., Singhal, A.: Feature selection for steganalysis based on modified Stochastic Diffusion Search using Fisher score. In: 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 2323–2330 (2014) Bhasin, V., Bedi, P., Singhal, A.: Feature selection for steganalysis based on modified Stochastic Diffusion Search using Fisher score. In: 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 2323–2330 (2014)
Metadaten
Titel
Context Injection as a Tool for Measuring Context Usage in Machine Learning
verfasst von
Maciej Huk
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-54472-4_65

Premium Partner