Skip to main content

2015 | OriginalPaper | Buchkapitel

Classification Cascades of Overlapping Feature Ensembles for Energy Time Series Data

verfasst von : Judith Neugebauer, Oliver Kramer, Michael Sonnenschein

Erschienen in: Data Analytics for Renewable Energy Integration

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The classification of high-dimensional time series data can be a challenging task due to the curse-of-dimensionality problem. The classification of time series is relevant in various applications, e.g., in the task of learning meta-models of feasible schedules for flexible components in the energy domain. In this paper, we introduce a classification approach that employs a cascade of classifiers based on features of overlapping time series steps. To evaluate the feasibility of the whole time series, each overlapping pattern is evaluated and the results are aggregated. We apply the approach to the problem of combined heat and power plant operation schedules and an artificial similarly structured data set. We identify conditions under which the cascade approach shows better results than a classic One-Class-SVM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
\(\gamma \in \{0.1, 1, 10, 50, 100, 150,200\}\).
 
3
\(\nu \in \{0.0001, 0.001, 0.0025, 0.005, 0.0075, 0.01, 0.025, 0.05, 0.075, 0.1, 0.2\}\).
 
4
\(\epsilon \in \{0.01, 0.05, 0.1, 0.15, 0.2\}\).
 
5
\(k_t \in \{1,5,10,15\}\).
 
Literatur
1.
Zurück zum Zitat Al-Hmouz, R., Pedrycz, W., Balamash, A., Morfeq, A.: Description and classification of granular time series. Soft. Comput. 19(4), 1003–1017 (2015)CrossRef Al-Hmouz, R., Pedrycz, W., Balamash, A., Morfeq, A.: Description and classification of granular time series. Soft. Comput. 19(4), 1003–1017 (2015)CrossRef
2.
Zurück zum Zitat Attenberg, J., Ertekin, C.: Class Imbalance and Active Learning. Wiley, Hoboken (2013)CrossRef Attenberg, J., Ertekin, C.: Class Imbalance and Active Learning. Wiley, Hoboken (2013)CrossRef
3.
Zurück zum Zitat Bagnall, A., Davis, L.M., Hills, J., Lines, J.: Transformation based ensembles for time series classification. In: Proceedings of the Twelfth SIAM International Conference on Data Mining, Anaheim, California, USA, pp. 307–318, 26–28 April 2012 Bagnall, A., Davis, L.M., Hills, J., Lines, J.: Transformation based ensembles for time series classification. In: Proceedings of the Twelfth SIAM International Conference on Data Mining, Anaheim, California, USA, pp. 307–318, 26–28 April 2012
4.
Zurück zum Zitat Batuwita, R., Palade, V.: Class Imbalance Learning Methods for Support Vector Machines. Wiley, New York (2013)CrossRef Batuwita, R., Palade, V.: Class Imbalance Learning Methods for Support Vector Machines. Wiley, New York (2013)CrossRef
5.
Zurück zum Zitat Beygelzimer, A., Dani, V., Hayes, T., Langford, J., Zadrozny, B.: Error limiting reductions between classification tasks. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, pp. 49–56. ACM, New York (2005) Beygelzimer, A., Dani, V., Hayes, T., Langford, J., Zadrozny, B.: Error limiting reductions between classification tasks. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, pp. 49–56. ACM, New York (2005)
6.
Zurück zum Zitat Blagus, R., Lusa, L.: Class prediction for high-dimensional class-imbalanced data. BMC Bioinform. 11(1), 523 (2010)CrossRef Blagus, R., Lusa, L.: Class prediction for high-dimensional class-imbalanced data. BMC Bioinform. 11(1), 523 (2010)CrossRef
8.
Zurück zum Zitat Bremer, J., Rapp, B., Sonnenschein, M.: Support vector based encoding of distributed energy resources’ feasible load spaces. In: Innovative Smart Grid Technologies Conference Europe IEEE PES (2010) Bremer, J., Rapp, B., Sonnenschein, M.: Support vector based encoding of distributed energy resources’ feasible load spaces. In: Innovative Smart Grid Technologies Conference Europe IEEE PES (2010)
9.
Zurück zum Zitat Bremer, J., Sonnenschein, M.: Model-based integration of constrained search spaces into distributed planning of active power provision. Comput. Sci. Inf. Syst. 10(4), 1823–1854 (2013)CrossRef Bremer, J., Sonnenschein, M.: Model-based integration of constrained search spaces into distributed planning of active power provision. Comput. Sci. Inf. Syst. 10(4), 1823–1854 (2013)CrossRef
11.
Zurück zum Zitat Castillo-Cagigal, M., Martín, E.C., Matallanas, E., Masa-Bote, D., Gutiérrez, A., Monasterio-Huelin, F., Jiménez-Leube, J.: PV self-consumption optimization with storage and active DSM for the residential sector. Sol. Energ. 85(9), 2338–2348 (2011)CrossRef Castillo-Cagigal, M., Martín, E.C., Matallanas, E., Masa-Bote, D., Gutiérrez, A., Monasterio-Huelin, F., Jiménez-Leube, J.: PV self-consumption optimization with storage and active DSM for the residential sector. Sol. Energ. 85(9), 2338–2348 (2011)CrossRef
12.
Zurück zum Zitat Chandrashekar, G., Sahin, F.: A survey on feature selection methods. Comput. Electr. Eng. 40(1), 16–28 (2014). 40th-year commemorative issueCrossRef Chandrashekar, G., Sahin, F.: A survey on feature selection methods. Comput. Electr. Eng. 40(1), 16–28 (2014). 40th-year commemorative issueCrossRef
13.
Zurück zum Zitat Engel, D., Hüttenberger, L., Hamann, B.: A survey of dimension reduction methods for high-dimensional data analysis and visualization. In: Garth, C., Middel, A., Hagen, H. (eds.) Visualization of Large and Unstructured Data Sets: Applications in Geospatial Planning. Modeling and Engineering - Proceedings of IRTG 1131 Workshop 2011, volume 27 of OpenAccess Series in Informatics (OASIcs), pp. 135–149. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2012) Engel, D., Hüttenberger, L., Hamann, B.: A survey of dimension reduction methods for high-dimensional data analysis and visualization. In: Garth, C., Middel, A., Hagen, H. (eds.) Visualization of Large and Unstructured Data Sets: Applications in Geospatial Planning. Modeling and Engineering - Proceedings of IRTG 1131 Workshop 2011, volume 27 of OpenAccess Series in Informatics (OASIcs), pp. 135–149. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2012)
14.
Zurück zum Zitat Fulcher, B., Jones, N.: Highly comparative feature-based time-series classification. IEEE Trans. Knowl. Data Eng. 26(12), 3026–3037 (2014)CrossRef Fulcher, B., Jones, N.: Highly comparative feature-based time-series classification. IEEE Trans. Knowl. Data Eng. 26(12), 3026–3037 (2014)CrossRef
15.
Zurück zum Zitat Fulcher, B.D., Little, M.A., Jones, N.S.: Highly comparative time-series analysis: the empirical structure of time series and their methods. J. R. Soc. Interface, 10(83) (2013) Fulcher, B.D., Little, M.A., Jones, N.S.: Highly comparative time-series analysis: the empirical structure of time series and their methods. J. R. Soc. Interface, 10(83) (2013)
16.
Zurück zum Zitat He, H., Garcia, E.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef He, H., Garcia, E.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef
17.
Zurück zum Zitat He, X., Mourot, G., Maquin, D., Ragot, J., Beauseroy, P., Smolarz, A., Grall-Maës, E.: Multi-task learning with one-class SVM. Neurocomputing 133, 416–426 (2014)CrossRef He, X., Mourot, G., Maquin, D., Ragot, J., Beauseroy, P., Smolarz, A., Grall-Maës, E.: Multi-task learning with one-class SVM. Neurocomputing 133, 416–426 (2014)CrossRef
18.
Zurück zum Zitat Hinrichs, C., Sonnenschein, M., Lehnhoff, S.: Evaluation of a self-organizing heuristic for interdependent distributed search spaces vol. 1 - agents. In: Filipe, J., Fred, A.L.N. (eds.) International Conference on Agents and Artificial Intelligence (ICAART 2013), pp. 25–34. SciTePress, Germany (2013) Hinrichs, C., Sonnenschein, M., Lehnhoff, S.: Evaluation of a self-organizing heuristic for interdependent distributed search spaces vol. 1 - agents. In: Filipe, J., Fred, A.L.N. (eds.) International Conference on Agents and Artificial Intelligence (ICAART 2013), pp. 25–34. SciTePress, Germany (2013)
19.
Zurück zum Zitat Hoens, T.R., Chawla, N.V.: Imbalanced Datasets: From Sampling to Classifiers. Wiley, New Jersey (2013) Hoens, T.R., Chawla, N.V.: Imbalanced Datasets: From Sampling to Classifiers. Wiley, New Jersey (2013)
20.
Zurück zum Zitat Hwang, W., Runger, G., Tuv, E.: Multivariate statistical process control with artificial contrasts. IIE Trans. 39(6), 659–669 (2007)CrossRef Hwang, W., Runger, G., Tuv, E.: Multivariate statistical process control with artificial contrasts. IIE Trans. 39(6), 659–669 (2007)CrossRef
21.
Zurück zum Zitat Japkowicz, N.: Assessment Metrics for Imbalanced Learning. Wiley, New Jersey (2013)CrossRef Japkowicz, N.: Assessment Metrics for Imbalanced Learning. Wiley, New Jersey (2013)CrossRef
22.
Zurück zum Zitat Juszczak, P., Duin, R.P.W.: Selective sampling methods in one-class classification problems. In: ICANN, pp. 140–148 (2003) Juszczak, P., Duin, R.P.W.: Selective sampling methods in one-class classification problems. In: ICANN, pp. 140–148 (2003)
23.
Zurück zum Zitat Kang, J.H., Kim, S.B.: A clustering algorithm-based control chart for inhomogeneously distributed tft-lcd processes. Int. J. Prod. Res. 51(18), 5644–5657 (2013)CrossRef Kang, J.H., Kim, S.B.: A clustering algorithm-based control chart for inhomogeneously distributed tft-lcd processes. Int. J. Prod. Res. 51(18), 5644–5657 (2013)CrossRef
24.
Zurück zum Zitat Lin, W.-J., Chen, J.J.: Class-imbalanced classifiers for high-dimensional data. Briefings Bioinf. 14(1), 13–26 (2013)CrossRef Lin, W.-J., Chen, J.J.: Class-imbalanced classifiers for high-dimensional data. Briefings Bioinf. 14(1), 13–26 (2013)CrossRef
25.
Zurück zum Zitat Lines, J., Bagnall, A., Caiger-Smith, P., Anderson, S.: Classification of household devices by electricity usage profiles. In: Yin, H., Wang, W., Rayward-Smith, V. (eds.) IDEAL 2011. LNCS, vol. 6936, pp. 403–412. Springer, Heidelberg (2011) CrossRef Lines, J., Bagnall, A., Caiger-Smith, P., Anderson, S.: Classification of household devices by electricity usage profiles. In: Yin, H., Wang, W., Rayward-Smith, V. (eds.) IDEAL 2011. LNCS, vol. 6936, pp. 403–412. Springer, Heidelberg (2011) CrossRef
26.
Zurück zum Zitat Liu, X.-Y., Zhou, Z.-H.: Ensemble Methods for Class Imbalance Learning. Wiley, New Jersey (2013)CrossRef Liu, X.-Y., Zhou, Z.-H.: Ensemble Methods for Class Imbalance Learning. Wiley, New Jersey (2013)CrossRef
27.
Zurück zum Zitat López, V., Fernández, A., García, S., Palade, V., Herrera, F.: An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 250, 113–141 (2013)CrossRef López, V., Fernández, A., García, S., Palade, V., Herrera, F.: An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 250, 113–141 (2013)CrossRef
28.
Zurück zum Zitat MacDougall, P., Roossien, B., Warmer, C., Kok, K.: Quantifying flexibility for smart grid services. In: Power and Energy Society General Meeting (PES), 2013 IEEE, pp. 1–5, July 2013 MacDougall, P., Roossien, B., Warmer, C., Kok, K.: Quantifying flexibility for smart grid services. In: Power and Energy Society General Meeting (PES), 2013 IEEE, pp. 1–5, July 2013
29.
Zurück zum Zitat Molina, J.M., Garcia, J., Garcia, A.C.B., Melo, R., Correia, L.: Segmentation and classification of time-series: real case studies. In: Corchado, E., Yin, H. (eds.) IDEAL 2009. LNCS, vol. 5788, pp. 743–750. Springer, Heidelberg (2009) CrossRef Molina, J.M., Garcia, J., Garcia, A.C.B., Melo, R., Correia, L.: Segmentation and classification of time-series: real case studies. In: Corchado, E., Yin, H. (eds.) IDEAL 2009. LNCS, vol. 5788, pp. 743–750. Springer, Heidelberg (2009) CrossRef
30.
Zurück zum Zitat Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
31.
Zurück zum Zitat Piao, Y., Park, H.W., Jin, C.H., Ryu, K.H.: Ensemble method for classification of high-dimensional data. In: 2014 International Conference on Big Data and Smart Computing (BIGCOMP), pp. 245–249, January 2014 Piao, Y., Park, H.W., Jin, C.H., Ryu, K.H.: Ensemble method for classification of high-dimensional data. In: 2014 International Conference on Big Data and Smart Computing (BIGCOMP), pp. 245–249, January 2014
33.
Zurück zum Zitat Saeys, Y., Inza, I.N., Larrañaga, P.: A review of feature selection techniques in bioinformatics. Bioinformatics 23(19), 2507–2517 (2007)CrossRef Saeys, Y., Inza, I.N., Larrañaga, P.: A review of feature selection techniques in bioinformatics. Bioinformatics 23(19), 2507–2517 (2007)CrossRef
34.
Zurück zum Zitat Seo, M., Oh, S.: A novel divide-and-merge classification for high dimensional datasets. Comput. Biol. Chem. 42, 23–34 (2013)CrossRefMathSciNet Seo, M., Oh, S.: A novel divide-and-merge classification for high dimensional datasets. Comput. Biol. Chem. 42, 23–34 (2013)CrossRefMathSciNet
35.
Zurück zum Zitat Sutton, C., Sindelar, M., McCallum, A.: Feature bagging: preventing weight undertraining in structured discriminative learning. IR 402, Department of Computer Science, University of Massachusetts Amherst (2005) Sutton, C., Sindelar, M., McCallum, A.: Feature bagging: preventing weight undertraining in structured discriminative learning. IR 402, Department of Computer Science, University of Massachusetts Amherst (2005)
36.
Zurück zum Zitat Tax, D.: Ddtools, the data description toolbox for matlab, version 2.1.1, July 2014 Tax, D.: Ddtools, the data description toolbox for matlab, version 2.1.1, July 2014
37.
Zurück zum Zitat Wang, D., Parkinson, S., Miao, W., Jia, H., Crawford, C., Djilali, N.: Hierarchical market integration of responsive loads as spinning reserve. Appl. Energy 104, 229–238 (2013)CrossRef Wang, D., Parkinson, S., Miao, W., Jia, H., Crawford, C., Djilali, N.: Hierarchical market integration of responsive loads as spinning reserve. Appl. Energy 104, 229–238 (2013)CrossRef
38.
Zurück zum Zitat Wang, Z., Zhao, Z., Weng, S., Zhang, C.: Solving one-class problem with outlier examples by SVM. Neurocomputing, 149, Part A: 100–105 (2015). Advances in neural networks Advances in Extreme Learning MachinesSelected papers from the Tenth International Symposium on Neural Networks (ISNN 2013) Selected articles from the International Symposium on Extreme Learning Machines (ELM 2013) Wang, Z., Zhao, Z., Weng, S., Zhang, C.: Solving one-class problem with outlier examples by SVM. Neurocomputing, 149, Part A: 100–105 (2015). Advances in neural networks Advances in Extreme Learning MachinesSelected papers from the Tenth International Symposium on Neural Networks (ISNN 2013) Selected articles from the International Symposium on Extreme Learning Machines (ELM 2013)
39.
Zurück zum Zitat Wille-Haussmann, B., Erge, T., Wittwer, C.: Decentralised optimisation of cogeneration in virtual power plants. Sol. Energy 84(4), 604–611 (2010). International Conference CISBAT 2007CrossRef Wille-Haussmann, B., Erge, T., Wittwer, C.: Decentralised optimisation of cogeneration in virtual power plants. Sol. Energy 84(4), 604–611 (2010). International Conference CISBAT 2007CrossRef
40.
Zurück zum Zitat Yang, H., King, I., Lyu, M.: Multi-task learning for one-class classification. In: The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, July 2010 Yang, H., King, I., Lyu, M.: Multi-task learning for one-class classification. In: The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, July 2010
41.
Zurück zum Zitat Yu, H., Mu, C., Sun, C., Yang, W., Yang, X., Zuo, X.: Support vector machine-based optimized decision threshold adjustment strategy for classifying imbalanced data. Knowl.-Based Syst. 76, 67–78 (2015)CrossRef Yu, H., Mu, C., Sun, C., Yang, W., Yang, X., Zuo, X.: Support vector machine-based optimized decision threshold adjustment strategy for classifying imbalanced data. Knowl.-Based Syst. 76, 67–78 (2015)CrossRef
Metadaten
Titel
Classification Cascades of Overlapping Feature Ensembles for Energy Time Series Data
verfasst von
Judith Neugebauer
Oliver Kramer
Michael Sonnenschein
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-27430-0_6