Skip to main content
Erschienen in: Cluster Computing 4/2019

29.05.2018

Research of the processing technology for time complex event based on LSTM

verfasst von: Qing Li, Jiang Zhong, Yongqin Tao, Lili Li, Xiaolong Miao

Erschienen in: Cluster Computing | Sonderheft 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the huge amount of data, it is increasingly meaningful to combine different business system data with potential values. In the traditional event description, the input event flow of the event engine is a single atomic event type. The event predicate constraint contains simple attribute value, comparison operation and simple aggregation operation. The time constraint between events always simply. This makes the traditional detection method cannot meet the requirements such as financial, medical and other relatively accurate time requirements, event predicate constraints require more complex applications. Thus, this paper introduces the long short-term memory network model (LSTM), designs a multivariate event input to process these data based on TCN quantitative timing constraint representation model and predicate constraint representation model. In this paper, an innovative method makes the complex event processing technology more high efficient. By the analysis 200 million records of 2045 stocks, the results show that the processing technology of the complex events is more effective, more efficient.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Efthymiou, V., Papadakis, G., Papastefanatos, G., et al.: Parallel meta-blocking for scaling entity resolution over big heterogeneous data. Inf. Syst. 65, 137–157 (2017)CrossRef Efthymiou, V., Papadakis, G., Papastefanatos, G., et al.: Parallel meta-blocking for scaling entity resolution over big heterogeneous data. Inf. Syst. 65, 137–157 (2017)CrossRef
2.
Zurück zum Zitat Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 1–62 (2012)CrossRef Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 1–62 (2012)CrossRef
3.
Zurück zum Zitat Chang, X., Yu, Y.L., Yang, Y., et al.: Semantic pooling for complex event analysis in untrimmed videos. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1617–1632 (2017)CrossRef Chang, X., Yu, Y.L., Yang, Y., et al.: Semantic pooling for complex event analysis in untrimmed videos. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1617–1632 (2017)CrossRef
4.
Zurück zum Zitat Chang, X., Yang, Y., Xing, E., et al.: Complex event detection using semantic saliency and nearly-isotonic SVM. In: Proceedings of the International Conference on Machine Learning. pp. 1348–1357 (2015) Chang, X., Yang, Y., Xing, E., et al.: Complex event detection using semantic saliency and nearly-isotonic SVM. In: Proceedings of the International Conference on Machine Learning. pp. 1348–1357 (2015)
5.
Zurück zum Zitat Kim, J.: Blocking causal drainage and other maintenance chores with mental causation. Philos. Phenomenol. Res. 67, 151–176 (2003)CrossRef Kim, J.: Blocking causal drainage and other maintenance chores with mental causation. Philos. Phenomenol. Res. 67, 151–176 (2003)CrossRef
6.
Zurück zum Zitat Zhou, Q., Simmhan, Y., Prasanna, V.: Knowledge-infused and consistent complex event processing over real-time and persistent streams. Future Gener. Comput. Syst. 76, 391–406 (2017)CrossRef Zhou, Q., Simmhan, Y., Prasanna, V.: Knowledge-infused and consistent complex event processing over real-time and persistent streams. Future Gener. Comput. Syst. 76, 391–406 (2017)CrossRef
7.
Zurück zum Zitat Data Stream Management: Processing high-speed data streams. Springer, Berlin (2016) Data Stream Management: Processing high-speed data streams. Springer, Berlin (2016)
8.
Zurück zum Zitat Kambatla, K., Kollias, G., Kumar, V., et al.: Trends in big data analytics. J. Parallel Distrib. Comput. 74(7), 2561–2573 (2014)CrossRef Kambatla, K., Kollias, G., Kumar, V., et al.: Trends in big data analytics. J. Parallel Distrib. Comput. 74(7), 2561–2573 (2014)CrossRef
9.
Zurück zum Zitat Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of data. ACM, pp. 407–418 (2006) Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of data. ACM, pp. 407–418 (2006)
10.
Zurück zum Zitat Zhang, H., Diao, Y., Immerman, N.: On complexity and optimization of expensive queries in complex event processing. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of data. ACM, pp. 217–228 (2014) Zhang, H., Diao, Y., Immerman, N.: On complexity and optimization of expensive queries in complex event processing. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of data. ACM, pp. 217–228 (2014)
11.
Zurück zum Zitat Li, M., Mani, M., Rundensteiner, E.A., et al.: Complex event pattern detection over streams with interval-based temporal semantics. In: Proceedings of the 5th ACM International Conference on Distributed Event-based System. ACM, pp. 291–302 (2011) Li, M., Mani, M., Rundensteiner, E.A., et al.: Complex event pattern detection over streams with interval-based temporal semantics. In: Proceedings of the 5th ACM International Conference on Distributed Event-based System. ACM, pp. 291–302 (2011)
12.
Zurück zum Zitat Sebastian B. et.al. OECEP: enriching complex event processing with domain knowledge from ontologies. In: Proceedings of the Fifth Balkan Conference in Informatics. BCI, pp. 20–25 (2012) Sebastian B. et.al. OECEP: enriching complex event processing with domain knowledge from ontologies. In: Proceedings of the Fifth Balkan Conference in Informatics. BCI, pp. 20–25 (2012)
13.
Zurück zum Zitat Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 15 (2012)CrossRef Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 15 (2012)CrossRef
14.
Zurück zum Zitat Hasan, S., Curry, E.: Approximate semantic matching of events for the internet of things. ACM Trans. Internet Technol. (TOIT) 14(1), 2 (2014)CrossRef Hasan, S., Curry, E.: Approximate semantic matching of events for the internet of things. ACM Trans. Internet Technol. (TOIT) 14(1), 2 (2014)CrossRef
15.
Zurück zum Zitat Aasi, J., Abbott, B.P., Abbott, R., et al.: Advanced ligo. Class. Quantum Gravity 32(7), 074001 (2015)CrossRef Aasi, J., Abbott, B.P., Abbott, R., et al.: Advanced ligo. Class. Quantum Gravity 32(7), 074001 (2015)CrossRef
16.
Zurück zum Zitat Isermann, R.: Model-based fault-detection and diagnosis–status and applications. Annu. Rev. Control 29(1), 71–85 (2005)CrossRef Isermann, R.: Model-based fault-detection and diagnosis–status and applications. Annu. Rev. Control 29(1), 71–85 (2005)CrossRef
17.
Zurück zum Zitat Ma, M., Wang, P., Chu, C.H., et al.: Efficient multipattern event processing over high-speed train data streams. IEEE Internet Things J. 2(4), 295–309 (2015)CrossRef Ma, M., Wang, P., Chu, C.H., et al.: Efficient multipattern event processing over high-speed train data streams. IEEE Internet Things J. 2(4), 295–309 (2015)CrossRef
18.
Zurück zum Zitat Bosch, H., Thom, D., Heimerl, F., et al.: Scatterblogs2: real-time monitoring of microblog messages through user-guided filtering. IEEE Trans. Vis. Comput. Graphics 19(12), 2022–2031 (2013)CrossRef Bosch, H., Thom, D., Heimerl, F., et al.: Scatterblogs2: real-time monitoring of microblog messages through user-guided filtering. IEEE Trans. Vis. Comput. Graphics 19(12), 2022–2031 (2013)CrossRef
19.
Zurück zum Zitat Yi, I., Lee, J.G., Whang, K.Y.: Apam: Adaptive eager-lazy hybrid evaluation of event patterns for low latency. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM, pp 2275–2280 (2016) Yi, I., Lee, J.G., Whang, K.Y.: Apam: Adaptive eager-lazy hybrid evaluation of event patterns for low latency. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM, pp 2275–2280 (2016)
20.
Zurück zum Zitat Brenna, L., Demers, A., Gehrke, J., et al.: Cayuga: a high-performance event processing engine. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data. ACM, pp 1100–1102 (2007) Brenna, L., Demers, A., Gehrke, J., et al.: Cayuga: a high-performance event processing engine. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data. ACM, pp 1100–1102 (2007)
21.
Zurück zum Zitat You, U., Zhong-Zhi, L., Ming, X., De-Pei, Q.: Operator-based extendable complex event processing model. J. Softw. 25(11), 2715–2730 (2014) You, U., Zhong-Zhi, L., Ming, X., De-Pei, Q.: Operator-based extendable complex event processing model. J. Softw. 25(11), 2715–2730 (2014)
22.
Zurück zum Zitat Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
Metadaten
Titel
Research of the processing technology for time complex event based on LSTM
verfasst von
Qing Li
Jiang Zhong
Yongqin Tao
Lili Li
Xiaolong Miao
Publikationsdatum
29.05.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 4/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-2765-z

Weitere Artikel der Sonderheft 4/2019

Cluster Computing 4/2019 Zur Ausgabe