Skip to main content

2016 | OriginalPaper | Buchkapitel

2. Preprocessing Procedures

verfasst von : Prodromos E. Tsinaslanidis, Achilleas D. Zapranis

Erschienen in: Technical Analysis for Algorithmic Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The purpose of this chapter is to present two important preprocessing procedures than need to be carried before someone moves to the phase of recognizing technical patterns in financial price series. Initially, the importance of detecting errors in a dataset and various manners of replacing missing values are discussed.
This chapter further describes the algorithms for the identification of regional locals and perceptually important points. These algorithms are a common prerequisite step for all the proposed, patterns’ identification mechanisms presented in this book.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Autoregressive Integrated Moving Average.
 
2
Functions presented in this book have the following general form: [output1, output2, …, outputn] = function’s name (input1, input2, …, inputn). The variables in the squared brackets are the outputs generated by the corresponding function and the variables inside the brackets are the necessary inputs. We follow the same notation used in the Matlab software since all the identification mechanisms presented in this book were developed with the use of this software.
 
3
Hereafter we will use the notation [a : b] to refer to all positive natural values between the closed interval [a, b], where \( 0<a<b \) and \( a,b\in\ \mathrm{\mathbb{N}} \).
 
4
A comprehensive review on the existing time series data mining research is presented in Fu (2011), where variant methodologies that deal with the aforementioned aspects of data mining are highlighted.
 
5
Since the first two PIPs are defined as the first and the last observation the ı th iteration identifies the \( {\left(\imath +2\right)}^{th} \) PIP.
 
6
nan stands for “not-a-number”. A nan value is the result from operations which have undefined numerical results. When nan is involved in a calculation (for example \( nan\times 10 \)) the result is also nan.
 
7
Since the division between matrices is not defined in Eqs. (2.13) and (2.14) an element wise division is implied.
 
Literatur
Zurück zum Zitat Beaumont J-F, Bocci C (2009) Variance estimation when donor imputation is used to fill in missing values. Can J Stat 37(3):400–416CrossRef Beaumont J-F, Bocci C (2009) Variance estimation when donor imputation is used to fill in missing values. Can J Stat 37(3):400–416CrossRef
Zurück zum Zitat Chambers R (2001) Evaluation criteria for statistical editing and imputation. National Statistics Methodological Series No. 28. Office for National Statistics, UK Chambers R (2001) Evaluation criteria for statistical editing and imputation. National Statistics Methodological Series No. 28. Office for National Statistics, UK
Zurück zum Zitat Chen C-H, Tseng VS, Yu H-H, Hong T-P (2013) Time series pattern discovery by a PIP-based evolutionary approach. Soft Comput 17:1699–1710CrossRef Chen C-H, Tseng VS, Yu H-H, Hong T-P (2013) Time series pattern discovery by a PIP-based evolutionary approach. Soft Comput 17:1699–1710CrossRef
Zurück zum Zitat Chung FL, Fu TC, Luk R, Ng V (2001) Flexible time series pattern matching based on perceptually important points. Paper presented at the international joint conference on artificial intelligence workshop on learning from temporal and spatial data Chung FL, Fu TC, Luk R, Ng V (2001) Flexible time series pattern matching based on perceptually important points. Paper presented at the international joint conference on artificial intelligence workshop on learning from temporal and spatial data
Zurück zum Zitat Dawson ER, Steeley JM (2003) On the existence of visual technical patterns in the UK stock market. J Bus Financ Account 30(1 and 2):263–293CrossRef Dawson ER, Steeley JM (2003) On the existence of visual technical patterns in the UK stock market. J Bus Financ Account 30(1 and 2):263–293CrossRef
Zurück zum Zitat Fu TC (2011) A review on time series data mining. Eng Appl Artif Intell 24(1):164–181CrossRef Fu TC (2011) A review on time series data mining. Eng Appl Artif Intell 24(1):164–181CrossRef
Zurück zum Zitat Fu TC, Chung FL, Luk R, Ng CM (2004) Financial time series indexing based on low resolution clustering. In: Workshop at the 4th international conference on data mining, pp. 5–14 Fu TC, Chung FL, Luk R, Ng CM (2004) Financial time series indexing based on low resolution clustering. In: Workshop at the 4th international conference on data mining, pp. 5–14
Zurück zum Zitat Fu TC, Chung FL, Luk R, Ng CM (2007) Stock time series pattern matching: template-based vs. rule-based approaches. Eng Appl Artif Intell 20(3):347–364CrossRef Fu TC, Chung FL, Luk R, Ng CM (2007) Stock time series pattern matching: template-based vs. rule-based approaches. Eng Appl Artif Intell 20(3):347–364CrossRef
Zurück zum Zitat Fu TC, Chung FL, Luk R, Ng CM (2008) Representing financial time series based on data point importance. Eng Appl Artif Intell 21(2):277–300CrossRef Fu TC, Chung FL, Luk R, Ng CM (2008) Representing financial time series based on data point importance. Eng Appl Artif Intell 21(2):277–300CrossRef
Zurück zum Zitat Fu TC, Chung FL, Ng CM (2006) Financial time series segmentation based on specialized binary tree representation. In: International conference on data mining, pp. 3-9 Fu TC, Chung FL, Ng CM (2006) Financial time series segmentation based on specialized binary tree representation. In: International conference on data mining, pp. 3-9
Zurück zum Zitat Jiang J, Zhang Z, Wang HA (2007) New segmentation algorithm to stock time series based on PIP approach. In: International conference on wireless communications, networking and mobile computing, pp. 5609–5612 Jiang J, Zhang Z, Wang HA (2007) New segmentation algorithm to stock time series based on PIP approach. In: International conference on wireless communications, networking and mobile computing, pp. 5609–5612
Zurück zum Zitat Kugiumtzis D, Vlachos I, Papana A, Larsson PG (2007) Assessment of measures of scalar time series analysis in discriminating Preictal states. Int J Bioelectromag 9(3):134–145 Kugiumtzis D, Vlachos I, Papana A, Larsson PG (2007) Assessment of measures of scalar time series analysis in discriminating Preictal states. Int J Bioelectromag 9(3):134–145
Zurück zum Zitat Kumiega A, Van Vliet B (2008) Quality money management. Elsevier, Amsterdam Kumiega A, Van Vliet B (2008) Quality money management. Elsevier, Amsterdam
Zurück zum Zitat Lo AW, Mamaysky H, Wang J (2000) Foundations of technical analysis: computational algorithms, statistical inference, and empirical implementation. J Financ 55(4):1705–1765CrossRef Lo AW, Mamaysky H, Wang J (2000) Foundations of technical analysis: computational algorithms, statistical inference, and empirical implementation. J Financ 55(4):1705–1765CrossRef
Zurück zum Zitat Lucke B (2003) Are technical trading rules profitable? Evidence for head-and-shoulder rules. Appl Econ 35:33–40CrossRef Lucke B (2003) Are technical trading rules profitable? Evidence for head-and-shoulder rules. Appl Econ 35:33–40CrossRef
Zurück zum Zitat Neftci SN (1991) Naïve trading rules in financial markets and Wiener-Kolmogorov prediction theory: a study of "Technical Analysis". J Bus 64(4):549–571CrossRef Neftci SN (1991) Naïve trading rules in financial markets and Wiener-Kolmogorov prediction theory: a study of "Technical Analysis". J Bus 64(4):549–571CrossRef
Zurück zum Zitat Phetchanchai C, Selamat A, Rehman A, Saba T (2010) Index financial time series based on zigzag-perceptually important points. J Comput Sci 6(12):1389–1395CrossRef Phetchanchai C, Selamat A, Rehman A, Saba T (2010) Index financial time series based on zigzag-perceptually important points. J Comput Sci 6(12):1389–1395CrossRef
Zurück zum Zitat Savin G, Weller P, Zvingelis J (2007) The predictive power of “Head-and-Shoulders” price patterns in the U.S. stock market. J Financ Econometr 5(2):243–265CrossRef Savin G, Weller P, Zvingelis J (2007) The predictive power of “Head-and-Shoulders” price patterns in the U.S. stock market. J Financ Econometr 5(2):243–265CrossRef
Zurück zum Zitat Tsinaslanidis PE, Kugiumtzis D (2014) A prediction scheme using perceptually important points and dynamic time warping. Expert Syst Appl 41(15):6848–6860CrossRef Tsinaslanidis PE, Kugiumtzis D (2014) A prediction scheme using perceptually important points and dynamic time warping. Expert Syst Appl 41(15):6848–6860CrossRef
Metadaten
Titel
Preprocessing Procedures
verfasst von
Prodromos E. Tsinaslanidis
Achilleas D. Zapranis
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-23636-0_2