Skip to main content

2013 | OriginalPaper | Buchkapitel

6. Higher-Order Markov Chains

verfasst von : Wai-Ki Ching, Ximin Huang, Michael K. Ng, Tak-Kuen Siu

Erschienen in: Markov Chains

Verlag: Springer US

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data sequences or time series occur frequently in many real world applications. One of the most important steps in analyzing a data sequence (or time series) is the selection of an appropriate mathematical model for the data. This is because it helps in predictions, hypothesis testing and rule discovery.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adke S, Deshmukh D (1988) Limit distribution of a high order Markov chain. J Roy Stat Soc Ser B 50:105–108 Adke S, Deshmukh D (1988) Limit distribution of a high order Markov chain. J Roy Stat Soc Ser B 50:105–108
2.
Zurück zum Zitat Albrecht D, Zukerman I, Nicholson A (1999) Pre-sending documents on the WWW: a comparative study. In: Proceedings of the sixteenth international joint conference on artificial intelligence IJCAI99 Albrecht D, Zukerman I, Nicholson A (1999) Pre-sending documents on the WWW: a comparative study. In: Proceedings of the sixteenth international joint conference on artificial intelligence IJCAI99
5.
Zurück zum Zitat Artzner P, Delbaen F, Eber J, Heath D (1997) Thinking coherently. Risk 10:68–71 Artzner P, Delbaen F, Eber J, Heath D (1997) Thinking coherently. Risk 10:68–71
6.
Zurück zum Zitat Artzner P, Delbaen F, Eber J, Heath D (1999) Coherent measures of risk. Math Finance 9:203–228CrossRef Artzner P, Delbaen F, Eber J, Heath D (1999) Coherent measures of risk. Math Finance 9:203–228CrossRef
25.
Zurück zum Zitat Brockwell P, Davis R (1991) Time series: theory and methods. Springer, New YorkCrossRef Brockwell P, Davis R (1991) Time series: theory and methods. Springer, New YorkCrossRef
29.
Zurück zum Zitat Buffington J, Elliott R (2002) Regime switching and European options. In: Stochastic theory and control, proceedings of a workshop, Lawrence, K.S. Springer, Berlin, pp 73–81 Buffington J, Elliott R (2002) Regime switching and European options. In: Stochastic theory and control, proceedings of a workshop, Lawrence, K.S. Springer, Berlin, pp 73–81
30.
Zurück zum Zitat Buffington J, Elliott R (2002) American options with regime switching. Int J Theoret Appl Finance 5:497–514CrossRef Buffington J, Elliott R (2002) American options with regime switching. Int J Theoret Appl Finance 5:497–514CrossRef
51.
Zurück zum Zitat Ching W, Fung E, Ng M (2003) A higher-order Markov model for the Newsboy’s problem. JOper Res Soc 54:291–298CrossRef Ching W, Fung E, Ng M (2003) A higher-order Markov model for the Newsboy’s problem. JOper Res Soc 54:291–298CrossRef
52.
Zurück zum Zitat Ching W, Fung E, Ng M (2004) Higher-order Markov chain models for categorical data sequences. Int J Naval Res Logist 51:557–574CrossRef Ching W, Fung E, Ng M (2004) Higher-order Markov chain models for categorical data sequences. Int J Naval Res Logist 51:557–574CrossRef
53.
Zurück zum Zitat Ching W, Fung E, Ng M (2004) Building higher-order Markov chain models with EXCEL. Int J Math Educ Sci Technol 35:921–932CrossRef Ching W, Fung E, Ng M (2004) Building higher-order Markov chain models with EXCEL. Int J Math Educ Sci Technol 35:921–932CrossRef
57.
Zurück zum Zitat Ching W, Ng M (2003) Recent advance in data mining and modeling. World Scientific, Singapore Ching W, Ng M (2003) Recent advance in data mining and modeling. World Scientific, Singapore
68.
Zurück zum Zitat Ching W, Ng M, Zhang S (2005) On computation with higher-order Markov chain. In: Zhang W, Chen Z, Glowinski R, Tong W (eds) Current trends in high performance computing and its applications proceedings of the international conference on high performance computing and applications, 8–10 August 2004. Springer, Shanghai, China, pp 15–24 Ching W, Ng M, Zhang S (2005) On computation with higher-order Markov chain. In: Zhang W, Chen Z, Glowinski R, Tong W (eds) Current trends in high performance computing and its applications proceedings of the international conference on high performance computing and applications, 8–10 August 2004. Springer, Shanghai, China, pp 15–24
79.
Zurück zum Zitat Davis P (1979) Circulant matrices. Wiley, New York Davis P (1979) Circulant matrices. Wiley, New York
81.
Zurück zum Zitat Duffie D, Pan J (1997) An overview of value at risk. J Derivat 4(3):7–49CrossRef Duffie D, Pan J (1997) An overview of value at risk. J Derivat 4(3):7–49CrossRef
83.
Zurück zum Zitat Elliott R (1993) New finite-dimensional filters and smoothers for noisily observed Markov chains. IEEE Trans Inform Theory 39(1):265–271CrossRef Elliott R (1993) New finite-dimensional filters and smoothers for noisily observed Markov chains. IEEE Trans Inform Theory 39(1):265–271CrossRef
84.
Zurück zum Zitat Elliott R, Aggoun L, Moore J (1994) Hidden Markov models: estimation and control. Springer, New York Elliott R, Aggoun L, Moore J (1994) Hidden Markov models: estimation and control. Springer, New York
85.
Zurück zum Zitat Elliott R, Chan L, Siu T (2005) Option pricing and Esscher transform under regime switching. Ann Finance 1(4):423–432CrossRef Elliott R, Chan L, Siu T (2005) Option pricing and Esscher transform under regime switching. Ann Finance 1(4):423–432CrossRef
86.
Zurück zum Zitat Elliott R, van der Hoek J (1997) An application of hidden Markov models to asset allocation problems. Finance Stochast 3:229–238CrossRef Elliott R, van der Hoek J (1997) An application of hidden Markov models to asset allocation problems. Finance Stochast 3:229–238CrossRef
87.
Zurück zum Zitat Elliott R, Hunter W, Jamieson B (1998) Drift and volatility estimation in discrete time. J Econ Dyn Contr 22:209–218CrossRef Elliott R, Hunter W, Jamieson B (1998) Drift and volatility estimation in discrete time. J Econ Dyn Contr 22:209–218CrossRef
88.
Zurück zum Zitat Elliott R, Liew C, Siu T (2011) On filtering and estimation of a threshold stochastic volatility model. Appl Math Comput 218(1):61–75CrossRef Elliott R, Liew C, Siu T (2011) On filtering and estimation of a threshold stochastic volatility model. Appl Math Comput 218(1):61–75CrossRef
89.
Zurück zum Zitat Elliott R, Malcolm W, Tsoi A (2003) Robust parameter estimation for asset price models with Markov modulated volatilities. J Econ Dyn Contr 27(8):1391–1409CrossRef Elliott R, Malcolm W, Tsoi A (2003) Robust parameter estimation for asset price models with Markov modulated volatilities. J Econ Dyn Contr 27(8):1391–1409CrossRef
90.
Zurück zum Zitat Elliott R, Mamon R (2003) An interest rate model with a Markovian mean-reverting level. Quant Finance 2:454–458 Elliott R, Mamon R (2003) An interest rate model with a Markovian mean-reverting level. Quant Finance 2:454–458
91.
Zurück zum Zitat Elliott R, Miao H (2006) Stochastic volatility model with filtering. Stochast Anal Appl 24:661–683CrossRef Elliott R, Miao H (2006) Stochastic volatility model with filtering. Stochast Anal Appl 24:661–683CrossRef
92.
Zurück zum Zitat Elliott R, Miao H (2009) VaR and expected shortfall: a non-normal regime switching framework. Quant Finance 9:747–755CrossRef Elliott R, Miao H (2009) VaR and expected shortfall: a non-normal regime switching framework. Quant Finance 9:747–755CrossRef
93.
Zurück zum Zitat Elliott R, Siu T (2009) On Markov-modulated exponential-affine bond price formulae. Appl Math Finance 16:1–15CrossRef Elliott R, Siu T (2009) On Markov-modulated exponential-affine bond price formulae. Appl Math Finance 16:1–15CrossRef
94.
Zurück zum Zitat Elliott R, Siu T (2010) On risk minimizing portfolios under a Markovian regime-switching black-scholes economy. Ann Oper Res 176:271–291CrossRef Elliott R, Siu T (2010) On risk minimizing portfolios under a Markovian regime-switching black-scholes economy. Ann Oper Res 176:271–291CrossRef
95.
Zurück zum Zitat Elliott R, Siu T (2011) Pricing and hedging contingent claims with regime switching risk. Commun Math Sci 9:477–498 Elliott R, Siu T (2011) Pricing and hedging contingent claims with regime switching risk. Commun Math Sci 9:477–498
96.
Zurück zum Zitat Elliott R, Siu T (2011) A stochastic differential game for optimal investment of an insurer with regime switching. Quant Finance 11:365–380CrossRef Elliott R, Siu T (2011) A stochastic differential game for optimal investment of an insurer with regime switching. Quant Finance 11:365–380CrossRef
97.
Zurück zum Zitat Elliott R, Siu T, Fung E (2011) Filtering a nonlinear stochastic volatility model. Nonlinear Dynam 67(2):1295–1313CrossRef Elliott R, Siu T, Fung E (2011) Filtering a nonlinear stochastic volatility model. Nonlinear Dynam 67(2):1295–1313CrossRef
98.
Zurück zum Zitat Fang S, Puthenpura S (1993) Linear optimization and extensions. Prentice-Hall, New Jersey Fang S, Puthenpura S (1993) Linear optimization and extensions. Prentice-Hall, New Jersey
107.
Zurück zum Zitat Goldfeld S, Quandt R (1973) A Markov model for switching regressions. J Econ 1:3–16 Goldfeld S, Quandt R (1973) A Markov model for switching regressions. J Econ 1:3–16
109.
Zurück zum Zitat Gowda K, Diday E (1991) Symbolic clustering using a new dissimilarity measure. Pattern Recogn 24(6):567–578CrossRef Gowda K, Diday E (1991) Symbolic clustering using a new dissimilarity measure. Pattern Recogn 24(6):567–578CrossRef
110.
112.
Zurück zum Zitat Hamilton J (1989) A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57:357–384CrossRef Hamilton J (1989) A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57:357–384CrossRef
120.
Zurück zum Zitat Huang J, Ng M, Ching W, Cheung D, Ng J (2001) A cube model for web access sessions and cluster analysis. In: Kohavi R, Masand B, Spiliopoulou M and Srivastava J (eds) WEBKDD 2001, Workshop on mining web log data across all customer touch points. The seventh ACM SIGKDD international conference on knowledge discovery and data mining. Lecture notes in computer science. Springer, Berlin, pp 47–58 Huang J, Ng M, Ching W, Cheung D, Ng J (2001) A cube model for web access sessions and cluster analysis. In: Kohavi R, Masand B, Spiliopoulou M and Srivastava J (eds) WEBKDD 2001, Workshop on mining web log data across all customer touch points. The seventh ACM SIGKDD international conference on knowledge discovery and data mining. Lecture notes in computer science. Springer, Berlin, pp 47–58
126.
Zurück zum Zitat Joachims T, Freitag D, Mitchell T (1997) WebWatch: a tour guide for the world wide web. In: Proceedings of the fifteenth international joint conference on artificial intelligence IJCAI 97, pp 770–775 Joachims T, Freitag D, Mitchell T (1997) WebWatch: a tour guide for the world wide web. In: Proceedings of the fifteenth international joint conference on artificial intelligence IJCAI 97, pp 770–775
127.
Zurück zum Zitat Jorion P (1997) Value at risk: the new benchmark for controlling market risk. McGraw-Hill, New York Jorion P (1997) Value at risk: the new benchmark for controlling market risk. McGraw-Hill, New York
146.
Zurück zum Zitat Li W, Kwok M (1989) Some results on the estimation of a higher order Markov chain. Department of Statistics, The University of Hong Kong Li W, Kwok M (1989) Some results on the estimation of a higher order Markov chain. Department of Statistics, The University of Hong Kong
147.
Zurück zum Zitat Lieberman H (1995) Letizia: an agent that assists web browsing. In: Proceedings of the fourteenth international joint conference on artificial intelligence IJCAI 95, pp 924–929 Lieberman H (1995) Letizia: an agent that assists web browsing. In: Proceedings of the fourteenth international joint conference on artificial intelligence IJCAI 95, pp 924–929
151.
Zurück zum Zitat Logan J (1981) A structural model of the higher-order Markov process incorporating reversion effects. J Math Sociol 8: 75–89CrossRef Logan J (1981) A structural model of the higher-order Markov process incorporating reversion effects. J Math Sociol 8: 75–89CrossRef
153.
Zurück zum Zitat Luo S, Tsoi A (2007) Filtering of hidden weak Markov chain: discrete range obervations. In: Mamon R, Elliott R (eds) Hidden Markov models in finance. Springer, New York, pp 101–119 Luo S, Tsoi A (2007) Filtering of hidden weak Markov chain: discrete range obervations. In: Mamon R, Elliott R (eds) Hidden Markov models in finance. Springer, New York, pp 101–119
155.
Zurück zum Zitat MacDonald I, Zucchini W (1997) Hidden Markov and other models for discrete-valued time series. Chapman & Hall, London MacDonald I, Zucchini W (1997) Hidden Markov and other models for discrete-valued time series. Chapman & Hall, London
156.
Zurück zum Zitat Mamon R, Elliott R (2007) Hidden Markov models in finance. Springer’s international series in operations research and management science, vol 104. Springer, New York Mamon R, Elliott R (2007) Hidden Markov models in finance. Springer’s international series in operations research and management science, vol 104. Springer, New York
157.
Zurück zum Zitat McNeil A, Frey R, Embrechts P (2005) Quantitative risk management: concepts, techniques and tools. Princeton University Press, Princeton McNeil A, Frey R, Embrechts P (2005) Quantitative risk management: concepts, techniques and tools. Princeton University Press, Princeton
165.
Zurück zum Zitat Nahmias S (1981) Managing repairable item inventory systems: a review in TIMS studies. Manag Sci 16:253–277 Nahmias S (1981) Managing repairable item inventory systems: a review in TIMS studies. Manag Sci 16:253–277
166.
Zurück zum Zitat Naik V (1993) Option valuation and hedging strategies with jumps in the volatility of asset returns. J Finance 48:1969–1984CrossRef Naik V (1993) Option valuation and hedging strategies with jumps in the volatility of asset returns. J Finance 48:1969–1984CrossRef
171.
Zurück zum Zitat Pliska S (2003) Introduction to mathematical finance: discrete time models. Blackwell, Oxford Pliska S (2003) Introduction to mathematical finance: discrete time models. Blackwell, Oxford
174.
Zurück zum Zitat Quandt R (1958) The estimation of parameters of linear regression system obeying two separate regimes. J Am Stat Assoc 55:873–880CrossRef Quandt R (1958) The estimation of parameters of linear regression system obeying two separate regimes. J Am Stat Assoc 55:873–880CrossRef
176.
Zurück zum Zitat Raftery A (1985) A model for high-order Markov chains. J Roy Stat Soc Ser B 47:528–539 Raftery A (1985) A model for high-order Markov chains. J Roy Stat Soc Ser B 47:528–539
177.
Zurück zum Zitat Raftery A, Tavare S (1994) Estimation and modelling repeated patterns in high order Markov chains with the mixture transition distribution model. J Appl Stat 43:179–199CrossRef Raftery A, Tavare S (1994) Estimation and modelling repeated patterns in high order Markov chains with the mixture transition distribution model. J Appl Stat 43:179–199CrossRef
183.
Zurück zum Zitat Shahabi C, Faisal A, Kashani F, Faruque J (2000) INSITE: a tool for real time knowledge discovery from users web navigation. In: Proceedings of VLDB2000, Cairo, Egypt Shahabi C, Faisal A, Kashani F, Faruque J (2000) INSITE: a tool for real time knowledge discovery from users web navigation. In: Proceedings of VLDB2000, Cairo, Egypt
184.
Zurück zum Zitat Siu T (2008) A game theoretic approach to option valuation under Markovian regime-switching models. Insur Math Econ 42:1146–1158CrossRef Siu T (2008) A game theoretic approach to option valuation under Markovian regime-switching models. Insur Math Econ 42:1146–1158CrossRef
185.
Zurück zum Zitat Siu T (2010) A Markov regime switching marked point process for short rate analysis with credit risk. Int J Stochast Anal 2010, Article ID 870516, 18 pages Siu T (2010) A Markov regime switching marked point process for short rate analysis with credit risk. Int J Stochast Anal 2010, Article ID 870516, 18 pages
186.
Zurück zum Zitat Siu T (2010) Bond pricing under a Markovian regime-switching jump-augmented vasicek model via stochastic flows. Appl Math Comput 216:3184–3190CrossRef Siu T (2010) Bond pricing under a Markovian regime-switching jump-augmented vasicek model via stochastic flows. Appl Math Comput 216:3184–3190CrossRef
189.
Zurück zum Zitat Siu T, Ching E, Fung E, Ng M, Li X (2009) A higher-order Markov-switching model for risk measurement. Comput Math Appl 58:1–10CrossRef Siu T, Ching E, Fung E, Ng M, Li X (2009) A higher-order Markov-switching model for risk measurement. Comput Math Appl 58:1–10CrossRef
197.
Zurück zum Zitat Tong H (1978) On a threshold model. In: Pattern recognition and signal processing. Sijthoff and Noordhoff, The Netherlands Tong H (1978) On a threshold model. In: Pattern recognition and signal processing. Sijthoff and Noordhoff, The Netherlands
198.
Zurück zum Zitat Tong H (1983) Threshold models in non-linear time series analysis. Springer, BerlinCrossRef Tong H (1983) Threshold models in non-linear time series analysis. Springer, BerlinCrossRef
199.
Zurück zum Zitat Tong H (1990) Non-linear time series: a dynamical system approach. Oxford University Press, Oxford Tong H (1990) Non-linear time series: a dynamical system approach. Oxford University Press, Oxford
200.
Zurück zum Zitat Tong H, Lim K (1980) Threshold autoregression, limit cycles and cyclical data. J Roy Stat Soc Ser B, Methodol 42:245–292 Tong H, Lim K (1980) Threshold autoregression, limit cycles and cyclical data. J Roy Stat Soc Ser B, Methodol 42:245–292
201.
Zurück zum Zitat Tsoi A (2007) Discrete time weak Markov term structure model (preprint) Tsoi A (2007) Discrete time weak Markov term structure model (preprint)
202.
Zurück zum Zitat Tsoi A (2007) Discrete time reversal and duality of weak Markov chain (preprint) Tsoi A (2007) Discrete time reversal and duality of weak Markov chain (preprint)
205.
Zurück zum Zitat Wang Y (1992) Approximation k th -order two-state Markov chains. J Appl Probab 29:861–868CrossRef Wang Y (1992) Approximation k th -order two-state Markov chains. J Appl Probab 29:861–868CrossRef
210.
Zurück zum Zitat Yang Q, Huang Z, Ng M (2003) A data cube model for prediction-based web prefetching. J Intell Inform Syst 20:11–30CrossRef Yang Q, Huang Z, Ng M (2003) A data cube model for prediction-based web prefetching. J Intell Inform Syst 20:11–30CrossRef
211.
Zurück zum Zitat Yin G, Zhou X (2004) Markowitz’s mean-variance portfolio selection with regime switching: from discrete-time models to their continuous-time limits. IEEE Trans Automat Contr 49:349–360CrossRef Yin G, Zhou X (2004) Markowitz’s mean-variance portfolio selection with regime switching: from discrete-time models to their continuous-time limits. IEEE Trans Automat Contr 49:349–360CrossRef
215.
Zurück zum Zitat Zhou X, Yin G (2003) Markowitz’s mean-variance portfolio selection with regime switching: a continuous time model. SIAM J Contr Optim 42:1466–1482CrossRef Zhou X, Yin G (2003) Markowitz’s mean-variance portfolio selection with regime switching: a continuous time model. SIAM J Contr Optim 42:1466–1482CrossRef
216.
Zurück zum Zitat Zhu D, Ching W (2011) A note on the stationary property of high-dimensional Markov chain models. Int J Pure Appl Math 66:321–330 Zhu D, Ching W (2011) A note on the stationary property of high-dimensional Markov chain models. Int J Pure Appl Math 66:321–330
Metadaten
Titel
Higher-Order Markov Chains
verfasst von
Wai-Ki Ching
Ximin Huang
Michael K. Ng
Tak-Kuen Siu
Copyright-Jahr
2013
Verlag
Springer US
DOI
https://doi.org/10.1007/978-1-4614-6312-2_6