Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 1/2006

01-01-2006

Structural Hidden Markov Models Using a Relation of Equivalence: Application to Automotive Designs

Authors: D. Bouchaffra, J. Tan

Published in: Data Mining and Knowledge Discovery | Issue 1/2006

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Standard hidden Markov models (HMM's) have been studied extensively in the last two decades. It is well known that these models assume state conditional independence of the observations. Therefore, they are inadequate for classification of complex and highly structured patterns. Nowadays, the need for new statistical models that are capable to cope with structural time series data is increasing. We propose in this paper a novel paradigm that we named “structural hidden Markov model” (SHMM). It extends traditional HMM's by partitioning the set of observation sequences into classes of equivalences. These observation sequences are related in the sense they all contribute to produce a particular local structure. We describe four basic problems that are assigned to a structural hidden Markov model: (1) probability evaluation, (2) statistical decoding, (3) local structure decoding, and (4) parameter estimation. We have applied SHMM in order to mine customers' preferences for automotive designs. The results reported in this application show that SHMM's outperform the traditional hidden Markov model with a 9% of increase in accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Asai, S., Hayamizu, K., and Handa, H. 1993. Prediction of protein secondary structures by hidden markov models. Computer Application in the Biosciences (CABIOS), 9(2):141–146. Asai, S., Hayamizu, K., and Handa, H. 1993. Prediction of protein secondary structures by hidden markov models. Computer Application in the Biosciences (CABIOS), 9(2):141–146.
go back to reference Baum, L. and Petrie, T. 1966. Statistical inference for probabilistic functions of finite state markov chain. Ann. Math. Stat., 37:1554–1563.CrossRefMathSciNetMATH Baum, L. and Petrie, T. 1966. Statistical inference for probabilistic functions of finite state markov chain. Ann. Math. Stat., 37:1554–1563.CrossRefMathSciNetMATH
go back to reference Bellman, R. 1961. On the approximation of curves by line segments using dynamic programming. Communication of the ACM, (4(6)). Bellman, R. 1961. On the approximation of curves by line segments using dynamic programming. Communication of the ACM, (4(6)).
go back to reference Bouchaffra, D., Govindaraju, V., and Srihari, S. 1999. Postprocessing of recognized strings using nonstationary Markovian models. IEEE Transactions: Pattern Analysis and Machine Intelligence, 21(10). Bouchaffra, D., Govindaraju, V., and Srihari, S. 1999. Postprocessing of recognized strings using nonstationary Markovian models. IEEE Transactions: Pattern Analysis and Machine Intelligence, 21(10).
go back to reference Bouchaffra, D. and Tan, J. 2004. The concept of structural hidden markov models: Application to mining customers' preferences for automotive designs. In 17th international conference on pattern recognition, (icpr). Cambridge, United Kingdom. Bouchaffra, D. and Tan, J. 2004. The concept of structural hidden markov models: Application to mining customers' preferences for automotive designs. In 17th international conference on pattern recognition, (icpr). Cambridge, United Kingdom.
go back to reference Cai, J. and Liu, Z. 1999. Integration of structural and statistical information for unconstrained handwritten numeral recognition. EEE Transactions: Pattern Analysis and Machine Intelligence, 21(3). Cai, J. and Liu, Z. 1999. Integration of structural and statistical information for unconstrained handwritten numeral recognition. EEE Transactions: Pattern Analysis and Machine Intelligence, 21(3).
go back to reference Churchill, G. 1989. Stochastic models for heterogeneous DNA sequences. Bulletin of Mathematical Biology, (51):79–94. Churchill, G. 1989. Stochastic models for heterogeneous DNA sequences. Bulletin of Mathematical Biology, (51):79–94.
go back to reference Duda, R., Hart, P., and Stork, D. 2001. Pattern classification, New York: Wiley. Duda, R., Hart, P., and Stork, D. 2001. Pattern classification, New York: Wiley.
go back to reference Efron, B. 1982. In the jackknife, the bootstrap and other resampling plans. SIAM. Efron, B. 1982. In the jackknife, the bootstrap and other resampling plans. SIAM.
go back to reference Fan, G. and Xia, X. 2001. Improved hidden markov models in the wavelet-domain. IEEE Transactions on Signal Processing, 49(1). Fan, G. and Xia, X. 2001. Improved hidden markov models in the wavelet-domain. IEEE Transactions on Signal Processing, 49(1).
go back to reference Fellbaum, C. 1998. Wordnet: an electronic lexical database. Bradford Book. Fellbaum, C. 1998. Wordnet: an electronic lexical database. Bradford Book.
go back to reference Fodor, J. and Pylyshyn, Z.W. 1988. Connectionism and cognitive architecture: a critical analysis. Cognition, (28):3–71. Fodor, J. and Pylyshyn, Z.W. 1988. Connectionism and cognitive architecture: a critical analysis. Cognition, (28):3–71.
go back to reference Freeman, H. 1961. On the encoding of arbitrary geometric configurations. IRE Trans. Electron. Comput., EC-10, 260–268.MathSciNetCrossRef Freeman, H. 1961. On the encoding of arbitrary geometric configurations. IRE Trans. Electron. Comput., EC-10, 260–268.MathSciNetCrossRef
go back to reference Gales, J. 2000. Cluster adaptive training of hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(4). Gales, J. 2000. Cluster adaptive training of hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(4).
go back to reference Geman, S., Bienenstock, E., Geman, S., and Potter, D. 2004. Compositionality, MDL priors, and object recognition (Tech. Rep.). Division of Applied Mathematics, Brown University. Geman, S., Bienenstock, E., Geman, S., and Potter, D. 2004. Compositionality, MDL priors, and object recognition (Tech. Rep.). Division of Applied Mathematics, Brown University.
go back to reference Gemignani, M. 1990. Elementary topology. second edition. New York: Dover Publications, Inc. Gemignani, M. 1990. Elementary topology. second edition. New York: Dover Publications, Inc.
go back to reference Hernandez-Hernandez, D., Marcus, S., and Fard, P. 1999 May. Analysis of a risk-sensitive control problem for hidden markov chains. IEEE Transactions on Automatic Control, 44(5):1093.CrossRefMATHMathSciNet Hernandez-Hernandez, D., Marcus, S., and Fard, P. 1999 May. Analysis of a risk-sensitive control problem for hidden markov chains. IEEE Transactions on Automatic Control, 44(5):1093.CrossRefMATHMathSciNet
go back to reference Kim, D. and Bang, S. 2000. A handwritten numeral character classification using tolerant rough set. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9). Kim, D. and Bang, S. 2000. A handwritten numeral character classification using tolerant rough set. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9).
go back to reference Krogh, A., Brown, M., Mian, I., Sjolander, K., and Haussler, D. 1994. Hidden markov models in computational biology: Applications to Protein Modeling. J. Mol. Biol. 235:1501–1531.CrossRefPubMed Krogh, A., Brown, M., Mian, I., Sjolander, K., and Haussler, D. 1994. Hidden markov models in computational biology: Applications to Protein Modeling. J. Mol. Biol. 235:1501–1531.CrossRefPubMed
go back to reference Li, J., Najmi, A., and Gray, R. 2000 Feb. Image classification by a two-dimensional hidden markov model. IEEE Transactions on Signal Processing, 482(2):517. Li, J., Najmi, A., and Gray, R. 2000 Feb. Image classification by a two-dimensional hidden markov model. IEEE Transactions on Signal Processing, 482(2):517.
go back to reference Rabiner, L. and Juang, B. 1993. Fundamentals of speech recognition. Prentice Hall. Rabiner, L. and Juang, B. 1993. Fundamentals of speech recognition. Prentice Hall.
go back to reference Ripley, B. 1996. Pattern recognition and neural networks. Cambridge University Press. Ripley, B. 1996. Pattern recognition and neural networks. Cambridge University Press.
go back to reference Sanches, I. 2000 Sept. Noise-compensated hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(5). Sanches, I. 2000 Sept. Noise-compensated hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(5).
go back to reference Zhou, J. and Chen, D. 2002 November. The subsystem of the fuzzed rough sets based on equivalence class. In Proceedings of the First International Conference on Machine Learning and Cybernetics. Beijing. Zhou, J. and Chen, D. 2002 November. The subsystem of the fuzzed rough sets based on equivalence class. In Proceedings of the First International Conference on Machine Learning and Cybernetics. Beijing.
go back to reference Zhu, W. and Frias, J. 2004 May. Stochastic context-free grammars and hidden markov models for modeling of bursty channels. IEEE Transactions on Vehicular Technology, 53(3). Zhu, W. and Frias, J. 2004 May. Stochastic context-free grammars and hidden markov models for modeling of bursty channels. IEEE Transactions on Vehicular Technology, 53(3).
Metadata
Title
Structural Hidden Markov Models Using a Relation of Equivalence: Application to Automotive Designs
Authors
D. Bouchaffra
J. Tan
Publication date
01-01-2006
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 1/2006
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-005-0020-8

Other articles of this Issue 1/2006

Data Mining and Knowledge Discovery 1/2006 Go to the issue

Premium Partner