Skip to main content
Erschienen in: Data Mining and Knowledge Discovery 1/2006

01.01.2006

Structural Hidden Markov Models Using a Relation of Equivalence: Application to Automotive Designs

verfasst von: D. Bouchaffra, J. Tan

Erschienen in: Data Mining and Knowledge Discovery | Ausgabe 1/2006

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Standard hidden Markov models (HMM's) have been studied extensively in the last two decades. It is well known that these models assume state conditional independence of the observations. Therefore, they are inadequate for classification of complex and highly structured patterns. Nowadays, the need for new statistical models that are capable to cope with structural time series data is increasing. We propose in this paper a novel paradigm that we named “structural hidden Markov model” (SHMM). It extends traditional HMM's by partitioning the set of observation sequences into classes of equivalences. These observation sequences are related in the sense they all contribute to produce a particular local structure. We describe four basic problems that are assigned to a structural hidden Markov model: (1) probability evaluation, (2) statistical decoding, (3) local structure decoding, and (4) parameter estimation. We have applied SHMM in order to mine customers' preferences for automotive designs. The results reported in this application show that SHMM's outperform the traditional hidden Markov model with a 9% of increase in accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Asai, S., Hayamizu, K., and Handa, H. 1993. Prediction of protein secondary structures by hidden markov models. Computer Application in the Biosciences (CABIOS), 9(2):141–146. Asai, S., Hayamizu, K., and Handa, H. 1993. Prediction of protein secondary structures by hidden markov models. Computer Application in the Biosciences (CABIOS), 9(2):141–146.
Zurück zum Zitat Baum, L. and Petrie, T. 1966. Statistical inference for probabilistic functions of finite state markov chain. Ann. Math. Stat., 37:1554–1563.CrossRefMathSciNetMATH Baum, L. and Petrie, T. 1966. Statistical inference for probabilistic functions of finite state markov chain. Ann. Math. Stat., 37:1554–1563.CrossRefMathSciNetMATH
Zurück zum Zitat Bellman, R. 1961. On the approximation of curves by line segments using dynamic programming. Communication of the ACM, (4(6)). Bellman, R. 1961. On the approximation of curves by line segments using dynamic programming. Communication of the ACM, (4(6)).
Zurück zum Zitat Bouchaffra, D., Govindaraju, V., and Srihari, S. 1999. Postprocessing of recognized strings using nonstationary Markovian models. IEEE Transactions: Pattern Analysis and Machine Intelligence, 21(10). Bouchaffra, D., Govindaraju, V., and Srihari, S. 1999. Postprocessing of recognized strings using nonstationary Markovian models. IEEE Transactions: Pattern Analysis and Machine Intelligence, 21(10).
Zurück zum Zitat Bouchaffra, D. and Tan, J. 2004. The concept of structural hidden markov models: Application to mining customers' preferences for automotive designs. In 17th international conference on pattern recognition, (icpr). Cambridge, United Kingdom. Bouchaffra, D. and Tan, J. 2004. The concept of structural hidden markov models: Application to mining customers' preferences for automotive designs. In 17th international conference on pattern recognition, (icpr). Cambridge, United Kingdom.
Zurück zum Zitat Cai, J. and Liu, Z. 1999. Integration of structural and statistical information for unconstrained handwritten numeral recognition. EEE Transactions: Pattern Analysis and Machine Intelligence, 21(3). Cai, J. and Liu, Z. 1999. Integration of structural and statistical information for unconstrained handwritten numeral recognition. EEE Transactions: Pattern Analysis and Machine Intelligence, 21(3).
Zurück zum Zitat Churchill, G. 1989. Stochastic models for heterogeneous DNA sequences. Bulletin of Mathematical Biology, (51):79–94. Churchill, G. 1989. Stochastic models for heterogeneous DNA sequences. Bulletin of Mathematical Biology, (51):79–94.
Zurück zum Zitat Duda, R., Hart, P., and Stork, D. 2001. Pattern classification, New York: Wiley. Duda, R., Hart, P., and Stork, D. 2001. Pattern classification, New York: Wiley.
Zurück zum Zitat Efron, B. 1982. In the jackknife, the bootstrap and other resampling plans. SIAM. Efron, B. 1982. In the jackknife, the bootstrap and other resampling plans. SIAM.
Zurück zum Zitat Fan, G. and Xia, X. 2001. Improved hidden markov models in the wavelet-domain. IEEE Transactions on Signal Processing, 49(1). Fan, G. and Xia, X. 2001. Improved hidden markov models in the wavelet-domain. IEEE Transactions on Signal Processing, 49(1).
Zurück zum Zitat Fellbaum, C. 1998. Wordnet: an electronic lexical database. Bradford Book. Fellbaum, C. 1998. Wordnet: an electronic lexical database. Bradford Book.
Zurück zum Zitat Fodor, J. and Pylyshyn, Z.W. 1988. Connectionism and cognitive architecture: a critical analysis. Cognition, (28):3–71. Fodor, J. and Pylyshyn, Z.W. 1988. Connectionism and cognitive architecture: a critical analysis. Cognition, (28):3–71.
Zurück zum Zitat Freeman, H. 1961. On the encoding of arbitrary geometric configurations. IRE Trans. Electron. Comput., EC-10, 260–268.MathSciNetCrossRef Freeman, H. 1961. On the encoding of arbitrary geometric configurations. IRE Trans. Electron. Comput., EC-10, 260–268.MathSciNetCrossRef
Zurück zum Zitat Gales, J. 2000. Cluster adaptive training of hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(4). Gales, J. 2000. Cluster adaptive training of hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(4).
Zurück zum Zitat Geman, S., Bienenstock, E., Geman, S., and Potter, D. 2004. Compositionality, MDL priors, and object recognition (Tech. Rep.). Division of Applied Mathematics, Brown University. Geman, S., Bienenstock, E., Geman, S., and Potter, D. 2004. Compositionality, MDL priors, and object recognition (Tech. Rep.). Division of Applied Mathematics, Brown University.
Zurück zum Zitat Gemignani, M. 1990. Elementary topology. second edition. New York: Dover Publications, Inc. Gemignani, M. 1990. Elementary topology. second edition. New York: Dover Publications, Inc.
Zurück zum Zitat Hernandez-Hernandez, D., Marcus, S., and Fard, P. 1999 May. Analysis of a risk-sensitive control problem for hidden markov chains. IEEE Transactions on Automatic Control, 44(5):1093.CrossRefMATHMathSciNet Hernandez-Hernandez, D., Marcus, S., and Fard, P. 1999 May. Analysis of a risk-sensitive control problem for hidden markov chains. IEEE Transactions on Automatic Control, 44(5):1093.CrossRefMATHMathSciNet
Zurück zum Zitat Kim, D. and Bang, S. 2000. A handwritten numeral character classification using tolerant rough set. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9). Kim, D. and Bang, S. 2000. A handwritten numeral character classification using tolerant rough set. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9).
Zurück zum Zitat Krogh, A., Brown, M., Mian, I., Sjolander, K., and Haussler, D. 1994. Hidden markov models in computational biology: Applications to Protein Modeling. J. Mol. Biol. 235:1501–1531.CrossRefPubMed Krogh, A., Brown, M., Mian, I., Sjolander, K., and Haussler, D. 1994. Hidden markov models in computational biology: Applications to Protein Modeling. J. Mol. Biol. 235:1501–1531.CrossRefPubMed
Zurück zum Zitat Li, J., Najmi, A., and Gray, R. 2000 Feb. Image classification by a two-dimensional hidden markov model. IEEE Transactions on Signal Processing, 482(2):517. Li, J., Najmi, A., and Gray, R. 2000 Feb. Image classification by a two-dimensional hidden markov model. IEEE Transactions on Signal Processing, 482(2):517.
Zurück zum Zitat Rabiner, L. and Juang, B. 1993. Fundamentals of speech recognition. Prentice Hall. Rabiner, L. and Juang, B. 1993. Fundamentals of speech recognition. Prentice Hall.
Zurück zum Zitat Ripley, B. 1996. Pattern recognition and neural networks. Cambridge University Press. Ripley, B. 1996. Pattern recognition and neural networks. Cambridge University Press.
Zurück zum Zitat Sanches, I. 2000 Sept. Noise-compensated hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(5). Sanches, I. 2000 Sept. Noise-compensated hidden markov models. IEEE Transactions on Speech and Audio Processing, 8(5).
Zurück zum Zitat Zhou, J. and Chen, D. 2002 November. The subsystem of the fuzzed rough sets based on equivalence class. In Proceedings of the First International Conference on Machine Learning and Cybernetics. Beijing. Zhou, J. and Chen, D. 2002 November. The subsystem of the fuzzed rough sets based on equivalence class. In Proceedings of the First International Conference on Machine Learning and Cybernetics. Beijing.
Zurück zum Zitat Zhu, W. and Frias, J. 2004 May. Stochastic context-free grammars and hidden markov models for modeling of bursty channels. IEEE Transactions on Vehicular Technology, 53(3). Zhu, W. and Frias, J. 2004 May. Stochastic context-free grammars and hidden markov models for modeling of bursty channels. IEEE Transactions on Vehicular Technology, 53(3).
Metadaten
Titel
Structural Hidden Markov Models Using a Relation of Equivalence: Application to Automotive Designs
verfasst von
D. Bouchaffra
J. Tan
Publikationsdatum
01.01.2006
Verlag
Springer US
Erschienen in
Data Mining and Knowledge Discovery / Ausgabe 1/2006
Print ISSN: 1384-5810
Elektronische ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-005-0020-8

Weitere Artikel der Ausgabe 1/2006

Data Mining and Knowledge Discovery 1/2006 Zur Ausgabe