Skip to main content
Top

2018 | OriginalPaper | Chapter

Improved Implementation of Expectation Maximization Algorithm on Graphic Processing Unit

Authors : Si-Yuan Jing, Rui Sun, Chun-Ming Xie, Peng Jin, Yi Liu, Cai-Ming Liu

Published in: Chinese Lexical Semantics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In our previous work, an efficient implementation of Expectation-Maximization (EM) algorithm using CUDA has been proposed for high-speed word alignment. The proposed algorithm can gain a 16.8-fold speedup compared to a multi-thread algorithm and a 234.7-fold speedup compared to a sequential algorithm on a modern graphic processing unit (GPU). In this paper, we try to improve the algorithm to achieve better performance. Through analysis of the previous algorithm, we find that two places in “E” step (expectation calculation) are unreasonably designed. An improved CUDA implementation of the EM algorithm is proposed in this paper. Experimental results show that the new algorithm can improve the speed of expectation calculation by 29.4%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Brown, P.F., Pietra, S.A.D., Pietra, V.J.D., et al.: The mathematics of statistical machine translation: parameter estimation. Comput. Linguist. 19, 263–311 (1993) Brown, P.F., Pietra, S.A.D., Pietra, V.J.D., et al.: The mathematics of statistical machine translation: parameter estimation. Comput. Linguist. 19, 263–311 (1993)
2.
go back to reference Och, F.J., Ney, H.: Improved statistical alignment models. In: Proceedings of the ACL 2000, pp. 440–447 (2000) Och, F.J., Ney, H.: Improved statistical alignment models. In: Proceedings of the ACL 2000, pp. 440–447 (2000)
3.
go back to reference Jing, S.Y., Yan, G.R., Chen, X.Y., et al.: CUDA-based parallel implementation of IBM word alignment algorithm for statistical machine translation. In: Proceedings of the PDCAT 2016, pp. 189–194 (2016) Jing, S.Y., Yan, G.R., Chen, X.Y., et al.: CUDA-based parallel implementation of IBM word alignment algorithm for statistical machine translation. In: Proceedings of the PDCAT 2016, pp. 189–194 (2016)
4.
go back to reference Gao, Q., Vogel, S.: Parallel implementations of word alignment tool. In: Proceedings of the SETQA-NLP 2008, pp. 49–59 (2008) Gao, Q., Vogel, S.: Parallel implementations of word alignment tool. In: Proceedings of the SETQA-NLP 2008, pp. 49–59 (2008)
5.
go back to reference Koehn, P.: Statistical Machine Translation. Cambridge University Press, London (2010)MATH Koehn, P.: Statistical Machine Translation. Cambridge University Press, London (2010)MATH
6.
go back to reference David, K., Hwu, W.M.: Programming Massively Parallel Processors: A Hand-On Approach. Morgan Kaufmann Publishers Inc., San Francisco (2010) David, K., Hwu, W.M.: Programming Massively Parallel Processors: A Hand-On Approach. Morgan Kaufmann Publishers Inc., San Francisco (2010)
7.
go back to reference Ryoo, S., Rodrigues, C.I., Baghsorkhi, S.S., et al.: Optimization principles and application performance evaluation of a multi-threaded GPU using CUDA. In: Proceedings of the PPoPP 2008, pp. 73–82 (2008) Ryoo, S., Rodrigues, C.I., Baghsorkhi, S.S., et al.: Optimization principles and application performance evaluation of a multi-threaded GPU using CUDA. In: Proceedings of the PPoPP 2008, pp. 73–82 (2008)
8.
go back to reference Xiao, T., Zhu, J.B., Zhang, H., et al.: NiuTrans: an open source toolkit for phrase-based and syntax-based machine translation. In: Proceedings of the ACL 2012, pp. 19–24 (2012) Xiao, T., Zhu, J.B., Zhang, H., et al.: NiuTrans: an open source toolkit for phrase-based and syntax-based machine translation. In: Proceedings of the ACL 2012, pp. 19–24 (2012)
9.
go back to reference Satish, N., Harris, M., Garland, M.: Designing efficient sorting algorithms for manycore GPUs. In: Proceedings of the IPDPS 2009, pp. 1–10 (2009) Satish, N., Harris, M., Garland, M.: Designing efficient sorting algorithms for manycore GPUs. In: Proceedings of the IPDPS 2009, pp. 1–10 (2009)
Metadata
Title
Improved Implementation of Expectation Maximization Algorithm on Graphic Processing Unit
Authors
Si-Yuan Jing
Rui Sun
Chun-Ming Xie
Peng Jin
Yi Liu
Cai-Ming Liu
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-04015-4_54

Premium Partner