Skip to main content
Top

2015 | OriginalPaper | Chapter

A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Bilingual dependency parsing aims to improve parsing performance with the help of bilingual information. While previous work have shown improvements on either or both sides, most of them mainly focus on designing complicated features and rely on golden translations during training and testing. In this paper, we propose a simple yet effective translation constrained reranking model to improve Chinese dependency parsing. The reranking model is trained using a max-margin neural network without any manually designed features. Instead of using golden translations for training and testing, we relax the restrictions and use sentences generated by a machine translation system, which dramatically extends the scope of our model. Experiments on the translated portion of the Chinese Treebank show that our method outperforms the state-of-the-art monolingual Graph/Transition-based parsers by a large margin (UAS).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yamada, H., Matsumoto, Y.: Statistical dependency parsing analysis with support vector machines. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003) Yamada, H., Matsumoto, Y.: Statistical dependency parsing analysis with support vector machines. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003)
2.
go back to reference Nirve, J.: An efficient algorithm for projective dependency parsing. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003) Nirve, J.: An efficient algorithm for projective dependency parsing. In: Proceedings of the Eighth International Workshop on Parsing Technologies (IWPT) (2003)
3.
go back to reference McDonald, R., Grammer, K., Peereira, F.: Online large-margin training of dependency parsers. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pp. 91–98. Association for Computational Linguistics (2005) McDonald, R., Grammer, K., Peereira, F.: Online large-margin training of dependency parsers. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pp. 91–98. Association for Computational Linguistics (2005)
4.
go back to reference Smith, D.A., Smith, N.A.: Bilingual parsing with factored estimation: using english to parse Korean. In: Proceedings of EMNLP (2004) Smith, D.A., Smith, N.A.: Bilingual parsing with factored estimation: using english to parse Korean. In: Proceedings of EMNLP (2004)
5.
go back to reference Burkett, D., Klein, D.: Two languages are better than one (for syntactic paring). In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 877–886. Association for Computational Linguistics (2008) Burkett, D., Klein, D.: Two languages are better than one (for syntactic paring). In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 877–886. Association for Computational Linguistics (2008)
6.
go back to reference Huang, L., Jiang, W., Liu, Q.: Bilingually-constrained (monolingual) shift-reduce parsing. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, vol. 3. Association for Computational Linguistics, pp. 1222–1231 (2009) Huang, L., Jiang, W., Liu, Q.: Bilingually-constrained (monolingual) shift-reduce parsing. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, vol. 3. Association for Computational Linguistics, pp. 1222–1231 (2009)
7.
go back to reference Chen, W., Kazama, J., Torisawa, K.: Bitext dependency parsing with bilingual subtree constraints. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 21–29. Association for Computational Linguistics (2010) Chen, W., Kazama, J., Torisawa, K.: Bitext dependency parsing with bilingual subtree constraints. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 21–29. Association for Computational Linguistics (2010)
8.
go back to reference Socher, R., Bauer, J., Manning, C.D., Ng, A.Y.: Parsing with compositional vector grammars. In: Proceedings of ACL (2013) Socher, R., Bauer, J., Manning, C.D., Ng, A.Y.: Parsing with compositional vector grammars. In: Proceedings of ACL (2013)
9.
go back to reference Pei, W., Ge, T., Baobao, C.: Max-margin tensor neural network for Chinese word segmentation. In: proceedings of ACL (2014) Pei, W., Ge, T., Baobao, C.: Max-margin tensor neural network for Chinese word segmentation. In: proceedings of ACL (2014)
10.
go back to reference Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12, 2121–2159 (2011)MathSciNetMATH Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12, 2121–2159 (2011)MathSciNetMATH
11.
go back to reference Nianwen, X., Chiou, F.D., Palmer, M.: Building a large-scale annotated Chinese coupus. In: Proceedings of the 19th International Conference on Computational Linguistics, vol. 1, pp. 1–8. Association for Computational Linguistics (2002) Nianwen, X., Chiou, F.D., Palmer, M.: Building a large-scale annotated Chinese coupus. In: Proceedings of the 19th International Conference on Computational Linguistics, vol. 1, pp. 1–8. Association for Computational Linguistics (2002)
12.
go back to reference Bies, A., Palmer, M., Mott, J., Warner, C.: English Chinese translation treebank v1.0. LDC2007T02 (2007) Bies, A., Palmer, M., Mott, J., Warner, C.: English Chinese translation treebank v1.0. LDC2007T02 (2007)
13.
go back to reference Huang, L., Sagae, K.: Dynamic programming for linear-time incremental parsing. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1077–1086. Association for Computational Linguistics (2010) Huang, L., Sagae, K.: Dynamic programming for linear-time incremental parsing. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1077–1086. Association for Computational Linguistics (2010)
14.
go back to reference Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O.: Alexandra constantin, and evan herbst. In: Moses: Open Source Toolkit for Statistical Machine Translation. Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pp. 177–180. Association for Computational Linguistics (2007) Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O.: Alexandra constantin, and evan herbst. In: Moses: Open Source Toolkit for Statistical Machine Translation. Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pp. 177–180. Association for Computational Linguistics (2007)
15.
go back to reference Graff, D., Chen, K.: Chinese Gigaword. LDC2003T09 (2003) Graff, D., Chen, K.: Chinese Gigaword. LDC2003T09 (2003)
16.
go back to reference Graff, D., Cieri, C.: English Gigaword. LDC2003T05 (2003) Graff, D., Cieri, C.: English Gigaword. LDC2003T05 (2003)
17.
go back to reference van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 85 (2008)MATH van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 85 (2008)MATH
18.
go back to reference Chen, D., Manning, C.D.: A fast and accurate dependency parser using neural networks. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 740–750 (2014) Chen, D., Manning, C.D.: A fast and accurate dependency parser using neural networks. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 740–750 (2014)
Metadata
Title
A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing
Authors
Miaohong Chen
Baobao Chang
Yang Liu
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-25816-4_20

Premium Partner