Skip to main content
Top

2020 | OriginalPaper | Chapter

Event Detection with Document Structure and Graph Modelling

Authors : Peipei Zhu, Zhongqing Wang, Hongling Wang, Shoushan Li, Guodong Zhou

Published in: Natural Language Processing and Chinese Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Event detection is the basic task of event extraction. Previous studies usually used independent sentences as basic event detection objects. They cannot effectively identify event triggers which depend on document information. Besides, there are correlations between the sentences and words in the document. Therefore, it is necessary to use document information for event detection. In this study, we propose a graph model for event detection based on document structure. It is used to connect sentences and words in a document. Specifically, we finetune BERT model and use Bi-LSTM to learn the sentences and their context features, and then use GCN to model the document relation graph. The document relation graph is based on the parts of speech of all words in different sentences, which contributes to establishing the triggers-triggers relation and triggers-arguments relation. The experimental results on LitBank show that our proposed model outperforms all baselines significantly and verifies the validity of document information.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
English BERT-Base: 12-layer, 768-hidden, 12-heads, 110M parameters.
 
Literature
1.
go back to reference Chen, Z., Ji, H.: Language specific issue and feature exploration in chinese event extraction. In: Proceedings of ACL 2009, pp. 209–212 (2009) Chen, Z., Ji, H.: Language specific issue and feature exploration in chinese event extraction. In: Proceedings of ACL 2009, pp. 209–212 (2009)
2.
go back to reference Li, P., Zhou, G.: Employing morphological structures and sememes for Chinese event extraction. In: Proceedings of COLING 2012, pp. 1619–1634 (2012) Li, P., Zhou, G.: Employing morphological structures and sememes for Chinese event extraction. In: Proceedings of COLING 2012, pp. 1619–1634 (2012)
3.
go back to reference Li, Q., Ji, H., Huang, L.: Joint event extraction via structured prediction with global features. In: Proceedings of ACL 2013, pp. 789–797 (2013) Li, Q., Ji, H., Huang, L.: Joint event extraction via structured prediction with global features. In: Proceedings of ACL 2013, pp. 789–797 (2013)
4.
go back to reference Nguyen, T.H., Grishman, R.: Event detection and domain adaptation with convolutional neural networks. In: Proceedings of ACL 2015, pp. 365–371 (2015) Nguyen, T.H., Grishman, R.: Event detection and domain adaptation with convolutional neural networks. In: Proceedings of ACL 2015, pp. 365–371 (2015)
5.
go back to reference Chen, Y., Xu, L., Kang Liu, K., Zeng, D., Zhao, J.: Event extraction via dynamic multi-pooling convolutional neural networks. In: Proceedings of ACL 2015, pp. 167–176 (2015) Chen, Y., Xu, L., Kang Liu, K., Zeng, D., Zhao, J.: Event extraction via dynamic multi-pooling convolutional neural networks. In: Proceedings of ACL 2015, pp. 167–176 (2015)
6.
go back to reference Nguyen, T.H., Grishman, R.: Modeling skip-grams for event detection with convolutional neural networks. In: Proceedings of EMNLP 2016, pp. 886–891 (2016) Nguyen, T.H., Grishman, R.: Modeling skip-grams for event detection with convolutional neural networks. In: Proceedings of EMNLP 2016, pp. 886–891 (2016)
7.
go back to reference Nguyen, T.H., Cho, K., Grishman, R.: Joint event extraction via recurrent neural networks. In: Proceedings of NAACL–HLT 2016, pp. 300–309 (2016) Nguyen, T.H., Cho, K., Grishman, R.: Joint event extraction via recurrent neural networks. In: Proceedings of NAACL–HLT 2016, pp. 300–309 (2016)
8.
go back to reference Feng, X., Huang, L., Tang, D., Qin, B., Ji, H., Liu, T.: A language-independent neural network for event detection. In: Proceedings of ACL 2016, pp. 66–71 (2016) Feng, X., Huang, L., Tang, D., Qin, B., Ji, H., Liu, T.: A language-independent neural network for event detection. In: Proceedings of ACL 2016, pp. 66–71 (2016)
9.
go back to reference Sha, L., Qian, F., Chang, B., Sui, Z.: Jointly extracting event triggers and arguments by dependency-bridge RNN and tensor-based argument interaction. In: Proceedings of AAAI 2018, pp. 5916–5923 (2018) Sha, L., Qian, F., Chang, B., Sui, Z.: Jointly extracting event triggers and arguments by dependency-bridge RNN and tensor-based argument interaction. In: Proceedings of AAAI 2018, pp. 5916–5923 (2018)
10.
go back to reference Liu, X., Luo, Z., Huang, H.: Jointly multiple events extraction via attention-based graph information aggregation. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1247–1256 (2018) Liu, X., Luo, Z., Huang, H.: Jointly multiple events extraction via attention-based graph information aggregation. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 1247–1256 (2018)
11.
go back to reference Yan, H., Jin, X., Meng, X., Guo, J., Cheng, X.: Event detection with multi-order graph convolution and aggregated attention. In: Proceedings of EMNLP 2019, pp. 5765–5769 (2019) Yan, H., Jin, X., Meng, X., Guo, J., Cheng, X.: Event detection with multi-order graph convolution and aggregated attention. In: Proceedings of EMNLP 2019, pp. 5765–5769 (2019)
12.
go back to reference Nguyen, T.H., Grishman, R.: Graph convolutional networks with argument-aware pooling for event detection. In: Proceedings of AAAI 2018, pp. 5900–5907 (2018) Nguyen, T.H., Grishman, R.: Graph convolutional networks with argument-aware pooling for event detection. In: Proceedings of AAAI 2018, pp. 5900–5907 (2018)
13.
go back to reference Peters, M.E., et al.: Deep contextualized word representations. In: Proceedings of NAACL-HLT 2018, pp. 2227–2237 (2018) Peters, M.E., et al.: Deep contextualized word representations. In: Proceedings of NAACL-HLT 2018, pp. 2227–2237 (2018)
14.
go back to reference Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018) Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:​1810.​04805 (2018)
15.
go back to reference Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: Xlnet: generalized autoregressive pretraining for language understanding. arXiv preprint arXiv:1906.08237 (2019) Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: Xlnet: generalized autoregressive pretraining for language understanding. arXiv preprint arXiv:​1906.​08237 (2019)
16.
go back to reference Yang, S., Feng, D., Qiao, L., Kan, Z., Li, D.: Exploring pre-trained language models for event extraction and generation. In: Proceedings of ACL 2019, pp. 5284–5294 (2019) Yang, S., Feng, D., Qiao, L., Kan, Z., Li, D.: Exploring pre-trained language models for event extraction and generation. In: Proceedings of ACL 2019, pp. 5284–5294 (2019)
17.
go back to reference Sims, M., Park, J.H., Bamman, D.: Literary event detection. In: Proceedings of ACL 2019, pp. 3623–3634 (2019) Sims, M., Park, J.H., Bamman, D.: Literary event detection. In: Proceedings of ACL 2019, pp. 3623–3634 (2019)
18.
go back to reference Ji, H., Grishman, R.: Refining event extraction through cross-document inference. In: Proceedings of ACL 2008, pp. 254–262 (2008) Ji, H., Grishman, R.: Refining event extraction through cross-document inference. In: Proceedings of ACL 2008, pp. 254–262 (2008)
19.
go back to reference Liao, S., Grishman, R.: Using document level cross-event inference to improve event extraction. In: Proceedings of ACL 2010, pp. 789–797 (2010) Liao, S., Grishman, R.: Using document level cross-event inference to improve event extraction. In: Proceedings of ACL 2010, pp. 789–797 (2010)
20.
go back to reference Hong, Y., Zhang, J., Ma, B., Yao, J., Zhou, G., Zhu, Q.: Using cross-entity inference to improve event extraction. In: Proceedings of ACL 2011, pp. 1127–1136 (2011) Hong, Y., Zhang, J., Ma, B., Yao, J., Zhou, G., Zhu, Q.: Using cross-entity inference to improve event extraction. In: Proceedings of ACL 2011, pp. 1127–1136 (2011)
21.
go back to reference Li, P., Zhou, G., Zhu, Q., Hou, L.: Employing compositional semantics and discourse consistency in Chinese event extraction. In: Proceedings of EMNLP 2012, pp. 1006–1016 (2012) Li, P., Zhou, G., Zhu, Q., Hou, L.: Employing compositional semantics and discourse consistency in Chinese event extraction. In: Proceedings of EMNLP 2012, pp. 1006–1016 (2012)
22.
go back to reference Chen, C., Ng, V.: Joint modeling for chinese event extraction with rich linguistic features. In: Proceedings of COLING 2012, pp. 529–544 (2012) Chen, C., Ng, V.: Joint modeling for chinese event extraction with rich linguistic features. In: Proceedings of COLING 2012, pp. 529–544 (2012)
23.
go back to reference Duan, S., He, R., Zhao, W.: Exploiting document level information to improve event detection via recurrent neural networks. In: Kondrak, G., Watanabe, T., (eds.) Proceedings of the Eighth International Joint Conference on Natural Language Processing, IJCNLP 2017, pp. 352–361 (2017) Duan, S., He, R., Zhao, W.: Exploiting document level information to improve event detection via recurrent neural networks. In: Kondrak, G., Watanabe, T., (eds.) Proceedings of the Eighth International Joint Conference on Natural Language Processing, IJCNLP 2017, pp. 352–361 (2017)
24.
go back to reference Zhao, Y., Jin, X., Wang, Y., Cheng, X.: Document embedding enhanced event detection with hierarchical and supervised attention. In: Proceedings of ACL 2018, pp. 414–419 (2018) Zhao, Y., Jin, X., Wang, Y., Cheng, X.: Document embedding enhanced event detection with hierarchical and supervised attention. In: Proceedings of ACL 2018, pp. 414–419 (2018)
25.
go back to reference Liu, S., Chen, Y., Liu, K., Zhao, J.: Exploiting argument information to improve event detection via supervised attention mechanisms. In: Proceedings of ACL 2017, pp. 1789–1798 (2017) Liu, S., Chen, Y., Liu, K., Zhao, J.: Exploiting argument information to improve event detection via supervised attention mechanisms. In: Proceedings of ACL 2017, pp. 1789–1798 (2017)
26.
go back to reference Liu, S., Chen, Y., He, S., Liu, K., Zhao, J.: Leveraging framenet to improve automatic event detection. In: Proceedings of ACL 2016, pp. 2134–2143 (2016) Liu, S., Chen, Y., He, S., Liu, K., Zhao, J.: Leveraging framenet to improve automatic event detection. In: Proceedings of ACL 2016, pp. 2134–2143 (2016)
27.
go back to reference Lin, H., Lu, Y., Han, X., Sun, L.: Nugget proposal networks for chinese event detection. In: Proceedings of ACL 2018, pp. 1565–1574 (2018) Lin, H., Lu, Y., Han, X., Sun, L.: Nugget proposal networks for chinese event detection. In: Proceedings of ACL 2018, pp. 1565–1574 (2018)
Metadata
Title
Event Detection with Document Structure and Graph Modelling
Authors
Peipei Zhu
Zhongqing Wang
Hongling Wang
Shoushan Li
Guodong Zhou
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-60450-9_47

Premium Partner