Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 2/2020

22-07-2019 | Original Article

Interactive learning for joint event and relation extraction

Authors: Jingli Zhang, Yu Hong, Wenxuan Zhou, Jianmin Yao, Min Zhang

Published in: International Journal of Machine Learning and Cybernetics | Issue 2/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We tackle the problems of both event and entity relation extraction, and come up with a novel method to implement joint extraction: iteratively interactive learning. This method is motivated by the empirical findings as below: the extracted event attributes (e.g., trigger and event type) can be used as the reliable features for the recognition of entity relation types, and vice versa. Accordingly, on one hand, we utilize the predicted event attributes (by a certain event extraction system) to remodel the distributed representations of features for entity relation extraction, and on the other hand, we use entity relations (recognized by a certain relation extraction system) to remodel the features for event extraction. This enables a double-channel task-independent joint model with an interactive learning: learning events for relation extraction, and meanwhile learning relations for event extraction. In practice, we perform the interactive learning in an iterative manner, so as to boost the joint model progressively. Methodologically, we take the neural network of bidirectional long short-term memory (Bi-LSTM) for learning event and relation respectively. And as usual, the attention mechanism is used. In our experiments, the automatic content extraction corpus is used for the evaluation of the proposed method. Such a corpus consists of event, entity and relation samples with gold-standard attribute tags. Experimental results show that our method outperforms the baselines (Bi-LSTMs with attention without interactive learning) in both event and relation extraction tasks, yielding performance gains of about 1.6% and 1.8% F-scores respectively, at the condition of low-resource setting.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Ahn D (2006) The stages of event extraction. In: Proceedings of the workshop on annotating and reasoning about time and events. Association for Computational Linguistics, pp 1–8 Ahn D (2006) The stages of event extraction. In: Proceedings of the workshop on annotating and reasoning about time and events. Association for Computational Linguistics, pp 1–8
2.
go back to reference Chen Y, Liu S, Zhang X, Liu K, Zhao J (2017) Automatically labeled data generation for large scale event extraction. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 409–419 Chen Y, Liu S, Zhang X, Liu K, Zhao J (2017) Automatically labeled data generation for large scale event extraction. In: Proceedings of the 55th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 409–419
3.
go back to reference Chen Y, Xu L, Liu K, Zeng D, Zhao J, et al. (2015) Event extraction via dynamic multi-pooling convolutional neural networks. In: ACL (1), pp 167–176 Chen Y, Xu L, Liu K, Zeng D, Zhao J, et al. (2015) Event extraction via dynamic multi-pooling convolutional neural networks. In: ACL (1), pp 167–176
4.
go back to reference Christopoulou F, Miwa M, Ananiadou S (2018) A walk-based model on entity graphs for relation extraction. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol 2, pp 81–88 Christopoulou F, Miwa M, Ananiadou S (2018) A walk-based model on entity graphs for relation extraction. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol 2, pp 81–88
5.
go back to reference Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th international conference on machine learning. ACM, pp 160–167 Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th international conference on machine learning. ACM, pp 160–167
6.
go back to reference Doddington GR, Mitchell A, Przybocki MA, Ramshaw LA, Strassel S, Weischedel RM (2004) The automatic content extraction (ACE) program-tasks, data, and evaluation. In: LREC, vol 2, p 1 Doddington GR, Mitchell A, Przybocki MA, Ramshaw LA, Strassel S, Weischedel RM (2004) The automatic content extraction (ACE) program-tasks, data, and evaluation. In: LREC, vol 2, p 1
7.
go back to reference Feng X, Huang L, Tang D, Ji H, Qin B, Liu T (2016) A language-independent neural network for event detection. In: Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol 2, pp 66–71 Feng X, Huang L, Tang D, Ji H, Qin B, Liu T (2016) A language-independent neural network for event detection. In: Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol 2, pp 66–71
8.
go back to reference He D, Xia Y, Qin T, Wang L, Yu N, Liu T, Ma WY (2016) Dual learning for machine translation. In: Advances in neural information processing systems, pp 820–828 He D, Xia Y, Qin T, Wang L, Yu N, Liu T, Ma WY (2016) Dual learning for machine translation. In: Advances in neural information processing systems, pp 820–828
9.
go back to reference Hong Y, Zhang J, Ma B, Yao J, Zhou G, Zhu Q (2011) Using cross-entity inference to improve event extraction. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies-volume 1. Association for Computational Linguistics, pp 1127–1136 Hong Y, Zhang J, Ma B, Yao J, Zhou G, Zhu Q (2011) Using cross-entity inference to improve event extraction. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies-volume 1. Association for Computational Linguistics, pp 1127–1136
10.
go back to reference Hong Y, Zhou W, Zhou G, Zhu Q, et al. (2018) Self-regulation: employing a generative adversarial network to improve event detection. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 515–526 Hong Y, Zhou W, Zhou G, Zhu Q, et al. (2018) Self-regulation: employing a generative adversarial network to improve event detection. In: Proceedings of the 56th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 515–526
11.
go back to reference Ji H, Grishman R (2008) Refining event extraction through cross-document inference. In: Proceedings of ACL-08: HLT, pp 254–262 Ji H, Grishman R (2008) Refining event extraction through cross-document inference. In: Proceedings of ACL-08: HLT, pp 254–262
12.
go back to reference Jinxiu C, Ji T (2005) Unsupervised feature selection for relation extraction. National University of Singapore, Singapore Jinxiu C, Ji T (2005) Unsupervised feature selection for relation extraction. National University of Singapore, Singapore
13.
go back to reference Li Q, Ji H (2014) Incremental joint extraction of entity mentions and relations. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 402–412 Li Q, Ji H (2014) Incremental joint extraction of entity mentions and relations. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 402–412
14.
go back to reference Li Q, Ji H, Huang L (2013) Joint event extraction via structured prediction with global features. In: ACL (1), pp 73–82 Li Q, Ji H, Huang L (2013) Joint event extraction via structured prediction with global features. In: ACL (1), pp 73–82
15.
go back to reference Liao S, Grishman R (2010) Using document level cross-event inference to improve event extraction. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, pp 789–797 Liao S, Grishman R (2010) Using document level cross-event inference to improve event extraction. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, pp 789–797
16.
go back to reference Lin Y, Shen S, Liu Z, Luan H, Sun M (2016) Neural relation extraction with selective attention over instances. In: Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 2124–2133 Lin Y, Shen S, Liu Z, Luan H, Sun M (2016) Neural relation extraction with selective attention over instances. In: Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 2124–2133
17.
go back to reference Liu J, Chen Y, Liu K, Zhao J (2018) Event detection via gated multilingual attention mechanism. Statistics 1000:1250 Liu J, Chen Y, Liu K, Zhao J (2018) Event detection via gated multilingual attention mechanism. Statistics 1000:1250
18.
go back to reference Liu S, Chen Y, Liu K, Zhao J (2017) Exploiting argument information to improve event detection via supervised attention mechanisms 1:1789–1797 Liu S, Chen Y, Liu K, Zhao J (2017) Exploiting argument information to improve event detection via supervised attention mechanisms 1:1789–1797
19.
go back to reference Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv:1301.3781 (arXiv preprint) Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv:​1301.​3781 (arXiv preprint)
20.
21.
go back to reference Nguyen T.H, Cho K, Grishman R (2016) Joint event extraction via recurrent neural networks. In: HLT-NAACL, pp 300–309 Nguyen T.H, Cho K, Grishman R (2016) Joint event extraction via recurrent neural networks. In: HLT-NAACL, pp 300–309
22.
go back to reference Nguyen T.H, Grishman R (2015) Event detection and domain adaptation with convolutional neural networks. In: ACL (2), pp 365–371 Nguyen T.H, Grishman R (2015) Event detection and domain adaptation with convolutional neural networks. In: ACL (2), pp 365–371
23.
go back to reference Pawar S, Bhattacharya P, Palshikar G.K (2016) End-to-end relation extraction using markov logic networks. In: International conference on intelligent text processing and computational linguistics. Springer, pp 535–551 Pawar S, Bhattacharya P, Palshikar G.K (2016) End-to-end relation extraction using markov logic networks. In: International conference on intelligent text processing and computational linguistics. Springer, pp 535–551
24.
go back to reference Qian L, Zhou G, Kong F, Zhu Q, Qian P (2008) Exploiting constituent dependencies for tree kernel-based semantic relation extraction. In: Proceedings of the 22nd international conference on computational linguistics-volume 1. Association for Computational Linguistics, pp. 697–704 Qian L, Zhou G, Kong F, Zhu Q, Qian P (2008) Exploiting constituent dependencies for tree kernel-based semantic relation extraction. In: Proceedings of the 22nd international conference on computational linguistics-volume 1. Association for Computational Linguistics, pp. 697–704
25.
go back to reference Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1422–1432 Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1422–1432
26.
go back to reference Turian J, Ratinov L, Bengio Y (2010) Word representations: a simple and general method for semi-supervised learning. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, pp 384–394 Turian J, Ratinov L, Bengio Y (2010) Word representations: a simple and general method for semi-supervised learning. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics. Association for Computational Linguistics, pp 384–394
27.
go back to reference Yan X, Mou L, Li G, Chen Y, Peng H, Jin Z (2015) Classifying relations via long short term memory networks along shortest dependency path. arXiv:1508.03720 (arXiv preprint) Yan X, Mou L, Li G, Chen Y, Peng H, Jin Z (2015) Classifying relations via long short term memory networks along shortest dependency path. arXiv:​1508.​03720 (arXiv preprint)
Metadata
Title
Interactive learning for joint event and relation extraction
Authors
Jingli Zhang
Yu Hong
Wenxuan Zhou
Jianmin Yao
Min Zhang
Publication date
22-07-2019
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 2/2020
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-019-00985-8

Other articles of this Issue 2/2020

International Journal of Machine Learning and Cybernetics 2/2020 Go to the issue