Skip to main content
Erschienen in: The Journal of Supercomputing 5/2021

24.09.2020

Anti-negation method for handling negation words in question answering system

verfasst von: J. Felicia Lilian, K. Sundarakantham, S. Mercy Shalinie

Erschienen in: The Journal of Supercomputing | Ausgabe 5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The question answer (QA) system for a reading comprehension task tries to answer the question by retrieving the needed phrase from the given content. Precise answering is the key role of a QA system. An ambiguity is developed when we need to answer a negative question with a positive reply. The negation words change the polarity of the sentence, and hence, the scope of negation words is notable. This has paved the way for studying the role of ‘negation’ in the natural language processing (NLP) task. The handling of these words is considered a major part of our proposed methodology. In this paper, we propose an algorithm to retrieve and replace the negation words present in the content and query. A comparative study is done for performing word embedding over these words using various state-of-the-art methods. In earlier works when handling the negation the semantics of the sentences are changed. Hence, in this paper we try to maintain the semantics through our proposed methodology. The updated content is embedded into the bi-directional long short-term memory (Bi-LSTM) and thus makes the retrieving of an answer for a question answer system easier. The proposed work has been carried over the Stanford Negation, and the SQuAD dataset with a higher precision value of 96.2% has been achieved in retrieving the answers that are given in the dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Otter DW, Medina JR, Kalita JK (2018) A survey of the usages of deep learning in natural language processing. arXiv preprint arXiv:1807.10854 Otter DW, Medina JR, Kalita JK (2018) A survey of the usages of deep learning in natural language processing. arXiv preprint arXiv:​1807.​10854
2.
Zurück zum Zitat Chen L (2019) Attention-based deep learning system for negation and assertion detection in clinical notes. Int J Artif Intell Appl IJAIA 10(1) Chen L (2019) Attention-based deep learning system for negation and assertion detection in clinical notes. Int J Artif Intell Appl IJAIA 10(1)
3.
Zurück zum Zitat Nkambou R, Mizoguchi R, Bourdeau J (eds) (2010) Advances in intelligent tutoring systems, vol 308. Springer, BerlinMATH Nkambou R, Mizoguchi R, Bourdeau J (eds) (2010) Advances in intelligent tutoring systems, vol 308. Springer, BerlinMATH
4.
Zurück zum Zitat Moghe N, Arora S, Banerjee S, Khapra MM (2018) Towards exploiting background knowledge for building conversation systems. arXiv preprint arXiv:1809.08205 Moghe N, Arora S, Banerjee S, Khapra MM (2018) Towards exploiting background knowledge for building conversation systems. arXiv preprint arXiv:​1809.​08205
5.
Zurück zum Zitat Lin X D, Peng H, Liu B (2006) Support vector machines for text categorization in Chinese question classification. In: Proceedings of the 2006 IEEEWICACM International Conference on Web Intelligence, pp 334–337. IEEE Computer Society Lin X D, Peng H, Liu B (2006) Support vector machines for text categorization in Chinese question classification. In: Proceedings of the 2006 IEEEWICACM International Conference on Web Intelligence, pp 334–337. IEEE Computer Society
6.
Zurück zum Zitat Saha A, Aralikatte R, Khapra MM, Sankaranarayanan K (2018) Duorc: towards complex language understanding with paraphrased reading comprehension. arXiv preprint arXiv:1804.07927 Saha A, Aralikatte R, Khapra MM, Sankaranarayanan K (2018) Duorc: towards complex language understanding with paraphrased reading comprehension. arXiv preprint arXiv:​1804.​07927
7.
Zurück zum Zitat Skovgaard-Olsen N, Collins P, Krzyżanowska K, Hahn U, Klauer KC (2019) Cancellation, negation, and rejection. Cognit Psychol 108:42–71CrossRef Skovgaard-Olsen N, Collins P, Krzyżanowska K, Hahn U, Klauer KC (2019) Cancellation, negation, and rejection. Cognit Psychol 108:42–71CrossRef
8.
Zurück zum Zitat Blanco E, Moldovan D (2011) Some issues on detecting negation from text. In: Twenty-Fourth International FLAIRS Conference Blanco E, Moldovan D (2011) Some issues on detecting negation from text. In: Twenty-Fourth International FLAIRS Conference
9.
Zurück zum Zitat Veningston K, Shanmugalakshmi R, Nirmala V (2015) Semantic association ranking schemes for information retrieval applications using term association graph representation. Sadhana 40(6):1793–1819MathSciNetCrossRef Veningston K, Shanmugalakshmi R, Nirmala V (2015) Semantic association ranking schemes for information retrieval applications using term association graph representation. Sadhana 40(6):1793–1819MathSciNetCrossRef
10.
Zurück zum Zitat Wu S, Miller T, Masanz J, Coarr M, Halgrim S, Carrell D, Clark C (2014) Negation’s not solved: generalizability versus optimizability in clinical natural language processing. PloS One 9(11):e112774CrossRef Wu S, Miller T, Masanz J, Coarr M, Halgrim S, Carrell D, Clark C (2014) Negation’s not solved: generalizability versus optimizability in clinical natural language processing. PloS One 9(11):e112774CrossRef
11.
Zurück zum Zitat Wiegand M, Balahur A, Roth B, Klakow D, Montoyo A (2010) A survey on the role of negation in sentiment analysis. In: Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (pp 60–68) Wiegand M, Balahur A, Roth B, Klakow D, Montoyo A (2010) A survey on the role of negation in sentiment analysis. In: Proceedings of the Workshop on Negation and Speculation in Natural Language Processing (pp 60–68)
12.
Zurück zum Zitat Wu AS, Do BH, Kim J, Rubin DL (2011) Evaluation of negation and uncertainty detection and its impact on precision and recall in search. J Digit Imaging 24(2):234–242CrossRef Wu AS, Do BH, Kim J, Rubin DL (2011) Evaluation of negation and uncertainty detection and its impact on precision and recall in search. J Digit Imaging 24(2):234–242CrossRef
16.
Zurück zum Zitat Bhatia P, Celikkaya B, Khalilia M (2019) Joint Entity Extraction and Assertion Detection for Clinical Text. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp 954–959 Bhatia P, Celikkaya B, Khalilia M (2019) Joint Entity Extraction and Assertion Detection for Clinical Text. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp 954–959
17.
Zurück zum Zitat Fancellu F, Lopez A, Webber B (2016) Neural networks for negation scope detection. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 495–504 Fancellu F, Lopez A, Webber B (2016) Neural networks for negation scope detection. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 495–504
18.
Zurück zum Zitat Chapman W W, Chu D, Dowling J N (2007) ConText: an algorithm for identifying contextual features from clinical text. In: Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing, pp 81–88. Association for Computational Linguistics Chapman W W, Chu D, Dowling J N (2007) ConText: an algorithm for identifying contextual features from clinical text. In: Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing, pp 81–88. Association for Computational Linguistics
19.
Zurück zum Zitat Rumeng L, Jagannatha AN, Hong Y (2017) A hybrid Neural Network Model for Joint Prediction of Presence and Period Assertions of Medical Events in Clinical Notes. In: AMIA Annual Symposium Proceedings, vol 2017, p 1149. American Medical Informatics Association Rumeng L, Jagannatha AN, Hong Y (2017) A hybrid Neural Network Model for Joint Prediction of Presence and Period Assertions of Medical Events in Clinical Notes. In: AMIA Annual Symposium Proceedings, vol 2017, p 1149. American Medical Informatics Association
20.
Zurück zum Zitat Sharif W, Samsudin NA, Deris MM, Naseem R (2016) Effect of negation in sentiment analysis. In: 2016 Sixth International Conference on Innovative Computing Technology (INTECH), pp 718–723. IEEE Sharif W, Samsudin NA, Deris MM, Naseem R (2016) Effect of negation in sentiment analysis. In: 2016 Sixth International Conference on Innovative Computing Technology (INTECH), pp 718–723. IEEE
21.
Zurück zum Zitat Kaity M, Balakrishnan V (2020) An integrated semi-automated framework for domain-based polarity words extraction from an unannotated non-English corpus. J Supercomput 1–28 Kaity M, Balakrishnan V (2020) An integrated semi-automated framework for domain-based polarity words extraction from an unannotated non-English corpus. J Supercomput 1–28
22.
Zurück zum Zitat Huddleston R, Pullum G (2005) The Cambridge grammar of the English language. Zeitschrift für Anglistik und Amerikanistik 53(2):193–194 Huddleston R, Pullum G (2005) The Cambridge grammar of the English language. Zeitschrift für Anglistik und Amerikanistik 53(2):193–194
23.
Zurück zum Zitat Rose CP, Roque A, Bhembe D, Vanlehn K (2003) A hybrid text classification approach for analysis of student essays. In: Proceedings of the HLT-NAACL 03 Workshop on Building Educational Applications Using Natural Language Processing-Volume 2, pp 68–75. Association for Computational Linguistics Rose CP, Roque A, Bhembe D, Vanlehn K (2003) A hybrid text classification approach for analysis of student essays. In: Proceedings of the HLT-NAACL 03 Workshop on Building Educational Applications Using Natural Language Processing-Volume 2, pp 68–75. Association for Computational Linguistics
24.
Zurück zum Zitat Horn L (1989) A natural history of negation Horn L (1989) A natural history of negation
25.
Zurück zum Zitat Lin C, Bethard S, Dligach D, Sadeque F, Savova G, Miller TA (2020) Does BERT need domain adaptation for clinical negation detection? J Am Med Inform Assoc 27(4):584–591CrossRef Lin C, Bethard S, Dligach D, Sadeque F, Savova G, Miller TA (2020) Does BERT need domain adaptation for clinical negation detection? J Am Med Inform Assoc 27(4):584–591CrossRef
26.
Zurück zum Zitat Celi LA, Chen C, Gruhl D, Shivade C, Wu JTY (2020) Introduction to Clinical Natural Language Processing with Python. In: Leveraging Data Science for Global Health, pp 229–250. Springer, Cham Celi LA, Chen C, Gruhl D, Shivade C, Wu JTY (2020) Introduction to Clinical Natural Language Processing with Python. In: Leveraging Data Science for Global Health, pp 229–250. Springer, Cham
27.
Zurück zum Zitat \(Solarte-Pab\acute{o}n\) O, Menasalvas E, \(Rodriguez-Gonz\acute{a}lez\) A (2020) Spa-neg: an Approach for Negation Detection in Clinical Text Written in Spanish. In: International Work-Conference on Bioinformatics and Biomedical Engineering, pp 323–337. Springer, Cham \(Solarte-Pab\acute{o}n\) O, Menasalvas E, \(Rodriguez-Gonz\acute{a}lez\) A (2020) Spa-neg: an Approach for Negation Detection in Clinical Text Written in Spanish. In: International Work-Conference on Bioinformatics and Biomedical Engineering, pp 323–337. Springer, Cham
28.
Zurück zum Zitat Funkner A, Balabaeva K, Kovalchuk S (2020) Negation Detection for Clinical Text Mining in Russian. arXiv preprint arXiv:2004.04980 Funkner A, Balabaeva K, Kovalchuk S (2020) Negation Detection for Clinical Text Mining in Russian. arXiv preprint arXiv:​2004.​04980
29.
Zurück zum Zitat Van Munster E (1988) The treatment of Scope and Negation in Rosetta. In: Proceedings of the 12th Conference on Computational Linguistics-Volume 2, pp 442–447. Association for Computational Linguistics Van Munster E (1988) The treatment of Scope and Negation in Rosetta. In: Proceedings of the 12th Conference on Computational Linguistics-Volume 2, pp 442–447. Association for Computational Linguistics
30.
Zurück zum Zitat Gruet-Skrabalova H (2016) Yes or no, or how to answer a negative question. Linguistica 56(1):127–142CrossRef Gruet-Skrabalova H (2016) Yes or no, or how to answer a negative question. Linguistica 56(1):127–142CrossRef
31.
Zurück zum Zitat Seshadri K, Mercy S, Manohar S (2018) A distributed parallel algorithm for inferring hierarchical groups from large-scale text corpuses. Concurr Comput Pract Exper 30(11):e4404CrossRef Seshadri K, Mercy S, Manohar S (2018) A distributed parallel algorithm for inferring hierarchical groups from large-scale text corpuses. Concurr Comput Pract Exper 30(11):e4404CrossRef
32.
Zurück zum Zitat Salton G, Wong A, Yang C S (1975) A Vector Space Model for Automatic Indexing “Communications of the ACM Vol. 18 Salton G, Wong A, Yang C S (1975) A Vector Space Model for Automatic Indexing “Communications of the ACM Vol. 18
34.
Zurück zum Zitat Salton G, McGill MJ (1986) Introduction to modern information retrieval Salton G, McGill MJ (1986) Introduction to modern information retrieval
35.
Zurück zum Zitat Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:​1301.​3781
36.
Zurück zum Zitat Camacho-Collados J, Pilehvar MT (2018) From word to sense embeddings: a survey on vector representations of meaning. J Artif Intell Res 63:743–788MathSciNetCrossRef Camacho-Collados J, Pilehvar MT (2018) From word to sense embeddings: a survey on vector representations of meaning. J Artif Intell Res 63:743–788MathSciNetCrossRef
37.
Zurück zum Zitat Pennington J, Socher R, Manning C (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1532–1543 Pennington J, Socher R, Manning C (2014) Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1532–1543
38.
Zurück zum Zitat Azhar-ul-Haq RA () Review: ranking documents using ranking algorithms & techniques Azhar-ul-Haq RA () Review: ranking documents using ranking algorithms & techniques
39.
Zurück zum Zitat Pawar A, Mago V (2018) Calculating the similarity between words and sentences using a lexical database and corpus statistics. arXiv preprint arXiv:1802.05667 Pawar A, Mago V (2018) Calculating the similarity between words and sentences using a lexical database and corpus statistics. arXiv preprint arXiv:​1802.​05667
40.
Zurück zum Zitat Li Y, McLean D, Bandar ZA, Crockett K (2006) Sentence similarity based on semantic nets and corpus statistics. IEEE Trans Knowl Data Eng 8:1138–1150CrossRef Li Y, McLean D, Bandar ZA, Crockett K (2006) Sentence similarity based on semantic nets and corpus statistics. IEEE Trans Knowl Data Eng 8:1138–1150CrossRef
41.
Zurück zum Zitat Ichida AY, Meneguzzi F, Ruiz D D (2018) Measuring semantic similarity between sentences using a siamese neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp 1–7. IEEE Ichida AY, Meneguzzi F, Ruiz D D (2018) Measuring semantic similarity between sentences using a siamese neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp 1–7. IEEE
42.
Zurück zum Zitat Mueller J, Thyagarajan A (2016) Siamese recurrent architectures for learning sentence similarity. In: Thirtieth AAAI Conference on Artificial Intelligence Mueller J, Thyagarajan A (2016) Siamese recurrent architectures for learning sentence similarity. In: Thirtieth AAAI Conference on Artificial Intelligence
43.
Zurück zum Zitat Neamah N, Saad S (2017) Question answering system supporting vector machine method for Hadith domain. J Theor Appl Inf Technol 95(7) Neamah N, Saad S (2017) Question answering system supporting vector machine method for Hadith domain. J Theor Appl Inf Technol 95(7)
44.
Zurück zum Zitat Xiang Y, Chen Q, Wang X, Qin Y (2017) Answer selection in community question answering via attentive neural networks. IEEE Signal Process Lett 24(4):505–509CrossRef Xiang Y, Chen Q, Wang X, Qin Y (2017) Answer selection in community question answering via attentive neural networks. IEEE Signal Process Lett 24(4):505–509CrossRef
45.
Zurück zum Zitat Panahi A, Saeedi S, Arodz T (2019) word2ket: space-efficient word embeddings inspired by quantum entanglement. arXiv preprint arXiv:1911.04975 Panahi A, Saeedi S, Arodz T (2019) word2ket: space-efficient word embeddings inspired by quantum entanglement. arXiv preprint arXiv:​1911.​04975
47.
Zurück zum Zitat Seo M, Kembhavi A, Farhadi A, Hajishirzi H (2016) Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603 Seo M, Kembhavi A, Farhadi A, Hajishirzi H (2016) Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:​1611.​01603
48.
Zurück zum Zitat Hermann K M, Kocisky T, Grefenstette E, Espeholt L, Kay W, Suleyman M, Blunsom P (2015) Teaching machines to read and comprehend. In: Advances in neural information processing systems, pp 1693–1701 Hermann K M, Kocisky T, Grefenstette E, Espeholt L, Kay W, Suleyman M, Blunsom P (2015) Teaching machines to read and comprehend. In: Advances in neural information processing systems, pp 1693–1701
49.
Zurück zum Zitat Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:​1409.​0473
50.
Zurück zum Zitat Mei J, Xiao C, Szepesvari C, Schuurmans D (2020) On the Global Convergence Rates of Softmax Policy Gradient Methods. arXiv preprint arXiv:2005.06392 Mei J, Xiao C, Szepesvari C, Schuurmans D (2020) On the Global Convergence Rates of Softmax Policy Gradient Methods. arXiv preprint arXiv:​2005.​06392
51.
Zurück zum Zitat De Marneffe MC, Rafferty AN, Manning CD (2008) Finding contradictions in text. In: Proceedings of ACL-08: HLT, 1039–1047 De Marneffe MC, Rafferty AN, Manning CD (2008) Finding contradictions in text. In: Proceedings of ACL-08: HLT, 1039–1047
52.
Zurück zum Zitat Rajpurkar P, Zhang J, Lopyrev K, Liang P (2016) Squad: 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:1606.05250 Rajpurkar P, Zhang J, Lopyrev K, Liang P (2016) Squad: 100,000+ questions for machine comprehension of text. arXiv preprint arXiv:​1606.​05250
53.
Zurück zum Zitat Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 168–177. ACM Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 168–177. ACM
54.
Zurück zum Zitat Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-Volume 10, pp 79–86. Association for Computational Linguistics Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-Volume 10, pp 79–86. Association for Computational Linguistics
55.
Zurück zum Zitat Popescu AM, Etzioni O (2007) Extracting product features and opinions from reviews. In: Natural Language Processing and Text Mining, pp 9–28. Springer, London Popescu AM, Etzioni O (2007) Extracting product features and opinions from reviews. In: Natural Language Processing and Text Mining, pp 9–28. Springer, London
56.
Zurück zum Zitat Farooq U, Mansoor H, Nongaillard A, Ouzrout Y, Qadir MA (2017) Negation handling in sentiment analysis at sentence level. JCP 12(5):470–478CrossRef Farooq U, Mansoor H, Nongaillard A, Ouzrout Y, Qadir MA (2017) Negation handling in sentiment analysis at sentence level. JCP 12(5):470–478CrossRef
57.
Zurück zum Zitat Narayanan R, Liu B, Choudhary A (2009) Sentiment analysis of conditional sentences. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1-Volume 1, pp 180–189. Association for Computational Linguistics Narayanan R, Liu B, Choudhary A (2009) Sentiment analysis of conditional sentences. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1-Volume 1, pp 180–189. Association for Computational Linguistics
Metadaten
Titel
Anti-negation method for handling negation words in question answering system
verfasst von
J. Felicia Lilian
K. Sundarakantham
S. Mercy Shalinie
Publikationsdatum
24.09.2020
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 5/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03437-1

Weitere Artikel der Ausgabe 5/2021

The Journal of Supercomputing 5/2021 Zur Ausgabe