Skip to main content
Top

2020 | OriginalPaper | Chapter

Automatic Extraction of Legal Norms: Evaluation of Natural Language Processing Tools

Authors : Gabriela Ferraro, Ho-Pun Lam, Silvano Colombo Tosatto, Francesco Olivieri, Mohammad Badiul Islam, Nick van Beest, Guido Governatori

Published in: New Frontiers in Artificial Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Extracting and formalising legal norms from legal documents is a time-consuming and complex procedure. Therefore, the automatic methods that can accelerate this process are in high demand. In this paper, we address two major questions related to this problem: (i) what are the challenges in formalising legal documents into a machine understandable formalism? (ii) to what extent can the data-driven state-of-the-art approaches developed in the Natural Language Processing (NLP) community be used to automate the normative mining process. The results of our experiments indicate that NLP technologies such as relation extraction and semantic parsing are promising research avenues to advance research in this area.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Here, the term generation is used in a loose way (normative rules can be generated or extracted or distilled or built, etc.), and is not used to refer exclusively to the text generation problem study by the Natural Language Generation community.
 
Literature
1.
go back to reference Angeli, G., Johnson Premkumar, M.J., Manning, C.D.: Leveraging linguistic structure for open domain information extraction. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015, Beijing, China, pp. 344–354 (2015) Angeli, G., Johnson Premkumar, M.J., Manning, C.D.: Leveraging linguistic structure for open domain information extraction. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics, ACL 2015, Beijing, China, pp. 344–354 (2015)
2.
go back to reference Banarescu, L., et al.: Abstract meaning representation for sembanking. In: Pareja-Lora, A., Liakata, M., Dipper, S. (eds.) Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, Sofia, Bulgaria, pp. 178–186, August 2013 Banarescu, L., et al.: Abstract meaning representation for sembanking. In: Pareja-Lora, A., Liakata, M., Dipper, S. (eds.) Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, Sofia, Bulgaria, pp. 178–186, August 2013
3.
go back to reference Boella, G., Di Caro, L., Robaldo, L.: Semantic relation extraction from legislative text using generalized syntactic dependencies and support vector machines. In: Morgenstern, L., Stefaneas, P., Lévy, F., Wyner, A., Paschke, A. (eds.) RuleML 2013. LNCS, vol. 8035, pp. 218–225. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39617-5_20CrossRef Boella, G., Di Caro, L., Robaldo, L.: Semantic relation extraction from legislative text using generalized syntactic dependencies and support vector machines. In: Morgenstern, L., Stefaneas, P., Lévy, F., Wyner, A., Paschke, A. (eds.) RuleML 2013. LNCS, vol. 8035, pp. 218–225. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-39617-5_​20CrossRef
4.
go back to reference Breaux, T.D., Antón, A.I.: A systematic method for acquiring regulatory requirements: a frame-based approach. In: Proceedings of the 6th International Workshop on Requirements for High Assurance Systems, Pittsburg, PA, USA, September 2007 Breaux, T.D., Antón, A.I.: A systematic method for acquiring regulatory requirements: a frame-based approach. In: Proceedings of the 6th International Workshop on Requirements for High Assurance Systems, Pittsburg, PA, USA, September 2007
5.
go back to reference Burga, A., Codina, J., Ferraro, G., Saggion, H., Wanner, L.: The challenge of syntactic dependency parsing adaptation for the patent domain. In: Proceedings of ESSLLI-13 Workshop on Extrinsic Parse Improvement. EPI, Düsseldorf, Germany, August 2013 Burga, A., Codina, J., Ferraro, G., Saggion, H., Wanner, L.: The challenge of syntactic dependency parsing adaptation for the patent domain. In: Proceedings of ESSLLI-13 Workshop on Extrinsic Parse Improvement. EPI, Düsseldorf, Germany, August 2013
6.
go back to reference Dong, L., Lapata, M.: Language to logical form with neural attention. In: Erk, K., Smith, N.A. (eds.) Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, Berlin, German, pp. 33–43, August 2016 Dong, L., Lapata, M.: Language to logical form with neural attention. In: Erk, K., Smith, N.A. (eds.) Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, Berlin, German, pp. 33–43, August 2016
7.
go back to reference Dragoni, M., Villata, S., Rizzi, W., Governatori, G.: Combining natural language processing approaches for rule extraction from legal documents. In: Pagallo, U., Palmirani, M., Casanovas, P., Sartor, G., Villata, S. (eds.) AICOL 2015-2017. LNCS (LNAI), vol. 10791, pp. 287–300. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00178-0_19CrossRef Dragoni, M., Villata, S., Rizzi, W., Governatori, G.: Combining natural language processing approaches for rule extraction from legal documents. In: Pagallo, U., Palmirani, M., Casanovas, P., Sartor, G., Villata, S. (eds.) AICOL 2015-2017. LNCS (LNAI), vol. 10791, pp. 287–300. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-030-00178-0_​19CrossRef
8.
go back to reference Dragoni, M., Villata, S., Rizzi, W., Governatori, G.: Combining NLP approaches for rule extraction from legal documents. In: 1st Workshop on MIning and REasoning with Legal texts (MIREL 2016), Sophia Antipolis, France, December 2016 Dragoni, M., Villata, S., Rizzi, W., Governatori, G.: Combining NLP approaches for rule extraction from legal documents. In: 1st Workshop on MIning and REasoning with Legal texts (MIREL 2016), Sophia Antipolis, France, December 2016
9.
go back to reference van Engers, T.M., van Gog, R., Sayah, K.: A case study on automated norm extraction. In: Gordon, T. (ed.) The 17th International Conference on Legal Knowledge and Information Systems, JURIX 2004, pp. 49–58. IOS Press, Amsterdam (2004) van Engers, T.M., van Gog, R., Sayah, K.: A case study on automated norm extraction. In: Gordon, T. (ed.) The 17th International Conference on Legal Knowledge and Information Systems, JURIX 2004, pp. 49–58. IOS Press, Amsterdam (2004)
10.
go back to reference Fan, X., Monti, E., Mathias, L., Dreyer, M.: Transfer learning for neural semantic parsing. In: Blunsom, P., et al. (eds.) Proceedings of the 2nd Workshop on Representation Learning for NLP, Rep4NLP 2017, Vancouver, Canada, pp. 48–56, August 2017 Fan, X., Monti, E., Mathias, L., Dreyer, M.: Transfer learning for neural semantic parsing. In: Blunsom, P., et al. (eds.) Proceedings of the 2nd Workshop on Representation Learning for NLP, Rep4NLP 2017, Vancouver, Canada, pp. 48–56, August 2017
11.
go back to reference Finegan-Dollak, C., et al.: Improving text-to-SQL evaluation methodology. In: Gurevych, I., Miyao, Y. (eds.) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, pp. 351–360, July 2018 Finegan-Dollak, C., et al.: Improving text-to-SQL evaluation methodology. In: Gurevych, I., Miyao, Y. (eds.) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, pp. 351–360, July 2018
13.
go back to reference Gordon, A.S., Hobbs, J.R.: A Formal Theory of Commonsense Psychology: How People Think People Think, 1st edn. Cambridge University Press, New York (2017)CrossRef Gordon, A.S., Hobbs, J.R.: A Formal Theory of Commonsense Psychology: How People Think People Think, 1st edn. Cambridge University Press, New York (2017)CrossRef
14.
go back to reference Governatori, G., Rotolo, A.: A conceptually rich model of business process compliance. In: Proceedings of the 7th Asia-Pacific Conference on Conceptual Modelling, APCCM 2010, ACS, Brisbane, QLD, Australia, pp. 3–12, January 2010 Governatori, G., Rotolo, A.: A conceptually rich model of business process compliance. In: Proceedings of the 7th Asia-Pacific Conference on Conceptual Modelling, APCCM 2010, ACS, Brisbane, QLD, Australia, pp. 3–12, January 2010
15.
go back to reference Herzig, J., Berant, J.: Neural semantic parsing over multiple knowledge-bases. In: Barzilay, R., Kan, M.Y. (eds.) Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, pp. 623–628, July 2017 Herzig, J., Berant, J.: Neural semantic parsing over multiple knowledge-bases. In: Barzilay, R., Kan, M.Y. (eds.) Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, pp. 623–628, July 2017
16.
go back to reference Jia, R., Liang, P.: Data recombination for neural semantic parsing. In: Erka, K., Smith, N.A. (eds.) Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, Berlin, Germany, pp. 12–22, August 2016 Jia, R., Liang, P.: Data recombination for neural semantic parsing. In: Erka, K., Smith, N.A. (eds.) Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, Berlin, Germany, pp. 12–22, August 2016
17.
go back to reference Kelsen, H.: General Theory of Norms. Oxford University Press, Inc., Oxford (1991)CrossRef Kelsen, H.: General Theory of Norms. Oxford University Press, Inc., Oxford (1991)CrossRef
18.
go back to reference Kennardi, A., Ferraro, G., Wang, Q.: Domain adaptation for low-resource neural semantic parsing. In: MacKinlay, A., Piccardi, M. (eds.) Proceedings of the 17th Workshop of the Australasian Language Technology Association, ALTA 2019, Sydney, Australia, pp. 107–113 (2019) Kennardi, A., Ferraro, G., Wang, Q.: Domain adaptation for low-resource neural semantic parsing. In: MacKinlay, A., Piccardi, M. (eds.) Proceedings of the 17th Workshop of the Australasian Language Technology Association, ALTA 2019, Sydney, Australia, pp. 107–113 (2019)
19.
go back to reference Kimura, Y., Nakamura, M., Shimazu, A.: Treatment of legal sentences including itemized and referential expressions – towards translation into logical forms. In: Hattori, H., Kawamura, T., Idé, T., Yokoo, M., Murakami, Y. (eds.) JSAI 2008. LNCS (LNAI), vol. 5447, pp. 242–253. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00609-8_21CrossRef Kimura, Y., Nakamura, M., Shimazu, A.: Treatment of legal sentences including itemized and referential expressions – towards translation into logical forms. In: Hattori, H., Kawamura, T., Idé, T., Yokoo, M., Murakami, Y. (eds.) JSAI 2008. LNCS (LNAI), vol. 5447, pp. 242–253. Springer, Heidelberg (2009). https://​doi.​org/​10.​1007/​978-3-642-00609-8_​21CrossRef
20.
go back to reference Kočiský, T., et al.: Semantic parsing with semi-supervised sequential autoencoders. In: Su, J., Duh, K., Carreras, X. (eds.) Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, pp. 1078–1087. Association for Computational Linguistics, Austin, November 2016 Kočiský, T., et al.: Semantic parsing with semi-supervised sequential autoencoders. In: Su, J., Duh, K., Carreras, X. (eds.) Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, pp. 1078–1087. Association for Computational Linguistics, Austin, November 2016
21.
go back to reference Kwiatkowski, T., Zettlemoyer, L., Goldwater, S., Steedman, M.: Lexical generalization in CCG grammar induction for semantic parsing. In: Barzilay, R., Johnsn, M. (eds.) Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, Edinburgh, Scotland, UK, pp. 1512–1523, July 2011 Kwiatkowski, T., Zettlemoyer, L., Goldwater, S., Steedman, M.: Lexical generalization in CCG grammar induction for semantic parsing. In: Barzilay, R., Johnsn, M. (eds.) Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, Edinburgh, Scotland, UK, pp. 1512–1523, July 2011
22.
go back to reference Lapata, M., Dong, L.: Coarse-to-fine decoding for neural semantic parsing. In: Gurevych, I., Miyao, Y. (eds.) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, pp. 731–742, July 2018 Lapata, M., Dong, L.: Coarse-to-fine decoding for neural semantic parsing. In: Gurevych, I., Miyao, Y. (eds.) Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, pp. 731–742, July 2018
23.
go back to reference Makinson, D.: On a fundamental problem of deontic logic. In: McNamara, P., Prakken, H. (eds.) Norms, Logics and Information Systems. New Studies in Deontic Logic and Computer Science, vol. 49, pp. 29–53. IOS Press, Amsterdam (1999) Makinson, D.: On a fundamental problem of deontic logic. In: McNamara, P., Prakken, H. (eds.) Norms, Logics and Information Systems. New Studies in Deontic Logic and Computer Science, vol. 49, pp. 29–53. IOS Press, Amsterdam (1999)
24.
go back to reference Miall, H.: Emergent Conflict and Peaceful Change. Palgrave MacMillan, London (2007)CrossRef Miall, H.: Emergent Conflict and Peaceful Change. Palgrave MacMillan, London (2007)CrossRef
25.
go back to reference Ministry of Business, Innovation and Employment, New Zealand: New Zealand Building Code Clause G4 Ventilation: Acceptable Solutions and Verification Methods, 4th edn. (2017) Ministry of Business, Innovation and Employment, New Zealand: New Zealand Building Code Clause G4 Ventilation: Acceptable Solutions and Verification Methods, 4th edn. (2017)
27.
go back to reference Niklaus, C., Cetto, M., Freitas, A., Handschuh, S.: Transforming complex sentences into a semantic hierarchy. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, pp. 3415–3427, July 2019 Niklaus, C., Cetto, M., Freitas, A., Handschuh, S.: Transforming complex sentences into a semantic hierarchy. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, pp. 3415–3427, July 2019
29.
go back to reference Popple, J.: A Pragmatic Legal Expert System. Dartmouth (1996) Popple, J.: A Pragmatic Legal Expert System. Dartmouth (1996)
30.
go back to reference Rubino, R., Rotolo, A., Sartor, G.: An OWL ontology of fundamental legal concepts. In: Proceedings of the 9th Annual Conference on Legal Knowledge and Information Systems, JURIX 2006, pp. 101–110. IOS Press, Amsterdam (2006) Rubino, R., Rotolo, A., Sartor, G.: An OWL ontology of fundamental legal concepts. In: Proceedings of the 9th Annual Conference on Legal Knowledge and Information Systems, JURIX 2006, pp. 101–110. IOS Press, Amsterdam (2006)
31.
go back to reference Sartor, G.: Legal Reasoning: A Cognitive Approach to the Law, A Treatise of Legal Philosophy and General Jurisprudence, vol. 5. Springer, Berlin (2005) Sartor, G.: Legal Reasoning: A Cognitive Approach to the Law, A Treatise of Legal Philosophy and General Jurisprudence, vol. 5. Springer, Berlin (2005)
32.
go back to reference Schwarm, S.E., Ostendorf, M.: Reading level assessment using support vector machines and statistical language models. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL 2005, Stroudsburg, PA, USA, pp. 523–530 (2005) Schwarm, S.E., Ostendorf, M.: Reading level assessment using support vector machines and statistical language models. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL 2005, Stroudsburg, PA, USA, pp. 523–530 (2005)
33.
go back to reference Sleimi, A., Sannier, N., Sabetzadeh, M., Briand, L., Dann, J.: Automated extraction of semantic legal metadata using natural language processing. In: The 26th IEEE International Requirements Engineering Conference, Banff, AB, Canada, pp. 124–135. IEEE, August 2018 Sleimi, A., Sannier, N., Sabetzadeh, M., Briand, L., Dann, J.: Automated extraction of semantic legal metadata using natural language processing. In: The 26th IEEE International Requirements Engineering Conference, Banff, AB, Canada, pp. 124–135. IEEE, August 2018
34.
go back to reference Susanto, R.H., Lu, W.: Neural architectures for multilingual semantic parsing. In: Barzilay, R., Kan, M.Y. (eds.) Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, pp. 38–44, July 2017 Susanto, R.H., Lu, W.: Neural architectures for multilingual semantic parsing. In: Barzilay, R., Kan, M.Y. (eds.) Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, pp. 38–44, July 2017
35.
go back to reference Tjong, E.F., Sang, K., Déjean, H.: Introduction to the CoNLL-2001 shared task: clause identification. In: Daelemans, W., Zajac, R. (eds.) Proceedings of the 2001 Workshop on Computational Natural Language Learning, ConLL 2001. Association for Computational Linguistics, Toulouse, July 2001 Tjong, E.F., Sang, K., Déjean, H.: Introduction to the CoNLL-2001 shared task: clause identification. In: Daelemans, W., Zajac, R. (eds.) Proceedings of the 2001 Workshop on Computational Natural Language Learning, ConLL 2001. Association for Computational Linguistics, Toulouse, July 2001
37.
go back to reference Wieringa, R.J., Meyer, J. J. C.: Applications of deontic logic in computer science: a concise overview. In: Meyer, J.J.C., Wieringa, R.J. (eds.) International Workshop on Deontic Logic in Computer Science, DEON 1993, Amsterdam, Netherlands, pp. 17–40, December 1993 Wieringa, R.J., Meyer, J. J. C.: Applications of deontic logic in computer science: a concise overview. In: Meyer, J.J.C., Wieringa, R.J. (eds.) International Workshop on Deontic Logic in Computer Science, DEON 1993, Amsterdam, Netherlands, pp. 17–40, December 1993
38.
go back to reference Woodsend, K., Lapata, M.: WikiSimple: automatic simplification of wikipedia articles. In: Proceedings of the 25th AAAI Conference on Artificial Intelligence, AAAI 2011, San Francisco, CA, USA, pp. 927–932. AAAI Press, August 2011 Woodsend, K., Lapata, M.: WikiSimple: automatic simplification of wikipedia articles. In: Proceedings of the 25th AAAI Conference on Artificial Intelligence, AAAI 2011, San Francisco, CA, USA, pp. 927–932. AAAI Press, August 2011
39.
go back to reference Wyner, A.Z., Peters, W.: On rule extraction from regulations. In: Atkinson, K.M. (ed.) Proceedings of the 24th International Conference on Legal Knowledge and Information, JURIX 2011, Vienna, Austria, pp. 113–122. IOS Press, September 2011 Wyner, A.Z., Peters, W.: On rule extraction from regulations. In: Atkinson, K.M. (ed.) Proceedings of the 24th International Conference on Legal Knowledge and Information, JURIX 2011, Vienna, Austria, pp. 113–122. IOS Press, September 2011
Metadata
Title
Automatic Extraction of Legal Norms: Evaluation of Natural Language Processing Tools
Authors
Gabriela Ferraro
Ho-Pun Lam
Silvano Colombo Tosatto
Francesco Olivieri
Mohammad Badiul Islam
Nick van Beest
Guido Governatori
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-58790-1_5

Premium Partner