Skip to main content
Erschienen in: Empirical Software Engineering 3/2021

01.05.2021

An automated framework for the extraction of semantic legal metadata from legal texts

verfasst von: Amin Sleimi, Nicolas Sannier, Mehrdad Sabetzadeh, Lionel Briand, Marcello Ceci, John Dann

Erschienen in: Empirical Software Engineering | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Semantic legal metadata provides information that helps with understanding and interpreting legal provisions. Such metadata is therefore important for the systematic analysis of legal requirements. However, manually enhancing a large legal corpus with semantic metadata is prohibitively expensive. Our work is motivated by two observations: (1) the existing requirements engineering (RE) literature does not provide a harmonized view on the semantic metadata types that are useful for legal requirements analysis; (2) automated support for the extraction of semantic legal metadata is scarce, and it does not exploit the full potential of artificial intelligence technologies, notably natural language processing (NLP) and machine learning (ML). Our objective is to take steps toward overcoming these limitations. To do so, we review and reconcile the semantic legal metadata types proposed in the RE literature. Subsequently, we devise an automated extraction approach for the identified metadata types using NLP and ML. We evaluate our approach through two case studies over the Luxembourgish legislation. Our results indicate a high accuracy in the generation of metadata annotations. In particular, in the two case studies, we were able to obtain precision scores of 97,2% and 82,4%, and recall scores of 94,9% and 92,4%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Arora C, Sabetzadeh M, Briand LC, Zimmer F (2015) Automated checking of conformance to requirements templates using natural language processing. IEEE Trans Softw Eng 41(10):944–968CrossRef Arora C, Sabetzadeh M, Briand LC, Zimmer F (2015) Automated checking of conformance to requirements templates using natural language processing. IEEE Trans Softw Eng 41(10):944–968CrossRef
Zurück zum Zitat Athan T, Boley H, Governatori G, Palmirani M, Paschke A, Wyner AZ (2013) OASIS LegalRuleML. In: Proceedings of the International Conference on Artificial Intelligence and Law (ICAIL’13), pp 3–12 Athan T, Boley H, Governatori G, Palmirani M, Paschke A, Wyner AZ (2013) OASIS LegalRuleML. In: Proceedings of the International Conference on Artificial Intelligence and Law (ICAIL’13), pp 3–12
Zurück zum Zitat Bhatia J, Breaux TD, Schaub F (2016) Mining privacy goals from privacy policies using hybridized task recomposition. ACM Transactions on Software Engineering and Methodology 25(3):22:1–22:24CrossRef Bhatia J, Breaux TD, Schaub F (2016) Mining privacy goals from privacy policies using hybridized task recomposition. ACM Transactions on Software Engineering and Methodology 25(3):22:1–22:24CrossRef
Zurück zum Zitat Bhatia J, Evans MC, Wadkar S, Breaux TD (2016) Automated extraction of regulated information types using hyponymy relations. In: Proceedings of the 3rd International Workshop on Artificial Intelligence for Requirements Engineering (AIRE’16), pp 19–25 Bhatia J, Evans MC, Wadkar S, Breaux TD (2016) Automated extraction of regulated information types using hyponymy relations. In: Proceedings of the 3rd International Workshop on Artificial Intelligence for Requirements Engineering (AIRE’16), pp 19–25
Zurück zum Zitat Boella G, Caro LD, Humphreys L, Robaldo L, Rossi P, van der Torre L (2016) Eunomos, a legal document and knowledge management system for the web to provide relevant, reliable and up-to-date information on the law. Artificial Intelligence and Law 24(3):245–283CrossRef Boella G, Caro LD, Humphreys L, Robaldo L, Rossi P, van der Torre L (2016) Eunomos, a legal document and knowledge management system for the web to provide relevant, reliable and up-to-date information on the law. Artificial Intelligence and Law 24(3):245–283CrossRef
Zurück zum Zitat Boer A, Winkels R, Vitali F (2007) Proposed XML standards for law: Metalex and LKIF. In: Proceedings of the 20th Annual Conference on Legal Knowledge and Information Systems (JURIX’07), pp 19–28 Boer A, Winkels R, Vitali F (2007) Proposed XML standards for law: Metalex and LKIF. In: Proceedings of the 20th Annual Conference on Legal Knowledge and Information Systems (JURIX’07), pp 19–28
Zurück zum Zitat Breaux T (2009) Legal requirements acquisition for the specification of legally compliant information systems. PhD thesis, North Carolina State University Raleigh, North Carolina, USA Breaux T (2009) Legal requirements acquisition for the specification of legally compliant information systems. PhD thesis, North Carolina State University Raleigh, North Carolina, USA
Zurück zum Zitat Breaux TD, Antȯn AI (2008) Analyzing regulatory rules for privacy and security requirements. IEEE Trans Softw Eng 34(1):5–20CrossRef Breaux TD, Antȯn AI (2008) Analyzing regulatory rules for privacy and security requirements. IEEE Trans Softw Eng 34(1):5–20CrossRef
Zurück zum Zitat Breaux TD, Vail MW, Antón AI (2006) Towards regulatory compliance: Extracting rights and obligations to align requirements with regulations. In: Proceedings of the 14th IEEE International Requirements Engineering Conference (RE’06), pp 46–55 Breaux TD, Vail MW, Antón AI (2006) Towards regulatory compliance: Extracting rights and obligations to align requirements with regulations. In: Proceedings of the 14th IEEE International Requirements Engineering Conference (RE’06), pp 46–55
Zurück zum Zitat Breuker J, Boer A, Hoekstra R, van den Berg K (2006) Developing content for LKIF: ontologies and frameworks for legal reasoning. In: Proceedings of the 19th Annual Conference on Legal Knowledge and Information Systems (JURIX’06), pp 169–174 Breuker J, Boer A, Hoekstra R, van den Berg K (2006) Developing content for LKIF: ontologies and frameworks for legal reasoning. In: Proceedings of the 19th Annual Conference on Legal Knowledge and Information Systems (JURIX’06), pp 169–174
Zurück zum Zitat Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46CrossRef
Zurück zum Zitat Dell’Orletta F, Marchi S, Montemagni S, Plank B, Venturi G (2012) The splet–2012 shared task on dependency parsing of legal texts. In: the 4th Workshop on Semantic Processing of Legal Texts (SPLeT’12), pp 42–51 Dell’Orletta F, Marchi S, Montemagni S, Plank B, Venturi G (2012) The splet–2012 shared task on dependency parsing of legal texts. In: the 4th Workshop on Semantic Processing of Legal Texts (SPLeT’12), pp 42–51
Zurück zum Zitat Elrakaiby Y, Ferrari A, Spoletini P, Gnesi S, Nuseibeh B (2017) Using argumentation to explain ambiguity in requirements elicitation interviews. In: Proceedings of the 25th IEEE International Requirements Engineering Conference (RE’17), pp 51–60 Elrakaiby Y, Ferrari A, Spoletini P, Gnesi S, Nuseibeh B (2017) Using argumentation to explain ambiguity in requirements elicitation interviews. In: Proceedings of the 25th IEEE International Requirements Engineering Conference (RE’17), pp 51–60
Zurück zum Zitat Evans MC, Bhatia J, Wadkar S, Breaux TD (2017) An evaluation of constituency-based hyponymy extraction from privacy policies. In: Proceedings of the 25th IEEE International Requirements Engineering Conference (RE’17), pp 312–321 Evans MC, Bhatia J, Wadkar S, Breaux TD (2017) An evaluation of constituency-based hyponymy extraction from privacy policies. In: Proceedings of the 25th IEEE International Requirements Engineering Conference (RE’17), pp 312–321
Zurück zum Zitat Frank E, Hall MA, Witten IH (2016) The WEKA workbench. online appendix for “data mining: Practical machine learning tools and techniques” Frank E, Hall MA, Witten IH (2016) The WEKA workbench. online appendix for “data mining: Practical machine learning tools and techniques”
Zurück zum Zitat Ghanavati S (2013) Legal-urn framework for legal compliance of business processes. PhD thesis, University of Ottawa Ottawa, Ontario, Canada Ghanavati S (2013) Legal-urn framework for legal compliance of business processes. PhD thesis, University of Ottawa Ottawa, Ontario, Canada
Zurück zum Zitat Ghanavati S, Amyot D, Rifaut A (2014) Legal goal-oriented requirement language (legal GRL) for modeling regulations. In: Proceedings of the 6th International Workshop on Modeling in Software Engineering (MISE’14), pp 1–6 Ghanavati S, Amyot D, Rifaut A (2014) Legal goal-oriented requirement language (legal GRL) for modeling regulations. In: Proceedings of the 6th International Workshop on Modeling in Software Engineering (MISE’14), pp 1–6
Zurück zum Zitat Gildea D, Jurafsky D (2000) Automatic labeling of semantic roles. In: the 38th Annual Conference of the Association for Computational Linguistics (ACL-00), pp 512–520 Gildea D, Jurafsky D (2000) Automatic labeling of semantic roles. In: the 38th Annual Conference of the Association for Computational Linguistics (ACL-00), pp 512–520
Zurück zum Zitat Giorgini P, Massacci F, Mylopoulos J, Zannone N (2005) Modeling security requirements through ownership, permission and delegation. In: Proceedings of the 13th IEEE International Conference on Requirements Engineering (RE’05), pp 167–176 Giorgini P, Massacci F, Mylopoulos J, Zannone N (2005) Modeling security requirements through ownership, permission and delegation. In: Proceedings of the 13th IEEE International Conference on Requirements Engineering (RE’05), pp 167–176
Zurück zum Zitat Gordon DG, Breaux TD (2012) Reconciling multi-jurisdictional legal requirements: A case study in requirements water marking. In: Proceedings of the 20th IEEE International Requirements Engineering Conference (RE’12), pp 91–100 Gordon DG, Breaux TD (2012) Reconciling multi-jurisdictional legal requirements: A case study in requirements water marking. In: Proceedings of the 20th IEEE International Requirements Engineering Conference (RE’12), pp 91–100
Zurück zum Zitat Hoekstra R, Breuker J, Bello MD, Boer A (2007) The LKIF core ontology of basic legal concepts. In: Proceedings of the 2nd Workshop on Legal Ontologies and Artificial Intelligence Techniques (LOAIT’07), pp 43–63 Hoekstra R, Breuker J, Bello MD, Boer A (2007) The LKIF core ontology of basic legal concepts. In: Proceedings of the 2nd Workshop on Legal Ontologies and Artificial Intelligence Techniques (LOAIT’07), pp 43–63
Zurück zum Zitat Hohfeld WN (1917) Fundamental legal conceptions as applied in judicial reasoning. The Yale Law Journal 26(8):710–770CrossRef Hohfeld WN (1917) Fundamental legal conceptions as applied in judicial reasoning. The Yale Law Journal 26(8):710–770CrossRef
Zurück zum Zitat Horty JF (2001) Agency and deontic logic oxford scholarship online. Oxford University Press, OxfordCrossRef Horty JF (2001) Agency and deontic logic oxford scholarship online. Oxford University Press, OxfordCrossRef
Zurück zum Zitat Ingolfo S, Jureta I, Siena A, Perini A, Susi A (2014) Nòmos 3: Legal compliance of roles and requirements. In: Proceedings of the 33rd international conference on conceptual modeling (ER’14), pp 275–288 Ingolfo S, Jureta I, Siena A, Perini A, Susi A (2014) Nòmos 3: Legal compliance of roles and requirements. In: Proceedings of the 33rd international conference on conceptual modeling (ER’14), pp 275–288
Zurück zum Zitat James G, Witten D, Hastie T, Tibshirani R (2014) An Introduction to Statistical Learning: With Applications in R James G, Witten D, Hastie T, Tibshirani R (2014) An Introduction to Statistical Learning: With Applications in R
Zurück zum Zitat Jurafsky D, Martin JH (2000) Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition, 1st edn. Prentice Hall PTR, Upper Saddle River Jurafsky D, Martin JH (2000) Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition, 1st edn. Prentice Hall PTR, Upper Saddle River
Zurück zum Zitat Kiyavitskaya N, Zeni N, Mich L, Cordy JR, Mylopoulos J (2006) Text mining through semi automatic semantic annotation. In: Proceedings of the 6th International Conference on Practical Aspects of Knowledge Management (PAKM’06), pp 143–154 Kiyavitskaya N, Zeni N, Mich L, Cordy JR, Mylopoulos J (2006) Text mining through semi automatic semantic annotation. In: Proceedings of the 6th International Conference on Practical Aspects of Knowledge Management (PAKM’06), pp 143–154
Zurück zum Zitat Kiyavitskaya N, Zeni N, Breaux TD, Antón AI, Cordy JR, Mich L, Mylopoulos J (2008) Automating the extraction of rights and obligations for regulatory compliance. In: Proceedings of the 27th International Conference on Conceptual Modeling (ER’08), pp 154–168 Kiyavitskaya N, Zeni N, Breaux TD, Antón AI, Cordy JR, Mich L, Mylopoulos J (2008) Automating the extraction of rights and obligations for regulatory compliance. In: Proceedings of the 27th International Conference on Conceptual Modeling (ER’08), pp 154–168
Zurück zum Zitat Kummerfeld JK, Hall DLW, Curran JR, Klein D (2012) Parser showdown at the wall street corral: An empirical investigation of error types in parser output. In: Proceedings of the joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL’12), pp 1048–1059 Kummerfeld JK, Hall DLW, Curran JR, Klein D (2012) Parser showdown at the wall street corral: An empirical investigation of error types in parser output. In: Proceedings of the joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL’12), pp 1048–1059
Zurück zum Zitat Lam H, Hashmi M, Scofield B (2016) Enabling reasoning with LegalRuleML. In: Proceedings of the 10th international symposium on rule technologies. Research, Tools, and Applications (RuleML’16), pp 241–257 Lam H, Hashmi M, Scofield B (2016) Enabling reasoning with LegalRuleML. In: Proceedings of the 10th international symposium on rule technologies. Research, Tools, and Applications (RuleML’16), pp 241–257
Zurück zum Zitat Landis J, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRef Landis J, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRef
Zurück zum Zitat Levy R, Andrew G (2006) Tregex and tsurgeon: tools for querying and manipulating tree data structures. In: Proceedings of the 5th international conference on language resources and evaluation (LREC’06), pp 2231–2234 Levy R, Andrew G (2006) Tregex and tsurgeon: tools for querying and manipulating tree data structures. In: Proceedings of the 5th international conference on language resources and evaluation (LREC’06), pp 2231–2234
Zurück zum Zitat Lucassen G, Robeer M, Dalpiaz F, van der Werf JMEM, Brinkkemper S (2017) Extracting conceptual models from user stories with visual narrator. Requir Eng 22(3):339–358CrossRef Lucassen G, Robeer M, Dalpiaz F, van der Werf JMEM, Brinkkemper S (2017) Extracting conceptual models from user stories with visual narrator. Requir Eng 22(3):339–358CrossRef
Zurück zum Zitat Massey A (2012) Legal requirements metrics for compliance analysis. PhD thesis, North Carolina State University Raleigh, North Carolina, USA Massey A (2012) Legal requirements metrics for compliance analysis. PhD thesis, North Carolina State University Raleigh, North Carolina, USA
Zurück zum Zitat Massey AK, Otto PN, Hayward LJ, Antȯn A I (2010) Evaluating existing security and privacy requirements for legal compliance. Requir Eng 15 (1):119–137CrossRef Massey AK, Otto PN, Hayward LJ, Antȯn A I (2010) Evaluating existing security and privacy requirements for legal compliance. Requir Eng 15 (1):119–137CrossRef
Zurück zum Zitat Maxwell JC, Antón AI (2010) The production rule framework: developing a canonical set of software requirements for compliance with law. In: Proceedings of the ACM international health informatics symposium (IHI’10), pp 629–636 Maxwell JC, Antón AI (2010) The production rule framework: developing a canonical set of software requirements for compliance with law. In: Proceedings of the ACM international health informatics symposium (IHI’10), pp 629–636
Zurück zum Zitat Maxwell JC, Antȯn AI, Swire PP, Riaz M, McCraw CM (2012) A legal cross-references taxonomy for reasoning about compliance requirements. Requir Eng 17(2):99–115CrossRef Maxwell JC, Antȯn AI, Swire PP, Riaz M, McCraw CM (2012) A legal cross-references taxonomy for reasoning about compliance requirements. Requir Eng 17(2):99–115CrossRef
Zurück zum Zitat McDonald RT, Nivre J (2007) Characterizing the errors of data-driven dependency parsing models. In: Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL’07), pp 122–131 McDonald RT, Nivre J (2007) Characterizing the errors of data-driven dependency parsing models. In: Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL’07), pp 122–131
Zurück zum Zitat Nivre J, Hall J, Nilsson J, Chanev A, Eryigit G, Ku̇bler S, Marinov S, Marsi E (2007) Maltparser: a language-independent system for data-driven dependency parsing. Nat Lang Eng 13(2):95–135CrossRef Nivre J, Hall J, Nilsson J, Chanev A, Eryigit G, Ku̇bler S, Marinov S, Marsi E (2007) Maltparser: a language-independent system for data-driven dependency parsing. Nat Lang Eng 13(2):95–135CrossRef
Zurück zum Zitat Peters W, Sagri M, Tiscornia D (2007) The structuring of legal knowledge in LOIS. Artificial Intelligence and Law 15(2):117–135CrossRef Peters W, Sagri M, Tiscornia D (2007) The structuring of legal knowledge in LOIS. Artificial Intelligence and Law 15(2):117–135CrossRef
Zurück zum Zitat Petrov S, Barrett L, Thibaux R, Klein D (2006) Learning accurate, compact, and interpretable tree annotation. In: Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the association for computational linguistics (ACL’06) Petrov S, Barrett L, Thibaux R, Klein D (2006) Learning accurate, compact, and interpretable tree annotation. In: Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the association for computational linguistics (ACL’06)
Zurück zum Zitat Pradet Q, Danlos L, de Chalendar G (2014) Adapting verbnet to french using existing resources. In: The ninth international conference on language resources and evaluation (LREC’14), pp 1122–1126 Pradet Q, Danlos L, de Chalendar G (2014) Adapting verbnet to french using existing resources. In: The ninth international conference on language resources and evaluation (LREC’14), pp 1122–1126
Zurück zum Zitat Quirchmayr T, Paech B, Kohl R, Karey H, Kasdepke G (2018) Semi-automatic rule-based domain terminology and software feature-relevant information extraction from natural language user manuals. Empirical Software Engineering 23(6):3630–3683CrossRef Quirchmayr T, Paech B, Kohl R, Karey H, Kasdepke G (2018) Semi-automatic rule-based domain terminology and software feature-relevant information extraction from natural language user manuals. Empirical Software Engineering 23(6):3630–3683CrossRef
Zurück zum Zitat Rosadini B, Ferrari A, Gori G, Fantechi A, Gnesi S, Trotta I, Bacherini S (2017) Using NLP to detect requirements defects: An industrial experience in the railway domain. In: Proceedings of the 23rd International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ’17), pp 344–360 Rosadini B, Ferrari A, Gori G, Fantechi A, Gnesi S, Trotta I, Bacherini S (2017) Using NLP to detect requirements defects: An industrial experience in the railway domain. In: Proceedings of the 23rd International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ’17), pp 344–360
Zurück zum Zitat Sagot B (2010) The Lefff, a freely available and large-coverage morphological and syntactic lexicon for french. In: Proceedings of the international conference on language resources and evaluation(LREC’10), pp 2745–2751 Sagot B (2010) The Lefff, a freely available and large-coverage morphological and syntactic lexicon for french. In: Proceedings of the international conference on language resources and evaluation(LREC’10), pp 2745–2751
Zurück zum Zitat Saldaña J (2015) The Coding Manual for Qualitative Researchers. Sage Saldaña J (2015) The Coding Manual for Qualitative Researchers. Sage
Zurück zum Zitat Sannier N, Adedjouma M, Sabetzadeh M, Briand LC (2016) Automated classification of legal cross references based on semantic intent. In: Proceedings of the 22nd international working conference on requirements engineering: foundation for software quality (REFSQ’16), pp 119–134 Sannier N, Adedjouma M, Sabetzadeh M, Briand LC (2016) Automated classification of legal cross references based on semantic intent. In: Proceedings of the 22nd international working conference on requirements engineering: foundation for software quality (REFSQ’16), pp 119–134
Zurück zum Zitat Sannier N, Adedjouma M, Sabetzadeh M, Briand LC (2017) An automated framework for detection and resolution of cross references in legal texts. Requir Eng 22(2):215–237CrossRef Sannier N, Adedjouma M, Sabetzadeh M, Briand LC (2017) An automated framework for detection and resolution of cross references in legal texts. Requir Eng 22(2):215–237CrossRef
Zurück zum Zitat Sartor G, Casanovas P, Biasiotti M, Fernndez-Barrera M (2013) Approaches to legal ontologies: Theories, Domains, Methodologies. Springer, Berlin Sartor G, Casanovas P, Biasiotti M, Fernndez-Barrera M (2013) Approaches to legal ontologies: Theories, Domains, Methodologies. Springer, Berlin
Zurück zum Zitat Siena A, Mylopoulos J, Perini A, Susi A (2009) Designing law-compliant software requirements. In: Proceedings of the 28th international conference on conceptual modeling (ER’09), pp 472–486 Siena A, Mylopoulos J, Perini A, Susi A (2009) Designing law-compliant software requirements. In: Proceedings of the 28th international conference on conceptual modeling (ER’09), pp 472–486
Zurück zum Zitat Siena A, Jureta I, Ingolfo S, Susi A, Perini A, Mylopoulos J (2012) Capturing variability of law with nómos 2. In: Proceedings of the 31st international conference on conceptual modeling (ER’12), pp 383–396 Siena A, Jureta I, Ingolfo S, Susi A, Perini A, Mylopoulos J (2012) Capturing variability of law with nómos 2. In: Proceedings of the 31st international conference on conceptual modeling (ER’12), pp 383–396
Zurück zum Zitat Sleimi A, Sannier N, Sabetzadeh M, Briand LC, Dann J (2018) Automated extraction of semantic legal metadata using natural language processing. In: Proceedings of the 26th IEEE international requirements engineering conference (RE’18), pp 302–311 Sleimi A, Sannier N, Sabetzadeh M, Briand LC, Dann J (2018) Automated extraction of semantic legal metadata using natural language processing. In: Proceedings of the 26th IEEE international requirements engineering conference (RE’18), pp 302–311
Zurück zum Zitat Sleimi A, Ceci M, Sannier N, Sabetzadeh M, Briand LC, Dann J (2019) A query system for extracting requirements-related information from legal texts. In: Proceedings of the 27th IEEE international requirements engineering conference (RE’19) Sleimi A, Ceci M, Sannier N, Sabetzadeh M, Briand LC, Dann J (2019) A query system for extracting requirements-related information from legal texts. In: Proceedings of the 27th IEEE international requirements engineering conference (RE’19)
Zurück zum Zitat Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-weka: Combined selection and hyperparameter optimization of classification algorithms. In: The 19th ACM SIGKDD international conference on knowledge discovery and data mining KDD, pp 847–855 Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-weka: Combined selection and hyperparameter optimization of classification algorithms. In: The 19th ACM SIGKDD international conference on knowledge discovery and data mining KDD, pp 847–855
Zurück zum Zitat Zeni N, Kiyavitskaya N, Mich L, Cordy JR, Mylopoulos J (2015) Gaiust: supporting the extraction of rights and obligations for regulatory compliance. Requir Eng 20(1):1–22CrossRef Zeni N, Kiyavitskaya N, Mich L, Cordy JR, Mylopoulos J (2015) Gaiust: supporting the extraction of rights and obligations for regulatory compliance. Requir Eng 20(1):1–22CrossRef
Zurück zum Zitat Zeni N, Seid EA, Engiel P, Ingolfo S, Mylopoulos J (2016) Building large models of law with NómosT. In: Proceedings of the 35th international conference on conceptual modeling (ER’16), pp 233–247 Zeni N, Seid EA, Engiel P, Ingolfo S, Mylopoulos J (2016) Building large models of law with NómosT. In: Proceedings of the 35th international conference on conceptual modeling (ER’16), pp 233–247
Metadaten
Titel
An automated framework for the extraction of semantic legal metadata from legal texts
verfasst von
Amin Sleimi
Nicolas Sannier
Mehrdad Sabetzadeh
Lionel Briand
Marcello Ceci
John Dann
Publikationsdatum
01.05.2021
Verlag
Springer US
Erschienen in
Empirical Software Engineering / Ausgabe 3/2021
Print ISSN: 1382-3256
Elektronische ISSN: 1573-7616
DOI
https://doi.org/10.1007/s10664-020-09933-5

Weitere Artikel der Ausgabe 3/2021

Empirical Software Engineering 3/2021 Zur Ausgabe

Premium Partner