jonathanli/eurlex
收藏资源简介：
--- annotations_creators: - found language_creators: - found language: - en license: - cc-by-sa-4.0 multilinguality: - monolingual size_categories: - 10K<n<100K source_datasets: - original task_categories: - text-classification task_ids: - multi-label-classification paperswithcode_id: eurlex57k pretty_name: the EUR-Lex dataset tags: - legal-topic-classification --- # Dataset Card for the EUR-Lex dataset ## Table of Contents - [Dataset Description](#dataset-description) - [Dataset Summary](#dataset-summary) - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards) - [Languages](#languages) - [Dataset Structure](#dataset-structure) - [Data Instances](#data-instances) - [Data Fields](#data-fields) - [Data Splits](#data-splits) - [Dataset Creation](#dataset-creation) - [Curation Rationale](#curation-rationale) - [Source Data](#source-data) - [Annotations](#annotations) - [Personal and Sensitive Information](#personal-and-sensitive-information) - [Considerations for Using the Data](#considerations-for-using-the-data) - [Social Impact of Dataset](#social-impact-of-dataset) - [Discussion of Biases](#discussion-of-biases) - [Other Known Limitations](#other-known-limitations) - [Additional Information](#additional-information) - [Dataset Curators](#dataset-curators) - [Licensing Information](#licensing-information) - [Citation Information](#citation-information) - [Contributions](#contributions) ## Dataset Description - **Homepage:** http://nlp.cs.aueb.gr/software_and_datasets/EURLEX57K/ - **Repository:** http://nlp.cs.aueb.gr/software_and_datasets/EURLEX57K/ - **Paper:** https://www.aclweb.org/anthology/P19-1636/ - **Leaderboard:** N/A ### Dataset Summary EURLEX57K can be viewed as an improved version of the dataset released by Mencia and Furnkranzand (2007), which has been widely used in Large-scale Multi-label Text Classification (LMTC) research, but is less than half the size of EURLEX57K (19.6k documents, 4k EUROVOC labels) and more than ten years old. EURLEX57K contains 57k legislative documents in English from EUR-Lex (https://eur-lex.europa.eu) with an average length of 727 words. Each document contains four major zones: - the header, which includes the title and name of the legal body enforcing the legal act; - the recitals, which are legal background references; and - the main body, usually organized in articles. **Labeling / Annotation** All the documents of the dataset have been annotated by the Publications Office of EU (https://publications.europa.eu/en) with multiple concepts from EUROVOC (http://eurovoc.europa.eu/). While EUROVOC includes approx. 7k concepts (labels), only 4,271 (59.31%) are present in EURLEX57K, from which only 2,049 (47.97%) have been assigned to more than 10 documents. The 4,271 labels are also divided into frequent (746 labels), few-shot (3,362), and zero- shot (163), depending on whether they were assigned to more than 50, fewer than 50 but at least one, or no training documents, respectively. ### Supported Tasks and Leaderboards The dataset supports: **Multi-label Text Classification:** Given the text of a document, a model predicts the relevant EUROVOC concepts. **Few-shot and Zero-shot learning:** As already noted, the labels can be divided into three groups: frequent (746 labels), few-shot (3,362), and zero- shot (163), depending on whether they were assigned to more than 50, fewer than 50 but at least one, or no training documents, respectively. ### Languages All documents are written in English. ## Dataset Structure ### Data Instances ```json { "celex_id": "31979D0509", "title": "79/509/EEC: Council Decision of 24 May 1979 on financial aid from the Community for the eradication of African swine fever in Spain", "text": "COUNCIL DECISION of 24 May 1979 on financial aid from the Community for the eradication of African swine fever in Spain (79/509/EEC)\nTHE COUNCIL OF THE EUROPEAN COMMUNITIES\nHaving regard to the Treaty establishing the European Economic Community, and in particular Article 43 thereof,\nHaving regard to the proposal from the Commission (1),\nHaving regard to the opinion of the European Parliament (2),\nWhereas the Community should take all appropriate measures to protect itself against the appearance of African swine fever on its territory;\nWhereas to this end the Community has undertaken, and continues to undertake, action designed to contain outbreaks of this type of disease far from its frontiers by helping countries affected to reinforce their preventive measures ; whereas for this purpose Community subsidies have already been granted to Spain;\nWhereas these measures have unquestionably made an effective contribution to the protection of Community livestock, especially through the creation and maintenance of a buffer zone north of the river Ebro;\nWhereas, however, in the opinion of the Spanish authorities themselves, the measures so far implemented must be reinforced if the fundamental objective of eradicating the disease from the entire country is to be achieved;\nWhereas the Spanish authorities have asked the Community to contribute to the expenses necessary for the efficient implementation of a total eradication programme;\nWhereas a favourable response should be given to this request by granting aid to Spain, having regard to the undertaking given by that country to protect the Community against African swine fever and to eliminate completely this disease by the end of a five-year eradication plan;\nWhereas this eradication plan must include certain measures which guarantee the effectiveness of the action taken, and it must be possible to adapt these measures to developments in the situation by means of a procedure establishing close cooperation between the Member States and the Commission;\nWhereas it is necessary to keep the Member States regularly informed as to the progress of the action undertaken,", "eurovoc_concepts": ["192", "2356", "2560", "862", "863"] } ``` ### Data Fields The following data fields are provided for documents (`train`, `dev`, `test`): `celex_id`: (**str**) The official ID of the document. The CELEX number is the unique identifier for all publications in both Eur-Lex and CELLAR.\ `title`: (**str**) The title of the document.\ `text`: (**str**) The full content of each document, which is represented by its `header`, `recitals` and `main_body`.\ `eurovoc_concepts`: (**List[str]**) The relevant EUROVOC concepts (labels). If you want to use the descriptors of EUROVOC concepts, similar to Chalkidis et al. (2020), please load: https://archive.org/download/EURLEX57K/eurovoc_concepts.jsonl ```python import json with open('./eurovoc_concepts.jsonl') as jsonl_file: eurovoc_concepts = {json.loads(concept) for concept in jsonl_file.readlines()} ``` ### Data Splits | Split | No of Documents | Avg. words | Avg. labels | | ------------------- | ------------------------------------ | --- | --- | | Train | 45,000 | 729 | 5 | |Development | 6,000 | 714 | 5 | |Test | 6,000 | 725 | 5 | ## Dataset Creation ### Curation Rationale The dataset was curated by Chalkidis et al. (2019).\ The documents have been annotated by the Publications Office of EU (https://publications.europa.eu/en). ### Source Data #### Initial Data Collection and Normalization The original data are available at EUR-Lex portal (https://eur-lex.europa.eu) in an unprocessed format. The documents were downloaded from EUR-Lex portal in HTML format. The relevant metadata and EUROVOC concepts were downloaded from the SPARQL endpoint of the Publications Office of EU (http://publications.europa.eu/webapi/rdf/sparql). #### Who are the source language producers? [More Information Needed] ### Annotations #### Annotation process * The original documents are available at EUR-Lex portal (https://eur-lex.europa.eu) in an unprocessed HTML format. The HTML code was striped and the documents split into sections. * The documents have been annotated by the Publications Office of EU (https://publications.europa.eu/en). #### Who are the annotators? Publications Office of EU (https://publications.europa.eu/en) ### Personal and Sensitive Information The dataset does not include personal or sensitive information. ## Considerations for Using the Data ### Social Impact of Dataset [More Information Needed] ### Discussion of Biases [More Information Needed] ### Other Known Limitations [More Information Needed] ## Additional Information ### Dataset Curators Chalkidis et al. (2019) ### Licensing Information © European Union, 1998-2021 The Commission’s document reuse policy is based on Decision 2011/833/EU. Unless otherwise specified, you can re-use the legal documents published in EUR-Lex for commercial or non-commercial purposes. The copyright for the editorial content of this website, the summaries of EU legislation and the consolidated texts, which is owned by the EU, is licensed under the Creative Commons Attribution 4.0 International licence. This means that you can re-use the content provided you acknowledge the source and indicate any changes you have made. Source: https://eur-lex.europa.eu/content/legal-notice/legal-notice.html \ Read more: https://eur-lex.europa.eu/content/help/faq/reuse-contents-eurlex.html ### Citation Information *Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis and Ion Androutsopoulos.* *Large-Scale Multi-Label Text Classification on EU Legislation.* *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). Florence, Italy. 2019* ``` @inproceedings{chalkidis-etal-2019-large, title = "Large-Scale Multi-Label Text Classification on {EU} Legislation", author = "Chalkidis, Ilias and Fergadiotis, Manos and Malakasiotis, Prodromos and Androutsopoulos, Ion", booktitle = "Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics", year = "2019", address = "Florence, Italy", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/P19-1636", doi = "10.18653/v1/P19-1636", pages = "6314--6322" } ``` ### Contributions Thanks to [@iliaschalkidis](https://github.com/iliaschalkidis) for adding this dataset.
annotations_creators: - 外部获取 language_creators: - 外部获取 language: - en license: - cc-by-sa-4.0 multilinguality: - 单语言 size_categories: - 10000 < 样本数 < 100000 source_datasets: - 原始数据集 task_categories: - 文本分类（text-classification） task_ids: - 多标签分类（multi-label-classification） paperswithcode_id: eurlex57k pretty_name: EUR-Lex数据集 tags: - 法律主题分类（legal-topic-classification） # EUR-Lex数据集卡片 ## 目录 - [数据集概述](#数据集概述) - [数据集摘要](#数据集摘要) - [支持任务与排行榜](#支持任务与排行榜) - [语言](#语言) - [数据集结构](#数据集结构) - [数据实例](#数据实例) - [数据字段](#数据字段) - [数据划分](#数据划分) - [数据集构建](#数据集构建) - [构建初衷](#构建初衷) - [源数据](#源数据) - [注释](#注释) - [个人与敏感信息](#个人与敏感信息) - [数据集使用注意事项](#数据集使用注意事项) - [数据集的社会影响](#数据集的社会影响) - [偏差讨论](#偏差讨论) - [其他已知局限](#其他已知局限) - [附加信息](#附加信息) - [数据集维护者](#数据集维护者) - [许可证信息](#许可证信息) - [引用信息](#引用信息) - [贡献者](#贡献者) ## 数据集概述 - **主页**：http://nlp.cs.aueb.gr/software_and_datasets/EURLEX57K/ - **代码仓库**：http://nlp.cs.aueb.gr/software_and_datasets/EURLEX57K/ - **论文**：https://www.aclweb.org/anthology/P19-1636/ - **排行榜**：无 ### 数据集摘要 EURLEX57K可被视为Mencia与Furnkranzand（2007）发布的数据集的改进版本，该数据集曾广泛应用于大规模多标签文本分类（Large-scale Multi-label Text Classification, LMTC）研究，但原始数据集仅包含19.6k份文档、4k个EUROVOC标签，且已发布超过十年，规模仅为EURLEX57K的一半不到。 EURLEX57K包含来自EUR-Lex（https://eur-lex.europa.eu）的57k份英语立法文档，平均长度为727词。每份文档包含四个主要部分： - 首部（header）：包含法律法案的标题与执行该法案的法律机构名称； - 陈述部分（recitals）：即法律背景引用； - 主体部分（main_body）：通常以条款形式组织。 **标注/注释** 本数据集所有文档均由欧盟出版物办公室（Publications Office of EU, https://publications.europa.eu/en）基于EUROVOC（http://eurovoc.europa.eu/）的多个概念进行标注。 EUROVOC共包含约7k个概念（标签），其中仅4271个（占比59.31%）出现在EURLEX57K中，而这4271个标签里又仅有2049个（占比47.97%）被分配给了超过10份文档。根据标签被分配至训练文档的数量，4271个标签可被分为三类：高频标签（746个，被分配至超过50份训练文档）、少样本（Few-shot）标签（3362个，被分配至1至49份训练文档）以及零样本（Zero-shot）标签（163个，未被分配至任何训练文档）。 ### 支持任务与排行榜 本数据集支持以下任务： **多标签文本分类（Multi-label Text Classification）**：给定文档文本，模型预测其对应的EUROVOC相关概念。 **少样本（Few-shot）与零样本（Zero-shot）学习**：如前所述，根据标签被分配至训练文档的数量，标签可被分为三类：高频标签（746个）、少样本标签（3362个）以及零样本标签（163个），分别对应被分配至超过50份、1至49份、0份训练文档的标签。 ### 语言 所有文档均为英语。 ## 数据集结构 ### 数据实例 json { "celex_id": "31979D0509", "title": "79/509/EEC: Council Decision of 24 May 1979 on financial aid from the Community for the eradication of African swine fever in Spain", "text": "COUNCIL DECISION of 24 May 1979 on financial aid from the Community for the eradication of African swine fever in Spain (79/509/EEC) THE COUNCIL OF THE EUROPEAN COMMUNITIES Having regard to the Treaty establishing the European Economic Community, and in particular Article 43 thereof, Having regard to the proposal from the Commission (1), Having regard to the opinion of the European Parliament (2), Whereas the Community should take all appropriate measures to protect itself against the appearance of African swine fever on its territory; Whereas to this end the Community has undertaken, and continues to undertake, action designed to contain outbreaks of this type of disease far from its frontiers by helping countries affected to reinforce their preventive measures ; whereas for this purpose Community subsidies have already been granted to Spain; Whereas these measures have unquestionably made an effective contribution to the protection of Community livestock, especially through the creation and maintenance of a buffer zone north of the river Ebro; Whereas, however, in the opinion of the Spanish authorities themselves, the measures so far implemented must be reinforced if the fundamental objective of eradicating the disease from the entire country is to be achieved; Whereas the Spanish authorities have asked the Community to contribute to the expenses necessary for the efficient implementation of a total eradication programme; Whereas a favourable response should be given to this request by granting aid to Spain, having regard to the undertaking given by that country to protect the Community against African swine fever and to eliminate completely this disease by the end of a five-year eradication plan; Whereas this eradication plan must include certain measures which guarantee the effectiveness of the action taken, and it must be possible to adapt these measures to developments in the situation by means of a procedure establishing close cooperation between the Member States and the Commission; Whereas it is necessary to keep the Member States regularly informed as to the progress of the action undertaken,", "eurovoc_concepts": ["192", "2356", "2560", "862", "863"] } ### 数据字段 针对训练集（train）、开发集（dev）与测试集（test）中的文档，提供以下数据字段： `celex_id`：（字符串类型）文档的官方唯一标识符。CELEX编号是EUR-Lex与CELLAR平台所有出版物的唯一标识。 `title`：（字符串类型）文档标题。 `text`：（字符串类型）文档的完整内容，由首部（header）、陈述部分（recitals）与主体部分（main_body）组成。 `eurovoc_concepts`：（字符串列表类型）文档对应的相关EUROVOC概念（标签）。 如果需要获取EUROVOC概念的描述词（参考Chalkidis等人2020年的研究），请加载：https://archive.org/download/EURLEX57K/eurovoc_concepts.jsonl python import json with open('./eurovoc_concepts.jsonl') as jsonl_file: eurovoc_concepts = {json.loads(concept) for concept in jsonl_file.readlines()} ### 数据划分 | 划分 | 文档数量 | 平均词数 | 平均标签数 | | ------------------- | ------------------------------------ | --- | --- | | 训练集 | 45,000 | 729 | 5 | | 开发集 | 6,000 | 714 | 5 | | 测试集 | 6,000 | 725 | 5 | ## 数据集构建 ### 构建初衷 本数据集由Chalkidis等人（2019）构建。所有文档均由欧盟出版物办公室（https://publications.europa.eu/en）完成标注。 ### 源数据 #### 初始数据收集与标准化 原始数据可在EUR-Lex门户（https://eur-lex.europa.eu）获取，格式为未处理的HTML。文档从EUR-Lex门户以HTML格式下载，相关元数据与EUROVOC概念则从欧盟出版物办公室的SPARQL端点（http://publications.europa.eu/webapi/rdf/sparql）下载。 #### 源语言生产者是谁？ [More Information Needed] ### 注释 #### 标注流程 * 原始文档以未处理的HTML格式存储于EUR-Lex门户（https://eur-lex.europa.eu），我们移除了HTML代码并将文档拆分为多个章节。 * 所有文档均由欧盟出版物办公室（https://publications.europa.eu/en）完成标注。 #### 标注者是谁？ 欧盟出版物办公室（https://publications.europa.eu/en） ### 个人与敏感信息 本数据集不包含任何个人或敏感信息。 ## 数据集使用注意事项 ### 数据集的社会影响 [More Information Needed] ### 偏差讨论 [More Information Needed] ### 其他已知局限 [More Information Needed] ## 附加信息 ### 数据集维护者 Chalkidis等人（2019） ### 许可证信息 © 欧盟，1998-2021 欧盟委员会的文档复用政策基于第2011/833/EU号决议。除非另有说明，您可将EUR-Lex中发布的法律文档用于商业或非商业用途。 本网站的编辑内容、欧盟立法摘要与整合文本的版权归欧盟所有，采用知识共享署名4.0国际许可协议（CC BY 4.0）进行授权。这意味着您可复用这些内容，但需注明来源并说明所做的修改。 来源：https://eur-lex.europa.eu/content/legal-notice/legal-notice.html 更多信息：https://eur-lex.europa.eu/content/help/faq/reuse-contents-eurlex.html ### 引用信息 *Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis and Ion Androutsopoulos.* *大规模多标签文本分类：欧盟立法场景（Large-Scale Multi-Label Text Classification on EU Legislation）* *第57届计算语言学协会（Association for Computational Linguistics, ACL）年会论文集，意大利佛罗伦萨，2019年* @inproceedings{chalkidis-etal-2019-large, title = "Large-Scale Multi-Label Text Classification on {EU} Legislation", author = "Chalkidis, Ilias and Fergadiotis, Manos and Malakasiotis, Prodromos and Androutsopoulos, Ion", booktitle = "Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics", year = "2019", address = "Florence, Italy", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/P19-1636", doi = "10.18653/v1/P19-1636", pages = "6314--6322" } ### 贡献者 感谢[@iliaschalkidis](https://github.com/iliaschalkidis) 添加本数据集。
数据集概述
数据集名称
- 名称: EUR-Lex dataset
- 别名: EURLEX57K
数据集基本信息
- 语言: 英语
- 许可证: CC-BY-SA-4.0
- 多语言性: 单语
- 大小: 10K<n<100K
- 来源: 原始数据
- 任务类别: 文本分类
- 任务ID: 多标签分类
- 标签: 法律主题分类
数据集内容
- 文档数量: 57,000
- 平均文档长度: 727字
- 标签数量: 4,271（其中2,049标签被分配给超过10个文档）
- 标签分类: 频繁（746标签），少样本（3,362标签），零样本（163标签）
数据集结构
- 数据实例: 包含celex_id, title, text, eurovoc_concepts等字段
- 数据分割: 训练集45,000文档，开发集6,000文档，测试集6,000文档
数据集创建
- 创建者: Chalkidis et al. (2019)
- 注释者: 欧盟出版办公室
- 数据来源: EUR-Lex门户网站
使用许可
- 版权信息: 欧洲联盟，1998-2021
- 重用政策: 基于Decision 2011/833/EU，可用于商业或非商业目的
引用信息
@inproceedings{chalkidis-etal-2019-large, title = "Large-Scale Multi-Label Text Classification on {EU} Legislation", author = "Chalkidis, Ilias and Fergadiotis, Manos and Malakasiotis, Prodromos and Androutsopoulos, Ion", booktitle = "Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics", year = "2019", address = "Florence, Italy", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/P19-1636", doi = "10.18653/v1/P19-1636", pages = "6314--6322" }
