gcaillaut/frwiki_el
收藏Hugging Face2022-09-28 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/gcaillaut/frwiki_el
下载链接
链接失效反馈官方服务:
资源简介:
---
annotations_creators:
- crowdsourced
language_creators:
- machine-generated
language:
- fr
license:
- wtfpl
multilinguality:
- monolingual
pretty_name: French Wikipedia dataset for Entity Linking
size_categories:
- 1M<n<10M
source_datasets:
- original
task_categories:
- token-classification
task_ids: []
---
# Dataset Card for frwiki_good_pages_el
## Dataset Description
- Repository: [frwiki_el](https://github.com/GaaH/frwiki_el)
- Point of Contact: [Gaëtan Caillaut](mailto://g.caillaut@brgm.fr)
### Dataset Summary
This dataset contains articles from the French Wikipédia.
It is intended to be used to train Entity Linking (EL) systems. Links in articles are used to detect named entities.
The dataset `frwiki` contains sentences of each Wikipedia pages.
The dataset `entities` contains description for each Wikipedia pages.
### Languages
- French
## Dataset Structure
### frwiki
```
{
"name": "Title of the page",
"wikidata_id": "Identifier of the related Wikidata entity. Can be null.",
"wikipedia_id": "Identifier of the Wikipedia page",
"wikipedia_url": "URL to the Wikipedia page",
"wikidata_url": "URL to the Wikidata page. Can be null.",
"sentences" : [
{
"text": "text of the current sentence",
"ner": ["list", "of", "ner", "labels"],
"mention_mappings": [
(start_of_first_mention, end_of_first_mention),
(start_of_second_mention, end_of_second_mention)
],
"el_wikidata_id": ["wikidata id of first mention", "wikidata id of second mention"],
"el_wikipedia_id": [wikipedia id of first mention, wikipedia id of second mention],
"el_wikipedia_title": ["wikipedia title of first mention", "wikipedia title of second mention"]
}
]
"words": ["words", "in", "the", "sentence"],
"ner": ["ner", "labels", "of", "each", "words"],
"el": ["el", "labels", "of", "each", "words"]
}
```
### entities
```
{
"name": "Title of the page",
"wikidata_id": "Identifier of the related Wikidata entity. Can be null.",
"wikipedia_id": "Identifier of the Wikipedia page",
"wikipedia_url": "URL to the Wikipedia page",
"wikidata_url": "URL to the Wikidata page. Can be null.",
"description": "Description of the entity"
}
```
提供机构:
gcaillaut
原始信息汇总
数据集概述
基本信息
- 名称: French Wikipedia dataset for Entity Linking
- 别名: frwiki_good_pages_el
- 语言: 法语
- 许可证: WTFPL
- 多语言性: 单语种
- 大小: 1M<n<10M
- 来源: 原创数据集
- 任务类别: 词元分类
数据集结构
组成部分
-
frwiki:
- 内容: 包含每个Wikipedia页面的句子。
- 结构:
name: 页面标题wikidata_id: 相关Wikidata实体的标识符,可为空。wikipedia_id: Wikipedia页面的标识符wikipedia_url: Wikipedia页面的URLwikidata_url: Wikidata页面的URL,可为空。sentences: 句子集合,每个句子包含文本、NER标签、提及映射、EL的Wikidata和Wikipedia标识及标题。words: 句子中的单词ner: 每个单词的NER标签el: 每个单词的EL标签
-
entities:
- 内容: 包含每个Wikipedia页面的实体描述。
- 结构:
name: 页面标题wikidata_id: 相关Wikidata实体的标识符,可为空。wikipedia_id: Wikipedia页面的标识符wikipedia_url: Wikipedia页面的URLwikidata_url: Wikidata页面的URL,可为空。description: 实体描述
数据集用途
- 目的: 用于训练Entity Linking (EL)系统,通过文章中的链接来检测命名实体。



