nlpso/m1_fine_tuning_ref_cmbert_iob2

---
language:
- fr
multilinguality:
- monolingual
task_categories:
- token-classification
---

# m1_fine_tuning_ref_cmbert_iob2

## Introduction

This dataset was used to fine-tuned [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner) for **nested NER task** using Independant NER layers approach [M1].
It contains Paris trade directories entries from the 19th century.

## Dataset parameters

* Approach : M1
* Dataset type : ground-truth
* Tokenizer : [Jean-Baptiste/camembert-ner](https://huggingface.co/Jean-Baptiste/camembert-ner)
* Tagging format : IOB2
* Counts :
* Train : 6084
* Dev : 676
* Test : 1685
* Associated fine-tuned models :
* Level-1 : [nlpso/m1_ind_layers_ref_cmbert_iob2_level_1](https://huggingface.co/nlpso/m1_ind_layers_ref_cmbert_iob2_level_1)
* Level 2 : [nlpso/m1_ind_layers_ref_cmbert_iob2_level_2](https://huggingface.co/nlpso/m1_ind_layers_ref_cmbert_iob2_level_2)

## Entity types

Abbreviation|Entity group (level)|Description
-|-|-
O |1 & 2|Outside of a named entity
PER |1|Person or company name
ACT |1 & 2|Person or company professional activity
TITREH |2|Military or civil distinction
DESC |1|Entry full description
TITREP |2|Professionnal reward
SPAT |1|Address
LOC |2|Street name
CARDINAL |2|Street number
FT |2|Geographical feature

## How to use this dataset

```python
from datasets import load_dataset

train_dev_test = load_dataset("nlpso/m1_fine_tuning_ref_cmbert_iob2")

原始信息汇总

数据集概述

基本信息

• 名称：m1_fine_tuning_ref_cmbert_iob2
• 语言：法语
• 多语言性：单语
• 任务类别：token-classification

数据集描述

• 用途：用于微调 Jean-Baptiste/camembert-ner 模型，以处理嵌套命名实体识别任务。
• 数据来源：包含19世纪巴黎贸易目录条目。

数据集参数

• 方法：M1
• 数据集类型：ground-truth
• 分词器：Jean-Baptiste/camembert-ner
• 标记格式：IOB2
• 数据集大小：
  • 训练集：6084
  • 验证集：676
  • 测试集：1685
• 关联的微调模型：
  • 第一级：nlpso/m1_ind_layers_ref_cmbert_iob2_level_1
  • 第二级：nlpso/m1_ind_layers_ref_cmbert_iob2_level_2

实体类型

• O：非实体
• PER：个人或公司名称
• ACT：个人或公司职业活动
• TITREH：军事或民事区别
• DESC：完整描述
• TITREP：职业奖励
• SPAT：地址
• LOC：街道名称
• CARDINAL：街道号码
• FT：地理特征

使用方法

python from datasets import load_dataset

train_dev_test = load_dataset("nlpso/m1_fine_tuning_ref_cmbert_iob2")