pietrolesci/eurlex-57k

---
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
- split: validation
path: data/validation-*
- split: test
path: data/test-*
- config_name: embedding_all-MiniLM-L12-v2
data_files:
- split: train
path: embedding_all-MiniLM-L12-v2/train-*
- split: validation
path: embedding_all-MiniLM-L12-v2/validation-*
- split: test
path: embedding_all-MiniLM-L12-v2/test-*
- config_name: embedding_all-mpnet-base-v2
data_files:
- split: train
path: embedding_all-mpnet-base-v2/train-*
- split: validation
path: embedding_all-mpnet-base-v2/validation-*
- split: test
path: embedding_all-mpnet-base-v2/test-*
- config_name: embedding_multi-qa-mpnet-base-dot-v1
data_files:
- split: train
path: embedding_multi-qa-mpnet-base-dot-v1/train-*
- split: validation
path: embedding_multi-qa-mpnet-base-dot-v1/validation-*
- split: test
path: embedding_multi-qa-mpnet-base-dot-v1/test-*
- config_name: eurovoc_concepts
data_files:
- split: train
path: eurovoc_concepts/train-*
dataset_info:
- config_name: default
features:
- name: celex_id
dtype: string
- name: document_type
dtype: string
- name: title
dtype: string
- name: header
dtype: string
- name: recitals
dtype: string
- name: main_body
sequence: string
- name: eurovoc_concepts
sequence: string
- name: text
dtype: string
- name: uid
dtype: int64
splits:
- name: train
num_bytes: 269684150
num_examples: 45000
- name: validation
num_bytes: 35266624
num_examples: 6000
- name: test
num_bytes: 35621361
num_examples: 6000
download_size: 0
dataset_size: 340572135
- config_name: embedding_all-MiniLM-L12-v2
features:
- name: uid
dtype: int64
- name: embedding_all-MiniLM-L12-v2
sequence: float32
splits:
- name: train
num_bytes: 69660000
num_examples: 45000
- name: validation
num_bytes: 9288000
num_examples: 6000
- name: test
num_bytes: 9288000
num_examples: 6000
download_size: 123441408
dataset_size: 88236000
- config_name: embedding_all-mpnet-base-v2
features:
- name: uid
dtype: int64
- name: embedding_all-mpnet-base-v2
sequence: float32
splits:
- name: train
num_bytes: 138780000
num_examples: 45000
- name: validation
num_bytes: 18504000
num_examples: 6000
- name: test
num_bytes: 18504000
num_examples: 6000
download_size: 211031101
dataset_size: 175788000
- config_name: embedding_multi-qa-mpnet-base-dot-v1
features:
- name: uid
dtype: int64
- name: embedding_multi-qa-mpnet-base-dot-v1
sequence: float32
splits:
- name: train
num_bytes: 138780000
num_examples: 45000
- name: validation
num_bytes: 18504000
num_examples: 6000
- name: test
num_bytes: 18504000
num_examples: 6000
download_size: 211029593
dataset_size: 175788000
- config_name: eurovoc_concepts
features:
- name: concept_id
dtype: string
- name: title
dtype: string
splits:
- name: train
num_bytes: 205049
num_examples: 7201
download_size: 157326
dataset_size: 205049
---
# Dataset Card for "eurlex-57k"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

配置信息

• 默认配置 (default)

  • 数据文件路径
    • 训练集: data/train-*
    • 验证集: data/validation-*
    • 测试集: data/test-*
  • 特征
    • celex_id: 字符串
    • document_type: 字符串
    • title: 字符串
    • header: 字符串
    • recitals: 字符串
    • main_body: 字符串序列
    • eurovoc_concepts: 字符串序列
    • text: 字符串
    • uid: 64位整数
  • 数据分割
    • 训练集: 45000个样本, 269684150字节
    • 验证集: 6000个样本, 35266624字节
    • 测试集: 6000个样本, 35621361字节
  • 数据集大小
    • 下载大小: 0字节
    • 数据集大小: 340572135字节

• 嵌入配置 (embedding_all-MiniLM-L12-v2)

  • 数据文件路径
    • 训练集: embedding_all-MiniLM-L12-v2/train-*
    • 验证集: embedding_all-MiniLM-L12-v2/validation-*
    • 测试集: embedding_all-MiniLM-L12-v2/test-*
  • 特征
    • uid: 64位整数
    • embedding_all-MiniLM-L12-v2: 32位浮点数序列
  • 数据分割
    • 训练集: 45000个样本, 69660000字节
    • 验证集: 6000个样本, 9288000字节
    • 测试集: 6000个样本, 9288000字节
  • 数据集大小
    • 下载大小: 123441408字节
    • 数据集大小: 88236000字节

• 嵌入配置 (embedding_all-mpnet-base-v2)

  • 数据文件路径
    • 训练集: embedding_all-mpnet-base-v2/train-*
    • 验证集: embedding_all-mpnet-base-v2/validation-*
    • 测试集: embedding_all-mpnet-base-v2/test-*
  • 特征
    • uid: 64位整数
    • embedding_all-mpnet-base-v2: 32位浮点数序列
  • 数据分割
    • 训练集: 45000个样本, 138780000字节
    • 验证集: 6000个样本, 18504000字节
    • 测试集: 6000个样本, 18504000字节
  • 数据集大小
    • 下载大小: 211031101字节
    • 数据集大小: 175788000字节

• 嵌入配置 (embedding_multi-qa-mpnet-base-dot-v1)

  • 数据文件路径
    • 训练集: embedding_multi-qa-mpnet-base-dot-v1/train-*
    • 验证集: embedding_multi-qa-mpnet-base-dot-v1/validation-*
    • 测试集: embedding_multi-qa-mpnet-base-dot-v1/test-*
  • 特征
    • uid: 64位整数
    • embedding_multi-qa-mpnet-base-dot-v1: 32位浮点数序列
  • 数据分割
    • 训练集: 45000个样本, 138780000字节
    • 验证集: 6000个样本, 18504000字节
    • 测试集: 6000个样本, 18504000字节
  • 数据集大小
    • 下载大小: 211029593字节
    • 数据集大小: 175788000字节

• Eurovoc概念配置 (eurovoc_concepts)

  • 数据文件路径
    • 训练集: eurovoc_concepts/train-*
  • 特征
    • concept_id: 字符串
    • title: 字符串
  • 数据分割
    • 训练集: 7201个样本, 205049字节
  • 数据集大小
    • 下载大小: 157326字节
    • 数据集大小: 205049字节