avsolatorio/mteb-imdb-avs_triplets

---
dataset_info:
features:
- name: text
dtype: string
- name: label
dtype: int64
- name: label_text
dtype: string
- name: idx
dtype: int64
- name: query_idx
dtype: int64
- name: positive_idx
dtype: int64
- name: negative_idx
dtype: int64
splits:
- name: train
num_bytes: 34532823
num_examples: 25000
download_size: 22310051
dataset_size: 34532823
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
# MTEB IMDB Triplets Dataset

This dataset was used in the paper GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning. Refer to https://arxiv.org/abs/2402.16829 for details.

The code for generating the data is available at https://github.com/avsolatorio/GISTEmbed/blob/main/scripts/create_classification_dataset.py.

## Citation
```
@article{solatorio2024gistembed,
title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning},
author={Aivin V. Solatorio},
journal={arXiv preprint arXiv:2402.16829},
year={2024},
URL={https://arxiv.org/abs/2402.16829}
eprint={2402.16829},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
```

原始信息汇总

MTEB IMDB Triplets Dataset

数据集信息

特征

• text: 数据类型为字符串（string）
• label: 数据类型为64位整数（int64）
• label_text: 数据类型为字符串（string）
• idx: 数据类型为64位整数（int64）
• query_idx: 数据类型为64位整数（int64）
• positive_idx: 数据类型为64位整数（int64）
• negative_idx: 数据类型为64位整数（int64）

数据分割

• train: 包含25000个样本，总字节数为34532823

数据大小

• 下载大小: 22310051字节
• 数据集大小: 34532823字节

配置

• default: 包含训练数据文件，路径为data/train-*

引用

@article{solatorio2024gistembed, title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning}, author={Aivin V. Solatorio}, journal={arXiv preprint arXiv:2402.16829}, year={2024}, URL={https://arxiv.org/abs/2402.16829}, eprint={2402.16829}, archivePrefix={arXiv}, primaryClass={cs.LG} }