avsolatorio/mteb-amazon_reviews_multi-avs_triplets

---
dataset_info:
features:
- name: id
dtype: string
- name: text
dtype: string
- name: label
dtype: int32
- name: label_text
dtype: string
- name: idx
dtype: int64
- name: query_idx
dtype: int64
- name: positive_idx
dtype: int64
- name: negative_idx
dtype: int64
splits:
- name: train
num_bytes: 52924802
num_examples: 200000
download_size: 33545313
dataset_size: 52924802
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
# MTEB Amazon Reviews Multi Dataset

This dataset was used in the paper GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning. Refer to https://arxiv.org/abs/2402.16829 for details.

The code for generating the data is available at https://github.com/avsolatorio/GISTEmbed/blob/main/scripts/create_classification_dataset.py.

## Citation
```
@article{solatorio2024gistembed,
title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning},
author={Aivin V. Solatorio},
journal={arXiv preprint arXiv:2402.16829},
year={2024},
URL={https://arxiv.org/abs/2402.16829}
eprint={2402.16829},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
```

原始信息汇总

数据集概述

数据集信息

特征

• id: 字符串类型
• text: 字符串类型
• label: 32位整数类型
• label_text: 字符串类型
• idx: 64位整数类型
• query_idx: 64位整数类型
• positive_idx: 64位整数类型
• negative_idx: 64位整数类型

数据分割

• train:
  • 字节数: 52924802
  • 样本数: 200000

数据大小

• 下载大小: 33545313
• 数据集大小: 52924802

配置

• default:
  • 数据文件:
    • 分割: train
    • 路径: data/train-*