CoIR-Retrieval/codefeedback-st-queries-corpus

---
dataset_info:
features:
- name: _id
dtype: string
- name: partition
dtype: string
- name: text
dtype: string
- name: title
dtype: string
- name: language
dtype: string
- name: meta_information
struct:
- name: resource
dtype: string
splits:
- name: queries
num_bytes: 118682563
num_examples: 156526
- name: corpus
num_bytes: 246229656
num_examples: 156526
download_size: 181151457
dataset_size: 364912219
---
Employing the CoIR evaluation framework's dataset version, utilize the code below for assessment:
```python
import coir
from coir.data_loader import get_tasks
from coir.evaluation import COIR
from coir.models import YourCustomDEModel

model_name = "intfloat/e5-base-v2"

# Load the model
model = YourCustomDEModel(model_name=model_name)

# Get tasks
#all task ["codetrans-dl","stackoverflow-qa","apps","codefeedback-mt","codefeedback-st","codetrans-contest","synthetic-
# text2sql","cosqa","codesearchnet","codesearchnet-ccr"]
tasks = get_tasks(tasks=["codetrans-dl"])

# Initialize evaluation
evaluation = COIR(tasks=tasks,batch_size=128)

# Run evaluation
results = evaluation.run(model, output_folder=f"results/{model_name}")
print(results)
```

原始信息汇总

数据集概述

数据集名称

codefeedback-st-queries-corpus

数据集特征

• _id: 字符串类型
• partition: 字符串类型
• text: 字符串类型
• title: 字符串类型
• language: 字符串类型
• meta_information: 结构体类型
  • resource: 字符串类型

数据集分割

• queries:
  • 字节数: 118682563
  • 样本数: 156526
• corpus:
  • 字节数: 246229656
  • 样本数: 156526

数据集大小

• 下载大小: 181151457 字节
• 数据集总大小: 364912219 字节