karakuri-ai/karakuri-bench-v0.1
收藏Hugging Face2024-06-13 更新2024-06-22 收录
下载链接：
https://hf-mirror.com/datasets/karakuri-ai/karakuri-bench-v0.1
下载链接
链接失效反馈官方服务：
资源简介：
---
license: apache-2.0
configs:
- config_name: default
data_files: "data/tasks/questions.csv"
---
# karakuri-bench-v0.1
## Usage
### 準備
```sh
export OPENAI_API_KEY="<YOUR_API_KEY>"
```
### 回答生成
```sh
python src/generation/gpt4.py data/tasks/questions.csv data/answers/gpt4.csv
# python src/generation/gpt35.py data/tasks/questions.csv data/answers/gpt35.csv
```
### 生成された回答の評価
```sh
python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt4.csv data/evaluation/gpt4.csv
# python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt35.csv data/evaluation/gpt35.csv
```
---
许可证：Apache-2.0
配置项：
- 配置名称：默认
数据文件："data/tasks/questions.csv"
---
# karakuri-bench-v0.1
## 使用方法
### 准备
sh
export OPENAI_API_KEY="<YOUR_API_KEY>"
### 回答生成
sh
python src/generation/gpt4.py data/tasks/questions.csv data/answers/gpt4.csv
# python src/generation/gpt35.py data/tasks/questions.csv data/answers/gpt35.csv
### 生成回答的评估
sh
python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt4.csv data/evaluation/gpt4.csv
# python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt35.csv data/evaluation/gpt35.csv
提供机构：
karakuri-ai
原始信息汇总
karakuri-bench-v0.1
数据集配置
- 配置名称: default
- 数据文件路径: data/tasks/questions.csv
使用说明
回答生成
-
GPT-4生成脚本: sh python src/generation/gpt4.py data/tasks/questions.csv data/answers/gpt4.csv
-
GPT-3.5生成脚本: sh python src/generation/gpt35.py data/tasks/questions.csv data/answers/gpt35.csv
生成回答的评估
-
GPT-4评估脚本: sh python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt4.csv data/evaluation/gpt4.csv
-
GPT-3.5评估脚本: sh python src/evaluation/main.py data/tasks/questions.csv data/answers/gpt35.csv data/evaluation/gpt35.csv
