tatsu-lab/linguistic_calibration

---
license: cc-by-nc-4.0
configs:
- config_name: trivia_qa_paragraph_generation
data_files:
- split: sft
path: "trivia_qa_paragraph_generation/sft_10k.csv"
- split: reward_model
path: "trivia_qa_paragraph_generation/reward_model_20k.csv"
- split: prompt_validation
path: "trivia_qa_paragraph_generation/prompt_validation_1k.csv"
- split: ppo
path: "trivia_qa_paragraph_generation/ppo_40k.csv"
- split: ppo_validation
path: "trivia_qa_paragraph_generation/ppo_validation_1k.csv"
- split: validation
path: "trivia_qa_paragraph_generation/validation_1k.csv"
- split: test
path: "trivia_qa_paragraph_generation/test_11k.csv"
- config_name: jeopardy_paragraph_generation
data_files:
- split: test
path: "jeopardy_paragraph_generation/test.csv"
- config_name: sft_training
data_files:
- split: train
path: "sft_training.csv"
- config_name: reward_model_training
data_files:
- split: train
path: "reward_model_training.csv"
- config_name: sciq_paragraph_generation
data_files:
- split: test
path: sciq_paragraph_generation/test.csv
- config_name: bioasq_paragraph_generation
data_files:
- split: test
path: bioasq_paragraph_generation/test.csv
---

This Datasets repo contains training and evaluation datasets for the paper "Linguistic Calibration of Long-Form Generations".

Please refer to our GitHub repo at https://github.com/tatsu-lab/linguistic_calibration for more information, and check out our paper for our research findings: https://arxiv.org/abs/2404.00474

原始信息汇总

数据集概述

数据集名称及配置

1. trivia_qa_paragraph_generation

   • sft: trivia_qa_paragraph_generation/sft_10k.csv
   • reward_model: trivia_qa_paragraph_generation/reward_model_20k.csv
   • prompt_validation: trivia_qa_paragraph_generation/prompt_validation_1k.csv
   • ppo: trivia_qa_paragraph_generation/ppo_40k.csv
   • ppo_validation: trivia_qa_paragraph_generation/ppo_validation_1k.csv
   • validation: trivia_qa_paragraph_generation/validation_1k.csv
   • test: trivia_qa_paragraph_generation/test_11k.csv

2. jeopardy_paragraph_generation

   • test: jeopardy_paragraph_generation/test.csv

3. sft_training

   • train: sft_training.csv

4. reward_model_training

   • train: reward_model_training.csv

5. sciq_paragraph_generation

   • test: sciq_paragraph_generation/test.csv

6. bioasq_paragraph_generation

   • test: bioasq_paragraph_generation/test.csv

许可证

• cc-by-nc-4.0