s-nlp/hotpotqa-dev-llama3.1-8b-instruct-temp0.9-samples99-logprobs
收藏Hugging Face2026-03-23 更新2026-03-29 收录
下载链接：
https://hf-mirror.com/datasets/s-nlp/hotpotqa-dev-llama3.1-8b-instruct-temp0.9-samples99-logprobs
下载链接
链接失效反馈官方服务：
资源简介：
---
license: mit
task_categories:
- text-generation
- question-answering
language:
- en
pretty_name: HotpotQA Llama 3.1 8B Self-Consistency Samples with Post-hoc Logprobs
tags:
- hotpotqa
- self-consistency
- logprobs
- llama-3.1
- reasc
---
# HotpotQA Llama 3.1 8B Self-Consistency Samples with Post-hoc Logprobs
This dataset contains the HotpotQA self-consistency generations for Llama 3.1 8B with post-hoc token-level log-probabilities added for each sampled completion.
Source generations:
- `memyprokotow/hotpotqa_dev_Llama3.1-8b-instruct_temp0.9_samples99`
Scoring model:
- `unsloth/Llama-3.1-8B-Instruct`
Main file:
- `predictions.parquet`
Auxiliary file:
- `merge_metadata.json`
Important columns:
- `question`
- `answer`
- `all_completions`
- `all_logprobs`
- `final_answer`
- `num_scored_completions`
Notes:
- `all_logprobs[i]` contains token-level log-probabilities for `all_completions[i]`.
- This artifact was produced by post-hoc scoring stored completions rather than by regenerating the samples.
提供机构：
s-nlp
