Transluce/input_ablation_llama_3.1_8b_instruct_mmlu_hint

该数据集包含一系列问题和选择题，涉及零样本预测、随机提示预测、提示标记ID、原始提示和提示提示等内容。数据集分为训练集和测试集，训练集包含12642个样本，测试集包含1400个样本。每个样本包含索引、问题、选项、正确答案、零样本预测、随机提示预测、提示标记ID、原始提示完整内容、提示提示完整内容、系统提示、原始用户提示、提示用户提示、提示、是否因提示改变预测以及消融提示等特征。

This dataset includes a series of questions and multiple-choice items, covering zero-shot predictions, random hint predictions, hint token IDs, original prompts, and hint prompts. The dataset is divided into training and test sets, with the training set containing 12,642 samples and the test set containing 1,400 samples. Each sample includes features such as index, question, choices, correct answer, zero-shot prediction, random hint prediction, hint token IDs, original prompt full content, hint prompt full content, system prompt, original user prompt, hint user prompt, hint, whether the prediction changed due to the hint, and ablation prompt.