yguooo/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_pythia_scene3

该数据集直接取自OpenAI的Summarize from Feedback任务，具体来源于GitHub上的一个特定版本。数据集包含多个特征，如id、subreddit、title、post、summary等，这些特征直接来源于原始数据集。通过预处理脚本添加了一些新的特征，如query、query_token、reference_response_token等，这些特征主要用于处理文本的token化和长度限制。数据集分为训练集、验证集和测试集，每个集的大小和示例数量都有详细说明。The dataset is directly taken from OpenAIs Summarize from Feedback task, specifically from a particular version on GitHub. It includes several features such as id, subreddit, title, post, summary, etc., which are directly sourced from the original dataset. Additional features like query, query_token, reference_response_token, etc., were added through a preprocessing script, primarily for handling text tokenization and length constraints. The dataset is divided into training, validation, and test sets, with detailed specifications on the size and number of examples for each set.