imminsik/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_gpt2_1757480907

这是一个用于OpenAI的Summarize from Feedback任务的SFT数据集，包含了Reddit上的帖子及其相关信息。数据集字段包括帖子的唯一标识符、所属子版块、标题、帖子内容、摘要以及参考回复。此外，预处理脚本还添加了用于摘要的限定长度的查询、查询的标记化版本、参考回复的标记化版本、参考回复标记化长度、查询与参考回复的拼接以及拼接后的标记化版本和长度。This is an SFT dataset for OpenAIs Summarize from Feedback task, containing posts from Reddit and their related information. Dataset fields include a unique identifier for the post, the subreddit it belongs to, the title of the post, the body of the post, the summary, and the reference response. In addition, the preprocessing script adds a length-limited query for summarization, the tokenized version of the query, the tokenized version of the reference response, the length of the tokenized reference response, the concatenation of the query and the reference response, the tokenized version of the concatenated query and reference response, and the length of the tokenized concatenation.