imminsik/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_gpt2_1757517007
收藏数据链接:
官方服务:
资源简介:
该数据集是从OpenAI的Summarize from Feedback任务中直接获取的Reddit TL;DR数据集。数据集包含帖子的唯一标识符、来源subreddit、标题、帖子内容、摘要以及参考回复。此外,预处理脚本添加了长度限制的查询、查询的标记化版本、参考回复的标记化版本、查询与参考回复的拼接及其标记化版本等信息。
The dataset is directly taken from OpenAIs Summarize from Feedback task Reddit TL;DR dataset. It includes unique identifier for the post, the subreddit it was taken from, the title of the post, the body of the post, the summary, and the reference response. Additionally, the preprocessing script adds a length-limited query, tokenized version of the query, tokenized version of the reference response, concatenation of the query and reference response and its tokenized version.
提供机构:
imminsik


