sentence-transformers/reddit

该数据集包含从Reddit-Title-Body数据集中收集的Reddit帖子的标题和正文。数据经过了一系列过滤条件，包括移除点赞率低于0.5的帖子、标题长度大于25字符且正文长度在一定范围内的帖子、以及至少包含3条评论或3个点赞的帖子。数据集的一个子集`pair`包含两列数据：title和body，均为字符串类型。

原始信息汇总

数据集概述

基本信息

• 语言: 英语
• 多语言性: 单语种
• 大小: 100M<n<1B
• 任务类别: 特征提取, 句子相似度
• 名称: Reddit
• 标签: sentence-transformers

数据集配置

• 配置名称: pair
• 特征:
  • title: 字符串类型
  • body: 字符串类型

数据集分割

• 训练集:
  • 字节数: 91941517956
  • 示例数: 127445911

下载大小与数据集大小

• 下载大小: 61672419296
• 数据集大小: 91941517956

数据集子集

• 子集名称: pair

  • 列: "title", "body"

  • 列类型: str, str

  • 示例: python { title: Has anybody else watched Kings?, body: "I know its not SciFi per se, but I thought this kind of "big concept" show might appeal to the same group. I hadnt heard of it, but Hulu recommended it to me, and I ended up watching the entire thing over a couple of days. I thought it was absolutely fantastic, and Im really bummed that it wont be coming back. Ive been recommending it to everyone I know, but I havent found anyone else whos watched it! Did anybody here? If so, what did people think? EDIT: P.S. Its all available on Hulu!", }

  • 收集策略: 合并Reddit-Title-Body dataset中的所有文件

  • 去重: 否