gqd/textfiles.com

---
language:
- en
---

textfiles.com files processed with llms to extract metadata per file, mainly to
get document dates, but also author and title

thank you for textfiles.com jason scott, if you want me to take this down for
any reason i will do so

## coverage

| # | Category | Should | Is | % |
| -- | ----------- | ------ | ----- | ------ |
| 1 | magazines | 10918 | 1280 | 11.7% |
| 2 | ufo | 2934 | 894 | 30.5% |
| 3 | internet | 852 | 195 | 22.9% |
| 4 | humor | 2067 | 1823 | 88.2% |
| 5 | sf | 636 | 510 | 80.2% |
| 6 | groups | 1290 | 1184 | 91.8% |
| 7 | politics | 2200 | 2145 | 97.5% |
| 8 | history | 103 | 52 | 50.5% |
| 9 | apple | 1562 | 1519 | 97.2% |
| 10 | hacking | 1116 | 1074 | 96.2% |
| 11 | games | 988 | 951 | 96.3% |
| 12 | programming | 608 | 579 | 95.2% |
| 13 | computers | 1702 | 1680 | 98.7% |
| 14 | virus | 548 | 530 | 96.7% |
| 15 | reports | 715 | 698 | 97.6% |
| 16 | exhibits | 14 | 2 | 14.3% |
| 17 | drugs | 1050 | 1041 | 99.1% |
| 18 | fun | 433 | 425 | 98.2% |
| 19 | adventure | 552 | 546 | 98.9% |
| 20 | art | 661 | 657 | 99.4% |
| 21 | hamradio | 639 | 635 | 99.4% |
| 22 | science | 280 | 276 | 98.6% |
| 23 | conspiracy | 1113 | 1111 | 99.8% |
| 24 | holiday | 74 | 73 | 98.6% |
| 25 | law | 534 | 533 | 99.8% |
| 26 | news | 185 | 184 | 99.5% |
| 27 | rpg | 301 | 300 | 99.7% |
| 28 | stories | 477 | 476 | 99.8% |
| 29 | uploads | 561 | 560 | 99.8% |
| 30 | anarchy | 2521 | 2521 | 100.0% |
| 31 | food | 214 | 214 | 100.0% |
| 32 | media | 167 | 167 | 100.0% |
| 33 | music | 613 | 613 | 100.0% |
| 34 | occult | 2417 | 2417 | 100.0% |
| 35 | phreak | 2206 | 2206 | 100.0% |
| 36 | sex | 5255 | 5255 | 100.0% |
| 37 | survival | 106 | 106 | 100.0% |
| 38 | messages | 1552 | 1554 | 100.1% |
| 39 | bbs | 5308 | 5327 | 100.4% |
| 40 | piracy | 2535 | 2555 | 100.8% |
| | TOTAL | 58007 | 44868 | 77.3% |

## dates

| Category | Year Only | Year+Month | Year+Month+Day | No Date | Total |
| ----------- | ----------- | ----------- | -------------- | ------------- | ----- |
| bbs | 444 | 119 | 3350 | 1414 | 5327 |
| piracy | 89 | 10 | 1243 | 1213 | 2555 |
| magazines | 121 | 301 | 730 | 128 | 1280 |
| computers | 47 | 26 | 631 | 976 | 1680 |
| ufo | 145 | 93 | 349 | 307 | 894 |
| messages | 243 | 1 | 297 | 1013 | 1554 |
| phreak | 128 | 92 | 296 | 1690 | 2206 |
| occult | 196 | 0 | 282 | 1939 | 2417 |
| apple | 96 | 1 | 225 | 1197 | 1519 |
| sf | 48 | 16 | 220 | 226 | 510 |
| programming | 62 | 92 | 208 | 217 | 579 |
| music | 52 | 39 | 183 | 339 | 613 |
| drugs | 23 | 14 | 174 | 830 | 1041 |
| internet | 1 | 3 | 170 | 21 | 195 |
| science | 20 | 13 | 170 | 73 | 276 |
| uploads | 58 | 25 | 160 | 317 | 560 |
| conspiracy | 101 | 85 | 148 | 777 | 1111 |
| politics | 362 | 105 | 141 | 1537 | 2145 |
| games | 51 | 16 | 134 | 750 | 951 |
| humor | 15 | 13 | 134 | 1661 | 1823 |
| news | 13 | 14 | 110 | 47 | 184 |
| groups | 63 | 23 | 100 | 998 | 1184 |
| anarchy | 279 | 17 | 98 | 2127 | 2521 |
| hamradio | 15 | 26 | 96 | 498 | 635 |
| fun | 1 | 0 | 91 | 333 | 425 |
| hacking | 17 | 21 | 90 | 946 | 1074 |
| virus | 57 | 74 | 82 | 317 | 530 |
| media | 7 | 14 | 78 | 68 | 167 |
| food | 23 | 9 | 48 | 134 | 214 |
| stories | 135 | 5 | 40 | 296 | 476 |
| adventure | 25 | 2 | 37 | 482 | 546 |
| rpg | 31 | 6 | 36 | 227 | 300 |
| history | 11 | 12 | 23 | 6 | 52 |
| sex | 579 | 5 | 22 | 4649 | 5255 |
| holiday | 7 | 2 | 18 | 46 | 73 |
| law | 24 | 29 | 17 | 463 | 533 |
| reports | 2 | 566 | 13 | 117 | 698 |
| survival | 20 | 15 | 10 | 61 | 106 |
| art | 13 | 25 | 4 | 615 | 657 |
| exhibits | 0 | 1 | 1 | 0 | 2 |
| TOTAL | 3624 (8.1%) | 1930 (4.3%) | 10259 (22.9%) | 29055 (64.8%) | 44868 |

### 数据集语言
- 英语

本数据集针对textfiles.com平台的文件，通过大语言模型（Large Language Model，LLM）为每份文件提取元数据，核心目标为获取文档的发布日期，同时同步提取作者与标题信息。
谨此感谢textfiles.com的Jason Scott，若因任何原因需要下架本数据集，我方将予以配合。

---

## 覆盖范围
| 序号 | 分类 | 应处理数量 | 实际处理数量 | 完成占比 |
| ---- | ---------- | ---------- | ------------ | -------- |
| 1 | 杂志 | 10918 | 1280 | 11.7% |
| 2 | 不明飞行物（UFO） | 2934 | 894 | 30.5% |
| 3 | 互联网 | 852 | 195 | 22.9% |
| 4 | 幽默 | 2067 | 1823 | 88.2% |
| 5 | 科幻（SF） | 636 | 510 | 80.2% |
| 6 | 群组 | 1290 | 1184 | 91.8% |
| 7 | 政治 | 2200 | 2145 | 97.5% |
| 8 | 历史 | 103 | 52 | 50.5% |
| 9 | 苹果 | 1562 | 1519 | 97.2% |
| 10 | 黑客 | 1116 | 1074 | 96.2% |
| 11 | 游戏 | 988 | 951 | 96.3% |
| 12 | 编程 | 608 | 579 | 95.2% |
| 13 | 计算机 | 1702 | 1680 | 98.7% |
| 14 | 病毒 | 548 | 530 | 96.7% |
| 15 | 报告 | 715 | 698 | 97.6% |
| 16 | 展览 | 14 | 2 | 14.3% |
| 17 | 药物/毒品 | 1050 | 1041 | 99.1% |
| 18 | 娱乐 | 433 | 425 | 98.2% |
| 19 | 冒险 | 552 | 546 | 98.9% |
| 20 | 艺术 | 661 | 657 | 99.4% |
| 21 | 业余无线电（HAM Radio） | 639 | 635 | 99.4% |
| 22 | 科学 | 280 | 276 | 98.6% |
| 23 | 阴谋论 | 1113 | 1111 | 99.8% |
| 24 | 假日 | 74 | 73 | 98.6% |
| 25 | 法律 | 534 | 533 | 99.8% |
| 26 | 新闻 | 185 | 184 | 99.5% |
| 27 | 角色扮演游戏（RPG） | 301 | 300 | 99.7% |
| 28 | 故事 | 477 | 476 | 99.8% |
| 29 | 上传文件 | 561 | 560 | 99.8% |
| 30 | 无政府主义 | 2521 | 2521 | 100.0% |
| 31 | 食物 | 214 | 214 | 100.0% |
| 32 | 媒体 | 167 | 167 | 100.0% |
| 33 | 音乐 | 613 | 613 | 100.0% |
| 34 | 神秘学 | 2417 | 2417 | 100.0% |
| 35 | 电话破解（Phreak） | 2206 | 2206 | 100.0% |
| 36 | 性内容 | 5255 | 5255 | 100.0% |
| 37 | 生存技巧 | 106 | 106 | 100.0% |
| 38 | 消息 | 1552 | 1554 | 100.1% |
| 39 | 电子公告板系统（BBS） | 5308 | 5327 | 100.4% |
| 40 | 盗版 | 2535 | 2555 | 100.8% |
| | 总计 | 58007 | 44868 | 77.3% |

---

## 日期分布
| 分类 | 仅年份 | 年份+月份 | 年份+月份+日期 | 无日期 | 总计 |
| -------------------------- | ------ | --------- | ------------- | ------ | ----- |
| 电子公告板系统（BBS） | 444 | 119 | 3350 | 1414 | 5327 |
| 盗版 | 89 | 10 | 1243 | 1213 | 2555 |
| 杂志 | 121 | 301 | 730 | 128 | 1280 |
| 计算机 | 47 | 26 | 631 | 976 | 1680 |
| 不明飞行物（UFO） | 145 | 93 | 349 | 307 | 894 |
| 消息 | 243 | 1 | 297 | 1013 | 1554 |
| 电话破解（Phreak） | 128 | 92 | 296 | 1690 | 2206 |
| 神秘学 | 196 | 0 | 282 | 1939 | 2417 |
| 苹果 | 96 | 1 | 225 | 1197 | 1519 |
| 科幻（SF） | 48 | 16 | 220 | 226 | 510 |
| 编程 | 62 | 92 | 208 | 217 | 579 |
| 音乐 | 52 | 39 | 183 | 339 | 613 |
| 药物/毒品 | 23 | 14 | 174 | 830 | 1041 |
| 互联网 | 1 | 3 | 170 | 21 | 195 |
| 科学 | 20 | 13 | 170 | 73 | 276 |
| 上传文件 | 58 | 25 | 160 | 317 | 560 |
| 阴谋论 | 101 | 85 | 148 | 777 | 1111 |
| 政治 | 362 | 105 | 141 | 1537 | 2145 |
| 游戏 | 51 | 16 | 134 | 750 | 951 |
| 幽默 | 15 | 13 | 134 | 1661 | 1823 |
| 新闻 | 13 | 14 | 110 | 47 | 184 |
| 群组 | 63 | 23 | 100 | 998 | 1184 |
| 无政府主义 | 279 | 17 | 98 | 2127 | 2521 |
| 业余无线电（HAM Radio） | 15 | 26 | 96 | 498 | 635 |
| 娱乐 | 1 | 0 | 91 | 333 | 425 |
| 黑客 | 17 | 21 | 90 | 946 | 1074 |
| 病毒 | 57 | 74 | 82 | 317 | 530 |
| 媒体 | 7 | 14 | 78 | 68 | 167 |
| 食物 | 23 | 9 | 48 | 134 | 214 |
| 故事 | 135 | 5 | 40 | 296 | 476 |
| 冒险 | 25 | 2 | 37 | 482 | 546 |
| 角色扮演游戏（RPG） | 31 | 6 | 36 | 227 | 300 |
| 历史 | 11 | 12 | 23 | 6 | 52 |
| 性内容 | 579 | 5 | 22 | 4649 | 5255 |
| 假日 | 7 | 2 | 18 | 46 | 73 |
| 法律 | 24 | 29 | 17 | 463 | 533 |
| 报告 | 2 | 566 | 13 | 117 | 698 |
| 生存技巧 | 20 | 15 | 10 | 61 | 106 |
| 艺术 | 13 | 25 | 4 | 615 | 657 |
| 展览 | 0 | 1 | 1 | 0 | 2 |
| **总计** | 3624 (8.1%) | 1930 (4.3%) | 10259 (22.9%) | 29055 (64.8%) | 44868 |