TeleChat-PTD
收藏OpenXLab2026-04-18 收录
下载链接:
https://openxlab.org.cn/datasets/OpenDataLab/TeleChat-PTD
下载链接
链接失效反馈官方服务:
资源简介:
"TeleChat-PTD is a comprehensive large-scale Chinese data set extracted from the TeleChat pre-training corpus of the Telecom Xingchen large model. The data mainly comes from web pages, books, official media, etc. We used the rule + model method to conduct relevant Filter and perform similarity deduplication on the data to extract high-quality data as much as possible.
The TeleChat-PTD data set exposes approximately 270 million pieces of data. The data consists of pure Chinese text, with an original size of approximately 1TB and a compressed size of 480G, with a total of 189 files. Other redundant information has been removed from the data set. "
提供机构:
OpenDataLab
创建时间:
2024-05-14



