OpenScholar/OpenScholar-DataStore-V2
收藏Hugging Face2024-11-18 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/OpenScholar/OpenScholar-DataStore-V2
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含两个主要部分：pes2o-chunks-32-shards和pes2o-embs-32-shards。pes2o-chunks-32-shards目录包含peS2o V2的嵌入数据，而pes2o-embs-32-shards目录包含与这些嵌入数据对应的文本块。两部分数据都被分割成32个分片，便于处理和分析。
This dataset consists of two main parts: pes2o-chunks-32-shards and pes2o-embs-32-shards. The pes2o-chunks-32-shards directory contains embeddings for peS2o V2, while the pes2o-embs-32-shards directory contains the corresponding text chunks for these embeddings. Both parts of the data are split into 32 shards for easier processing and analysis.
提供机构：
OpenScholar
