Sorted Unsigned Integer Datasets
收藏资源简介:
This page contains some well-known datasets (and some original ones) for sorted unsigned 32/64 bit integers. Most of them come from the SOSD learned index benchmark (https://github.com/learnedsystems/SOSD), but a few were generated by "flattening" adjacency lists of graphs. All binary datasets have a 64-bit preamble containing the dataset size. The filename always ends with uint32 or uint64, specifying the number of bits used for storing the integers. Specifics about the single datasets will follow: books_200M_uint32: "amzn" dataset from SOSD books_800M_uint64: larger slice (and 64-bit version) of the "amzn" dataset in SOSD companynet_uint32: flattened adjacency list of a proprietary (companies) network. Its size is 1 million items. exponential_uint32: 50 million integer dataset following an exponential distribution (z=2, all items then multiplied by uint32_max/5). fb_200M_uint64: "fb" dataset from SOSD. friendster_50M_uint32: flattened adjacency list of the "friendster" network from https://snap.stanford.edu/data/com-Friendster.html. lognormal_uint32: 50 million integer dataset following a lognormal distribution (mu = 0, sigma = 0.5, all items then multiplied by uint32_max/5). normal_800M_uint32: 800 million integer dataset following a normal distribution (mu = uint32_max/2, sigma = uint32_max/4). normal_uint32: 50 million integer dataset following a normal distribution (mu = uint32_max/2, sigma = uint32_max/4). osm_cellids_800M_uint64: "osm" dataset from SOSD. wiki_ts_200M_uint32: "wiki" dataset from SOSD, but integers are all cast to 32 bits. wiki_ts_200M_uint64: "wiki" dataset from SOSD. zipf_uint32: 50 million integer dataset following a Zipf distribution (q = 0.7, max_val = uint32_max/2). books_50M_uint64: 50M slice of the 64-bit "amzn" dataset from SOSD
本页面收录了一批面向无符号32位/64位有序整数的知名数据集(含部分原创数据集)。其中绝大多数源自SOSD学习型索引基准测试集(https://github.com/learnedsystems/SOSD),剩余少量数据集则通过对图的邻接表进行"扁平化"处理生成。 所有二进制数据集均包含一个64位前置字段,用于存储数据集的总规模。文件名始终以uint32或uint64结尾,用以标识存储整数所采用的比特位数。 各数据集的详细说明如下: `books_200M_uint32`:源自SOSD的"amzn"数据集。 `books_800M_uint64`:SOSD中"amzn"数据集的更大分块(同时为64位版本)。 `companynet_uint32`:某专有企业网络的扁平化邻接表,共包含100万条数据项。 `exponential_uint32`:遵循指数分布的5000万条整数数据集(参数z=2,所有数据项均乘以无符号32位整数最大值(uint32_max)/5后得到)。 `fb_200M_uint64`:源自SOSD的"fb"数据集。 `friendster_50M_uint32`:源自https://snap.stanford.edu/data/com-Friendster.html的"Friendster"社交网络的扁平化邻接表。 `lognormal_uint32`:遵循对数正态分布的5000万条整数数据集(参数μ=0,σ=0.5,所有数据项均乘以uint32_max/5后得到)。 `normal_800M_uint32`:遵循正态分布的8亿条整数数据集(参数μ=uint32_max/2,σ=uint32_max/4)。 `normal_uint32`:遵循正态分布的5000万条整数数据集(参数μ=uint32_max/2,σ=uint32_max/4)。 `osm_cellids_800M_uint64`:源自SOSD的"osm"数据集。 `wiki_ts_200M_uint32`:源自SOSD的"wiki"数据集,其中所有整数均被转换为32位格式。 `wiki_ts_200M_uint64`:源自SOSD的"wiki"数据集。 `zipf_uint32`:遵循齐普夫(Zipf)分布的5000万条整数数据集(参数q=0.7,最大值为uint32_max/2)。 `books_50M_uint64`:SOSD中64位"amzn"数据集的5000万分块。



