WikiDBs 10k - A Corpus Of Relational Databases From Wikidata

WikiDBs-10k (https://wikidbs.github.io/) is a corpus of relational databases built from Wikidata (https://www.wikidata.org/). This is the preliminary 10k version, the newer version of 100k databases (https://zenodo.org/records/11559814) includes more coherent databases and more diverse table and column names. The WikiDBs-10k corpus consists of 10,000 databases, for more details read our paper: https://ceur-ws.org/Vol-3462/TADA3.pdf (TaDA@VLDB'23) Each database is saved in a sub-folder, the table files are provided as csv files and the database schema as a json file. We thank Till Döhmen and Madelon Hulsebos for generously providing the table statistics from their GitSchemas dataset and Jan-Micha Bodensohn for converting the dataset to SQLite files. This work has been supported by the BMBF and the state of Hesse as part of the NHR Program and the BMBF project KompAKI (grant number 02L19C150), as well as the HMWK cluster project 3AI. Finally, we want to thank hessian.AI, and DFKI Darmstadt for their support.WikiDBs-10k（https://wikidbs.github.io/）是一套基于维基数据（Wikidata，https://www.wikidata.org/）构建的关系型数据库语料库。本版本为初始10k规模版本，后续推出的10万级数据库新版本（https://zenodo.org/records/11559814）包含了更具一致性的数据库集合，以及更多样化的表与列命名规则。WikiDBs-10k语料库共计包含10000个数据库，如需了解更多细节，请参阅我们的论文：https://ceur-ws.org/Vol-3462/TADA3.pdf（TaDA@VLDB'23）。每个数据库均存储于独立子文件夹中，表文件以逗号分隔值（CSV）格式提供，数据库模式以JavaScript对象表示法（JSON）文件形式存储。我们谨向Till Döhmen与Madelon Hulsebos致谢，感谢他们慷慨分享其GitSchemas数据集中的表统计信息；同时感谢Jan-Micha Bodensohn将本数据集转换为SQLite文件格式。本研究得到了德国联邦教育与研究部（BMBF）及黑森州的资助支持，相关项目属于国家高性能计算（NHR）计划范畴，同时也获得了BMBF资助的KompAKI项目（资助编号：02L19C150）以及黑森州科学与艺术部（HMWK）的3AI集群项目支持。最后，我们谨向hessian.AI与德国人工智能研究中心达姆施塔特分部（DFKI Darmstadt）致谢，感谢他们的支持。