GitTables benchmark - column type detection
收藏资源简介:
<strong>Note: the download page of the entire GitTables corpus is here: https://zenodo.org/record/4943312.</strong> This dataset represents a <strong>small subset</strong> of tables from GitTables curated for benchmarking column type detection methods. This benchmark evaluates systems that match table columns to semantic types from the DBpedia and Schema.org ontologies. It is featured in the SemTab 2021 challenge (CTA task). This dataset consists of the following files: “tables.zip”: directory with a sample of 1101 tables from GitTables. Filenames correspond to table IDs, the first column (without column name) corresponds to row indices, column names are replaced with "col_0", "col_1", etc. which match to the targets and labels (semantic types). “<ontology>_targets.csv”: target columns per table ID, 1 file per ontology (DBpedia or Schema.org): columns are “table_id” (ignore the "_<ontology>" suffix) and “target_column” (i.e. the column that should be annotated). “<ontology>_gt.csv”: ground truth column annotations per table ID, 1 file per ontology: columns are “table_id” (ignore the _<ontology> suffix), “target_column”, “annotation_id”, “annotation_label”. “<ontology>_labels.csv”: unique labels present in the annotated tables, 1 file per ontology: columns are “annotation_id” and “annotation_label”. The labels (semantic types) from each ontology come from: DBpedia: only properties from the DBpedia ontology. Schema.org: properties and types from Schema.org. For the entire GitTables corpus, please refer to this dataset. Visit https://gittables.github.io for more background and contact details.
注意:完整GitTables语料库的下载页面为:https://zenodo.org/record/4943312。本数据集为GitTables中用于基准测试列类型检测方法的小型子集。该基准测试用于评估可将表格列匹配至DBpedia与Schema.org本体(ontology)中语义类型的系统,是SemTab 2021挑战赛CTA任务的指定测试集。本数据集包含以下文件: "tables.zip":包含来自GitTables的1101张表格样本的目录。文件名对应表格ID,第一列(无列名)为行索引,列名被替换为"col_0"、"col_1"等格式,与目标集及标签(语义类型)一一对应。 "<ontology>_targets.csv":每个表格ID对应的目标列,每个本体(DBpedia或Schema.org)对应一个文件,列字段包括"table_id"(忽略"_<ontology>"后缀)与"target_column"(即需标注的列)。 "<ontology>_gt.csv":每个表格ID对应的真实列标注,每个本体对应一个文件,列字段包括"table_id"(忽略"_<ontology>"后缀)、"target_column"、"annotation_id"、"annotation_label"。 "<ontology>_labels.csv":标注表格中出现的唯一标签,每个本体对应一个文件,列字段包括"annotation_id"与"annotation_label"。 各本体的标签(语义类型)来源如下:DBpedia仅使用DBpedia本体中的属性;Schema.org使用Schema.org的属性与类型。如需获取完整GitTables语料库,请参考本数据集。更多背景信息与联系方式请访问https://gittables.github.io。



