Tab2Know evaluation data

Evaluation data for the paper "Tab2Know: Building a Knowledge Base from Tables in Scientific Papers" published at ISWC2020. For code, see https://github.com/karmaresearch/tab2know . This resource contains the following files: - `venues.txt`: The venues that were use for selecting PDFs from the [Semantic Scholar Open Research Corpus](http://s2-public-api-prod.us-west-2.elasticbeanstalk.com/corpus/) that were published in the last 5 years. - `extracted-tables.tar.gz`: All tables that we extracted using [Tabula](https://github.com/tabulapdf/tabula) from these PDFs. - `sample-400.tar.gz`: A sample of these tables which we used for annotation. - `ontology.ttl`: The annotation ontology in Turtle format. - `all_metadata.jsonl`: Annotations for this sample in the JSON format described below. - `labelqueries.csv`: The label queries used for weak annotation, created using the annotation interface. This CSV file contains 6 columns: a numeric ID, the label query template name (`template`), the template slots (`slots`), the label type (`label`), the annotation value (`value`), and a toggle for the interface (`enabled`). - `labelqueries-sparql-templates.zip`: The label query templates. These are SPARQL queries with slots of the form `{{slot}}`. The templates in `labelqueries.csv` refer to these files. - `rules.txt`: Datalog rules that we used for entity resolution. - `tab2know-graph.nt.gz`: The final RDF graph that contains all extracted table structures, predicted table and column classes, and resolved entity links.本数据集为发表于ISWC2020的论文《Tab2Know：从学术论文表格构建知识库》的配套评测数据。代码仓库参见https://github.com/karmaresearch/tab2know。本数据集包含以下文件： - `venues.txt`：用于从[语义学者开放研究语料库（Semantic Scholar Open Research Corpus）](http://s2-public-api-prod.us-west-2.elasticbeanstalk.com/corpus/)中筛选近5年发表学术论文的会议/期刊列表文件。 - `extracted-tables.tar.gz`：我们通过[Tabula](https://github.com/tabulapdf/tabula)从上述PDF文档中提取的全部表格归档文件。 - `sample-400.tar.gz`：我们用于标注任务的上述表格抽样归档集。 - `ontology.ttl`：采用Turtle格式编写的标注本体文件。 - `all_metadata.jsonl`：采用下文所述JSON格式编写的该抽样集标注数据文件。 - `labelqueries.csv`：用于弱标注的标签查询集，通过标注界面生成。该CSV文件包含6列：数字ID、标签查询模板名称（`template`）、模板槽位（`slots`）、标签类型（`label`）、标注值（`value`）以及界面启用开关（`enabled`）。 - `labelqueries-sparql-templates.zip`：标签查询模板归档集。此类模板为包含`{{slot}}`形式槽位的SPARQL查询语句，`labelqueries.csv`中的模板均引用此类文件。 - `rules.txt`：我们用于实体消解任务的Datalog规则集。 - `tab2know-graph.nt.gz`：包含所有提取的表格结构、预测的表格与列类别以及已解析实体链接的最终资源描述框架图（RDF）归档文件。