AIrating annotated datasets
收藏官方服务:
资源简介:
AIrating datasets are built to support the manual evaluation of the results of two services (Google vs Impaakt) that return documents related to a given query (e.g. Weatherford,Core Business Impact (Access to Energy)).For each query and each service, the documents are annotated YES/NO on two dimensions: the document's accessibility, and its relevance to the query.The annotators were trained on this task, and the assessment was doubled in case of doubt.
创建时间:
2024-07-01



