adsyamsafa/tydiqa-id

TyDi QA 是一个问答数据集，涵盖11种类型多样的语言，包含204K个问答对。TyDi QA的语言在类型学上具有多样性——即每种语言所表达的语言特征集合——因此，我们期望在此数据集上表现良好的模型能够泛化到世界上大量语言。它包含了在仅英语语料库中找不到的语言现象。为了提供一个真实的信息寻求任务并避免启动效应，问题由想知道答案但尚未知道答案的人撰写（与SQuAD及其衍生数据集不同），并且数据是直接用每种语言收集的，未使用翻译（与MLQA和XQuAD不同）。

TyDi QA is a question answering dataset covering 11 typologically diverse languages with 204K question-answer pairs. The languages of TyDi QA are diverse with regard to their typology -- the set of linguistic features that each language expresses -- such that we expect models performing well on this set to generalize across a large number of the languages in the world. It contains language phenomena that would not be found in English-only corpora. To provide a realistic information-seeking task and avoid priming effects, questions are written by people who want to know the answer, but don’t know the answer yet, (unlike SQuAD and its descendents) and the data is collected directly in each language without the use of translation (unlike MLQA and XQuAD).