遇见数据集

Paired MSA-Saudi Arabic Tool-Use Test Set

收藏
Zenodo2026-07-30 更新2026-08-01 收录
官方服务:

资源简介:

A paired test set for controlled evaluation of tool use in Modern Standard Arabic and Saudi Arabic. The release contains 150 records forming 75 meaning-matched MSA–Saudi Arabic pairs across five deterministic mock tools, together with tool definitions, fixtures, answer contracts, schemas, provenance information, and checksums. Version 1.0.2 corrects authorship provenance: two different assigned human request authors produced the realizations, one for MSA and another for Saudi Arabic. Request text, semantic pairs, gold behavior, fixtures, answer contracts, and schemas are unchanged from version 1.0.1. Because each variety has one request author, author identity is confounded with language variety. Private working materials, identity mappings, raw model interactions, and item-level review judgments are excluded.

提供机构:
Zenodo
创建时间:
2026-07-30
二维码
社区交流群
二维码
科研交流群
商业服务