Paired MSA-Saudi Arabic Tool-Use Test Set
收藏资源简介:
A paired test set for controlled evaluation of tool use in Modern Standard Arabic and Saudi Arabic. The release contains 150 records forming 75 meaning-matched MSA–Saudi Arabic pairs across five deterministic mock tools, together with tool definitions, fixtures, answer contracts, schemas, provenance information, and checksums. Version 1.0.2 corrects authorship provenance: two different assigned human request authors produced the realizations, one for MSA and another for Saudi Arabic. Request text, semantic pairs, gold behavior, fixtures, answer contracts, and schemas are unchanged from version 1.0.1. Because each variety has one request author, author identity is confounded with language variety. Private working materials, identity mappings, raw model interactions, and item-level review judgments are excluded.



