aisingapore/instruction_following-ifeval

SEA-IFEval数据集用于评估模型在提示中遵守约束条件的能力，例如以特定单词/短语开始响应或以特定数量的部分回答问题。该数据集基于IFEval，并由母语者手动翻译为印尼语、爪哇语、巽他语、泰语、他加禄语和越南语。数据集设计用于评估聊天或指令调整的大型语言模型（LLMs），并且是SEA-HELM排行榜的一部分。数据集包含多种语言，并提供了每种语言的示例数量和令牌数量统计。

SEA-IFEval evaluates a models ability to adhere to constraints provided in the prompt, for example beginning a response with a specific word/phrase or answering with a certain number of sections. It is based on IFEval and was manually translated by native speakers for Indonesian, Javanese, Sundanese, Thai, Tagalog, and Vietnamese. The dataset is designed for evaluating chat or instruction-tuned large language models (LLMs) and is part of the SEA-HELM leaderboard. It includes multiple languages and provides statistics on the number of examples and tokens for each language.