pfnet/bbh-ja

BBH-ja是一个翻译成日语的BIG-Bench Hard数据集，旨在评估大语言模型在日语Chain of Thought能力。数据集由两部分组成：评估问题(`bbh-ja/`)和few-shot示例的提示(`cot-prompts/`)。评估问题存储在JSON Lines格式中，提示存储在YAML格式中。翻译使用了PLaMo Translation Model。BBH-ja is a Japanese translation of the BIG-Bench Hard dataset, designed to evaluate the Chain of Thought capabilities of large language models in Japanese. The dataset consists of two parts: evaluation problems (`bbh-ja/`) and prompts for few-shot examples (`cot-prompts/`). Evaluation problems are stored in JSON Lines format, while prompts are stored in YAML format. The translation was performed using the PLaMo Translation Model.