Percena/lme-mc10
收藏官方服务:
资源简介:
LME-MC10是一个由500个多项选择题组成的基准数据集,源自LongMemEval(s)。每个题目针对LongMemEval的五种长期记忆能力之一进行测试,但被重新格式化为具有10个选项的多项选择题,以便于自动评估(如普通准确度、平衡准确度等)。
LME-MC10 is a 500-item multiple-choice benchmark derived from LongMemEval(s). Each item probes one of LongMemEval’s five long-term memory abilities, but is reformatted into a 10-option MC task for straightforward automated evaluation (plain accuracy, balanced accuracy, etc.).
提供机构:
Percena


