introvoyz041/EMMA-mini

我们介绍了**EMMA（增强多模态推理）**，一个针对数学、物理、化学和编码领域的有机多模态推理基准测试。EMMA任务需要高级的跨模态推理能力，无法通过单独思考每个模态来解决，为MLLMs的推理能力提供了一个增强的测试套件。EMMA包含2,788个问题，其中1,796个是新构建的，覆盖四个领域。在每个主题中，我们还根据问题测量的具体技能为每个问题提供细粒度的标签。为了创建一个更平衡的EMMA子集，我们从基准中随机抽取了400个问题（每个领域100个），得到**EMMA-mini**。

We introduce **EMMA (Enhanced MultiModal reAsoning)**, a benchmark targeting organic multimodal reasoning across mathematics, physics, chemistry, and coding. EMMA tasks demand advanced cross-modal reasoning that cannot be solved by thinking separately in each modality, offering an enhanced test suite for MLLMs reasoning capabilities. EMMA is composed of 2,788 problems, of which 1,796 are newly constructed, across four domains. Within each subject, we further provide fine-grained labels for each question based on the specific skills it measures. To create a more balanced subset of EMMA, we randomly sample 400 questions (100 per subject) from the benchmark and get **EMMA-mini**.