SimpleQA Verified is a 1,000-prompt benchmark for reliably evaluating Large Language Models (LLMs) on short-form factuality and parametric knowledge. The authors from Google DeepMind and Google Resear
SimpleQA Verified 是一个由 Google DeepMind 和 Google Research 创建的 1000 条提示的基准数据集，用于评估大型语言模型 (LLM) 的短格式事实性。该数据集通过严格的过滤过程创建，包括去重、主题平衡和源数据校对，以产生更可靠和具有挑战性的评估集。数据集旨在解决 SimpleQA 基准数据集中存在的噪声和不正确的标签、主题偏差和问题冗余等问题。
# SimpleQA Verified #### A 1,000-prompt factuality benchmark from Google DeepMind and Google Research, designed to reliably evaluate LLM parametric knowledge. ▶ [SimpleQA Verified Leaderboard on Kag
