SIQA

displayName: SIQA (Social Interaction QA)
labelTypes: []
license:
- CC BY 4.0
mediaTypes: []
paperUrl: https://arxiv.org/pdf/1904.09728.pdf
publishDate: "2019-01-01"
publishUrl: https://leaderboard.allenai.org/socialiqa/submissions/get-started
publisher:
- Allen Institute for Artificial Intelligence
- University of Washington - Seattle - Paul G. Allen School of Computer Science &
Engineering
tags: []
taskTypes: []

---
## 简介
社交IQa: 社交互动QA，用于测试社交常识智能的新问答基准。与许多以前侧重于物理或分类学知识的基准相反，社会IQa侧重于对人们的行为及其社会影响的推理。例如，给定一个像 “杰西看到了一场音乐会” 这样的动作和一个像 “杰西为什么这样做？”，人类可以很容易地推断出杰西想要 “看他们最喜欢的表演者” 或 “欣赏音乐”，而不是 “看里面发生了什么” 或 “看它是否有效”。社交IQa中的动作跨越了各种各样的社交场合，并且答案候选者既包含人为策划的答案，也包含经过对手过滤的机器生成的候选者。社交IQa包含37,000多个QA对，用于评估模型对日常事件和情况的社会影响进行推理的能力。

## Download dataset
:modelscope-code[]{type="git"}

displayName: SIQA (Social Interaction QA)
labelTypes: []
license:
- CC BY 4.0
mediaTypes: []
paperUrl: https://arxiv.org/pdf/1904.09728.pdf
publishDate: "2019-01-01"
publishUrl: https://leaderboard.allenai.org/socialiqa/submissions/get-started
publisher:
- Allen Institute for Artificial Intelligence
- University of Washington, Seattle - Paul G. Allen School of Computer Science &
Engineering
tags: []
taskTypes: []

---

## Introduction
Social IQa (Social Interaction QA) is a novel question answering benchmark designed to test social commonsense intelligence. Unlike many prior benchmarks that focus on physical or taxonomic knowledge, Social IQa focuses on reasoning about people’s actions and their social impacts. For example, given an action such as "Jesse attended a concert" and a question like "Why did Jesse do this?", humans can easily infer that Jesse intended to "see their favorite performer" or "enjoy the music", rather than "see what was happening inside" or "see if it worked". The actions in Social IQa span a wide variety of social scenarios, and the answer candidates include both human-curated answers and machine-generated candidates filtered by adversaries. Social IQa contains over 37,000 QA pairs for evaluating models' ability to reason about the social impacts of everyday events and situations.

## Download dataset
:modelscope-code[]{type="git"}

搜集汇总

背景与挑战

背景概述

SIQA（Social Interaction QA）是一个专注于社交常识推理的问答基准数据集，旨在测试模型对日常事件社会影响的理解能力。该数据集包含超过37,000个问答对，涵盖多种社交情境，通过人类策划和机器生成的答案候选来评估推理性能。