Human performance on a deductive reasoning task in the description logic ALE

The data was collected through the (online-distributed, currently unavailable) survey to test the accuracy of the cognitive model SHARP (for more info about this model, see: https://hdl.handle.net/2077/74797 ). The code for SHARP is available at: https://doi.org/10.5281/zenodo.13759504 SHARP was designed to simulate human performance on certain deduction tasks related to the description logic ALE. More specifically, SHARP models the task of checking whether a given ABox (in the logic ALE) is inconsistent. In the survey, participants were presented (among other things) ABoxes after which they were supposed to decide their inconsistency. The data consists of: - responses to questions about previous logic experience - responses to demographic questions - responses for each presented ABox (`Consistent', `Inconsistent' or `I don't know') - responses for questions where the participant was asked to rate the difficulty of the previous ABox on a five-point Likert scale - response times for all questions, in seconds - a number indicating the order in which the ABoxes were presented (this order was randomised and different for each participant) See list of variable codes and their explanation below, please note that the mathematical notation used there is only properly shown when using MathJax. The documentation file Data_Description-2.pdf has been rendered with the corresponding notation and may be used for reference. DATA-SPECIFIC INFORMATION FOR: [results-survey539252-16.csv] Number of variables: 108 Number of cases/rows: 84 Variable List: G01Q37: 'Do you know what a contradiction is?' G01Q36: 'Do you have experience with description logic?'' G01Q39: 'Have you seen this notation before? \( \\{ a \{\,:\,\} (A \sqcap B) \\} \) (If the expression does not show properly, please consider using a different browser)' G02Q38: 'What is your gender?' G02Q39: 'What is your age?' G02Q40: 'What is your nationality?' G01Q00: '\( \\{ a \{\,:\,\} A,\ b \{\,:\,\} \neg A,\ a \{\,:\,\} \neg B \\} \)' G01Q01: '\( \\{ a \{\,:\,\} \forall s.(\neg A \sqcap B),\ (b,a) \{\,:\,\} r,\ c \{\,:\,\} (\neg B \sqcap C),\ b \{\,:\,\} \forall r. \exists s.(A \sqcap B),\ a \{\,:\,\} (B \sqcap \neg C),\ (b,c) \{\,:\,\} s \\} \)' G02Q27: 'How difficult was it to decide whether the last ABox was inconsistent? 1 is very easy. 5 is very difficult.' G02Q18: '\( \\{ a \{\,:\,\} (A \sqcap (B \sqcap (C \sqcap (D \sqcap \neg A)))) \\} \)' G04Q56: the order of the ABox presented in question G02Q18 G02Q12: '\( \\{ a \{\,:\,\} (B \sqcap (C \sqcap (\neg A \sqcap A))) \\} \)' G04Q57: the order of the ABox presented in question G02Q12 G02Q19: '\( \\{ a \{\,:\,\} (A \sqcap B),\ a \{\,:\,\} (B \sqcap C),\ a \{\,:\,\} (C \sqcap D),\ a\{\,:\,\} (D \sqcap \neg A) \\} \)' G04Q58: the order of the ABox presented in question G02Q19 G02Q17: '\( \\{ a \{\,:\,\} ((\exists r. A \sqcap \exists r. B) \sqcap \forall r. ((\exists r. A \sqcap \exists r. B) \sqcap \forall r. (\exists r. A \sqcap \exists r. B))) \\} \)' G04Q59: the order of the ABox presented in question G02Q17 G02Q22: '\( \\{ a \{\,:\,\} \exists r. \exists s. \neg A,\ a \{\,:\,\} \forall r. \forall s. A,\ b \{\,:\,\} \exists s. \neg B \\} \)' G04Q60: the order of the ABox presented in question G02Q22 G02Q23: 'How difficult was it to decide whether the last ABox was inconsistent? 1 is very easy. 5 is very difficult.' G02Q07: '\( \\{ a \{\,:\,\} (A \sqcap B),\ a \{\,:\,\} \neg B \\} \)' G04Q61: the order of the ABox presented in question G02Q07 G02Q14: '\( \\{ a \{\,:\,\} (\exists r. (\exists r. A \sqcap \exists r. B) \sqcap \exists r. B) \\} \)' G04Q62: the order of the ABox presented in question G02Q14 G02Q03: '\( \\{ a \{\,:\,\} A,\ a \{\,:\,\} B,\ a \{\,:\,\} \neg A \\} \)' G04Q63: the order of the ABox presented in question G02Q03 G02Q11: '\( \\{ a \{\,:\,\} (A \sqcap (\neg A \sqcap (B \sqcap C))) \\} \)' G04Q64: the order of the ABox presented in question G02Q11 G02Q13: '\( \\{ a \{\,:\,\} (\exists r. A \sqcap \exists r. B) \\} \)' G04Q65: the order of the ABox presented in question G02Q13 G02Q25: 'How difficult was it to decide whether the last ABox was inconsistent? 1 is very easy. 5 is very difficult.' G02Q10: '\( \\{ a \{\,:\,\} \neg A,\ a \{\,:\,\} \neg B \\} \)' G04Q66: the order of the ABox presented in question G02Q10 G02Q21: '\( \\{ a \{\,:\,\} A,\ a \{\,:\,\} \neg A,\ b \{\,:\,\} \forall r. A \\} \)' G04Q67: the order of the ABox presented in question G02Q21 G02Q15: '\( \\{ a \{\,:\,\} ( (\exists r. A \sqcap \exists r. B) \sqcap \forall r. (\exists r. A \sqcap \exists r. B)) \\} \)' G04Q68: the order of the ABox presented in question G02Q15 G02Q09: '\( \\{ a \{\,:\,\} A,\ a \{\,:\,\} B \\} \)' G04Q69: the order of the ABox presented in question G02Q09 G02Q05: '\( \\{ a \{\,:\,\} \exists r.A,\ a \{\,:\,\} \forall s. \neg A,\ a \{\,:\,\} \exists r. B \\} \)' G04Q69Copy: the order of the ABox presented in question G02Q05 G02Q26: 'How difficult was it to decide whether the last ABox was inconsistent? 1 is very easy. 5 is very difficult.' G02Q16: \( \\{ a \{\,:\,\} ( (\exists r. A \sqcap \exists r. B) \sqcap \forall r. (\exists r. (\exists r. A \sqcap \exists r. B) \sqcap \exists r. B)) \\} \) G04Q70: the order of the ABox presented in question G02Q16 G02Q08: '\( \\{ a \{\,:\,\} \neg B,\ a \{\,:\,\} (A \sqcap B) \\} \)' G04Q71: the order of the ABox presented in question G02Q08 G02Q06: '\( \\{ a \{\,:\,\} \exists r. A,\ a \{\,:\,\} \forall s. \neg A,\ a \{\,:\,\} \exists s. B \\} \)' G04Q72: the order of the ABox presented in question G02Q06 G02Q04: '\( \\{ a \{\,:\,\} A,\ b \{\,:\,\} B,\ a \{\,:\,\} \neg A \\} \)' G04Q73: the order of the ABox presented in question G02Q04 G02Q20: '\( \\{ a \{\,:\,\} (\neg A \sqcap (B \sqcap \neg C)),\ b \{\,:\,\} (\neg B \sqcap (C \sqcap A)),\ b \{\,:\,\} (A \sqcap C),\ a \{\,:\,\} B \\} \)' G04Q74: the order of the ABox presented in question G02Q20 G02Q26Copy: 'How difficult was it to decide whether the last ABox was inconsistent? 1 is very easy. 5 is very difficult.' interviewtime: the total response time G01Q37Time: the reponse time of question G01Q37 G01Q36Time: the reponse time of question G01Q36 G01Q39Time: the reponse time of question G01Q39 G02Q38Time: the reponse time of question G02Q38 G02Q39Time: the reponse time of question G02Q39 G02Q40Time: the reponse time of question G02Q40 G01Q00Time: the reponse time of question G01Q00 G01Q01Time: the reponse time of question G01Q01 G02Q27Time: the reponse time of question G02Q27 G02Q28Time: the reponse time of question G02Q28 remove G04Q41CopyTime: the waiting time before question G02Q18 G02Q18Time: the reponse time of question G02Q18 G04Q41Time: the waiting time before question G02Q12 G02Q12Time: the reponse time of question G02Q12 G04Q42Time: the waiting time before question G02Q19 G02Q19Time: the reponse time of question G02Q19 G04Q45Time: the waiting time before question G02Q17 G02Q17Time: the reponse time of question G02Q17 G04Q45CopyTime: the waiting time before question G02Q22 G02Q22Time: the reponse time of question G02Q22 G02Q23Time: the reponse time of question G02Q23 G04Q43Time: the waiting time before question G02Q07 G02Q07Time: the reponse time of question G02Q07 G04Q44Time: the waiting time before question G02Q14 G02Q14Time: the reponse time of question G02Q14 G04Q46Time: the waiting time before question G02Q03 G02Q03Time: the reponse time of question G02Q03 G04Q88Time: the waiting time before question G02Q11 G02Q11Time: the reponse time of question G02Q11 G04Q88CopyTime: the waiting time before question G02Q13 G02Q13Time: the reponse time of question G02Q13 G02Q25Time: the response time of question G02Q25 G04Q48Time: the waiting time before question G02Q10 G02Q10Time: the reponse time of question G02Q10 G04Q49Time: the waiting time before question G02Q21 G02Q21Time: the reponse time of question G02Q21 G04Q50Time: the waiting time before question G02Q15 G02Q15Time: the reponse time of question G02Q15 G04Q51Time: the waiting time before question G02Q09 G02Q09Time: the reponse time of question G02Q09 G04Q89Time: the waiting time before question G02Q05 G02Q05Time: the reponse time of question G02Q05 G02Q26Time: the reponse time of question G02Q26 G04Q53Time: the waiting time before question G02Q16 G02Q16Time: the reponse time of question G02Q16 G04Q54Time: the waiting time before question G02Q08 G02Q08Time: the reponse time of question G02Q08 G04Q54CopyTime: the waiting time before question G02Q06 G02Q06Time: the reponse time of question G02Q06 G04Q52CopyTime: the waiting time before question G02Q04 G02Q04Time: the reponse time of question G02Q04 G04Q92Time: the waiting time before question G02Q20 G02Q20Time: the reponse time of question G02Q20 G02Q26CopyTime: the reponse time of question G02Q26Copy本数据集通过线上发放（目前已不可获取）的问卷收集所得，用于验证认知模型SHARP的准确性。若需了解该模型的更多细节，请访问：https://hdl.handle.net/2077/74797。 SHARP的开源代码可通过以下链接获取：https://doi.org/10.5281/zenodo.13759504 SHARP旨在模拟人类在与描述逻辑ALE相关的特定演绎推理任务中的表现。具体而言，SHARP针对的任务为：判断给定的（ALE逻辑下的）断言盒（ABox）是否不一致。 本次问卷中，除包含其他题目外，参与者还会收到若干断言盒（ABox），并需判断其是否存在不一致性。本数据集包含以下内容： - 逻辑学习经历相关问卷的作答结果 - 人口统计学问题的作答结果 - 每个呈现的断言盒（ABox）对应的作答结果（选项为「一致」「不一致」或「不知道」） - 参与者需按5级李克特量表对前一个断言盒的推理难度进行评分的相关问题作答结果 - 所有问题的作答时长（单位：秒） - 用于标注断言盒呈现顺序的序号（该顺序为随机生成，且每位参与者的呈现顺序均不相同） 详见下文的变量编码及其说明列表。请注意，文中使用的数学符号仅在启用MathJax时可正常显示。配套文档文件Data_Description-2.pdf已针对公式进行渲染，可作为参考依据。 # 数据集[results-survey539252-16.csv]专属信息： 变量总数：108个 有效样本量/行数：84条 ## 变量列表： G01Q37："你是否了解矛盾的概念？" G01Q36："你是否具备描述逻辑相关的学习或实践经验？" G01Q39："你是否见过以下符号表示？( \{ a \{,:\,\} (A \sqcap B) \} ) （若该表达式无法正常显示，请尝试更换浏览器）" G02Q38："你的性别是？" G02Q39："你的年龄是？" G02Q40："你的国籍是？" G01Q00：( \{ a \{,:\,\} A, b \{,:\,\} eg A, a \{,:\,\} eg B \} ) G01Q01：( \{ a \{,:\,\} forall s.( eg A \sqcap B), (b,a) \{,:\,\} r, c \{,:\,\} ( eg B \sqcap C), b \{,:\,\} forall r. exists s.(A \sqcap B), a \{,:\,\} (B \sqcap eg C), (b,c) \{,:\,\} s \} ) G02Q27："判断上一个断言盒是否不一致的难度如何？1分代表非常容易，5分代表非常困难。" G02Q18：( \{ a \{,:\,\} (A \sqcap (B \sqcap (C \sqcap (D \sqcap eg A)))) \} ) G04Q56：题目G02Q18中呈现的断言盒的展示顺序 G02Q12：( \{ a \{,:\,\} (B \sqcap (C \sqcap ( eg A \sqcap A))) \} ) G04Q57：题目G02Q12中呈现的断言盒的展示顺序 G02Q19：( \{ a \{,:\,\} (A \sqcap B), a \{,:\,\} (B \sqcap C), a \{,:\,\} (C \sqcap D), a\{,:\,\} (D \sqcap eg A) \} ) G04Q58：题目G02Q19中呈现的断言盒的展示顺序 G02Q17：( \{ a \{,:\,\} ((exists r. A \sqcap exists r. B) \sqcap forall r. ((exists r. A \sqcap exists r. B) \sqcap forall r. (exists r. A \sqcap exists r. B))) \} ) G04Q59：题目G02Q17中呈现的断言盒的展示顺序 G02Q22：( \{ a \{,:\,\} exists r. exists s. eg A, a \{,:\,\} forall r. forall s. A, b \{,:\,\} exists s. eg B \} ) G04Q60：题目G02Q22中呈现的断言盒的展示顺序 G02Q23："判断上一个断言盒是否不一致的难度如何？1分代表非常容易，5分代表非常困难。" G02Q07：( \{ a \{,:\,\} (A \sqcap B), a \{,:\,\} eg B \} ) G04Q61：题目G02Q07中呈现的断言盒的展示顺序 G02Q14：( \{ a \{,:\,\} (exists r. (exists r. A \sqcap exists r. B) \sqcap exists r. B) \} ) G04Q62：题目G02Q14中呈现的断言盒的展示顺序 G02Q03：( \{ a \{,:\,\} A, a \{,:\,\} B, a \{,:\,\} eg A \} ) G04Q63：题目G02Q03中呈现的断言盒的展示顺序 G02Q11：( \{ a \{,:\,\} (A \sqcap ( eg A \sqcap (B \sqcap C))) \} ) G04Q64：题目G02Q11中呈现的断言盒的展示顺序 G02Q13：( \{ a \{,:\,\} (exists r. A \sqcap exists r. B) \} ) G04Q65：题目G02Q13中呈现的断言盒的展示顺序 G02Q25："判断上一个断言盒是否不一致的难度如何？1分代表非常容易，5分代表非常困难。" G02Q10：( \{ a \{,:\,\} eg A, a \{,:\,\} eg B \} ) G04Q66：题目G02Q10中呈现的断言盒的展示顺序 G02Q21：( \{ a \{,:\,\} A, a \{,:\,\} eg A, b \{,:\,\} forall r. A \} ) G04Q67：题目G02Q21中呈现的断言盒的展示顺序 G02Q15：( \{ a \{,:\,\} ( (exists r. A \sqcap exists r. B) \sqcap forall r. (exists r. A \sqcap exists r. B)) \} ) G04Q68：题目G02Q15中呈现的断言盒的展示顺序 G02Q09：( \{ a \{,:\,\} A, a \{,:\,\} B \} ) G04Q69：题目G02Q09中呈现的断言盒的展示顺序 G02Q05：( \{ a \{,:\,\} exists r.A, a \{,:\,\} forall s. eg A, a \{,:\,\} exists r. B \} ) G04Q69Copy：题目G02Q05中呈现的断言盒的展示顺序 G02Q26："判断上一个断言盒是否不一致的难度如何？1分代表非常容易，5分代表非常困难。" G02Q16：( \{ a \{,:\,\} ( (exists r. A \sqcap exists r. B) \sqcap forall r. (exists r. (exists r. A \sqcap exists r. B) \sqcap exists r. B)) \} ) G04Q70：题目G02Q16中呈现的断言盒的展示顺序 G02Q08：( \{ a \{,:\,\} eg B, a \{,:\,\} (A \sqcap B) \} ) G04Q71：题目G02Q08中呈现的断言盒的展示顺序 G02Q06：( \{ a \{,:\,\} exists r. A, a \{,:\,\} forall s. eg A, a \{,:\,\} exists s. B \} ) G04Q72：题目G02Q06中呈现的断言盒的展示顺序 G02Q04：( \{ a \{,:\,\} A, b \{,:\,\} B, a \{,:\,\} eg A \} ) G04Q73：题目G02Q04中呈现的断言盒的展示顺序 G02Q20：( \{ a \{,:\,\} ( eg A \sqcap (B \sqcap eg C)), b \{,:\,\} ( eg B \sqcap (C \sqcap A)), b \{,:\,\} (A \sqcap C), a \{,:\,\} B \} ) G04Q74：题目G02Q20中呈现的断言盒的展示顺序 G02Q26Copy："判断上一个断言盒是否不一致的难度如何？1分代表非常容易，5分代表非常困难。" interviewtime：总作答时长 G01Q37Time：题目G01Q37的作答时长 G01Q36Time：题目G01Q36的作答时长 G01Q39Time：题目G01Q39的作答时长 G02Q38Time：题目G02Q38的作答时长 G02Q39Time：题目G02Q39的作答时长 G02Q40Time：题目G02Q40的作答时长 G01Q00Time：题目G01Q00的作答时长 G01Q01Time：题目G01Q01的作答时长 G02Q27Time：题目G02Q27的作答时长 G02Q28Time：题目G02Q28的作答时长（已移除） G04Q41CopyTime：作答题目G02Q18前的等待时长 G02Q18Time：题目G02Q18的作答时长 G04Q41Time：作答题目G02Q12前的等待时长 G02Q12Time：题目G02Q12的作答时长 G04Q42Time：作答题目G02Q19前的等待时长 G02Q19Time：题目G02Q19的作答时长 G04Q45Time：作答题目G02Q17前的等待时长 G02Q17Time：题目G02Q17的作答时长 G04Q45CopyTime：作答题目G02Q22前的等待时长 G02Q22Time：题目G02Q22的作答时长 G02Q23Time：题目G02Q23的作答时长 G04Q43Time：作答题目G02Q07前的等待时长 G02Q07Time：题目G02Q07的作答时长 G04Q44Time：作答题目G02Q14前的等待时长 G02Q14Time：题目G02Q14的作答时长 G04Q46Time：作答题目G02Q03前的等待时长 G02Q03Time：题目G02Q03的作答时长 G04Q88Time：作答题目G02Q11前的等待时长 G02Q11Time：题目G02Q11的作答时长 G04Q88CopyTime：作答题目G02Q13前的等待时长 G02Q13Time：题目G02Q13的作答时长 G02Q25Time：题目G02Q25的作答时长 G04Q48Time：作答题目G02Q10前的等待时长 G02Q10Time：题目G02Q10的作答时长 G04Q49Time：作答题目G02Q21前的等待时长 G02Q21Time：题目G02Q21的作答时长 G04Q50Time：作答题目G02Q15前的等待时长 G02Q15Time：题目G02Q15的作答时长 G04Q51Time：作答题目G02Q09前的等待时长 G02Q09Time：题目G02Q09的作答时长 G04Q89Time：作答题目G02Q05前的等待时长 G02Q05Time：题目G02Q05的作答时长 G02Q26Time：题目G02Q26的作答时长 G04Q53Time：作答题目G02Q16前的等待时长 G02Q16Time：题目G02Q16的作答时长 G04Q54Time：作答题目G02Q08前的等待时长 G02Q08Time：题目G02Q08的作答时长 G04Q54CopyTime：作答题目G02Q06前的等待时长 G02Q06Time：题目G02Q06的作答时长 G04Q52CopyTime：作答题目G02Q04前的等待时长 G02Q04Time：题目G02Q04的作答时长 G04Q92Time：作答题目G02Q20前的等待时长 G02Q20Time：题目G02Q20的作答时长 G02Q26CopyTime：题目G02Q26Copy的作答时长