vnnm/MCC
收藏Hugging Face2024-03-07 更新2024-06-22 收录
下载链接：
https://hf-mirror.com/datasets/vnnm/MCC
下载链接
链接失效反馈官方服务：
资源简介：
---
task_categories:
- question-answering
tags:
- moral
- consistency
---
# MCC
Despite recent advancements showcasing the impressive capabilities of Large Language Models (LLMs) in conversational systems, we show that even state-of-the-art LLMs are morally inconsistent in their generations, questioning their reliability (and trustworthiness in general). Prior works in LLM evaluation focus on developing ground-truth data to measure accuracy on specific tasks. However, for moral scenarios that often lack universally agreed-upon answers, consistency in model responses becomes crucial for their reliability. To this extent, we construct the Moral Consistency Corpus (MCC), containing 50K moral questions, responses to them by LLMs, and the RoTs that these models followed.
提供机构：
vnnm
原始信息汇总
道德一致性语料库（MCC）
数据集概述
- 任务类别: 问答
- 标签: 道德, 一致性
数据集描述
- 目的: 评估大型语言模型（LLMs）在道德场景下的响应一致性。
- 内容: 包含50,000个道德问题，LLMs对这些问题的响应，以及这些模型遵循的理由（RoTs）。
- 特点: 针对道德场景缺乏普遍认同答案的情况，强调模型响应的一致性对于其可靠性至关重要。
